Job store-review-moderation-policy-and-labelled-test · revised 12 October 2026
A written review policy and rules for what gets held or removed, tested on 60 reviews
A written review policy and a decision table for publish, hold or remove with a reason, tested on 60 labelled reviews. Genuine negative reviews stay, and a person decides every removal.
You might be seeing
- You are unsure which reviews you may remove
- Spam and copied reviews sit beside real ones
No passwords, keys, card details or admin invites needed to start.
What usually happened
Hiding or removing genuine negative reviews can itself break consumer law. Leaving fake reviews up can too. A moderation rule that works by sentiment, which is how many tools behave, is the wrong rule.
Who it’s for: Owner of a store that hosts customer reviews and wants clear rules for spam, off-topic and fake-looking reviews without hiding honest criticism.
Usually starts when: You host reviews, need to show that you handle fake or abusive ones, and are afraid of removing the wrong ones.
The result: You get a review policy and a decision table (publish, hold for a person, remove) in which every hold or removal needs a stated non-sentiment reason, such as spam, off-topic, personal data or copied text. It is tested on 60 reviews you have labelled, 30 held back from us. No genuine negative review is held or removed in the test.
Check whether this job fits
Answer these without sending files or logins. Nothing is submitted unless you choose to contact us.
What you get
- The review policy
- The decision table
- The reason log format
- The 60-review test, key and results
- Steps to re-run the test
Included
- One review policy, written for your store
- A decision table with reasons: spam, off-topic, personal data, abuse (threats or slurs that describe no purchase), copied text, signs of a fake
- A rule that low ratings and negative tone are never a reason to hold or remove
- A logged reason for every hold or removal
- A test on 60 reviews you have labelled, 30 held back from us
Not included
- Removing or hiding any review
- Hiding or removing genuine negative reviews
- Buying, writing or generating reviews
- Asking only happy customers for reviews
- Legal advice on review rules
- Customer names or contact details
How we know it’s done
Agreed with you before work starts. Each check produces evidence you keep.
Of the 30 reviews you keep sealed until the run, decisions match your labels on at least 27 (a true rate of at least 76% with 95% confidence).
Evidence: The results for the 30 sealed reviews beside your labels.
No genuine negative review in the test set is held or removed; one held or removed fails the whole test.
Evidence: The genuine negatives marked in your key and their results.
Every hold or removal has a logged reason that is not sentiment.
Evidence: The reason log.
Every decision is marked as a draft for a person. Of the sealed reviews you labelled hold or remove, at least 80% are held or removed with a reason; a table that publishes everything fails.
Evidence: The decision table and results.
Sign-off. You re-run the acceptance checks with the steps we hand over, read the results and sign off in writing. Payment follows sign-off.
If it fails. If an agreed check fails, you do not pay for this fixed scope. We hand over what we found and agree whether to stop or re-quote; no surprise work.
When it fits, and when we stop
It fits when
- You host reviews yourself or through an app and can see each review
- You can send 60 reviews with names removed and label each as publish, hold or remove with a reason; at least 10 of the 60 are hold or remove (at least 5 of them in the sealed 30). A genuine negative review is a real customer's honest experience, however harsh
- Two people on your side label the same 20 and agree on at least 17
- A named person decides every hold or removal
We stop and tell you if
- The aim is to remove or hide negative reviews
- You want reviews written, bought or generated
- You want review requests sent only to happy customers
- Two people on your side cannot agree on the labels
What could go wrong
The job works on copies of files you send and returns files and a report. Nothing in your store or helpdesk is changed by us, so there is nothing to undo. Our copies of your files are deleted when the job ends.
Scroll the table sideways to read it all.
| Risk | How we handle it |
|---|---|
| Genuine negative reviews are held or removed. | Sentiment is banned as a reason, the test checks every genuine negative review is published, and one held fails the whole test. |
| The table is used to bury criticism. | The page and the policy say what it is for. The job stops if the aim is to hide criticism. |
| Real people's words and details are handled. | Names are removed before sending, and the review text is kept only for the job. |
A separate automated reviewer checks the work and the test results before hand-over. Your named person decides every hold and removal and publishes the policy. No human supervisor from us is included unless your agreement names one, and at launch the work is largely automated.
How we deliver
We arrange the work and independent review, then show you the result against the agreed checks. You keep authority over your systems.
- Agree the policy goals and the reasons allowed for a hold or removal
- Receive 30 anonymised reviews with labels; the other 30 stay sealed
- Write the policy and decision table, banning sentiment as a reason
- Run the table on the 60 reviews against your labels
- Check no genuine negative review is held; a separate automated reviewer checks the rest
- Hand over the policy, table and results
This is a one-off job, not emergency cover or a subscription. We confirm eligibility, price, start window and delivery date in writing before you accept, and work starts only after the agreed inputs are in place. An enquiry creates no charge or booking.
Need to keep it working?
Discuss re-testing the table when your review app or policy changes.
Ongoing work is separately scoped and quoted: no monitoring, response-time guarantee or automatic subscription is included in this job.
Mention the responsibility you need in your enquiry.
What you can check
This is a new service. We have not delivered this job for a client yet.
Other ways to get this done
- Use the moderation settings in your review app and write the rules down.
- Publish a short policy page saying what you remove and why.
Questions
Can you remove bad reviews for me?
No. We never remove or hide reviews. We write rules and test them.
What about fake reviews written about me?
The table can flag signs of a fake for a person to check. It cannot prove one.
Is this legal advice?
No. Whether your policy meets the rules is for your adviser.
Does a pass mean it will be right next month?
No. A pass describes items like the test sample on the day of the test. It is not a promise about future items, and it does not replace your own checking.
Send an enquiry
Send us
- Which app or platform hosts your reviews
- Roughly how many reviews you get a month
- What kinds of bad reviews you see (spam, abuse, off-topic)
- No customer data
Later, once you agree
- 30 anonymised reviews with your labels now, and 30 more sealed until the run
- Your labels, with 30 held back until the run
- The name of the person who decides holds and removals
You keep your store, your helpdesk and every login. We work on the files you send through a secure route agreed after you say yes, and hand back files and a report. We never ask for store or helpdesk logins, and nothing goes live until your named person applies it.
Email fallback: open your mail app
If website submission is unavailable, review and send the fallback email yourself. An email fallback is not a website receipt. Or write to hello@syntheticindustry.ai with “store-review-moderation-policy-and-labelled-test” as the subject.