Free tool for store owners
Store chatbot grader
Ask your store's chatbot the 12 questions shoppers ask most. For each one you get what a good answer looks like and where on your site to check it, then a scorecard you can compare with the 10 stores we tested.
- No sign-up
- Nothing leaves your browser
- The same 12 questions as our test
On November 9, 2026 we asked the chatbots of 10 online stores these same questions and checked every reply against the store's own pages. 76 of 120 answers passed. The questions, the order and the grades here are the ones we used. Read how the 10 stores did.
Step 1
Tell us about your store
We use these only to fill in the questions below. They stay in your browser: nothing is sent to us and we do not visit your store.
- Open your store in a private window, so the chatbot sees you as a new shopper.
- Ask the 12 questions below in order, one at a time. Wait for each reply before the next.
- For each reply, find the sentence on your own page that settles it, then pick a grade. Do not grade on what sounds right.
- Never type a real order number, an email or other personal details into the chat.
Step 2
Ask the 12 questions and grade each reply
0 of 12 graded
1. Order status
In our test, 8 of 10 stores passed
“Where is my order? I placed it last week.”
- A good reply
- Asks for the order number and email, asks you to sign in, or links your order tracking page.
- Check it against
- Your order tracking page or contact page.
- Counts as wrong
- Gives any status, date or carrier for an order it has not looked up.
2. Return window
In our test, 7 of 10 stores passed
“How many days do I have to return something?”
- A good reply
- Gives the number of days from your returns page, and from when it counts if your page says.
- Check it against
- Your returns policy.
3. Returning a sale item
In our test, 6 of 10 stores passed
“Can I return an item I bought on sale?”
- A good reply
- Says what your returns page says about sale or final-sale items.
- Check it against
- Your returns policy.
4. Return shipping cost
In our test, 6 of 10 stores passed
“Are returns free, or do I pay for return shipping?”
- A good reply
- Gives the return cost from your returns page: free, a fee, or taken off the refund. If your page differs by country, the answer for the shopper's country.
- Check it against
- Your returns policy.
5. Products under a price
In our test, 5 of 10 stores passed
“Show me [product type] under $[price].”
- A good reply
- Shows real products from your store priced under that amount.
- Check it against
- The collection or category page for that product type.
- Counts as wrong
- Suggests anything over the price, or a product you do not sell.
6. Size or stock
In our test, 6 of 10 stores passed
“Is the [product] available in size [size]?”
- A good reply
- Says whether that size is offered and, if your product page shows it, whether it is in stock. Saying it cannot see stock and pointing to the product page or a person is also fine.
- Check it against
- The product page for that product.
- Counts as wrong
- Says a sold-out size is in stock, or names a size you do not make.
7. Shipping to a country
In our test, 5 of 10 stores passed
“Do you ship to Singapore, and how much does shipping cost?”
- A good reply
- Says yes or no as your shipping page does, with the cost or the free-shipping threshold if the page gives one.
- Check it against
- Your shipping policy.
8. Delivery time
In our test, 4 of 10 stores passed
“How long does standard delivery take to the US?”
- A good reply
- Gives the standard delivery time to the US from your shipping page.
- Check it against
- Your shipping policy.
9. Changing the address
In our test, 5 of 10 stores passed
“Can I change the delivery address after I place an order?”
- A good reply
- Says what your FAQ says: how long the shopper has and how to ask. If no page covers it, sends the shopper to a person.
- Check it against
- Your FAQ, shipping page or order changes page.
10. Paying in instalments
In our test, 7 of 10 stores passed
“Can I pay in instalments, like with Afterpay or Klarna?”
- A good reply
- Names the instalment options your pages list, or says plainly that you do not offer any.
- Check it against
- Your payment FAQ or the payment options at checkout.
11. A question nobody can answer
In our test, 8 of 10 stores passed
“Will the [product] be cheaper next month?”
- A good reply
- Says it cannot know or promise future prices. It may mention a newsletter or a current offer.
- Check it against
- Nothing to check: no store can promise a future price.
- Counts as wrong
- Predicts a price drop or a sale date your site has not published.
12. Talking to a person
In our test, 9 of 10 stores passed
“Can I talk to a real person?”
- A good reply
- Connects the shopper to a person, or clearly offers a working way to reach one (live chat, email, form), with your hours if your contact page lists them.
- Check it against
- Your contact page.
- Counts as wrong
- Refuses, loops back to itself, or offers a route your contact page does not list.
What the grades mean
- Right: Answered the question and matches your own page.
- Partly: Right direction, but the shopper would still have to look it up (a link with no answer, one of two facts).
- Wrong: Said something your page contradicts, or made up a status, a promise, a product or a price.
- No answer: No reply, an error, "I can't help with that" with no way forward, or an answer to a different question.
- Sent to a person: Could not answer from your pages, said so, and gave a working way to reach a person. A pass only when your pages do not hold the answer.
Right and Sent to a person count as a pass. The other three do not.
Step 3
Your scorecard
0 of 12 passed
Grade the replies above to fill this in.
- Right0
- Partly0
- Wrong0
- No answer0
- Sent to a person0
How the 10 stores in our test scored
Same questions, graded against each store's own pages. Read the test.
- Store A11/12
- Store B10/12
- Store C10/12
- Store D10/12
- Store E9/12
- Store F8/12
- Store G7/12
- Store H5/12
- Store I5/12
- Store J1/12
HoverBot answers from the store pages you approve and sends the shopper to a person when they do not hold the answer. Try it on your own store with the free plan.
Get started free01Does this page test my chatbot automatically?
No. You ask the questions in your own chat and grade the replies yourself. The page does not visit your store or talk to your chatbot, and the store address you type stays in your browser.
02Why grade against my own pages instead of what sounds right?
A confident answer that disagrees with your returns or shipping page is worse than no answer: the shopper acts on it. In our test, one bot quoted a shipping fee to Singapore that the store's own shipping page does not charge. It read as a perfectly normal answer.
03When does "sent to a person" count as a pass?
When your pages do not hold the answer, for example an order status, a future price, or a request to talk to someone, and the bot says so and gives a working way to reach your team. If your returns or shipping page does answer the question, a handoff is only partly right.
04What should I fix first if my bot misses?
Check that the page it should have read states the answer in one plain sentence: the number of return days, the delivery time per country, the instalment options. If you sell in more than one country, check the bot knows which storefront the shopper is on.