DominaresTools

Your /health says ok. canary asks your chatbot real questions and tells you when the answers go wrong.

canary asks your live chatbot the questions that matter, on a schedule. It checks each reply for the facts it must contain and the claims it must never make, and names the question that failed and why.

Buy canary for $49

One payment of $49, plus sales tax where it applies, and every future update. Delivered as a private GitHub repository you're invited to.

What it does

Grades what a customer reads
Reads the reply the way a customer gets it, from a streamed response, a JSON field or plain text. An error, a timeout, an empty answer or your app's own apology line all fail.
Facts it must contain
Strings or regular expressions, all or any, so a bot quoting the wrong price fails the check.
Knows a denial from a claim
A forbidden claim only counts when the sentence doesn't deny it: “chats are not stored” is not a claim that they are.
Checks what it says about today
A weekday or date the bot gives for today is checked against the real date in your time zone.
Exit codes a scheduler can act on
0 honest, 1 failed, 2 could not check, with a report that names the question, the reason and the reply, as text or JSON.
One alert per incident
An included Cloudflare Worker checks your health URLs and one chat question every five minutes, and emails or posts a webhook once when something breaks and once when it recovers.

Try it

pip install ./canary
canary demo            # a stand-in bot, in honest, lie, broken and down modes
canary run canary.json

What you get

canary 1.0.0: the canary command, the Cloudflare Worker and a GitHub Actions workflow, with 274 automated tests. Python 3.10 or newer.

A commercial license. Use it and change it in your own projects and your clients' projects. Don't share or resell the source. Read the license.

Every update. New versions land in the same repository; git pull to get them.

How buying works

  1. Enter your GitHub username. You'll see the account before you pay, so you can check it's yours.
  2. Pay $49, plus any sales tax shown at checkout, on Stripe's checkout page.
  3. Accept the invitation GitHub emails you. Signed in as that account, you'll also find it at github.com/dominares-tools/canary/invitations. Invitations expire after 7 days; you can get a new one any time.
  4. Clone and install:
    git clone https://github.com/dominares-tools/canary.git
pip install ./canary

Questions

Do I need GitHub?
Yes. Access is a read-only invitation to a private repository, sent to the GitHub account you choose.
Can I get a refund?
Yes, within 14 days, no questions asked. Access ends when the refund goes through. Refund policy.
Who takes the payment?
Stripe. Your purchase is sold through Link, Stripe's checkout service, which also works out sales tax and sends your receipt.
Something wrong?
Email josephlinares02@gmail.com. Every buyer of a tool shares its repository, so support happens by email rather than in GitHub issues.