Frequently asked questions
A closer look at Datool, from your first trace to your next evaluation.
What is Datool?
In detail
Datool helps teams inspect AI traces, build evaluation datasets, and measure quality with scorers. Follow a request from input to output and see where it needs work.
Related questions
What can I evaluate?
In detail
Use recorded traces or dataset cases to evaluate your AI workflows. Combine code-based and LLM scorers with human reviews, then compare results across evaluation runs.
Related questions
Where can Datool agents talk to my customers?
In detail
On WhatsApp, in a chat widget on your website and inside your product. Your team works the same conversations from one inbox and can take over whenever a person should answer.
Related questions
How does an agent know my products and policies?
In detail
Add your catalog, help articles and policies as knowledge, and give the agent actions such as checking an order or opening a ticket. Guardrails and tests keep its answers on track before and after launch.
Related questions
How do I get started?
In detail
Sign in with your approved Google account, select a workspace and project, and follow the project setup instructions to connect your application.
Related questions
Can I use Datool with an AI app I built myself?
In detail
Yes. Connect any AI application with the Datool SDK or OpenTelemetry to trace its requests, evaluate real examples and measure quality. You don't need to build your agents in Datool.
Related questions
How does Datool connect to my application?
In detail
Use the Datool SDK to record workflows, model calls, and tool calls, or add Datool's span processor to your existing OpenTelemetry setup. You can also connect an application for dataset evaluations without the tracing SDK. Instrumenting the steps inside it gives you the detailed trace.
Related questions
What can I see inside a trace?
In detail
Follow a request through its recorded steps, with inputs, outputs, timing, errors, and scores in context. For instrumented model calls, Datool also shows reported token usage and cost estimates when usage and pricing information are available. Related traces can be grouped into sessions.
Related questions
Can I turn a real failure into a test case?
In detail
Yes. Save useful examples from recorded traces into a dataset, add reference answers where needed, and use those cases in evaluation runs. That unexpected answer becomes a repeatable check for the next version of your workflow.
Related questions
How do I decide what a good answer looks like?
In detail
Choose a built-in evaluator, write a JavaScript or Python scorer for a precise rule, or use an LLM scorer with your own rubric. Test the scorer on representative examples before running it across a dataset. Human reviews can add ratings and comments alongside automated judgments.
Related questions
Can I compare different prompts or models?
In detail
Yes. Run the same cases against different application versions or prompt and model settings supported by your app. Compare scores and individual outputs to see which cases improved or regressed. You can also re-score saved outputs with a different scorer without calling the application again.
Related questions
Can my team review answers manually?
In detail
Yes. Create a review session from selected traces, define the ratings that matter to your team, and inspect each answer in context. Reviewers can save scores, leave comments, and annotate specific parts of the input or output. Those judgments complement your automated evaluations.
Related questions
Which WhatsApp number does a Datool agent use?
In detail
Your business's own WhatsApp number, connected in Datool. Customers keep messaging the number they already know.
Related questions
How do I add a Datool agent to my website?
In detail
Add the chat widget to your site or link to the hosted help page. You choose its position and appearance.
Related questions
How does a sales agent know my products?
In detail
You connect your catalog as a data source. It recommends only from what you've connected, so it never suggests something you don't sell.
Related questions
Can customers buy inside the chat?
In detail
It sends checkout links from your store, and it can call your own APIs for things like order lookups.
Related questions
Where does a support agent get its answers?
In detail
From the help articles, policies and data sources you connect. It can also call your own APIs to look up orders or accounts.
Related questions
What happens when an agent can't solve something?
In detail
It hands the conversation to your team in the inbox, with a summary and everything it already collected.
Related questions
Does an AI agent replace my team?
In detail
No. It takes the repetitive conversations so your team spends its time on the ones that need a person.
Related questions
- How does a product guide get into my app?
- Can a product guide click things for users?
- Can a product guide use each user's own data?
- Can I control what an agent says?
- How do I get started with an agent?
- Which WhatsApp number does a Datool agent use?
- How does a sales agent know my products?
- Can customers buy inside the chat?
- How do I add a Datool agent to my website?
- Where does a support agent get its answers?
- What happens when an agent can't solve something?
Can I control what an agent says?
In detail
Yes. You write its instructions, choose its data sources and set guardrails for topics it should avoid. You can test it on real conversations before it goes live.
Related questions
- How does a product guide get into my app?
- Can a product guide click things for users?
- Can a product guide use each user's own data?
- Does an AI agent replace my team?
- How do I get started with an agent?
- Which WhatsApp number does a Datool agent use?
- How does a sales agent know my products?
- Can customers buy inside the chat?
- How do I add a Datool agent to my website?
- Where does a support agent get its answers?
- What happens when an agent can't solve something?
How do I get started with an agent?
In detail
Request a demo on WhatsApp. We set it up with your own content so you can see real answers before you decide.
Related questions
- How does a product guide get into my app?
- Can a product guide click things for users?
- Can a product guide use each user's own data?
- Does an AI agent replace my team?
- Can I control what an agent says?
- Which WhatsApp number does a Datool agent use?
- How does a sales agent know my products?
- Can customers buy inside the chat?
- How do I add a Datool agent to my website?
- Where does a support agent get its answers?
- What happens when an agent can't solve something?
How does a product guide get into my app?
In detail
You add the chat widget to your app, then define the actions it can run there and the APIs it can call.
Related questions
Can a product guide click things for users?
In detail
It can run client-side actions you define, such as opening a page or highlighting an element, and call your APIs.
Related questions
Can a product guide use each user's own data?
In detail
Yes, through the APIs you connect. It looks up the account it's helping, so answers fit that user instead of a generic article.