{"id":26482,"date":"2026-11-18T15:55:49","date_gmt":"2026-11-18T15:55:49","guid":{"rendered":"https:\/\/indigitall.com\/?p=26482"},"modified":"2026-11-18T15:55:49","modified_gmt":"2026-11-18T15:55:49","slug":"questions-to-ask-ai-customer-service-vendor-before-pilot","status":"publish","type":"post","link":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/","title":{"rendered":"Questions to Ask an AI Customer Service Vendor Before You Commit to a Pilot"},"content":{"rendered":"<p><strong>TL;DR:<\/strong> The questions to ask an AI customer service vendor before committing to a pilot fall into seven areas: scope, customer data, security, human handoff, testing, metrics and stop criteria. An answer only counts if your team can check it before a single customer talks to the agent. That means checking audit reports for their date, period and scope, testing the agent on your own past conversations, getting the resolution rule in writing and watching a live handoff. Sign the stop and rollback plan before day one, and calculate the pilot cost per resolved conversation.<\/p>\n<p>It&#39;s the week after the second demo. The vendor&#39;s agent answered every question the sales engineer typed, passed a mock refund request to a &quot;live agent&quot; without a hitch, and the last slide proposed a pilot starting next month. Your security lead has already sent a list of questions. Legal wants to know who&#39;s responsible if the agent gets a refund policy wrong. Your team leads want to know whether customers will end up stuck in a loop. And you&#39;re the one who signs off.<\/p>\n<p>The demo showed the agent answering the questions the vendor picked. The pilot has to show it answering yours, so you need to set that up before you commit.<\/p>\n<p>This guide is for heads of support, CX and contact center operations at mid-size and large US companies who are about to sign off on an AI agent pilot, with security, legal and procurement reviewing it alongside them. You&#39;ll leave with the questions to ask, what a verifiable answer looks like for each one, and a stop plan you can sign before the agent sees a real customer.<\/p>\n<h2>What should you ask an AI customer service vendor before committing to a pilot?<\/h2>\n<p>Ask the questions that turn a demo into evidence, grouped into seven areas (scope, customer data, security, human handoff, testing, metrics and stop criteria).<\/p>\n<p>A useful AI customer service vendor evaluation adds three things to every question before anyone signs: what evidence counts as an answer, how your team will check it, and what decision that answer lets you make.<\/p>\n<p>Plenty of published lists of questions to ask AI vendors already exist, and some of them ask for proof. The table below puts the evidence, the check and the decision next to every question. Its last row ties every answer to a stop plan that you and the vendor sign before the pilot starts.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-vendor-answer-to-decision-1200x480-1.png\" alt=\"Flow from question to evidence, check, decision and stop plan, with the seven pilot areas listed under the first box.\" \/><figcaption>A vendor answer only counts once your team can check it and tie it to a decision to go, change the scope or stop.<\/figcaption><\/figure>\n<div data-pw-table-wrap=\"1\" style=\"margin:28px 0;overflow-x:auto;-webkit-overflow-scrolling:touch;border:1px solid #e5e7eb;border-top:3px solid #1f2937;border-radius:10px;box-shadow:0 1px 2px rgba(16,24,40,.04)\">\n<table data-pw-table=\"1\" style=\"width:100%;min-width:560px;border-collapse:collapse;font-size:15px;line-height:1.5;color:#111827;margin:0\">\n<thead>\n<tr>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Area and question<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Evidence that counts<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">How you check it<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Decision it unlocks<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Scope.<\/strong> Which questions, channels, hours and actions will the agent handle?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A written scope built from your own contact logs, with excluded topics named<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Compare the scope with a sample of recent conversations from your queue<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Sign off on the scope, or narrow it before day one<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Customer data.<\/strong> What will the agent read, and where is it processed?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A data flow listing knowledge sources, connected systems, any third-party model, retention and deletion<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Have the vendor show each source, its last sync date and every system the agent can reach<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Approve each source and system, or take it out of the pilot<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Security.<\/strong> Which independent audits cover the service you&#39;re buying?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Audit reports with a report date, an audit period and a stated scope<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Match the scope line in each report to the product in the pilot<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Submit it for security review, or request the missing report<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Human handoff.<\/strong> What happens when the agent can&#39;t answer?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A live handoff on one of your own tickets, showing what the person receives<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Time the wait, read what lands on the human agent&#39;s screen and note whether the customer has to repeat information<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Accept the handoff design, or add it to the stop criteria<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Testing.<\/strong> How will the agent be tested before customers see it?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A test run on your own past questions, including the same question asked several ways<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Score every answer with your own reviewers against your own sources<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Move to a limited rollout, or extend testing<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Metrics.<\/strong> How does the vendor count a resolution?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">The resolution rule in writing, with its denominator<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Recount a sample of &quot;resolved&quot; conversations by hand<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Agree on the success criteria and how the total cost per resolved conversation is calculated<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Stop criteria.<\/strong> Who can switch the agent off, and what happens then?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A signed stop and rollback plan with named owners and a manual fallback<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Rehearse one pause before launch, with the vendor on the call<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Start the pilot, or hold it until the plan exists<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>The last row connects the others. Every &quot;add it to the stop criteria&quot; in the decision column ends up in that plan, so by the time the pilot starts, you already know which answer would end it. The <a href=\"https:\/\/nvlpubs.nist.gov\/nistpubs\/ai\/NIST.AI.100-1.pdf\">NIST AI Risk Management Framework<\/a> is voluntary and sets no pass mark for any of this. It gives your security and legal reviewers a shared language, from third-party risk to who is responsible for deactivating a system.<\/p>\n<h2>What will the AI customer service pilot cover and exclude?<\/h2>\n<p>Start with your own logs. Pull the routine questions your team answers every day. Check which channels they arrive on and when they peak. Then write the pilot scope around those questions.<\/p>\n<p>The document should specify the share of conversations the agent will see, the systems it may only read, and the actions it may take (an order lookup, a booking change). It should also identify the topics that stay with people from day one and who on your team is responsible for each of those decisions.<\/p>\n<p>AI pilot programs built on the vendor&#39;s showcase use cases can only prove the showcase.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-pilot-scope-card-1200x640-1.png\" alt=\"Pilot scope card with fields for questions, excluded topics, channels and hours, share of conversations, systems and actions, and two signatures.\" \/><figcaption>A pilot scope is ready when every field comes from your own logs and both sides have signed it.<\/figcaption><\/figure>\n<p>Ask how the vendor limits exposure while the pilot runs. HubSpot&#39;s documentation describes deploying its customer agent to a single channel or to a small percentage of conversations, and setting the days and hours it responds. Sierra describes rolling a release out to a portion of customer traffic and rolling back just as fast if something unexpected appears. Make sure the scope document names the mechanism and the person allowed to change the percentage.<\/p>\n<p>Then ask where you can try the agent before a customer can reach it. indigitall documents a client-specific <a href=\"https:\/\/documentation.indigitall.com\/docs\/testing\">space for testing chatbot responses<\/a> before channel integration, with two-factor sign-in, and clients in the US and Latin America work on its AM1 platform. Confirm the testing space&#39;s isolation and access controls for your deployment. Its <a href=\"https:\/\/indigitall.com\/en\/ai-voice\/\">AI Voice<\/a> page describes four stages (design, test in a sandbox, scale and optimize), with test calls run in the sandbox on your own scenarios. If you&#39;re still figuring out which conversations a bot should handle, indigitall&#39;s <a href=\"https:\/\/indigitall.com\/en\/blog\/chatbots-for-customer-support-the-definitive-guide-for-2026\/\">guide to chatbots for customer support<\/a> is a broader place to start.<\/p>\n<h2>What customer data will the AI agent read, and where will it go?<\/h2>\n<p>Request the data flow on one page. It should show the knowledge sources the agent answers from and how often each one syncs. It should also identify the systems the agent can query in real time and whether any third-party language model sees your customers&#39; messages. Finally, it should explain how long data is kept and how it gets deleted.<\/p>\n<p>Security and legal will want this page before anything else. In banking, healthcare or any other regulated sector, it&#39;s the page that determines whether the pilot goes ahead at all.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-pilot-data-flow-1200x620-1.png\" alt=\"Data flow from knowledge sources to an AI agent and connected systems, with a dashed box for any third-party model and retention labels.\" \/><figcaption>Every arrow on this diagram is a question for the vendor, and every box needs a written answer before the pilot.<\/figcaption><\/figure>\n<p>NIST&#39;s <a href=\"https:\/\/nvlpubs.nist.gov\/nistpubs\/ai\/NIST.AI.600-1.pdf\">generative AI profile<\/a> suggests contracts and service level agreements that spell out content ownership and usage rights, and it folds vendor due diligence into the way an organization acquires a generative AI system. It&#39;s a voluntary framework and doesn&#39;t certify anyone. Use it as a checklist for the contract review and as vocabulary both sides already share.<\/p>\n<p>indigitall&#39;s <a href=\"https:\/\/indigitall.com\/en\/ai-agents\/\">AI agents<\/a> are a concrete example of a checkable answer. They use retrieval-augmented generation trained only on the content the client provides, with nothing from the public internet. The <a href=\"https:\/\/documentation.indigitall.com\/docs\/ai-agents\">AI agent documentation<\/a> also says the client decides what information the agent uses.<\/p>\n<p>Sources can be PDF or TXT files, web addresses or sitemaps, all in the same language. The <a href=\"https:\/\/documentation.indigitall.com\/docs\/ai-agent-sources\">sources settings<\/a> show how often each one re-syncs and when it last did. The agent reaches systems such as a CRM, ERP, inventory, payments or a healthcare record through the Model Context Protocol (MCP).<\/p>\n<p>On the same AI agents page, indigitall states that customer queries are not sent to OpenAI, Anthropic or Google for processing by a third-party language model. It also states that the reasoning layer runs on its own infrastructure with your data. Its security documentation, covered in the next section, lists Google Cloud as the infrastructure the platform is built on.<\/p>\n<p>Confirm the full data flow and infrastructure for your deployment.<\/p>\n<p>Each connected system also requires integration work. Ask which systems the pilot really needs, who builds each connection, and how much time and support the vendor expects each connection to require, including support from your team.<\/p>\n<p>Retention and deletion belong on that same page. Ask how long conversation logs and data pulled from connected systems are stored, where they&#39;re stored, and how you&#39;d get them deleted when the pilot ends. Get those answers in writing, whatever the vendor&#39;s certifications say.<\/p>\n<h2>How can you verify the vendor&#39;s security before the pilot?<\/h2>\n<p>Get the reports, with their dates. A security page full of badges tells you which audits a vendor has passed at some point. A dated report tells you when the audit happened, which period it covered and which service it applied to, and that&#39;s what your security team needs before it signs off.<\/p>\n<p>The scope is the detail that&#39;s easiest to overlook. An audit can cover one product and leave out another, so match the scope in each report to the exact service in your pilot. Check access and encryption next, meaning role-based access with multi-factor authentication for the people who configure the agent, and encryption in transit and at rest. A healthcare buyer should also ask whether the vendor signs Business Associate Agreements and which service its HIPAA audit actually covers.<\/p>\n<p>indigitall&#39;s <a href=\"https:\/\/documentation.indigitall.com\/docs\/security\">security documentation<\/a> shows what a checkable answer looks like.<\/p>\n<p>It lists a SOC 2 Type II report dated January 20, 2026, covering an audit period from August 15 to November 14, 2025. It also lists ISO\/IEC 27001:2022 certification valid until July 23, 2029, and a GDPR verification valid until April 17, 2027.<\/p>\n<p>Its HIPAA audit has a final report dated May 22, 2025, and covers the encrypted push notification service. The page also says indigitall signs BAAs with US healthcare organizations.<\/p>\n<p>The same page lists role-based access control with multi-factor authentication, TLS 1.2+ in transit, AES-256 at rest and infrastructure built on Google Cloud.<\/p>\n<p>Claims about accuracy deserve the same treatment as claims about security. When the FTC announced <a href=\"https:\/\/www.ftc.gov\/news-events\/news\/press-releases\/2024\/09\/ftc-announces-crackdown-deceptive-ai-claims-schemes\">Operation AI Comply<\/a> on September 25, 2024, it said there is &quot;no AI exemption from the laws on the books,&quot; and its complaint against DoNotPay alleged the company hadn&#39;t tested whether its chatbot&#39;s output matched the level of a human lawyer. The agency&#39;s <a href=\"https:\/\/www.ftc.gov\/news-events\/news\/press-releases\/2025\/08\/ftc-approves-final-order-against-workado-llc-which-misrepresented-accuracy-its-artificial\">final order against Workado<\/a>, announced on August 28, 2025, requires &quot;competent and reliable evidence to support the claim at the time it is made&quot; for claims about its product&#39;s effectiveness. If a vendor quotes a resolution or accuracy rate, ask for the method and the evidence before the pilot, and treat a number that comes with neither as marketing.<\/p>\n<h2>What happens when the AI customer service agent can&#39;t answer?<\/h2>\n<p>Have the vendor demonstrate it on one of your own tickets. A good handoff test answers four questions in a single run:<\/p>\n<ul>\n<li>How does the agent know it can&#39;t answer?<\/li>\n<li>How long does the customer wait for a person?<\/li>\n<li>What does that person see when the conversation lands (the history, the customer profile, the steps already tried)?<\/li>\n<li>Was the customer told from the start that they were talking to an AI?<\/li>\n<\/ul>\n<p>A handoff that makes the customer start over only delays the resolution it was meant to deliver.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-ai-handoff-sequence-1200x720-1.png\" alt=\"Sequence of a customer, an AI agent and a person, with checkpoints for AI disclosure, unanswered question, queue wait and a check of the context passed.\" \/><figcaption>Test whether the person receives the history, relevant profile and steps already tried, and whether the customer needs to repeat information.<\/figcaption><\/figure>\n<p>Regulators and lawmakers are already treating the handoff as a compliance question. The CFPB&#39;s report on <a href=\"https:\/\/www.consumerfinance.gov\/data-research\/research-reports\/chatbots-in-consumer-finance\/chatbots-in-consumer-finance\/\">chatbots in consumer finance<\/a>, published on June 6, 2023, described &quot;doom loops&quot; that are often caused when an issue falls outside a chatbot&#39;s limited capabilities, warned that offramps to human support can be blocked by unreasonable waits, and said inaccurate information about a financial product &quot;could be catastrophic.&quot; It added that chatbots must comply with all applicable federal consumer financial laws. California&#39;s AB 1609, signed on September 28, 2026, requires large businesses to make a good-faith effort to connect a customer to a human within 15 minutes of a request, or schedule an appointment, and to disclose when the representative is a chatbot, according to the <a href=\"https:\/\/www.gov.ca.gov\/2026\/09\/28\/governor-newsom-signs-commonsense-legislation-to-make-your-life-easier\/\">governor&#39;s announcement<\/a>.<\/p>\n<p>indigitall&#39;s <a href=\"https:\/\/indigitall.com\/en\/ai-agents\/\">AI agents page<\/a> says its agent hands off to a live agent in the Contact Center with the full conversation history, the customer profile and the attempted resolution steps already loaded, which the company sums up as &quot;No cold handoffs.&quot; Check that claim on your own tickets, as you would any other. The agent can transfer to an unlimited, configurable number of human agents. The person taking over a voice call gets a real-time transcript and a summary of the context, and the voice agent tells the customer at the start of each call that they&#39;re speaking with an AI agent.<\/p>\n<p>Then ask how you&#39;ll monitor handoffs while the pilot runs. You want queue length, average and maximum wait, and the ability to read any conversation and transfer it. indigitall&#39;s <a href=\"https:\/\/documentation.indigitall.com\/docs\/supervisor-role\">supervisor view<\/a> shows those statistics in real time, and its <a href=\"https:\/\/documentation.indigitall.com\/docs\/agent-panel\">agent panel<\/a> lets an agent route an ongoing chat to another agent or department.<\/p>\n<h2>How should you test the AI agent before real customers see it?<\/h2>\n<p>Test with your own past questions in an environment customers can&#39;t access. Take a set of real conversations from your logs, keep the awkward ones, ask the same question several ways, and have your own reviewers score the answers against your sources. NIST&#39;s generative AI profile frames this as evaluating &quot;claims of model capabilities using empirically validated methods,&quot; and it names confabulation, a model confidently presenting false content, among the risks it covers. Vendors talk a lot about hallucination prevention. A test run on your own data is the version of that claim your security and legal teams can actually check.<\/p>\n<p>Vendor documentation shows what a serious test looks like. Salesforce recommends using its Agentforce Testing Center only in a sandbox environment.<\/p>\n<p>Intercom describes batch tests of up to 50 questions for eligible existing workspaces. Since November 5, 2026, new workspaces use Evals instead. Evals simulate multi-turn conversations and can be rerun as a regression suite after a change. Teams can recreate a real conversation to test it again.<\/p>\n<p>HubSpot lets admins generate batch test questions from existing customer conversations before the agent goes to live channels. Zendesk advises asking realistic questions, asking the same question in different ways, and using two kinds of testers: one focused on process and one on experience. Sierra describes voice simulations with accents, background noise and interruptions, built to catch the problems that only show up in calls.<\/p>\n<p>Turn that into commitments and write them into the pilot plan.<\/p>\n<p>Ask whether you can load a batch of your own questions or only type them one by one. Find out who scores the answers and against which rubric. Also ask whether the tests run again after every change to the knowledge sources and who on your team gets access to the test environment.<\/p>\n<p>Guardrails belong in the same test run. indigitall&#39;s <a href=\"https:\/\/documentation.indigitall.com\/docs\/chatbot-gen-ai\">generative AI chatbot documentation<\/a> lists guardrails you can check in the testing space before channel integration. The bot never returns HTML code, it limits the length of individual words in its answers, and its welcome message identifies it as a bot. According to its <a href=\"https:\/\/documentation.indigitall.com\/docs\/testing\">testing documentation<\/a>, the chatbot restricts access until the following day when a user exceeds the default limit of 10 inappropriate questions in one day. The limit is configurable through the chat channel&#39;s API.<\/p>\n<h2>Which metrics decide whether the pilot works?<\/h2>\n<p>Write five metrics into the pilot plan, each with a baseline you measure yourself before day one:<\/p>\n<ul>\n<li>The resolution rule and its denominator<\/li>\n<li>Fallbacks<\/li>\n<li>Recontact on the same issue<\/li>\n<li>Wait time after a handoff<\/li>\n<li>Cost per resolved conversation<\/li>\n<\/ul>\n<p>Agree on the resolution rule before you agree on any target. Those five numbers, compared with your own baseline, become the pilot&#39;s success criteria in the contract annex.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-pilot-scorecard-1200x600-1.png\" alt=\"Pilot scorecard with rows for resolution rule, fallbacks, recontact, wait after handoff and cost per resolved conversation, and blank columns.\" \/><figcaption>The pilot works when these five numbers move against a baseline you measured yourself, under a resolution rule both sides signed.<\/figcaption><\/figure>\n<p>Each vendor counts a resolution its own way, so get the definition in writing and decide which conversations count as resolved in your pilot. Zendesk separates a verified resolution from a contained one. For customer-agent replies, HubSpot counts a resolution when the agent provides a sourced answer or performs an action and there&#39;s no qualifying handoff within 72 hours of the visitor&#39;s last response. Lead qualification is a separate resolution path. Salesforce reports a deflection rate, the share of sessions that ended without escalation. That&#39;s why there&#39;s no meaningful average resolution rate for AI customer service agents across industries. The published numbers don&#39;t count the same thing.<\/p>\n<p>Quality and customer experience need their own signals. Track fallbacks (the questions the agent couldn&#39;t answer) and whether they drop week by week as you fix the knowledge sources. Track recontact too. A customer returning about the same issue can signal an unresolved problem. Review those conversations before you classify them as unresolved. Calculate the total pilot cost per resolved conversation using an agreed resolution rule, and review a sample to check whether customers actually received help.<\/p>\n<p>indigitall&#39;s chatbot detects when a question goes unanswered, reports the most frequently asked topics and the fallbacks, and lets customers rate the conversation with emojis. Clients can also set a monthly spending limit and receive email alerts at 80% and 100% of it, which keeps the cost of a pilot visible while you measure it. Ask for access to the underlying conversations, whichever tool you pilot, so your team can recount a sample of &quot;resolved&quot; ones by hand.<\/p>\n<h2>When should you pause or stop the AI customer service pilot?<\/h2>\n<p>Decide that before day one, and sign it.<\/p>\n<p>A stop and rollback plan should name the signals that pause the agent and who can switch it off. It should explain what happens to conversations in flight and how customers get back to a person while you fix the problem. It should also name who signs the plan (support, security and the vendor).<\/p>\n<p>NIST&#39;s generative AI profile asks for protocols that make sure a system is &quot;able to be deactivated when necessary,&quot; along with specific deactivation criteria that are reviewed regularly. The AI RMF adds mechanisms and assigned responsibilities to &quot;supersede, disengage, or deactivate&quot; a system that performs in ways inconsistent with its intended use.<\/p>\n<p>The framework is voluntary and sets no thresholds. Your team picks those, and NIST gives the plan a structure your reviewers will recognize.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-pilot-stop-plan-1200x620-1.png\" alt=\"Stop and rollback plan with stop signals, owners, open conversations, route to a person, manual fallback and three signature lines.\" \/><figcaption>The pilot is ready to start when the plan that would end it is already signed by support, security and the vendor.<\/figcaption><\/figure>\n<p>The thresholds are yours to set, but the signals are easy to name in advance. These are examples to adapt.<\/p>\n<div data-pw-table-wrap=\"1\" style=\"margin:28px 0;overflow-x:auto;-webkit-overflow-scrolling:touch;border:1px solid #e5e7eb;border-top:3px solid #1f2937;border-radius:10px;box-shadow:0 1px 2px rgba(16,24,40,.04)\">\n<table data-pw-table=\"1\" style=\"width:100%;min-width:560px;border-collapse:collapse;font-size:15px;line-height:1.5;color:#111827;margin:0\">\n<thead>\n<tr>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Stop signal<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">What it looks like<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Who decides<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">What happens next<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">Inaccurate answer on a sensitive topic<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">The agent gives a wrong refund, billing or eligibility answer<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Support lead with compliance<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Pause that topic, route it to people, fix the source<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">A person can&#39;t be reached<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Customers who ask for a human wait longer than your plan allows<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Contact center manager<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Pause the agent on that channel until staffing recovers<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">Data outside the agreed scope<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">The agent reads or reveals data from a system that isn&#39;t in the scope<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Security<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Stop the pilot and review access<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">Fallbacks that don&#39;t drop<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Unanswered questions stay flat after knowledge fixes<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Support lead and vendor<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Freeze any expansion and review the scope<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">A vendor claim you can&#39;t reproduce<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A quoted rate doesn&#39;t hold on your own sample<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Procurement<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Hold the rollout decision<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>Rollback needs a destination. NIST&#39;s profile treats fallback as something to test and manage, and notes that the fallback can be manual processing, so write down which queue takes over the agent&#39;s conversations, how quickly, and who tells the team. Rehearse one pause before launch with the vendor on the call, and measure how long it takes for every channel to return to human handling.<\/p>\n<p>Plan the exit while you&#39;re at it. Ask what happens to your knowledge sources, test sets and conversation logs if you don&#39;t continue, and how they&#39;re returned or deleted. A pilot you can exit cleanly is a pilot your reviewers can approve faster.<\/p>\n<p>If you&#39;re putting these questions to vendors right now, put them to indigitall too. You can ask for a demo and check every answer against its public documentation on security, knowledge sources and the handoff to the Contact Center.<\/p>\n<h2>FAQs: AI customer service vendor pilot<\/h2>\n<h3>How do you test an AI customer service agent for hallucinations before a pilot?<\/h3>\n<p>Run the agent on a set of your own past conversations before any customer can reach it, ask the same question several ways, include questions it shouldn&#39;t answer, and have your own reviewers score each answer against your sources. NIST&#39;s generative AI profile calls the risk confabulation and recommends evaluating claims of model capabilities with empirically validated methods. Ask the vendor which content the agent answers from and whether you can restrict it to your own sources, then make an inaccurate answer on a sensitive topic one of the pilot&#39;s stop signals.<\/p>\n<h3>Can you configure an AI agent&#39;s guardrails yourself, or does the vendor set them?<\/h3>\n<p>It depends on the vendor, so ask which guardrails are fixed, which ones your team can change, and who changes them during the pilot. indigitall&#39;s generative AI chatbot, for example, never returns HTML code, limits the length of individual words, identifies itself as a bot in its welcome message, and restricts access until the following day when a user exceeds the default limit of 10 inappropriate questions in one day. The limit is configurable through the chat channel&#39;s API. Write every guardrail you rely on into the pilot scope and test each one before launch.<\/p>\n<h3>What observability should an AI customer service vendor give you during a pilot?<\/h3>\n<p>You need real-time visibility into conversations, handoffs and queues, plus regular reports on the questions the agent couldn&#39;t answer. A workable setup shows queue length and average and maximum wait, lets a supervisor read any conversation and transfer it, and reports fallbacks and the most frequently asked topics. indigitall&#39;s supervisor view, for example, shows agent and conversation statistics in real time. Before the pilot starts, agree on who reviews these reports, how often, and which numbers trigger a stop.<\/p>\n<h3>How do you know the AI agent hands off to a person at the right moment?<\/h3>\n<p>Define the moments in writing (a topic on your sensitive list, a customer asking for a person, a repeated unanswered question) and test each one on your own tickets before launch. Once the pilot is live, read a sample of conversations where the agent kept going and check whether it should have handed off. California&#39;s AB 1609, signed on September 28, 2026, asks large businesses to make a good-faith effort to connect a customer with a person within 15 minutes of a request or schedule an appointment, and the CFPB&#39;s 2023 report on chatbots in consumer finance warned about offramps blocked by unreasonable waits.<\/p>\n<h3>What data residency and certifications should you ask an AI customer service vendor about?<\/h3>\n<p>Ask where your data is stored and processed, which language models see your customers&#39; messages, how long logs are kept and how they&#39;re deleted, and get every answer in writing. Ask for each certification report with its date, audit period and scope, and check that the scope covers the product in the pilot. indigitall, for example, lists a SOC 2 Type II report dated January 20, 2026, ISO\/IEC 27001:2022 certification valid until July 23, 2029, and a HIPAA audit whose scope is its encrypted push notification service.<\/p>\n<h3>Should you start with a sandbox or a pilot before signing a long contract?<\/h3>\n<p>Start with a sandbox, then move to a limited pilot. Testing in an environment customers can&#39;t reach lets you check answers, guardrails and handoffs on your own questions without exposing a single customer. A pilot then puts the agent in front of a share of real conversations under a signed scope, written success criteria and a stop plan. Ask each vendor where testing happens and what it takes to move from the sandbox to the pilot.<\/p>\n<h3>Why do AI customer service pilots fail to reach production?<\/h3>\n<p>AI customer service pilots stall when the success criteria, the resolution rule or the stop plan were never written down, so the results can&#39;t support a decision either way. Other common causes are a scope copied from the vendor&#39;s showcase use cases, and integration work with your own systems that nobody planned for. Writing down the success criteria, the resolution rule and the stop plan before the pilot starts gives you a result you can take to a committee.<\/p>\n<h2>About the Authors<\/h2>\n<div class=\"pw-authors\">\n<div class=\"pw-author\" style=\"margin: 0 0 24px;\">\n<div style=\"display: flex; align-items: center; gap: 12px;\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"pw-author-photo\" style=\"width: 72px; height: 72px; min-width: 72px; border-radius: 9999px; object-fit: cover; display: block; flex: 0 0 72px; margin: 0;\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-juan-carlos-de-la-vela.webp\" alt=\"Juan Carlos de la Vela\" width=\"72\" height=\"72\"><\/p>\n<div><strong style=\"display: block; font-weight: bold; line-height: 1.2;\">Juan Carlos de la Vela<\/strong><span style=\"display: block; color: #666; font-size: 0.9em; margin-top: 2px;\">Chief Executive Officer (CEO) at Indigitall<\/span><\/div>\n<\/div>\n<p class=\"pw-author-bio\" style=\"margin: 8px 0 0;\">Juan Carlos de la Vela Benavides is the CEO and co-founder of Indigitall, an AI-driven customer engagement platform. With over 23 years of international experience, he has held senior roles at leading technology companies. At Indigitall, he leads the company&#8217;s strategic direction and oversees operations. His extensive background in sales and management has been instrumental in Indigitall&#8217;s growth and innovation in the digital communication sector.<\/p>\n<p class=\"pw-author-link\" style=\"margin: 6px 0 0;\"><a href=\"https:\/\/www.linkedin.com\/in\/juancvela\/\" target=\"_blank\" rel=\"author noopener\">LinkedIn<\/a><\/p>\n<\/div>\n<div class=\"pw-author\" style=\"margin: 0 0 24px;\">\n<div style=\"display: flex; align-items: center; gap: 12px;\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"pw-author-photo\" style=\"width: 72px; height: 72px; min-width: 72px; border-radius: 9999px; object-fit: cover; display: block; flex: 0 0 72px; margin: 0;\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-xavier-omella.jpg\" alt=\"Xavier Omella\" width=\"72\" height=\"72\"><\/p>\n<div><strong style=\"display: block; font-weight: bold; line-height: 1.2;\">Xavier Omella<\/strong><span style=\"display: block; color: #666; font-size: 0.9em; margin-top: 2px;\">Co-Founder<\/span><\/div>\n<\/div>\n<p class=\"pw-author-bio\" style=\"margin: 8px 0 0;\">Xavier Omella is the Co-Founder of Indigitall, an AI-driven platform that enables businesses to manage and automate customer engagement across multiple digital channels. Under his leadership, Indigitall has expanded its global presence with offices in Miami, New York, Madrid, Bogot\u00e1, Mexico City, Lima, Quito, and S\u00e3o Paulo. The company has been recognized for its innovative approach to digital communication, earning the ISO 27001 Certification for Information Security Management System (ISMS) and the Innovative SME certificate from the Spanish Ministry of Science, Innovation and Universities. Indigitall&#8217;s platform offers a comprehensive suite of tools, including AI-powered marketing automation, customer journey orchestration, and omnichannel engagement, serving industries such as retail, healthcare, banking, and telecommunications.<\/p>\n<p class=\"pw-author-link\" style=\"margin: 6px 0 0;\"><a href=\"https:\/\/www.linkedin.com\/in\/xavier-omella-2480109\/\" target=\"_blank\" rel=\"author noopener\">LinkedIn<\/a><\/p>\n<\/div>\n<div class=\"pw-author\" style=\"margin: 0 0 24px;\">\n<div style=\"display: flex; align-items: center; gap: 12px;\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"pw-author-photo\" style=\"width: 72px; height: 72px; min-width: 72px; border-radius: 9999px; object-fit: cover; display: block; flex: 0 0 72px; margin: 0;\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-josh-rice.jpg\" alt=\"Josh Rice\" width=\"72\" height=\"72\"><\/p>\n<div><strong style=\"display: block; font-weight: bold; line-height: 1.2;\">Josh Rice<\/strong><span style=\"display: block; color: #666; font-size: 0.9em; margin-top: 2px;\">Chief Marketing Officer at Indigitall<\/span><\/div>\n<\/div>\n<p class=\"pw-author-bio\" style=\"margin: 8px 0 0;\">Josh Rice is the Chief Marketing Officer at Indigitall, an AI-driven customer engagement platform. Previously, he served as Associate Director of Marketing at Decision Lens, focusing on modernizing government planning and funding processes. Prior to that, he held roles at Rosetta Stone, including Senior Manager of North American Marketing and Marketing Operations, and Enterprise Marketing Manager. Josh also worked as Digital Marketing Manager at Perfect Sense, where he developed demand generation strategies that significantly increased discovery calls and qualified opportunities. Earlier in his career, he was Product Marketing Manager and Digital Marketing Coordinator at Jinfonet Software, and Inside Sales Representative at Lenovo. His diverse experience in marketing and operations across various companies contributes to Indigitall&#8217;s mission of enhancing customer engagement through AI-powered solutions.<\/p>\n<p class=\"pw-author-link\" style=\"margin: 6px 0 0;\"><a href=\"https:\/\/www.linkedin.com\/in\/joshrice1\/\" target=\"_blank\" rel=\"author noopener\">LinkedIn<\/a><\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Questions to ask an AI customer service vendor before a pilot, what a verifiable answer looks like for each, how to check it and when to stop the pilot.<\/p>\n","protected":false},"author":35,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false},"categories":[293],"tags":[],"topic":[16,17,311],"class_list":["post-26482","post","type-post","status-publish","format-standard","hentry","category-blog-2","topic-artificial-intelligence","topic-chatbot","topic-customer-support"],"acf":{"flexible_content":[{"acf_fc_layout":"hero_success_story","pretitle":"","title":"Questions to Ask an AI Customer Service Vendor Before You Commit to a Pilot","logo":null,"image":null,"card_title":"","card_text":""},{"acf_fc_layout":"body_post","info_title":"","info_image":null,"info_name":"","info_position":"","info_text":"","content_sections":[{"acf_fc_layout":"rich_text","title":"","text":"<p style=\"margin:0 0 10px;color:#5A6B85;font-size:14px;\"><em>Last Updated: 2026-11-17<\/em><\/p>\n<div class=\"idg-tldr\" style=\"font-family:'Manrope',system-ui,-apple-system,sans-serif;border-left:5px solid #0072EF;background:#F1F6FC;border-radius:10px;padding:22px 26px;margin:8px 0 28px;\">\n<div style=\"font-family:'Manrope',system-ui,-apple-system,sans-serif;display:inline-block;background:#8ADA3F;color:#0F0F0F;font-weight:700;font-size:12px;letter-spacing:.04em;padding:4px 12px;border-radius:14px;margin-bottom:12px;\">TL;DR<\/div>\n<p style=\"font-family:'Manrope',system-ui,-apple-system,sans-serif;margin:0;color:#12366C;font-size:17px;line-height:1.6;font-weight:400;\">The questions to ask an AI customer service vendor before committing to a pilot fall into seven areas: scope, customer data, security, human handoff, testing, metrics and stop criteria. An answer only counts if your team can check it before a single customer talks to the agent. That means checking audit reports for their date, period and scope, testing the agent on your own past conversations, getting the resolution rule in writing and watching a live handoff. Sign the stop and rollback plan before day one, and calculate the pilot cost per resolved conversation.<\/p>\n<\/div>\n<p>It&#39;s the week after the second demo. The vendor&#39;s agent answered every question the sales engineer typed, passed a mock refund request to a &quot;live agent&quot; without a hitch, and the last slide proposed a pilot starting next month. Your security lead has already sent a list of questions. Legal wants to know who&#39;s responsible if the agent gets a refund policy wrong. Your team leads want to know whether customers will end up stuck in a loop. And you&#39;re the one who signs off.<\/p>\n<p>The demo showed the agent answering the questions the vendor picked. The pilot has to show it answering yours, so you need to set that up before you commit.<\/p>\n<p>This guide is for heads of support, CX and contact center operations at mid-size and large US companies who are about to sign off on an AI agent pilot, with security, legal and procurement reviewing it alongside them. You&#39;ll leave with the questions to ask, what a verifiable answer looks like for each one, and a stop plan you can sign before the agent sees a real customer.<\/p>\n<h2>What should you ask an AI customer service vendor before committing to a pilot?<\/h2>\n<p>Ask the questions that turn a demo into evidence, grouped into seven areas (scope, customer data, security, human handoff, testing, metrics and stop criteria).<\/p>\n<p>A useful AI customer service vendor evaluation adds three things to every question before anyone signs: what evidence counts as an answer, how your team will check it, and what decision that answer lets you make.<\/p>\n<p>Plenty of published lists of questions to ask AI vendors already exist, and some of them ask for proof. The table below puts the evidence, the check and the decision next to every question. Its last row ties every answer to a stop plan that you and the vendor sign before the pilot starts.<\/p>"},{"acf_fc_layout":"simple_image","image":26550},{"acf_fc_layout":"rich_text","title":"","text":"<p class=\"pw-caption\" style=\"margin: -46px 0 0; font-size: 0.9em; line-height: 1.45; color: #666;\">A vendor answer only counts once your team can check it and tie it to a decision to go, change the scope or stop.<\/p>"},{"acf_fc_layout":"rich_text","title":"","text":"<div data-pw-table-wrap=\"1\" style=\"margin:28px 0;overflow-x:auto;-webkit-overflow-scrolling:touch;border:1px solid #e5e7eb;border-top:3px solid #1f2937;border-radius:10px;box-shadow:0 1px 2px rgba(16,24,40,.04)\"><table data-pw-table=\"1\" style=\"width:100%;min-width:560px;border-collapse:collapse;font-size:15px;line-height:1.5;color:#111827;margin:0\">\n<thead>\n<tr>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Area and question<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Evidence that counts<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">How you check it<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Decision it unlocks<\/th>\n<\/tr>\n<\/thead>\n<tbody><tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Scope.<\/strong> Which questions, channels, hours and actions will the agent handle?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A written scope built from your own contact logs, with excluded topics named<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Compare the scope with a sample of recent conversations from your queue<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Sign off on the scope, or narrow it before day one<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Customer data.<\/strong> What will the agent read, and where is it processed?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A data flow listing knowledge sources, connected systems, any third-party model, retention and deletion<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Have the vendor show each source, its last sync date and every system the agent can reach<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Approve each source and system, or take it out of the pilot<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Security.<\/strong> Which independent audits cover the service you&#39;re buying?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Audit reports with a report date, an audit period and a stated scope<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Match the scope line in each report to the product in the pilot<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Submit it for security review, or request the missing report<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Human handoff.<\/strong> What happens when the agent can&#39;t answer?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A live handoff on one of your own tickets, showing what the person receives<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Time the wait, read what lands on the human agent&#39;s screen and note whether the customer has to repeat information<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Accept the handoff design, or add it to the stop criteria<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Testing.<\/strong> How will the agent be tested before customers see it?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A test run on your own past questions, including the same question asked several ways<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Score every answer with your own reviewers against your own sources<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Move to a limited rollout, or extend testing<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Metrics.<\/strong> How does the vendor count a resolution?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">The resolution rule in writing, with its denominator<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Recount a sample of &quot;resolved&quot; conversations by hand<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Agree on the success criteria and how the total cost per resolved conversation is calculated<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\"><strong>Stop criteria.<\/strong> Who can switch the agent off, and what happens then?<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A signed stop and rollback plan with named owners and a manual fallback<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Rehearse one pause before launch, with the vendor on the call<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Start the pilot, or hold it until the plan exists<\/td>\n<\/tr>\n<\/tbody><\/table><\/div>\n<p>The last row connects the others. Every &quot;add it to the stop criteria&quot; in the decision column ends up in that plan, so by the time the pilot starts, you already know which answer would end it. The <a href=\"https:\/\/nvlpubs.nist.gov\/nistpubs\/ai\/NIST.AI.100-1.pdf\">NIST AI Risk Management Framework<\/a> is voluntary and sets no pass mark for any of this. It gives your security and legal reviewers a shared language, from third-party risk to who is responsible for deactivating a system.<\/p>"},{"acf_fc_layout":"rich_text","title":"What will the AI customer service pilot cover and exclude?","text":"<p>Start with your own logs. Pull the routine questions your team answers every day. Check which channels they arrive on and when they peak. Then write the pilot scope around those questions.<\/p>\n<p>The document should specify the share of conversations the agent will see, the systems it may only read, and the actions it may take (an order lookup, a booking change). It should also identify the topics that stay with people from day one and who on your team is responsible for each of those decisions.<\/p>\n<p>AI pilot programs built on the vendor&#39;s showcase use cases can only prove the showcase.<\/p>"},{"acf_fc_layout":"simple_image","image":26576},{"acf_fc_layout":"rich_text","title":"","text":"<p class=\"pw-caption\" style=\"margin: -46px 0 0; font-size: 0.9em; line-height: 1.45; color: #666;\">A pilot scope is ready when every field comes from your own logs and both sides have signed it.<\/p>"},{"acf_fc_layout":"rich_text","title":"","text":"<p>Ask how the vendor limits exposure while the pilot runs. HubSpot&#39;s documentation describes deploying its customer agent to a single channel or to a small percentage of conversations, and setting the days and hours it responds. Sierra describes rolling a release out to a portion of customer traffic and rolling back just as fast if something unexpected appears. Make sure the scope document names the mechanism and the person allowed to change the percentage.<\/p>\n<p>Then ask where you can try the agent before a customer can reach it. indigitall documents a client-specific <a href=\"https:\/\/documentation.indigitall.com\/docs\/testing\">space for testing chatbot responses<\/a> before channel integration, with two-factor sign-in, and clients in the US and Latin America work on its AM1 platform. Confirm the testing space&#39;s isolation and access controls for your deployment. Its <a href=\"https:\/\/indigitall.com\/en\/ai-voice\/\">AI Voice<\/a> page describes four stages (design, test in a sandbox, scale and optimize), with test calls run in the sandbox on your own scenarios. If you&#39;re still figuring out which conversations a bot should handle, indigitall&#39;s <a href=\"https:\/\/indigitall.com\/en\/blog\/chatbots-for-customer-support-the-definitive-guide-for-2026\/\">guide to chatbots for customer support<\/a> is a broader place to start.<\/p>\n<h2>What customer data will the AI agent read, and where will it go?<\/h2>\n<p>Request the data flow on one page. It should show the knowledge sources the agent answers from and how often each one syncs. It should also identify the systems the agent can query in real time and whether any third-party language model sees your customers&#39; messages. Finally, it should explain how long data is kept and how it gets deleted.<\/p>\n<p>Security and legal will want this page before anything else. In banking, healthcare or any other regulated sector, it&#39;s the page that determines whether the pilot goes ahead at all.<\/p>"},{"acf_fc_layout":"simple_image","image":26622},{"acf_fc_layout":"rich_text","title":"","text":"<p class=\"pw-caption\" style=\"margin: -46px 0 0; font-size: 0.9em; line-height: 1.45; color: #666;\">Every arrow on this diagram is a question for the vendor, and every box needs a written answer before the pilot.<\/p>"},{"acf_fc_layout":"rich_text","title":"","text":"<p>NIST&#39;s <a href=\"https:\/\/nvlpubs.nist.gov\/nistpubs\/ai\/NIST.AI.600-1.pdf\">generative AI profile<\/a> suggests contracts and service level agreements that spell out content ownership and usage rights, and it folds vendor due diligence into the way an organization acquires a generative AI system. It&#39;s a voluntary framework and doesn&#39;t certify anyone. Use it as a checklist for the contract review and as vocabulary both sides already share.<\/p>\n<p>indigitall&#39;s <a href=\"https:\/\/indigitall.com\/en\/ai-agents\/\">AI agents<\/a> are a concrete example of a checkable answer. They use retrieval-augmented generation trained only on the content the client provides, with nothing from the public internet. The <a href=\"https:\/\/documentation.indigitall.com\/docs\/ai-agents\">AI agent documentation<\/a> also says the client decides what information the agent uses.<\/p>\n<p>Sources can be PDF or TXT files, web addresses or sitemaps, all in the same language. The <a href=\"https:\/\/documentation.indigitall.com\/docs\/ai-agent-sources\">sources settings<\/a> show how often each one re-syncs and when it last did. The agent reaches systems such as a CRM, ERP, inventory, payments or a healthcare record through the Model Context Protocol (MCP).<\/p>\n<p>On the same AI agents page, indigitall states that customer queries are not sent to OpenAI, Anthropic or Google for processing by a third-party language model. It also states that the reasoning layer runs on its own infrastructure with your data. Its security documentation, covered in the next section, lists Google Cloud as the infrastructure the platform is built on.<\/p>\n<p>Confirm the full data flow and infrastructure for your deployment.<\/p>\n<p>Each connected system also requires integration work. Ask which systems the pilot really needs, who builds each connection, and how much time and support the vendor expects each connection to require, including support from your team.<\/p>\n<p>Retention and deletion belong on that same page. Ask how long conversation logs and data pulled from connected systems are stored, where they&#39;re stored, and how you&#39;d get them deleted when the pilot ends. Get those answers in writing, whatever the vendor&#39;s certifications say.<\/p>"},{"acf_fc_layout":"rich_text","title":"How can you verify the vendor&#39;s security before the pilot?","text":"<p>Get the reports, with their dates. A security page full of badges tells you which audits a vendor has passed at some point. A dated report tells you when the audit happened, which period it covered and which service it applied to, and that&#39;s what your security team needs before it signs off.<\/p>\n<p>The scope is the detail that&#39;s easiest to overlook. An audit can cover one product and leave out another, so match the scope in each report to the exact service in your pilot. Check access and encryption next, meaning role-based access with multi-factor authentication for the people who configure the agent, and encryption in transit and at rest. A healthcare buyer should also ask whether the vendor signs Business Associate Agreements and which service its HIPAA audit actually covers.<\/p>\n<p>indigitall&#39;s <a href=\"https:\/\/documentation.indigitall.com\/docs\/security\">security documentation<\/a> shows what a checkable answer looks like.<\/p>\n<p>It lists a SOC 2 Type II report dated January 20, 2026, covering an audit period from August 15 to November 14, 2025. It also lists ISO\/IEC 27001:2022 certification valid until July 23, 2029, and a GDPR verification valid until April 17, 2027.<\/p>\n<p>Its HIPAA audit has a final report dated May 22, 2025, and covers the encrypted push notification service. The page also says indigitall signs BAAs with US healthcare organizations.<\/p>\n<p>The same page lists role-based access control with multi-factor authentication, TLS 1.2+ in transit, AES-256 at rest and infrastructure built on Google Cloud.<\/p>\n<p>Claims about accuracy deserve the same treatment as claims about security. When the FTC announced <a href=\"https:\/\/www.ftc.gov\/news-events\/news\/press-releases\/2024\/09\/ftc-announces-crackdown-deceptive-ai-claims-schemes\">Operation AI Comply<\/a> on September 25, 2024, it said there is &quot;no AI exemption from the laws on the books,&quot; and its complaint against DoNotPay alleged the company hadn&#39;t tested whether its chatbot&#39;s output matched the level of a human lawyer. The agency&#39;s <a href=\"https:\/\/www.ftc.gov\/news-events\/news\/press-releases\/2025\/08\/ftc-approves-final-order-against-workado-llc-which-misrepresented-accuracy-its-artificial\">final order against Workado<\/a>, announced on August 28, 2025, requires &quot;competent and reliable evidence to support the claim at the time it is made&quot; for claims about its product&#39;s effectiveness. If a vendor quotes a resolution or accuracy rate, ask for the method and the evidence before the pilot, and treat a number that comes with neither as marketing.<\/p>\n<h2>What happens when the AI customer service agent can&amp;#39;t answer?<\/h2>\n<p>Have the vendor demonstrate it on one of your own tickets. A good handoff test answers four questions in a single run:<\/p>\n<ul>\n<li>How does the agent know it can&#39;t answer?<\/li>\n<li>How long does the customer wait for a person?<\/li>\n<li>What does that person see when the conversation lands (the history, the customer profile, the steps already tried)?<\/li>\n<li>Was the customer told from the start that they were talking to an AI?<\/li>\n<\/ul>\n<p>A handoff that makes the customer start over only delays the resolution it was meant to deliver.<\/p>"},{"acf_fc_layout":"simple_image","image":26641},{"acf_fc_layout":"rich_text","title":"","text":"<p class=\"pw-caption\" style=\"margin: -46px 0 0; font-size: 0.9em; line-height: 1.45; color: #666;\">Test whether the person receives the history, relevant profile and steps already tried, and whether the customer needs to repeat information.<\/p>"},{"acf_fc_layout":"rich_text","title":"","text":"<p>Regulators and lawmakers are already treating the handoff as a compliance question. The CFPB&#39;s report on <a href=\"https:\/\/www.consumerfinance.gov\/data-research\/research-reports\/chatbots-in-consumer-finance\/chatbots-in-consumer-finance\/\">chatbots in consumer finance<\/a>, published on June 6, 2023, described &quot;doom loops&quot; that are often caused when an issue falls outside a chatbot&#39;s limited capabilities, warned that offramps to human support can be blocked by unreasonable waits, and said inaccurate information about a financial product &quot;could be catastrophic.&quot; It added that chatbots must comply with all applicable federal consumer financial laws. California&#39;s AB 1609, signed on September 28, 2026, requires large businesses to make a good-faith effort to connect a customer to a human within 15 minutes of a request, or schedule an appointment, and to disclose when the representative is a chatbot, according to the <a href=\"https:\/\/www.gov.ca.gov\/2026\/09\/28\/governor-newsom-signs-commonsense-legislation-to-make-your-life-easier\/\">governor&#39;s announcement<\/a>.<\/p>\n<p>indigitall&#39;s <a href=\"https:\/\/indigitall.com\/en\/ai-agents\/\">AI agents page<\/a> says its agent hands off to a live agent in the Contact Center with the full conversation history, the customer profile and the attempted resolution steps already loaded, which the company sums up as &quot;No cold handoffs.&quot; Check that claim on your own tickets, as you would any other. The agent can transfer to an unlimited, configurable number of human agents. The person taking over a voice call gets a real-time transcript and a summary of the context, and the voice agent tells the customer at the start of each call that they&#39;re speaking with an AI agent.<\/p>\n<p>Then ask how you&#39;ll monitor handoffs while the pilot runs. You want queue length, average and maximum wait, and the ability to read any conversation and transfer it. indigitall&#39;s <a href=\"https:\/\/documentation.indigitall.com\/docs\/supervisor-role\">supervisor view<\/a> shows those statistics in real time, and its <a href=\"https:\/\/documentation.indigitall.com\/docs\/agent-panel\">agent panel<\/a> lets an agent route an ongoing chat to another agent or department.<\/p>"},{"acf_fc_layout":"rich_text","title":"How should you test the AI agent before real customers see it?","text":"<p>Test with your own past questions in an environment customers can&#39;t access. Take a set of real conversations from your logs, keep the awkward ones, ask the same question several ways, and have your own reviewers score the answers against your sources. NIST&#39;s generative AI profile frames this as evaluating &quot;claims of model capabilities using empirically validated methods,&quot; and it names confabulation, a model confidently presenting false content, among the risks it covers. Vendors talk a lot about hallucination prevention. A test run on your own data is the version of that claim your security and legal teams can actually check.<\/p>\n<p>Vendor documentation shows what a serious test looks like. Salesforce recommends using its Agentforce Testing Center only in a sandbox environment.<\/p>\n<p>Intercom describes batch tests of up to 50 questions for eligible existing workspaces. Since November 5, 2026, new workspaces use Evals instead. Evals simulate multi-turn conversations and can be rerun as a regression suite after a change. Teams can recreate a real conversation to test it again.<\/p>\n<p>HubSpot lets admins generate batch test questions from existing customer conversations before the agent goes to live channels. Zendesk advises asking realistic questions, asking the same question in different ways, and using two kinds of testers: one focused on process and one on experience. Sierra describes voice simulations with accents, background noise and interruptions, built to catch the problems that only show up in calls.<\/p>\n<p>Turn that into commitments and write them into the pilot plan.<\/p>\n<p>Ask whether you can load a batch of your own questions or only type them one by one. Find out who scores the answers and against which rubric. Also ask whether the tests run again after every change to the knowledge sources and who on your team gets access to the test environment.<\/p>\n<p>Guardrails belong in the same test run. indigitall&#39;s <a href=\"https:\/\/documentation.indigitall.com\/docs\/chatbot-gen-ai\">generative AI chatbot documentation<\/a> lists guardrails you can check in the testing space before channel integration. The bot never returns HTML code, it limits the length of individual words in its answers, and its welcome message identifies it as a bot. According to its <a href=\"https:\/\/documentation.indigitall.com\/docs\/testing\">testing documentation<\/a>, the chatbot restricts access until the following day when a user exceeds the default limit of 10 inappropriate questions in one day. The limit is configurable through the chat channel&#39;s API.<\/p>\n<h2>Which metrics decide whether the pilot works?<\/h2>\n<p>Write five metrics into the pilot plan, each with a baseline you measure yourself before day one:<\/p>\n<ul>\n<li>The resolution rule and its denominator<\/li>\n<li>Fallbacks<\/li>\n<li>Recontact on the same issue<\/li>\n<li>Wait time after a handoff<\/li>\n<li>Cost per resolved conversation<\/li>\n<\/ul>\n<p>Agree on the resolution rule before you agree on any target. Those five numbers, compared with your own baseline, become the pilot&#39;s success criteria in the contract annex.<\/p>"},{"acf_fc_layout":"simple_image","image":26658},{"acf_fc_layout":"rich_text","title":"","text":"<p class=\"pw-caption\" style=\"margin: -46px 0 0; font-size: 0.9em; line-height: 1.45; color: #666;\">The pilot works when these five numbers move against a baseline you measured yourself, under a resolution rule both sides signed.<\/p>"},{"acf_fc_layout":"rich_text","title":"","text":"<p>Each vendor counts a resolution its own way, so get the definition in writing and decide which conversations count as resolved in your pilot. Zendesk separates a verified resolution from a contained one. For customer-agent replies, HubSpot counts a resolution when the agent provides a sourced answer or performs an action and there&#39;s no qualifying handoff within 72 hours of the visitor&#39;s last response. Lead qualification is a separate resolution path. Salesforce reports a deflection rate, the share of sessions that ended without escalation. That&#39;s why there&#39;s no meaningful average resolution rate for AI customer service agents across industries. The published numbers don&#39;t count the same thing.<\/p>\n<p>Quality and customer experience need their own signals. Track fallbacks (the questions the agent couldn&#39;t answer) and whether they drop week by week as you fix the knowledge sources. Track recontact too. A customer returning about the same issue can signal an unresolved problem. Review those conversations before you classify them as unresolved. Calculate the total pilot cost per resolved conversation using an agreed resolution rule, and review a sample to check whether customers actually received help.<\/p>\n<p>indigitall&#39;s chatbot detects when a question goes unanswered, reports the most frequently asked topics and the fallbacks, and lets customers rate the conversation with emojis. Clients can also set a monthly spending limit and receive email alerts at 80% and 100% of it, which keeps the cost of a pilot visible while you measure it. Ask for access to the underlying conversations, whichever tool you pilot, so your team can recount a sample of &quot;resolved&quot; ones by hand.<\/p>"},{"acf_fc_layout":"rich_text","title":"When should you pause or stop the AI customer service pilot?","text":"<p>Decide that before day one, and sign it.<\/p>\n<p>A stop and rollback plan should name the signals that pause the agent and who can switch it off. It should explain what happens to conversations in flight and how customers get back to a person while you fix the problem. It should also name who signs the plan (support, security and the vendor).<\/p>\n<p>NIST&#39;s generative AI profile asks for protocols that make sure a system is &quot;able to be deactivated when necessary,&quot; along with specific deactivation criteria that are reviewed regularly. The AI RMF adds mechanisms and assigned responsibilities to &quot;supersede, disengage, or deactivate&quot; a system that performs in ways inconsistent with its intended use.<\/p>\n<p>The framework is voluntary and sets no thresholds. Your team picks those, and NIST gives the plan a structure your reviewers will recognize.<\/p>"},{"acf_fc_layout":"simple_image","image":26669},{"acf_fc_layout":"rich_text","title":"","text":"<p class=\"pw-caption\" style=\"margin: -46px 0 0; font-size: 0.9em; line-height: 1.45; color: #666;\">The pilot is ready to start when the plan that would end it is already signed by support, security and the vendor.<\/p>"},{"acf_fc_layout":"rich_text","title":"","text":"<p>The thresholds are yours to set, but the signals are easy to name in advance. These are examples to adapt.<\/p>\n<div data-pw-table-wrap=\"1\" style=\"margin:28px 0;overflow-x:auto;-webkit-overflow-scrolling:touch;border:1px solid #e5e7eb;border-top:3px solid #1f2937;border-radius:10px;box-shadow:0 1px 2px rgba(16,24,40,.04)\"><table data-pw-table=\"1\" style=\"width:100%;min-width:560px;border-collapse:collapse;font-size:15px;line-height:1.5;color:#111827;margin:0\">\n<thead>\n<tr>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Stop signal<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">What it looks like<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">Who decides<\/th>\n<th style=\"background:#1f2937;color:#ffffff;text-align:left;vertical-align:bottom;padding:14px 16px;font-weight:600;font-size:13px;letter-spacing:.02em;text-transform:uppercase;border:0\">What happens next<\/th>\n<\/tr>\n<\/thead>\n<tbody><tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">Inaccurate answer on a sensitive topic<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">The agent gives a wrong refund, billing or eligibility answer<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Support lead with compliance<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Pause that topic, route it to people, fix the source<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">A person can&#39;t be reached<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Customers who ask for a human wait longer than your plan allows<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Contact center manager<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Pause the agent on that channel until staffing recovers<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">Data outside the agreed scope<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">The agent reads or reveals data from a system that isn&#39;t in the scope<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Security<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Stop the pilot and review access<\/td>\n<\/tr>\n<tr style=\"background:#f9fafb;\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">Fallbacks that don&#39;t drop<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Unanswered questions stay flat after knowledge fixes<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Support lead and vendor<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Freeze any expansion and review the scope<\/td>\n<\/tr>\n<tr style=\"\">\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:600\">A vendor claim you can&#39;t reproduce<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">A quoted rate doesn&#39;t hold on your own sample<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Procurement<\/td>\n<td style=\"padding:14px 16px;vertical-align:top;border-top:1px solid #e5e7eb;border-left:0;border-right:0;font-weight:400\">Hold the rollout decision<\/td>\n<\/tr>\n<\/tbody><\/table><\/div>\n<p>Rollback needs a destination. NIST&#39;s profile treats fallback as something to test and manage, and notes that the fallback can be manual processing, so write down which queue takes over the agent&#39;s conversations, how quickly, and who tells the team. Rehearse one pause before launch with the vendor on the call, and measure how long it takes for every channel to return to human handling.<\/p>\n<p>Plan the exit while you&#39;re at it. Ask what happens to your knowledge sources, test sets and conversation logs if you don&#39;t continue, and how they&#39;re returned or deleted. A pilot you can exit cleanly is a pilot your reviewers can approve faster.<\/p>\n<p>If you&#39;re putting these questions to vendors right now, put them to indigitall too. You can ask for a demo and check every answer against its public documentation on security, knowledge sources and the handoff to the Contact Center.<\/p>\n<h2>FAQs: AI customer service vendor pilot<\/h2>\n<h3>How do you test an AI customer service agent for hallucinations before a pilot?<\/h3>\n<p>Run the agent on a set of your own past conversations before any customer can reach it, ask the same question several ways, include questions it shouldn&#39;t answer, and have your own reviewers score each answer against your sources. NIST&#39;s generative AI profile calls the risk confabulation and recommends evaluating claims of model capabilities with empirically validated methods. Ask the vendor which content the agent answers from and whether you can restrict it to your own sources, then make an inaccurate answer on a sensitive topic one of the pilot&#39;s stop signals.<\/p>\n<h3>Can you configure an AI agent&#39;s guardrails yourself, or does the vendor set them?<\/h3>\n<p>It depends on the vendor, so ask which guardrails are fixed, which ones your team can change, and who changes them during the pilot. indigitall&#39;s generative AI chatbot, for example, never returns HTML code, limits the length of individual words, identifies itself as a bot in its welcome message, and restricts access until the following day when a user exceeds the default limit of 10 inappropriate questions in one day. The limit is configurable through the chat channel&#39;s API. Write every guardrail you rely on into the pilot scope and test each one before launch.<\/p>\n<h3>What observability should an AI customer service vendor give you during a pilot?<\/h3>\n<p>You need real-time visibility into conversations, handoffs and queues, plus regular reports on the questions the agent couldn&#39;t answer. A workable setup shows queue length and average and maximum wait, lets a supervisor read any conversation and transfer it, and reports fallbacks and the most frequently asked topics. indigitall&#39;s supervisor view, for example, shows agent and conversation statistics in real time. Before the pilot starts, agree on who reviews these reports, how often, and which numbers trigger a stop.<\/p>\n<h3>How do you know the AI agent hands off to a person at the right moment?<\/h3>\n<p>Define the moments in writing (a topic on your sensitive list, a customer asking for a person, a repeated unanswered question) and test each one on your own tickets before launch. Once the pilot is live, read a sample of conversations where the agent kept going and check whether it should have handed off. California&#39;s AB 1609, signed on September 28, 2026, asks large businesses to make a good-faith effort to connect a customer with a person within 15 minutes of a request or schedule an appointment, and the CFPB&#39;s 2023 report on chatbots in consumer finance warned about offramps blocked by unreasonable waits.<\/p>\n<h3>What data residency and certifications should you ask an AI customer service vendor about?<\/h3>\n<p>Ask where your data is stored and processed, which language models see your customers&#39; messages, how long logs are kept and how they&#39;re deleted, and get every answer in writing. Ask for each certification report with its date, audit period and scope, and check that the scope covers the product in the pilot. indigitall, for example, lists a SOC 2 Type II report dated January 20, 2026, ISO\/IEC 27001:2022 certification valid until July 23, 2029, and a HIPAA audit whose scope is its encrypted push notification service.<\/p>\n<h3>Should you start with a sandbox or a pilot before signing a long contract?<\/h3>\n<p>Start with a sandbox, then move to a limited pilot. Testing in an environment customers can&#39;t reach lets you check answers, guardrails and handoffs on your own questions without exposing a single customer. A pilot then puts the agent in front of a share of real conversations under a signed scope, written success criteria and a stop plan. Ask each vendor where testing happens and what it takes to move from the sandbox to the pilot.<\/p>\n<h3>Why do AI customer service pilots fail to reach production?<\/h3>\n<p>AI customer service pilots stall when the success criteria, the resolution rule or the stop plan were never written down, so the results can&#39;t support a decision either way. Other common causes are a scope copied from the vendor&#39;s showcase use cases, and integration work with your own systems that nobody planned for. Writing down the success criteria, the resolution rule and the stop plan before the pilot starts gives you a result you can take to a committee.<\/p>\n<h2>About the Authors<\/h2>\n<div class=\"pw-authors\">\n<div class=\"pw-author\" style=\"margin: 0 0 24px;\">\n<div style=\"display: flex; align-items: center; gap: 12px;\">\n\n<img class=\"pw-author-photo\" style=\"width: 72px; height: 72px; min-width: 72px; border-radius: 9999px; object-fit: cover; display: block; flex: 0 0 72px; margin: 0;\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-juan-carlos-de-la-vela.webp\" alt=\"Juan Carlos de la Vela\" width=\"72\" height=\"72\">\n<div><strong style=\"display: block; font-weight: bold; line-height: 1.2;\">Juan Carlos de la Vela<\/strong><span style=\"display: block; color: #666; font-size: 0.9em; margin-top: 2px;\">Chief Executive Officer (CEO) at Indigitall<\/span><\/div>\n<\/div>\n<p class=\"pw-author-bio\" style=\"margin: 8px 0 0;\">Juan Carlos de la Vela Benavides is the CEO and co-founder of Indigitall, an AI-driven customer engagement platform. With over 23 years of international experience, he has held senior roles at leading technology companies. At Indigitall, he leads the company's strategic direction and oversees operations. His extensive background in sales and management has been instrumental in Indigitall's growth and innovation in the digital communication sector.<\/p>\n<p class=\"pw-author-link\" style=\"margin: 6px 0 0;\"><a href=\"https:\/\/www.linkedin.com\/in\/juancvela\/\" target=\"_blank\" rel=\"author noopener\">LinkedIn<\/a><\/p>\n\n<\/div>\n<div class=\"pw-author\" style=\"margin: 0 0 24px;\">\n<div style=\"display: flex; align-items: center; gap: 12px;\">\n\n<img class=\"pw-author-photo\" style=\"width: 72px; height: 72px; min-width: 72px; border-radius: 9999px; object-fit: cover; display: block; flex: 0 0 72px; margin: 0;\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-xavier-omella.jpg\" alt=\"Xavier Omella\" width=\"72\" height=\"72\">\n<div><strong style=\"display: block; font-weight: bold; line-height: 1.2;\">Xavier Omella<\/strong><span style=\"display: block; color: #666; font-size: 0.9em; margin-top: 2px;\">Co-Founder<\/span><\/div>\n<\/div>\n<p class=\"pw-author-bio\" style=\"margin: 8px 0 0;\">Xavier Omella is the Co-Founder of Indigitall, an AI-driven platform that enables businesses to manage and automate customer engagement across multiple digital channels. Under his leadership, Indigitall has expanded its global presence with offices in Miami, New York, Madrid, Bogot\u00e1, Mexico City, Lima, Quito, and S\u00e3o Paulo. The company has been recognized for its innovative approach to digital communication, earning the ISO 27001 Certification for Information Security Management System (ISMS) and the Innovative SME certificate from the Spanish Ministry of Science, Innovation and Universities. Indigitall's platform offers a comprehensive suite of tools, including AI-powered marketing automation, customer journey orchestration, and omnichannel engagement, serving industries such as retail, healthcare, banking, and telecommunications.<\/p>\n<p class=\"pw-author-link\" style=\"margin: 6px 0 0;\"><a href=\"https:\/\/www.linkedin.com\/in\/xavier-omella-2480109\/\" target=\"_blank\" rel=\"author noopener\">LinkedIn<\/a><\/p>\n\n<\/div>\n<div class=\"pw-author\" style=\"margin: 0 0 24px;\">\n<div style=\"display: flex; align-items: center; gap: 12px;\">\n\n<img class=\"pw-author-photo\" style=\"width: 72px; height: 72px; min-width: 72px; border-radius: 9999px; object-fit: cover; display: block; flex: 0 0 72px; margin: 0;\" src=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-josh-rice.jpg\" alt=\"Josh Rice\" width=\"72\" height=\"72\">\n<div><strong style=\"display: block; font-weight: bold; line-height: 1.2;\">Josh Rice<\/strong><span style=\"display: block; color: #666; font-size: 0.9em; margin-top: 2px;\">Chief Marketing Officer at Indigitall<\/span><\/div>\n<\/div>\n<p class=\"pw-author-bio\" style=\"margin: 8px 0 0;\">Josh Rice is the Chief Marketing Officer at Indigitall, an AI-driven customer engagement platform. Previously, he served as Associate Director of Marketing at Decision Lens, focusing on modernizing government planning and funding processes. Prior to that, he held roles at Rosetta Stone, including Senior Manager of North American Marketing and Marketing Operations, and Enterprise Marketing Manager. Josh also worked as Digital Marketing Manager at Perfect Sense, where he developed demand generation strategies that significantly increased discovery calls and qualified opportunities. Earlier in his career, he was Product Marketing Manager and Digital Marketing Coordinator at Jinfonet Software, and Inside Sales Representative at Lenovo. His diverse experience in marketing and operations across various companies contributes to Indigitall's mission of enhancing customer engagement through AI-powered solutions.<\/p>\n<p class=\"pw-author-link\" style=\"margin: 6px 0 0;\"><a href=\"https:\/\/www.linkedin.com\/in\/joshrice1\/\" target=\"_blank\" rel=\"author noopener\">LinkedIn<\/a><\/p>\n\n<\/div>\n\n<\/div>"}]},{"acf_fc_layout":"custom_html","code":"<script type=\"application\/ld+json\">\n{\n \"@context\": \"https:\/\/schema.org\",\n \"@graph\": [\n  {\n   \"@type\": \"Person\",\n   \"name\": \"Juan Carlos de la Vela\",\n   \"jobTitle\": \"Chief Executive Officer (CEO) at Indigitall\",\n   \"description\": \"Juan Carlos de la Vela Benavides is the CEO and co-founder of Indigitall, an AI-driven customer engagement platform. With over 23 years of international experience, he has held senior roles at leading technology companies. At Indigitall, he leads the company's strategic direction and oversees operations. His extensive background in sales and management has been instrumental in Indigitall's growth and innovation in the digital communication sector.\",\n   \"image\": \"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-juan-carlos-de-la-vela.webp\",\n   \"sameAs\": [\n    \"https:\/\/www.linkedin.com\/in\/juancvela\/\"\n   ]\n  },\n  {\n   \"@type\": \"Person\",\n   \"name\": \"Xavier Omella\",\n   \"jobTitle\": \"Co-Founder\",\n   \"description\": \"Xavier Omella is the Co-Founder of Indigitall, an AI-driven platform that enables businesses to manage and automate customer engagement across multiple digital channels. Under his leadership, Indigitall has expanded its global presence with offices in Miami, New York, Madrid, Bogot\u00e1, Mexico City, Lima, Quito, and S\u00e3o Paulo. The company has been recognized for its innovative approach to digital communication, earning the ISO 27001 Certification for Information Security Management System (ISMS) and the Innovative SME certificate from the Spanish Ministry of Science, Innovation and Universities. Indigitall's platform offers a comprehensive suite of tools, including AI-powered marketing automation, customer journey orchestration, and omnichannel engagement, serving industries such as retail, healthcare, banking, and telecommunications.\",\n   \"image\": \"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-xavier-omella.jpg\",\n   \"sameAs\": [\n    \"https:\/\/www.linkedin.com\/in\/xavier-omella-2480109\/\"\n   ]\n  },\n  {\n   \"@type\": \"Person\",\n   \"name\": \"Josh Rice\",\n   \"jobTitle\": \"Chief Marketing Officer at Indigitall\",\n   \"description\": \"Josh Rice is the Chief Marketing Officer at Indigitall, an AI-driven customer engagement platform. Previously, he served as Associate Director of Marketing at Decision Lens, focusing on modernizing government planning and funding processes. Prior to that, he held roles at Rosetta Stone, including Senior Manager of North American Marketing and Marketing Operations, and Enterprise Marketing Manager. Josh also worked as Digital Marketing Manager at Perfect Sense, where he developed demand generation strategies that significantly increased discovery calls and qualified opportunities. Earlier in his career, he was Product Marketing Manager and Digital Marketing Coordinator at Jinfonet Software, and Inside Sales Representative at Lenovo. His diverse experience in marketing and operations across various companies contributes to Indigitall's mission of enhancing customer engagement through AI-powered solutions.\",\n   \"image\": \"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/08\/indigitall-author-josh-rice.jpg\",\n   \"sameAs\": [\n    \"https:\/\/www.linkedin.com\/in\/joshrice1\/\"\n   ]\n  }\n ]\n}\n<\/script>\n\n<script type=\"application\/ld+json\">\n{\n  \"@context\": \"https:\/\/schema.org\",\n  \"@type\": \"FAQPage\",\n  \"mainEntity\": [\n    {\n      \"@type\": \"Question\",\n      \"name\": \"How do you test an AI customer service agent for hallucinations before a pilot?\",\n      \"acceptedAnswer\": {\n        \"@type\": \"Answer\",\n        \"text\": \"Run the agent on a set of your own past conversations before any customer can reach it, ask the same question several ways, include questions it shouldn't answer, and have your own reviewers score each answer against your sources. NIST's generative AI profile calls the risk confabulation and recommends evaluating claims of model capabilities with empirically validated methods. Ask the vendor which content the agent answers from and whether you can restrict it to your own sources, then make an inaccurate answer on a sensitive topic one of the pilot's stop signals.\"\n      }\n    },\n    {\n      \"@type\": \"Question\",\n      \"name\": \"Can you configure an AI agent's guardrails yourself, or does the vendor set them?\",\n      \"acceptedAnswer\": {\n        \"@type\": \"Answer\",\n        \"text\": \"It depends on the vendor, so ask which guardrails are fixed, which ones your team can change, and who changes them during the pilot. indigitall's generative AI chatbot, for example, never returns HTML code, limits the length of individual words, identifies itself as a bot in its welcome message, and restricts access until the following day when a user exceeds the default limit of 10 inappropriate questions in one day. The limit is configurable through the chat channel's API. Write every guardrail you rely on into the pilot scope and test each one before launch.\"\n      }\n    },\n    {\n      \"@type\": \"Question\",\n      \"name\": \"What observability should an AI customer service vendor give you during a pilot?\",\n      \"acceptedAnswer\": {\n        \"@type\": \"Answer\",\n        \"text\": \"You need real-time visibility into conversations, handoffs and queues, plus regular reports on the questions the agent couldn't answer. A workable setup shows queue length and average and maximum wait, lets a supervisor read any conversation and transfer it, and reports fallbacks and the most frequently asked topics. indigitall's supervisor view, for example, shows agent and conversation statistics in real time. Before the pilot starts, agree on who reviews these reports, how often, and which numbers trigger a stop.\"\n      }\n    },\n    {\n      \"@type\": \"Question\",\n      \"name\": \"How do you know the AI agent hands off to a person at the right moment?\",\n      \"acceptedAnswer\": {\n        \"@type\": \"Answer\",\n        \"text\": \"Define the moments in writing (a topic on your sensitive list, a customer asking for a person, a repeated unanswered question) and test each one on your own tickets before launch. Once the pilot is live, read a sample of conversations where the agent kept going and check whether it should have handed off. California's AB 1609, signed on September 28, 2026, asks large businesses to make a good-faith effort to connect a customer with a person within 15 minutes of a request or schedule an appointment, and the CFPB's 2023 report on chatbots in consumer finance warned about offramps blocked by unreasonable waits.\"\n      }\n    },\n    {\n      \"@type\": \"Question\",\n      \"name\": \"What data residency and certifications should you ask an AI customer service vendor about?\",\n      \"acceptedAnswer\": {\n        \"@type\": \"Answer\",\n        \"text\": \"Ask where your data is stored and processed, which language models see your customers' messages, how long logs are kept and how they're deleted, and get every answer in writing. Ask for each certification report with its date, audit period and scope, and check that the scope covers the product in the pilot. indigitall, for example, lists a SOC 2 Type II report dated January 20, 2026, ISO\/IEC 27001:2022 certification valid until July 23, 2029, and a HIPAA audit whose scope is its encrypted push notification service.\"\n      }\n    },\n    {\n      \"@type\": \"Question\",\n      \"name\": \"Should you start with a sandbox or a pilot before signing a long contract?\",\n      \"acceptedAnswer\": {\n        \"@type\": \"Answer\",\n        \"text\": \"Start with a sandbox, then move to a limited pilot. Testing in an environment customers can't reach lets you check answers, guardrails and handoffs on your own questions without exposing a single customer. A pilot then puts the agent in front of a share of real conversations under a signed scope, written success criteria and a stop plan. Ask each vendor where testing happens and what it takes to move from the sandbox to the pilot.\"\n      }\n    },\n    {\n      \"@type\": \"Question\",\n      \"name\": \"Why do AI customer service pilots fail to reach production?\",\n      \"acceptedAnswer\": {\n        \"@type\": \"Answer\",\n        \"text\": \"AI customer service pilots stall when the success criteria, the resolution rule or the stop plan were never written down, so the results can't support a decision either way. Other common causes are a scope copied from the vendor's showcase use cases, and integration work with your own systems that nobody planned for. Writing down the success criteria, the resolution rule and the stop plan before the pilot starts gives you a result you can take to a committee.\"\n      }\n    }\n  ]\n}\n<\/script>","code_extra_content":"code_ex_none","code_extitle_cards":"","code_ex_cards":null,"code_ex_brands_custom_background_color":false,"code_ex_custom_brands":false,"code_ex_custom_slider_title":"","code_ex_brands":null,"code_ex_brands_background_color":""}],"glossary_title":"","glossary_definition":"","featured_image":null,"featured_video":null,"channel":[9094,7477]},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Questions to Ask an AI Customer Service Vendor: Pilot Guide<\/title>\n<meta name=\"description\" content=\"Questions to ask an AI customer service vendor before a pilot, what a verifiable answer looks like for each, how to check it and when to stop the pilot.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Questions to Ask an AI Customer Service Vendor: Pilot Guide\" \/>\n<meta property=\"og:description\" content=\"Questions to ask an AI customer service vendor before a pilot, what a verifiable answer looks like for each, how to check it and when to stop the pilot.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/\" \/>\n<meta property=\"og:site_name\" content=\"indigitall\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-18T15:55:49+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-vendor-answer-to-decision-1200x480-1.png\" \/>\n<meta name=\"author\" content=\"Jorge de la Vela\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jorge de la Vela\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"23 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/\"},\"author\":{\"name\":\"Jorge de la Vela\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#\\\/schema\\\/person\\\/46b8f9bcf54a4a2f9dff8ac6357c60b2\"},\"headline\":\"Questions to Ask an AI Customer Service Vendor Before You Commit to a Pilot\",\"datePublished\":\"2026-11-18T15:55:49+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/\"},\"wordCount\":4687,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/indigitall.com\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/indigitall-vendor-answer-to-decision-1200x480-1.png\",\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/\",\"url\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/\",\"name\":\"Questions to Ask an AI Customer Service Vendor: Pilot Guide\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/indigitall.com\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/indigitall-vendor-answer-to-decision-1200x480-1.png\",\"datePublished\":\"2026-11-18T15:55:49+00:00\",\"description\":\"Questions to ask an AI customer service vendor before a pilot, what a verifiable answer looks like for each, how to check it and when to stop the pilot.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/#primaryimage\",\"url\":\"https:\\\/\\\/indigitall.com\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/indigitall-vendor-answer-to-decision-1200x480-1.png\",\"contentUrl\":\"https:\\\/\\\/indigitall.com\\\/wp-content\\\/uploads\\\/2026\\\/11\\\/indigitall-vendor-answer-to-decision-1200x480-1.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/questions-to-ask-ai-customer-service-vendor-before-pilot\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/indigitall.com\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Questions to Ask an AI Customer Service Vendor Before You Commit to a Pilot\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/indigitall.com\\\/en\\\/\",\"name\":\"indigitall\",\"description\":\"Because Every Interaction Matters\",\"publisher\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/indigitall.com\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#organization\",\"name\":\"indigitall\",\"url\":\"https:\\\/\\\/indigitall.com\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/indigitall.com\\\/wp-content\\\/uploads\\\/2026\\\/06\\\/logo_indigitall_notificacion.png\",\"contentUrl\":\"https:\\\/\\\/indigitall.com\\\/wp-content\\\/uploads\\\/2026\\\/06\\\/logo_indigitall_notificacion.png\",\"width\":434,\"height\":434,\"caption\":\"indigitall\"},\"image\":{\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/indigitall.com\\\/en\\\/#\\\/schema\\\/person\\\/46b8f9bcf54a4a2f9dff8ac6357c60b2\",\"name\":\"Jorge de la Vela\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6dbb03883bdbada98bcd7ac2d8b7309442c627739ad3e74f25b0901552249f35?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6dbb03883bdbada98bcd7ac2d8b7309442c627739ad3e74f25b0901552249f35?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6dbb03883bdbada98bcd7ac2d8b7309442c627739ad3e74f25b0901552249f35?s=96&d=mm&r=g\",\"caption\":\"Jorge de la Vela\"},\"url\":\"https:\\\/\\\/indigitall.com\\\/en\\\/author\\\/699debb30043d03bd89b42f6085de34e\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Questions to Ask an AI Customer Service Vendor: Pilot Guide","description":"Questions to ask an AI customer service vendor before a pilot, what a verifiable answer looks like for each, how to check it and when to stop the pilot.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/","og_locale":"en_US","og_type":"article","og_title":"Questions to Ask an AI Customer Service Vendor: Pilot Guide","og_description":"Questions to ask an AI customer service vendor before a pilot, what a verifiable answer looks like for each, how to check it and when to stop the pilot.","og_url":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/","og_site_name":"indigitall","article_published_time":"2026-11-18T15:55:49+00:00","og_image":[{"url":"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-vendor-answer-to-decision-1200x480-1.png","type":"","width":"","height":""}],"author":"Jorge de la Vela","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Jorge de la Vela","Est. reading time":"23 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/#article","isPartOf":{"@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/"},"author":{"name":"Jorge de la Vela","@id":"https:\/\/indigitall.com\/en\/#\/schema\/person\/46b8f9bcf54a4a2f9dff8ac6357c60b2"},"headline":"Questions to Ask an AI Customer Service Vendor Before You Commit to a Pilot","datePublished":"2026-11-18T15:55:49+00:00","mainEntityOfPage":{"@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/"},"wordCount":4687,"commentCount":0,"publisher":{"@id":"https:\/\/indigitall.com\/en\/#organization"},"image":{"@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/#primaryimage"},"thumbnailUrl":"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-vendor-answer-to-decision-1200x480-1.png","articleSection":["Blog"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/","url":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/","name":"Questions to Ask an AI Customer Service Vendor: Pilot Guide","isPartOf":{"@id":"https:\/\/indigitall.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/#primaryimage"},"image":{"@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/#primaryimage"},"thumbnailUrl":"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-vendor-answer-to-decision-1200x480-1.png","datePublished":"2026-11-18T15:55:49+00:00","description":"Questions to ask an AI customer service vendor before a pilot, what a verifiable answer looks like for each, how to check it and when to stop the pilot.","breadcrumb":{"@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/#primaryimage","url":"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-vendor-answer-to-decision-1200x480-1.png","contentUrl":"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/11\/indigitall-vendor-answer-to-decision-1200x480-1.png"},{"@type":"BreadcrumbList","@id":"https:\/\/indigitall.com\/en\/questions-to-ask-ai-customer-service-vendor-before-pilot\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/indigitall.com\/en\/"},{"@type":"ListItem","position":2,"name":"Questions to Ask an AI Customer Service Vendor Before You Commit to a Pilot"}]},{"@type":"WebSite","@id":"https:\/\/indigitall.com\/en\/#website","url":"https:\/\/indigitall.com\/en\/","name":"indigitall","description":"Because Every Interaction Matters","publisher":{"@id":"https:\/\/indigitall.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/indigitall.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/indigitall.com\/en\/#organization","name":"indigitall","url":"https:\/\/indigitall.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/indigitall.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/06\/logo_indigitall_notificacion.png","contentUrl":"https:\/\/indigitall.com\/wp-content\/uploads\/2026\/06\/logo_indigitall_notificacion.png","width":434,"height":434,"caption":"indigitall"},"image":{"@id":"https:\/\/indigitall.com\/en\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/indigitall.com\/en\/#\/schema\/person\/46b8f9bcf54a4a2f9dff8ac6357c60b2","name":"Jorge de la Vela","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/6dbb03883bdbada98bcd7ac2d8b7309442c627739ad3e74f25b0901552249f35?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/6dbb03883bdbada98bcd7ac2d8b7309442c627739ad3e74f25b0901552249f35?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6dbb03883bdbada98bcd7ac2d8b7309442c627739ad3e74f25b0901552249f35?s=96&d=mm&r=g","caption":"Jorge de la Vela"},"url":"https:\/\/indigitall.com\/en\/author\/699debb30043d03bd89b42f6085de34e\/"}]}},"permalink_manager":null,"_links":{"self":[{"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/posts\/26482","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/users\/35"}],"replies":[{"embeddable":true,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/comments?post=26482"}],"version-history":[{"count":3,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/posts\/26482\/revisions"}],"predecessor-version":[{"id":26735,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/posts\/26482\/revisions\/26735"}],"acf:post":[{"embeddable":true,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/channel\/7477"},{"embeddable":true,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/channel\/9094"}],"wp:attachment":[{"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/media?parent=26482"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/categories?post=26482"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/tags?post=26482"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/indigitall.com\/en\/wp-json\/wp\/v2\/topic?post=26482"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}