Metrics and terms
The biggest thing that happens, and the least visible
Somebody opened the assistant, asked one thing, read the reply, closed it and went somewhere else. That is the single most common ending on any widget anywhere, and it is the one ending that produces no event, no row and no number. Everything below is about working with that absence rather than pretending it away.
not measured here
Nothing here measures abandonment. Closing the panel sends nothing, no conversation is marked as ended, no return visit is linked to an earlier one, and there is no tile, list or figure anywhere in the product about visitors who left. The insights page reports conversations, messages, the share that were not refusals, the cache share, latency, spend and the list headed "Unanswered questions". Every one of those is a fact about somebody who stayed long enough to type.
What it means
Abandonment is a visitor leaving without getting what they came for and without telling anybody. It matters more than any figure on any dashboard because it is where the cost of a bad assistant is actually paid: not in a refusal you can read, not in a rating somebody pressed, but in a person who decided this was not worth another minute and left to phone you, or to buy elsewhere, or to give up entirely. It is also, by construction, the hardest thing on this list to see. Every other failure here leaves a mark of some kind. A refusal is recorded. A handover is stored. A thumbs down is a button somebody chose to press. Abandonment is defined by the absence of all of those, which means that any attempt to count it is really an attempt to interpret silence, and silence supports whichever interpretation you brought with you.
How it is actually calculated
What the widget sends when somebody leaves
Nothing. The close control and the escape key hide the panel, and hiding it is a message passed around inside the page rather than a request to anywhere. Nobody is told. There is no ending event, no duration, and no record that the panel was ever on screen.
A conversation record is written when the first question is sent, not when the panel opens. So a visitor who opened it, read the greeting, thought better of it and closed it again has produced no record of any kind. They are not a conversation with no messages. They are not there at all.
That is worth sitting with before reading any other number here, because it sets the boundary of what the whole system knows. The population everybody most wants to understand is outside every denominator on the insights page.
What a conversation record does carry
When it started, when the last message arrived, how many messages it holds, the address of the page it was opened from, a country where the request carried one, an email address if the visitor volunteered one, and a rating if they pressed a button. That is the shape of it.
None of those fields says the conversation ended. There is no closing step, nothing marks a thread finished, and a record that stopped an hour ago looks exactly like a record that stopped in March. The last message time is the only clue and it is a clue about when, never about why.
Why the two endings are identical
A visitor who got a perfect answer and left satisfied produces a conversation with one question and one answer. A visitor who got a useless answer and left annoyed produces a conversation with one question and one answer. Same shape, same length, same everything.
This is the reason a satisfaction figure cannot be inferred from behaviour, and the reason any product claiming to measure abandonment is measuring a rule somebody wrote rather than a thing that happened. Change the rule and the number changes, with no visitor having behaved differently.
The nearest honest move is to stop looking for a rate and start reading. A conversation holding one exchange is a candidate, and reading twenty of them tells you which of the two endings your assistant is producing. That answer is qualitative, it is bounded, and it is far more useful than a percentage would have been.
What would be needed to measure it properly
Three things, none of which is here. A signal when the panel closes, which means sending something on the way out and accepting that the browser will sometimes fail to deliver it. A way to recognise the same person on a later visit, which the widget deliberately avoids doing. And a way to know what they did next, which lives on your side of the fence rather than ours.
The third is the one that cannot be bought. Somebody who leaves the panel and telephones you has not been helped by the assistant, and no widget on earth can observe that call. Any abandonment figure is silently missing it, and it is usually the most expensive part.
How the number gets moved without anything improving
How an abandonment figure gets invented and then improved
Define it as a conversation holding only one exchange, and you can improve it in an afternoon by ending every reply with a question back. Visitors answer politely, conversations grow a second turn, and the figure falls without one person being better served. This is the most common proxy in the category and it is the easiest to move.
Define it as leaving without a handover, and the way to improve it is to push the handover harder at everybody, including the people who were perfectly happy. You have now converted a silent good outcome into an enquiry somebody on your team has to answer, and called it progress.
The accidental version needs nobody to decide anything. A month of visitors asking short factual questions produces short conversations, and any proxy built on length reports a worse month than one full of complicated back and forth. The traffic changed. The assistant did not.
What to look at instead, or alongside
- Twenty conversations holding a single exchange, read end to end, which answers the real question directly for twenty real people.
- Negative ratings read next to their conversations, since somebody who bothered to press a button is telling you what the silent ones felt.
- The unanswered questions list, which is the part of the same population that left a record of what it wanted.
- Your own site analytics for what people did after the page carrying the widget, which is the half of the story that lives on your side.
Questions
- Could you at least count how many people opened the panel?
- Not without sending something on open, which would mean a request from every visitor who so much as brushed the launcher, on every page, whether or not they ever asked anything. The current arrangement is that the first question is what creates a record. That is a deliberate trade and the cost of it is exactly this page.
- Is a one message conversation a bad sign?
- On its own, no. Plenty of questions have one answer and need no follow up, and a visitor leaving immediately after a correct reply is the assistant working. The signal is not the length, it is what the answer said, which is why this is a reading job rather than a counting one.
- How do I report on this to somebody who wants a number?
- Report the reading. Say you read thirty single exchange conversations, how many of the answers were right, and what the wrong ones had in common. It is a smaller claim than a percentage and it is the only one you can defend when somebody asks how it was calculated.
Keep reading
- Deflection rate: our figure counts refusals, not resolutionsThe Deflection tile is the share of assistant messages that were not refusals. Support teams usually mean something wider by the word.
- Fallback rate: how often the assistant declines to answerThe refusal share is the other half of the Deflection tile. What triggers a fallback, what it costs, and why a low one is not automatically good.
- Coverage gaps: questions your material does not answerEvery refused question is a documented hole in your knowledge base, written by a real visitor. How the list is built and how to work through it.
- Every metric and termWhat each one means, and which of them this product actually computes.
Try it on your own material
Upload a document or point it at your site, paste one line of HTML, then ask it something only your business could answer.