Metrics and terms

The question is not how many, it is what arrived

Counting handovers is easy and it is the wrong question. The one that decides whether any of this saved anybody time is whether the message that landed in somebody's inbox gave them enough to answer it, or whether the first thing they had to do was write back asking what it was about.

not measured here

No quality figure for handovers is computed. The enquiries screen is described as "People who asked to be contacted, and what they asked. Each one arrived by email as well." and lists the name, the address, the message and when it arrived. Its empty state reads "When a visitor asks to speak to someone, the assistant offers to take their name and email, and it appears here." An enquiry whose notification failed carries a "Not emailed" badge and is called out above the list. Nothing on that screen scores an enquiry, groups it, or shows the conversation it came out of.

What it means

Handover quality is whether a handed over enquiry can be answered by the person who receives it, using what came with it. It is a property of the message and its context rather than of the volume, and it is the point at which an automated assistant either does or does not reduce human effort. A handover that arrives with a clear question and enough surrounding detail removes work: somebody reads it, answers it, and it is finished. A handover that arrives as four words with no context creates work, because the first reply is a question, the second is the answer to that question, and only the third is the actual answer. The volume is identical in both cases. The cost to your team differs by a factor most people never measure, because nobody is counting the round trips.

How it is actually calculated

What an enquiry consists of here

A name, an email address and a message the visitor typed, plus the time it arrived and whether the notification went out. The form takes those three fields and no more, and the message is the visitor's own words rather than anything the assistant composed.

There is also a hidden field on the form that no person ever fills in. A submission carrying it is answered as though it succeeded and is not stored, so the obvious automated junk never reaches the list. That keeps the list clean and it also means nothing counts what was dropped.

The conversation the enquiry came out of is recorded against it when the identifier the browser sent genuinely belongs to that assistant, which is checked rather than trusted. So the link exists in the record. The enquiries screen does not display the conversation, and the notification email does not carry it.

Why the message is usually thinner than the conversation

Consider when it is written. Somebody has just failed to get an answer, they have been offered a form, and they are now retyping their problem for the second time into a smaller box. Almost nobody restates the context they already gave. Most people write a compressed version of the question they already asked, or something even shorter, because from where they sit they have said it once already.

So the systematic quality problem is not carelessness on the visitor's part. It is that the thing that would make the enquiry answerable is sitting in the conversation immediately before it, and the message is the one place it does not need to be repeated for the visitor and is the only place it exists for the reader.

Knowing that shapes what you do about it. The lever is not asking visitors to write more. It is deciding, on your side, to read the conversation before replying, and building that into how enquiries are handled.

What can be judged and by whom

Nothing in the product judges an enquiry. There is no score, no flag for one that looks incomplete, no grouping by topic, and no record of what happened after it left. The reply is written in your email, which is a place this product cannot see, so it cannot know whether the answer took one message or four.

The measurement that works is a tally kept by the person who answers them. Two columns: answered from what arrived, and had to ask what they meant. A month of that is a real number about a real cost, it takes seconds per enquiry, and it points at something you can change.

There is one field that is reported, and it is worth checking first for a different reason. Each enquiry records whether the notification email was delivered. An enquiry nobody received has no quality at all, and it is the failure most likely to be invisible.

How the number gets moved without anything improving

How the enquiries get better looking and less useful

Add a required field asking what it is about. Every enquiry that arrives now has a category, the list looks tidier, and fewer of them arrive at all, because each extra field loses people. The ones you lost were disproportionately the ones in a hurry, which is to say the ones with something urgent.

Judge quality by how quickly enquiries were answered. Your team will answer the easy ones first and the figure will improve while the difficult ones sit. This is the oldest distortion in support and it does not stop being true because the queue is an inbox.

The accidental version is a change to the fallback wording. Reword the refusal so it points more firmly at the form and enquiry volume rises, mostly with people who would have found the answer given one more try. The list is longer, each item is thinner, and nothing about the material changed.

What to look at instead, or alongside

  • A two column tally kept by whoever answers them: answered from what arrived, or had to ask what they meant.
  • The enquiry read next to the unanswered questions list, since an enquiry about a topic that is also refusing is a document waiting to be written.
  • The delivery state on each enquiry, because one that never reached anybody is a failure of a different and more urgent kind.
  • The wording of the fallback and of the form, which decide between them what a visitor thinks they are supposed to write.

Questions

Does the notification email include the conversation?
No. It carries the name, the address and the message the visitor wrote, along with the assistant it came from. The conversation is recorded against the enquiry, and neither the email nor the enquiries screen shows it, so the context has to be looked up rather than read off.
Should we ask for more information on the form?
Rarely, and never without watching what it costs. Three fields is already enough friction to lose people at the moment they most wanted to reach you. If a field would genuinely change the reply, add it and count the enquiries before and after, because the trade is real and it runs in both directions.
Is a rising enquiry count good or bad?
Neither on its own, and the direction is decided by what the enquiries say. A rise in enquiries that could not have been answered by any document is the assistant routing correctly. A rise in enquiries about things your material covers is a retrieval or wording problem wearing a disguise, and reading five of them tells you which you have.

Keep reading

Try it on your own material

Upload a document or point it at your site, paste one line of HTML, then ask it something only your business could answer.