Metrics and terms

Published is not the same as answerable

You write the page everybody has been asking for, put it live, ask the assistant about it, and get the refusal you were trying to fix. Nothing is broken. The assistant answers from a copy taken at the last sync, and this page is about everything that sits between those two moments.

not measured here

No elapsed time between publishing and answerability is computed anywhere, and half of that interval is invisible to this product by construction, because nothing here knows when you published. What is shown is the second half. Each source carries a state of "Queued", "Indexing", "Ready", "Partial" or "Failed", a document count, its size, when it last synced, and where it has a schedule a line reading "re-crawls daily" or "re-crawls weekly". A progress bar runs while a source is indexing, and there is a "Resync" control on every source.

What it means

This is the interval between material existing on your side and the assistant being able to answer from it. People expect it to be instant, and the expectation is reasonable rather than naive: the widget is on the same site as the page, so it feels like one thing with one state. It is not. The assistant answers from an indexed copy, taken when a source last ran, and a source runs when it is created, when somebody asks it to, or when its schedule says it is due. The interval therefore has two halves with very different characters. The first is a wait for the next run, measured in hours or days and set by a schedule you chose. The second is the run itself, measured in minutes and visible while it happens. Almost everybody who is surprised by the delay is surprised by the first half, and almost every explanation of it describes the second.

How it is actually calculated

The wait before anything starts

A crawl or a connected system can carry a schedule of daily or weekly. A check runs every hour and queues any scheduled source whose last run is older than that interval, so a daily source becomes due at some point in the day after it last ran rather than at a fixed time you can plan around.

The consequence is the part people miss. Publish a page an hour after the crawl ran and the wait is close to a full interval, not close to nothing. On a weekly schedule that is most of a week. The average wait on a daily source is around half a day and the worst case is a full one, and neither of those is a fault.

Uploaded files have no schedule at all. A file source is indexed when it is uploaded and again when somebody presses Resync. Editing the document on your own machine changes nothing here, because nothing is watching your machine.

Whether the new page is reachable at all

A crawl starts from an address and follows links, to a depth, staying on the same site by default, and it can use the site's own map of itself. A page that nothing links to and that is not in that map is never fetched, and waiting longer does not help. The lag in that case is not long, it is infinite, and it shows up as a topic that keeps refusing.

There is a size ceiling too. A crawl takes up to the pages your plan allows, minus what is already indexed, and stops there. Where there is no room left the source fails with a message naming the limit rather than pretending, so it is visible when it happens, but a page can be missing because there was no space rather than because there was no time.

The run itself, which is the visible half

Pages are fetched, text is extracted, split into passages and stored so they can be matched against questions. While that happens the source shows as indexing with a progress bar, and it finishes as ready, partial or failed, with the reason attached when something went wrong.

Content that has not changed is recognised and skipped, which is what makes a daily re-crawl of a mostly static site cheap. It also explains a confusing case: a page you edited trivially may produce no new material, and a page you thought you changed but did not will look exactly like a page the crawler ignored.

One more day at the end

Answers are cached for at most a day, and only answers that cited something are cached at all. So a question somebody already asked can come back with the previous answer even after new material exists, for up to that long.

This matters most when you test your own change. Ask the question in the exact words somebody asked it yesterday and you may be reading yesterday's answer. Ask it in your own words and you are more likely to get a fresh one. Either way the citation underneath is what tells you which material actually answered.

How the number gets moved without anything improving

How the lag gets reported as minutes

Start the clock when the sync started. The run takes minutes and the figure is excellent, and the hours or days of waiting for the run to be due are outside the measurement entirely. This is the honest looking version and it describes the half nobody was asking about.

Set everything to daily and call the lag a day. Pages nothing links to are never fetched at any schedule, and they contribute an unbounded lag that no average will ever contain, because they are not in the sample.

The accidental version is a test that lies to you. Press Resync, ask the question in the same words as before, get the old cached answer, conclude the sync did not work, and press it again. Nothing is wrong except the test. Read the citation rather than the answer, since the citation names which document was actually used.

What to look at instead, or alongside

  • The source state and its last sync time, checked after you publish rather than assumed.
  • A manual resync whenever the change matters, which turns an unknown wait into a known few minutes.
  • The question asked in the widget with the citation read underneath it, which is the only direct proof the new document is being used.
  • A working rule that whoever changes a policy also resyncs the source, since the schedule is a floor on freshness and never a guarantee.

Questions

I published a page and the assistant still does not know it. What is wrong?
Usually one of three dull things. The crawl has not come round again, so nothing has fetched it yet. Nothing links to the page and it is not in the site map, so no crawl will ever find it. Or the source is a set of uploaded files, which has no schedule and only updates when you ask it to.
Does editing a file I uploaded update the answers?
No. What was indexed is the copy taken when the file was added, and editing your local copy is invisible here. Upload the new version or resync the source, and then check by asking a question whose answer changed.
Should I set everything to daily?
On crawled sites it is usually the right default, because unchanged pages cost effectively nothing to re-check. It does not help with uploads, which have no schedule, and it does not help with a page nothing links to. Neither of those is a scheduling problem and neither is fixed by a shorter interval.

Keep reading

Try it on your own material

Upload a document or point it at your site, paste one line of HTML, then ask it something only your business could answer.