Ask Rusty reads the manuals
Shipped 2026-10-13
Until now Ask Rusty could name a manual and link it but could not read it. A question like “how many hours of tunnel time does FITP include?” got a link to the Instructor Level 1 Manual and nothing more.
What changed
- Document search. A new tool,
search_documents, searches the text of every open reference document and every open skill’s Flight Tutorial, in the member’s language. Answers quote what the document says and link the PDF at the right page (#page=N). When nothing matches, Rusty names the likely document and says it could not find the answer there, never a guess. - Same access rules. Search checks each document against the live CMS, so members only get passages from documents they can already see, and a closed document drops out immediately.
- Nightly re-index. The
chatbot_ingestcron (03:30 UTC) picks up new and changed PDFs. Unchanged files are skipped. - Flyer currency (TUN-848). Rusty now knows the flyer rules: currency lapses 180 days after the last logged flight, reminders go out at 150 days and about a week before, and a lapsed flyer recovers by completing the recurrent checkbox for every skill they have passed. This was the most common unanswered topic.
- Better logging. Each answer records the documents search returned and the documents the answer linked, so gaps in the documents show up in the query log.
How well it finds things
Tested on 16 real questions from the query log. When the search is phrased the way the document would phrase it (which Rusty is told to do), the right passage was in the top six for 15 of them, and first for most. Phrased exactly as members typed them, 11 of 16. Searches take about 5 ms. The misses are questions made entirely of common words, which is what the next step, comparing with vector search, is for.
Translations
Building the index found 7 Spanish and French documents listed on the site whose files were missing from their language folder, so their links opened nothing. Six were translated and uploaded, and the seventh was already there under a differently-cased filename and has been put back at the name the site links to. Every reference document and tutorial is now available in all three languages.