investigating separating out documents from the rest of the message h…

[jason-raitz]

…istory and instructions.

[anarchivist]

interesting work - i'm excited to see this proceeding.

[awilfox]

Overall this looks good and I'm glad to see this. It feels like the beginning of cleaning up Graph Manager to be more coherent (no pun intended) and easier to follow.

A few nits, and a single question. After those are handled, r+ from me.

[anarchivist]

a couple of questions around error handling and typing, but largely looks good.

[Copilot]

Pull request overview

This PR refactors the chatbot's graph workflow to separate document retrieval from message preparation, introducing a clearer separation of concerns between context retrieval and response generation.

Key Changes:

• Introduced a new workflow node prepare_for_generation to separate message preparation from response generation
• Replaced the docs_context string-based approach with structured documents list containing metadata
• Modified the prompt system to no longer inject context directly into the system message, instead passing documents via additional_model_request_fields

[awilfox]

Have not tested locally yet, but looks good to me. Thank you for splitting it off the other changes and tidying it up!

[anarchivist]

just confirming that i have tested this locally and it's ready to go 🚀