Retrieval-augmented generation
Use RAG to improve Bob's response accuracy using official IBM i documentation.
IBM Bob Premium Package for i includes a retrieval-augmented generation (RAG) documentation search capability that allows Bob to semantically search a comprehensive corpus of IBM i documentation when answering questions.
What is RAG
Retrieval-augmented generation (RAG) is a technique that combines the generative power of a large language model (LLM) with a curated, searchable knowledge base. IBM Bob Premium Package for i has access to a vector database of indexed IBM i documentation, IBM Redbooks, and other IBM i reference manuals — structured in a way that allows Bob to quickly find content that is meaningfully related to your question, not just textually similar.
Instead of relying solely on what the model knows, Bob can fetch contextually relevant excerpts from official IBM i documentation and use them to base its answers in verified, up-to-date content. This means Bob's responses are less likely to be based on outdated training data or hallucinated facts, and more likely to reflect accurate and IBM-sourced guidance.
How it works
Bob follows these steps:
The IBM i Developer and IBM i Database modes are each equipped with the search_ibm_i_docs_with_rag tool, which accepts natural language queries and returns contextually relevant documentation excerpts ranked by semantic similarity.
Bob triggers the tool when answering conceptual or open-ended IBM i questions that benefit from semantic understanding. This can be to further understand IBM i topics including ILE programming (RPG, CL, DDS, COBOL, C, C++), Db2 for i SQL, IFS and QSYS file systems, system operations, security, performance, networking, storage, and troubleshooting.
Bob incorporates the returned documentation excerpts into its response. If the initial results do not fully address the question, Bob refines its query and searches again before forming a final answer.
Bob will typically trigger RAG when encountering IBM i Q&A style questions or when it finds that it is stuck in a repetitive cycle (e.g. after repeated attempts to solve a compilation issue). However, you can always ask Bob to search the documentation directly if:
- Bob's answer seems outdated or incomplete and it has not already used the tool
- You want to explore a topic in depth, such as a specific RPG or SQL concept
- Bob is making repeated inaccurate assumptions without referencing documentation
For example, you can be explicit and say: "Search the IBM i docs for what SQL techniques exist to clear messages from a data queue." or simply "Check the documentation before answering...".