Conceptual illustration demonstrating a growing knowledge base

How to Use Knowledge Base (RAG)


What is Knowledge Base?

Knowledge Base is a library of files and URLs from which your AI bot can retrieve information. It helps to provide more accurate and helpful answers. Builders can upload and manage files here. 

It uses a framework called Retrieval Augmented Generation (RAG).

Knowledge base UI

What is Retrieval Augmented Generation (RAG)?

Retrieval Augmented Generation (RAG) basically allows LLMs - which are trained on general knowledge from the Internet - to access your organization’s data and knowledge.

How does RAG work?How RAG works from prompt to generation

Knowledge Base Retrieval Types 

Top K: A variable that sets the number of top chunks to be retrieved. A higher 'K' value means more chunks are retrieved, which can improve accuracy but may slow down response time.

Retrieval type: This allows you to determine how information is retrieved from the selection in the dropdown 

  • 'Chunk' retrieves specific sections that are the most similar to the user prompt. 
  • 'Neighbor' retrieves related content that is most similar to the user prompt, and retrieves 1 chunk before and 1 chunk after.
  • 'Document' retrieves the entire document for context. 

When to use which retrieval method? 

  • Chunk: This is best used when the answer to a user's query might be found in a small section of text within a larger document.
  • Neighbor: This is useful when LLM needs more context surrounding the direct answer to the user query.
  • Document: This works best when the user query requires LLM to understand the entire documents.
  • When experimenting with different retrieval methods, pay attention to quality of output, latency, and context window limit.

Keep Reading

CreateAI Office Hours Details: Get Help and Share Feedback

Faith Timoh Abang

We’re excited to share how you can connect directly with the CreateAI team for live support, feedback, and community learning. Our weekly office hours are designed to help both general users and our dedicated beta testers get the most out of CreateAI Builder.

CreateAI Builder: File Upload Handling & Privacy for Project Owners

Faith Timoh Abang

If you’re building bots in CreateAI Builder, it’s important to understand how uploaded files are handled and what data privacy expectations apply. 

Google Drive Integration Feature in CreateAI Builder

Faith Abang Timoh

What is the  Google Drive integration feature on CreateAI Builder?

Is There a Cost to Using CreateAI?

Faith Abang Timoh

Understanding Usage, Cost, and What It Means for You.