How to Use Knowledge Base (RAG)
What is Knowledge Base?
Knowledge Base is a library of files and URLs from which your AI bot can retrieve information. It helps to provide more accurate and helpful answers. Builders can upload and manage files here.
It uses a framework called Retrieval Augmented Generation (RAG).
What is Retrieval Augmented Generation (RAG)?
Retrieval Augmented Generation (RAG) basically allows LLMs - which are trained on general knowledge from the Internet - to access your organization’s data and knowledge.
Knowledge Base Retrieval Types
Top K: A variable that sets the number of top chunks to be retrieved. A higher 'K' value means more chunks are retrieved, which can improve accuracy but may slow down response time.
Retrieval type: This allows you to determine how information is retrieved from the selection in the dropdown
- 'Chunk' retrieves specific sections that are the most similar to the user prompt.
- 'Neighbor' retrieves related content that is most similar to the user prompt, and retrieves 1 chunk before and 1 chunk after.
- 'Document' retrieves the entire document for context.
When to use which retrieval method?
- Chunk: This is best used when the answer to a user's query might be found in a small section of text within a larger document.
- Neighbor: This is useful when LLM needs more context surrounding the direct answer to the user query.
- Document: This works best when the user query requires LLM to understand the entire documents.
- When experimenting with different retrieval methods, pay attention to quality of output, latency, and context window limit.
Keep Reading
When to Use CreateAI Beta vs. Production: What You Need to Know
Faith Timoh Abang
Since launching CreateAI, we've seen incredible growth from early testers, faculty innovators, and now the broader ASU community. But as more users join the platform, we’re noticing some confusion about the Beta vs. Production environments and it’s time to clear that up.
Here’s the key message:
Unless you're actively testing new features, you should be using the Production version of CreateAI Platform.
Can I Use FERPA Data in CreateAI Builder?
Faith Timoh Abang
Yes, you may use FERPA-regulated student data in CreateAI Builder, but only under specific conditions. This article explains what that means, what protections are in place, and what responsibilities you have as a project owner.
Accepted File Types in CreateAI Builder
Faith Timoh Abang
CreateAI Builder supports a wide range of file types for uploading into your project’s Knowledge Base. This guide provides the full list of accepted file formats.
Students Using CreateAI: What Happens When You Upload a File?
Faith Timoh Abang
If you’re using a CreateAI chatbot as part of a class, research, or student service, you may have the option to upload files like PDFs, assignments, or notes into the chat. Here’s what you need to know about how your files are handled and your privacy is protected.