States and Data Storage
In this section we cover two main areas:
- Managing system states - LLMs are inherently stateless, so we need a way to keep track of the information we give to and get out of them.
- Databases - an introduction to ChromaDB and how to build a database.
We will cover how to keep track of information like conversation history and token usage. We then use LLMs to generate a running summary of a conversaton for us. Finally, we introduce databases, and explore how we can build and search them.