Kong's AI Semantic Cache plugin allows us to perform differently formulated questions, with different semantics, but, nonetheless, the same meaning, and make use of a cache system, to keep the answers to those questions persisted. It allows to use a vector database, like for example the Redis database. In this video we are having a quick look at how to configure the AI Semantic Cache plugin and we will see how it works. We will also focus on how it can go wrong and what can we do to improve it. The point of this plugin is to avoid making "unnecessary" requests to our LLM model. The way this works is that the LLM model returns data in the form of embeddings that get vectorized in the Redis database. Using vectors, the Redis database can then leverage the plugin to be able to find similarities and determine if a certain question has already been made or not, based on how similar it is to other questions with the same response. The theory behind this is quite fascinating, but we are only looking at this plugin from a very technical perspective in this video. We will use as an examplel, questions about the color of items, like for the example, the color of the Sun. I hope you enjoy the video and have fun with it and until the next one, be sure to stay tech, keep programming, be kind and have a good one everyone! Cheers! br br --- br br Chapters: br br 00:00:00 Start br 00:00:42 Intro br 00:03:42 Explaining Kong AI Semantic Cache Plugin br 00:05:52 Referencing "What is a vector database ?" video br - br 00:07:51 Referencing the "Kong KONNECT, the first steps" video br - br 00:08:12 Configuring Kong Konnect br 00:09:48 Configuring the AI Semantic Cache Plugin in the example br 00:13:12 Referencing the "How to and why configure the Kong AI-Proxy plugin in 10 minutes" video br - br 00:13:33 How to download the REDIS container br 00:14:20 Explaining how to use environment variables with the prepared commands br 00:18:52 Performing tests against the AI Semantic Cache plugin br 00:24:56 End Notes br 00:25:46 See you in the next video! br 00:27:22 End credits br 00:28:01 Disclaimer br br --- br br Related videos: br br - br - br - br - br - br - br - br br br --- Source code br br - br - br br --- br br Soundtrack: br br - br br --- br br Sources: br br - br br --- br br As a short disclaimer, I'd like to mention that I'm not associated or affiliated with any of the brands eventually shown, displayed, or mentioned in this video.