Welcome to the AutoSysOps blog
This blog is all about automating the boring work. Leo Visser has spend many years in the IT industry and experienced different ways of working in IT teams. In this blog he will share some tips and tricks about how you can make your life as an IT administrator easier.
Use Azure API Management to enhance your Microsoft AI Foundry LLM models. By implementing semantic caching your can use an Managed Redis Cache as a vector database to check for similar requests. This way you can reduce the amount on inferences done by your LLM and reduce your environmental impact.