If you have ever tried to prompt an LLM to give you what you want, you have probably run into some frustrating challenges. This frustration can range from trying to write what you want in pseudo-code to arguing with a child about putting their toys away. This week we will focus on some guidelines for […]

We have been covering a series this year based on how a RAG works, and how to build one. Now it’s time to look at what it will cost to deploy it! BLUF: If you have constraints that require you to host your own LLM instead of using services such as OpenAI, Anthropic, or Google […]

This week we will cover the last round of DoD SBIR Topics that are scheduled to be released on Wednesday. This is always a good checkpoint to see what areas of AI that DoD organizations are interested in. The last time we covered SBIR topics, there were several on the call that were new to […]

This week we will cover the Faster Whisper library. It is similar to the approach used by llama.cpp and provides a much smaller footprint and faster execution times than the OpenAI Whisper library. We will also walk through the approach for using this library within an AWS Lambda function, along with tips and tricks for […]

We will cover the Pixtral multimodal model released by Mistral AI last week. Hopefully we can get it loaded up in Le Chat (French ChatGPT?) and kick the tires on it a bit. From what I am hearing from some of our group, it’s definitely something to look into. From the Mistral announcement: Natively multimodal, […]

We have a few topics that we will cover this week, led by Josh Phillips (vLLM) and Gary Turner (Helene Response). We will also cover the list of AI related SBIR topics that were released last week. vLLM In this session, we will demonstrate how easy it is to deploy vLLM on RunPod using an […]

Our next meetup with be a social at Stovehouse, where we can get to know each other a bit better. We had a large group last week and it’s difficult to catch up and learn what everyone is doing with AI in such a short period of time. If you’re new to the group, or […]

We have two guest speakers this week, Josh Phillips & Charlie Rogers! Josh has covered a few topics for us in the past, but this will be Charlie’s first time presenting for us, so please come and engage. Topic 1 (Josh Phillips) : Structured Outputs with Finite State Machines Discover how the integration of finite state […]

Thanks to Josh Phillips for hosting last week while I was out! I should have the recording up soon at https://hsv.ai/videos/ This week we will take a look at Speech to Text models in three different categories: Products that create audio from text in an offline mode APIs that can be integrated into a product Open […]