We have been covering a series this year based on how a RAG works, and how to build one. Now it’s time to look at what it will cost to deploy it! BLUF: If you have constraints that require you to host your own LLM instead of using services such as OpenAI, Anthropic, or Google […]

This week we will cover the last round of DoD SBIR Topics that are scheduled to be released on Wednesday. This is always a good checkpoint to see what areas of AI that DoD organizations are interested in. The last time we covered SBIR topics, there were several on the call that were new to […]

This week we will cover the Faster Whisper library. It is similar to the approach used by llama.cpp and provides a much smaller footprint and faster execution times than the OpenAI Whisper library. We will also walk through the approach for using this library within an AWS Lambda function, along with tips and tricks for […]

We will cover the Pixtral multimodal model released by Mistral AI last week. Hopefully we can get it loaded up in Le Chat (French ChatGPT?) and kick the tires on it a bit. From what I am hearing from some of our group, it’s definitely something to look into. From the Mistral announcement: Natively multimodal, […]

We have a few topics that we will cover this week, led by Josh Phillips (vLLM) and Gary Turner (Helene Response). We will also cover the list of AI related SBIR topics that were released last week. vLLM In this session, we will demonstrate how easy it is to deploy vLLM on RunPod using an […]

Our next meetup with be a social at Stovehouse, where we can get to know each other a bit better. We had a large group last week and it’s difficult to catch up and learn what everyone is doing with AI in such a short period of time. If you’re new to the group, or […]

We have two guest speakers this week, Josh Phillips & Charlie Rogers! Josh has covered a few topics for us in the past, but this will be Charlie’s first time presenting for us, so please come and engage. Topic 1 (Josh Phillips) : Structured Outputs with Finite State Machines Discover how the integration of finite state […]

Thanks to Josh Phillips for hosting last week while I was out! I should have the recording up soon at https://hsv.ai/videos/ This week we will take a look at Speech to Text models in three different categories: Products that create audio from text in an offline mode APIs that can be integrated into a product Open […]

This week we will walk through the components used in the transcription service along with how they are integrated and deployed. This has been updated over the year to incorporate new features and infrastructure as it became available. This session will be a little light on AI, but should give you an idea of what […]

We made it through 2024! Well, close enough for this group anyway 🙂 This week we will get together and go through the list of topics and other items that we covered over the year. There are 3 questions that I want to ask for each topic: Did it stick, or was it overcome by other […]