| We have a few topics that we will cover this week, led by Josh Phillips (vLLM) and Gary Turner (Helene Response). We will also cover the list of AI related SBIR topics that were released last week.
vLLM
In this session, we will demonstrate how easy it is to deploy vLLM on RunPod using an A40 GPU instance (approximately $0.40 per hour for 48GB of VRAM). We will be deploying the new LLama 3.2 11B vision model to showcase vLLM’s deployment simplicity and performance capabilities in a cost-effective environment. This hands-on example will provide practical insights into getting started with vLLM and show the real-world benefits of using a platform like RunPod for efficient model serving.
Hurricane Helene Response
Gary and I have been having a running conversation about the chaotic response in the Eastern TN and Western NC mountains. This will be a short brainstorming session to see if there’s anything we can do to assist.
SBIR/STTR
According to the announcement on the DoD SBIR/STTR website: “New DoD SBIR & STTR topics will be released on the first Wednesday of every month.” To align with this schedule, we will stop planning our normal sessions specific to SBIR and cover new topics as they come in. From the list of topics that dropped last week, the AI related topics are:
- AF244-0001: Interactive Knowledge Graphs for Situational Awareness
- AF244-0004: Securing Legacies: Developing an AI-Enhanced Privacy Architecture for Military Family Knowledge Systems
- AF244-D002: Automated Correction of Optical Distortions in Canopy Transparencies
- AF244-D006: Artificial Intelligence-Enabled Design Rule Checker
- AF244-D016: Develop next-generation autonomous tracking
- OSD254-P001: Generative AI BAA Open Topic
|
