| This week we have two topics to cover from very different areas of AI. I will cover a traditional ML approach that I’m using for a “Current Season Crop Classifier”. Josh will cover the NIST AI Risk Management Framework.
For the crop classifier, we’ll talk about the technical aspects of collecting the training and evaluation data – as well as this new world of telling Claude what I want. And then trying to figure out what to do with the >30k SLOC that resulted.
From Josh:
As AI systems move into real products and programs, “how do we know it works?” is now a question that needs a documented answer. In this session, we’ll look at the NIST AI Risk Management Framework (AI RMF 1.0). We’ll cover what it is, who it’s for, and how its four functions (Govern, Map, Measure, and Manage) fit together to manage AI risk.
Then we’ll take a closer look at Test, Evaluation, Verification, and Validation (TEVV). We’ll cover what each of those terms means, where TEVV fits in the AI lifecycle, and what a TEVV report should capture about how an AI system was tested and what the results mean.
Links:
The best way to park and get to the Deloitte office is via the large parking lot on the west side of the building (across from Food City). You can enter the building from that side and head upstairs to the 2nd floor. The address is below in the details list. |
