Abstract: Rigorous independent and objective assessments of AI-enabled systems in the DoD are a necessary step in ensuring that our systems are fielded and used responsibly. However, standards, technologies and processes for performing test and evaluation (T&E) on AI-enabled systems remain largely a research endeavor. This talk will provide an overview of challenges and progress in AI Assurance to facilitate speedy and agile deployment of reliable and effective AI/ML capabilities to the warfighter. It will highlight the latest advancements in understanding the fundamental issues of designing safe and secure of AI systems and in how AI systems should be tested and assured as a means of shaping appropriate use. Additionally, Dr. Pinelis will talk about her work since graduation, which has mainly been in the areas of defense and national security.


Dr. Jane Pinelis is the Chief of AI Assurance at the Department of Defense Joint Artificial Intelligence Center (JAIC). In this role, she leads a diverse team of testers and analysts in rigorous test and evaluation (T&E) for JAIC capabilities, as well as the development of T&E-specific products and standards that will support testing of AI-enabled systems across the DoD. She also leads the team responsible for instantiating Responsible AI principles into DoD practices.