Event Title – Building Trusted AI: Overcoming Hallucinations in AI Systems
Date Thursday, 19 October 2023, 1300-1500 hours EDT
All 2023 Cyber Talks will start promptly at 1300!
Speaker:
John Bohannon – Primer AI, Senior Director of Data Science
Event Description
When asked to write up a description, a large-language model may fill in gaps in its knowledge with false claims — otherwise known as a “hallucination.” The model is not lying, since it has no motivation to deceive, nor any awareness that what it is saying is false. Regardless, hallucinations are a nightmare for analysts, operators, and decision-makers in national security. When tracking cyber threats, you want to be able to use AI without worrying about the reliability of its results. On the other side, cyber criminals are using AI hallucinations to their advantage by creating LLM-generated scripts to identify vulnerabilities, then creating hallucinations to distribute malicious code. These hallucinations are caused by training; the solution to hallucinations is “grounding.” Instead of merely predicting the next words, given a user’s input, a grounded system first retrieves relevant information from a trusted system of record, then generates a prompt for the generative model. That prompt instructs the model to answer the user’s question based only on the retrieved information and only if possible.
Who Should Attend?
This event is open to the public for those who are eager to enhance the effectiveness of the Department of the Army Defense Cyber Operations (DCO) cyberspace and cybersecurity infrastructure through critical research, experiments, development, testing, and the development of innovative technologies. US Government (military and civilian), contractors, SOSSEC members and non-members are encouraged and welcome to attend to learn more about successful technology collaboration from these Cyber Talk briefings. The recommended audience is program managers, development teams; engineers, architects; security managers; security specialists; system administrators; and analysts who work in DoD cyberspace.
About The Consortium
The purpose of the Army’s Cyber Operations Broad Responsive Agreement (COBRA) is to spur innovative development, demonstration, and expedited delivery of prototypes for Warfighter readiness. When awarded an Other Transaction Authority (OTA) there is a requirement to join the System of Systems Consortium (SOSSEC), the consortium manager for Program Executive Office Enterprise Information Systems (PEO EIS). For more information on joining the consortium, please go to www.sossecinc.com.
COVID-19 Restrictions
Due to the restrictions on group gatherings imposed by the COVID-19 conditions, this Cyber Talk will be executed virtually. To participate, please use the Zoom for Government link listed above or follow this link: https://www.zoomgov.com/j/1600710969?pwd=bHQzZzJRTEVaSjQvQThuV2lvMkdRdz09
Questions?
Any questions about the event or joining the consortium can be directed to Ed Aguirre of SOSSEC, Inc. at eaguirre@sossecinc.com.
