MIT Spinout Teaches AI to Recognize and Admit Uncertainty

Published Date : 04/06/2025 

MIT spinout Themis AI has developed a platform that helps AI systems recognize and admit when they are uncertain, reducing the risk of dangerous hallucinations in critical applications. 

AI hallucinations are becoming more dangerous as models are increasingly trusted to surface information and make critical decisions. We’ve all got that know-it-all friend that can’t admit when they don’t know something, or resorts to giving dodgy advice based on something they’ve read online. Hallucinations by AI models are like that friend, but this one could be in charge of creating your cancer treatment plan.\n\nThat’s where Themis AI enters the picture. This MIT spinout has managed to achieve something that seems straightforward in theory but is actually quite complex, teaching AI systems to say, “I’m not sure about this.” AI systems typically display overconfidence. Themis’ Capsa platform acts as a reality check for AI, helping models recognize when they’re venturing into guesswork rather than certainty.\n\nFounded in 2021 by MIT Professor Daniela Rus, along with former research colleagues Alexander Amini and Elaheh Ahmadi, Themis AI has developed a platform that can integrate with virtually any AI system to flag moments of uncertainty before they lead to mistakes. Capsa essentially trains AI to detect patterns in how it processes information that might indicate it’s confused, biased, or working with incomplete data that could lead to hallucinations.\n\nSince launching, Themis claims it has helped telecoms companies avoid costly network planning errors, assisted oil and gas firms in making sense of complex seismic data, and published research on creating chatbots that don’t confidently make things up. Most people remain unaware of how frequently AI systems are simply taking their best guess. As these systems handle increasingly critical tasks, those guesses could have serious consequences. Themis AI’s software adds a layer of self-awareness that’s been missing.\n\nThe journey to Themis AI began years ago in Professor Rus’s MIT lab, where the team was investigating a fundamental problem: how do you make a machine aware of its own limitations? In 2018, Toyota funded their research into reliable AI for self-driving vehicles—a sector where mistakes could be fatal. The stakes are incredibly high when autonomous vehicles must accurately identify pedestrians and other road hazards.\n\nTheir breakthrough came when they developed an algorithm that could spot racial and gender bias in facial recognition systems. Rather than just identifying the problem, their system actually fixed it by rebalancing the training data—essentially teaching the AI to correct its own prejudices. By 2021, they’d demonstrated how this approach could revolutionize drug discovery. AI systems could evaluate potential medications but – crucially – flag when their predictions were based on solid evidence versus educated guesswork or complete hallucinations. The pharmaceutical industry recognized the potential savings in money and time by focusing only on drug candidates the AI was confident about.\n\nAnother advantage of the technology is for devices with limited computing power. Edge devices use smaller models that cannot match the accuracy of huge models run on a server, but with Themis’ technology, these devices will be far more capable of handling most tasks locally and only request help from the big servers when they encounter something challenging.\n\nAI holds tremendous potential to improve our lives, but that potential comes with real risks. As AI systems become more deeply integrated into critical infrastructure and decision-making, the ability to acknowledge uncertainty leading to hallucinations may prove to be their most human – and most valuable – quality. Themis AI is making sure they learn this crucial skill. 

Frequently Asked Questions (FAQS): 

Q: What are AI hallucinations?

A: AI hallucinations occur when AI systems generate information that is incorrect or nonsensical, often due to overconfidence or lack of data. These can be particularly dangerous in critical applications like healthcare or autonomous vehicles.

Q: What is Themis AI?

A: Themis AI is an MIT spinout company that has developed a platform called Capsa to help AI systems recognize and admit when they are uncertain, reducing the risk of hallucinations.

Q: How does Capsa work?

A: Capsa trains AI systems to detect patterns in their data processing that might indicate confusion, bias, or incomplete data. This helps the AI recognize when it's making a guess rather than a confident prediction.

Q: What are some applications of Themis AI's technology?

A: Themis AI has helped telecoms companies avoid network planning errors, assisted oil and gas firms with seismic data analysis, and published research on creating more reliable chatbots. It also has applications in drug discovery and edge computing.

Q: Why is acknowledging uncertainty important in AI?

A: Acknowledging uncertainty is crucial in AI because it helps prevent dangerous hallucinations in critical applications. It ensures that AI systems only make confident decisions and seek help when needed, improving reliability and safety. 

More Related Topics :