Explore 19 projects in the Ai Auditing category of the Civic Tech Field Guide.
AI Forensics is a European non-profit that investigates influential and opaque algorithms. We hold major technology platforms accountable by conducting independent and high-profile technical investigations to uncover and expose the harms caused by their algorithms.
Worker-led audits in the platform economy
Community-led AI Audits: Making AI Systems Fair & Accountable
An open-source Python library designed to assist developers in calculating fairness metrics and assessing bias in machine learning models.
The OASI Register compiles information about algorithms with the aim of increasing public awareness and providing the necessary knowledge for an informed public conversation, and of making possible for experts and the public to search and analyse the use and social impact of algorithmic systems across the world.
Eticas Foundation's adversarial audit of an AI-powered criminal justice tool, RisCanvi, that has been used in Catalonia since 2009 finds it "does not meet the required standards of reliability and fairness."
The ADL AI Index evaluates leading large language models (LLMs) on their ability to detect and counter antisemitic and extremist tropes and narratives.
Humane Intelligence is a tech nonprofit building a community of practice around algorithmic evaluations.
The MLCommons AI Safety working group is composed of a global consortium of industry leaders, practitioners, researchers, and civil society experts committed to building a harmonized approach to AI safety.