Frameworks and Tools on Responsible AI
The Global Index is being designed to support a growing movement for the responsible use of AI, which includes a range of work to date by stakeholders around the world.
In designing the Global Index on Responsible AI, we have conducted a comprehensive review of existing tools and frameworks that seek to advance the ethical, responsible, or trustworthy use of AI. The tools and frameworks listed below constitute an important starting point for defining the methodology and measurement areas for the Global Index. Below you can explore the tools and frameworks identified during the review.
- ACLU Washington | ACLU-Algorithmic Equity Toolkit
Algorithmic and Automated decision-making Accountability and Impact Assessments
- Dot Everyone | Doteveryone / Ada Lovelace Consequence Scanning
Algorithmic and Automated decision-making Accountability and Impact Assessments
- Government of Canada | Canadian Algorithmic Impact Assessment
Algorithmic and Automated decision-making Accountability and Impact Assessments
- IEEE SA Standards | IEEE Ethics Certification Program for Autonomous and Intelligent Systems
Algorithmic and Automated decision-making Accountability and Impact Assessments
- Open Government Partnership | Open Government Partnership: Algorithmic Accountability for the Public Sector
Algorithmic and Automated decision-making Accountability and Impact Assessments
- Gemeente Amsterdam | Amsterdam Algorithm Register
Algorithmic and Automated decision-making Accountability and Impact Assessments
- AI Indcident Database | Artificial Intelligence Incident Database
Algorithmic and Automated decision-making Accountability and Impact Assessments
- Assessment List of Trustworthy AI | The Assessment List on Trustworthy AI
Algorithmic and Automated decision-making Accountability and Impact Assessments
- Ada Lovelace Institute | Ada Lovelace Institute
Algorithmic and Automated decision-making Accountability and Impact Assessments
- The Information Accountability Foundation | The Information Accountability Foundation: AI Impact Assessment
Algorithmic and Automated decision-making Accountability and Impact Assessments
- European Parliament | European Parliament: Governance Framework for Algorithmic Accountability and Transparency
Algorithmic and Automated decision-making Accountability and Impact Assessments
- AI Now Institute | AI Now Institute
Algorithmic and Automated decision-making Accountability and Impact Assessments
- The Alan Turing Institute | Alan Turing Institute: Understanding AI Ethics and Safety
Responsible AI / ML
- Microsoft | Microsoft Responsible AI Toolbox
Responsible AI / ML
- PWC | PWC Responsible AI Framework & Toolkit
Responsible AI / ML
- Tensor Flow | TensorFlow: Responsible AI Toolkit
Responsible AI / ML
- Atomium – EISMD initiative | AI4People
Responsible AI / ML
- Personal Data Protection Commission SIngapore | Personal Data Protection Commission Singapore: Model AI Governance Framework
Responsible AI / ML
- Interpret ML | Microsoft Interpret ML
Responsible AI / ML
- Responsible Artificial Intelligence Institute | Responsible AI Institute Certification
Responsible AI / ML
- United Nations | United Nations Interregional Crime and Justice Research Institute (UNICRI)
Responsible AI / ML
- World Economic Forum | World Economic Forum: AI Procurement in a Box
Responsible AI / ML
- The Institute for Ethical AI & Machine Learning | Institute for Ethical AI & Machine Learning: AI-RFX Procurement Framework
Responsible AI / ML
- Nethope | Artificial Intelligence (AI) Ethics for Nonprofits Toolkit
Ethics Assessments and Readiness
- VDE Association for Electrical, Electronic & Information Technologies and Bertelsmann Stiftung. | AI Ethics Impact Group
Ethics Assessments and Readiness
- AI Ethics Lab | AI Ethics Lab Toolbox
Ethics Assessments and Readiness
- Digital Catapult | Machine Intelligence Garage / Digital Catapult: Ethics Framework
Ethics Assessments and Readiness
- Digital Catapult | Data Ethics: Data Ethics Readiness Test
Ethics Assessments and Readiness
- Design Ethically | Design Ethically Framework and Toolkits
Ethics Assessments and Readiness
- Inter-American Development Bank | Inter-American Development Bank
Ethics Assessments and Readiness
- Gradient Institute | Ethical AI Advisory
Ethics Assessments and Readiness
- Ethics for Designers | Ethics Kit – Design Better
Ethics Assessments and Readiness
- Omidyar Network and Institute for the Future | Omidyar Network Ethical Operating System Toolkit
Ethics Assessments and Readiness
- GovEx, the City and County of San Francisco, Harvard DataSmart, and Data Community DC | Ethics & Algorithms Toolkit
Ethics Assessments and Readiness
- The Information Accountability Foundation | The Information Accountability Foundation: Ethical Data Impact Assessments and Oversight Models
Ethics Assessments and Readiness
- World Economic Forum | World Economic Forum Empowering AI Leadership
Ethics Assessments and Readiness
- University of Pennsylvania | AISP Toolkit: Centering Racial Equity Throughout Data Integration
Inclusive Design and Diversity
- Amazon Web Services | Amazon Conditional Demographic Disparity
Inclusive Design and Diversity
- Microsoft | Microsoft Inclusive Design
Inclusive Design and Diversity
- University of Southern California | USC Diversity Toolkit
Inclusive Design and Diversity
- The Alan Turing Institute | Alan Turing: Project ExplAIn
Transparency; Explainability; & Interpretability
- International Journal of Human–Computer Interaction | Human-Centered Artificial Intelligence (HCAI) Framework
Transparency; Explainability; & Interpretability
- Google Cloud | Google Model Cards
Transparency; Explainability; & Interpretability
- IBM Research and IBM | IBM AI Explainability 360
Transparency; Explainability; & Interpretability
- Standards Association | IEEE Ethics Certification Program for Autonomous and Intelligent Systems
Transparency; Explainability; & Interpretability
- GitHub | Lime (Github)
Transparency; Explainability; & Interpretability
- People + AI Research and GitHub | Know Your Data
Transparency; Explainability; & Interpretability
- Data Ethics | Data Ethics: Digital Self-Defence
Human Rights
- Elsevier B.V. | Human Rights, Ethical and Social Impact Assessment
Human Rights
- Data Science and Ethics Group | Humanitarian Data Science and Ethics Group: Framework for the Ethical Use of Advanced Data Science Methods in the Humanitarian Sector
Human Rights
- European Union | SIENNA (Stakeholder-Informed Ethics for New Technologies with High Socio-economic and Human Rights Impact)
Human Rights
- The Danish Institute for Human Rights | The Danish Institute for Human Rights
Human Rights
- Women at the Table and United Nations Human Rights Office of the High Commission | Women at the Table: AI & Equality Human Rights
Gender
- World Wide Web Foundation | World Wide Web: Open Questions About Gender Inclusion
Gender
- Carnegie Mellon University | Aequitas
Fairness / Bias
- GitHub | Audit AI
Fairness / Bias
- Australian Government - Department of Industry, Science and Resources | Australian Human Rights Commission
Fairness / Bias
- GitHub | Black Box Auditing and Certifying and Removing Disparate Impact
Fairness / Bias
- Fairlearn | Fairlearn
Fairness / Bias
- Google Research | Google PAIR
Fairness / Bias
- Government of India | IndiaAI: Mitigating Bias in AI
Fairness / Bias
- GitHub | LinkedIn Fairness Toolkit
Fairness / Bias
- Microsoft Research | Microsoft AI Fairness Checklist
Fairness / Bias
- GitHub | TensorFlow
Fairness / Bias
- Digital Civil Society Lab | Digital Civil Society Lab: Digital Impact Toolkit
Privacy, Data Ethics and Protection
- Data Ethics | Data Ethics: Digital Self-Defence
Privacy, Data Ethics and Protection
- People + AI Research and GitHub | Know Your Data
Privacy, Data Ethics and Protection
- Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) | GIZ / Data Security Council of India
Privacy, Data Ethics and Protection
- Un Global Pulse | United Nations Global Pulse: Building Ethics into Privacy Frameworks for Big Data and AI
Privacy, Data Ethics and Protection
- GitHub | Google Tensorflow: Privacy in Machine Learning
Privacy, Data Ethics and Protection
- Open Data Institute | Open Data Institute: Data Ethics Canvas
Privacy, Data Ethics and Protection
- GitHub | Presido (Github): Anonymizer for Text and Images
Privacy, Data Ethics and Protection
- Government Digital Service | United Kingdom: Data Ethics Framework
Privacy, Data Ethics and Protection
- GitHub | Adversarial ML Threat Matrix
Security
- GitHub | Adversarial Robustness Toolbox (ART)
Security
- Responsible AI Collaborative | Artificial Intelligence Incident Database
Security
- Microsoft | Counterfit
Security
- Mila, BCG Gamma, Haverford College, and Comet | Code Carbon
Environmental Impact and Sustainability
- United States Agency International Development | USAID: Managing ML Projects in International Development
Environmental Impact and Sustainability
- Cornell University | Carbon Emissions and Large Neural Network Training
Environmental Impact and Sustainability
- GitHub | Experiment-Impact-Tracker
Environmental Impact and Sustainability
- Research Gate | ML C0₂ Impact
Environmental Impact and Sustainability
- Nethope | Nethope Digital Skills Framework
Digital Literacy and Participation
- Santa Clara University | Microsoft Judgment Call / Community Jury
Digital Literacy and Participation
- Harvard University | Berkman Klein Centre: Digital Citizenship+ (Plus) Resource Platform
Digital Literacy and Participation
- Stanford University | Stanford AI Index
AI Indexes
- Oxford Insights | Government AI Readiness Index
AI Indexes
- Global Data Barometer | Global Data Barometer
AI Indexes
- Tortoise Media | The Global AI Index
AI Indexes
- Carnegie Endowment for International Peace | AI Global Surveillance Index
AI Indexes
- International Telecommunication Union (ITU) | ICT Development Index
AI Indexes
- World Intellectual Property Organization | Global Innovation Index
AI Indexes
- World Economic Forum | Global Competitiveness Index
AI Indexes
- Ranking Digital Rights | Digital Rights Corporate Accountability Index
AI Indexes
- Center for AI and Digital Policy | Artificial Intelligence and Democratic Values Index
AI Indexes