All about Google Model Card Toolkit.
                     ALL ABOUT GOOGLE MODEL CARD 
TOOLKIT
INTRODUCTION
• Google launched Model Card Toolkit to facilitate processes for AI-
based model transparency reporting.
• This can be used by downstream users, regulators, and developers. 
Source:  Marketing land
AIM
• The toolkit is built on the Model Cards framework that is used for 
reporting on ethics-informed evaluation, usage, and provenance. 
• It aims to provide an overview of the model’s potential limitations 
and uses.
Source:  Google AI Blog
EASY TO DEVELOP
• The Toolkit make it easier for third-party vendors to easily develop 
Model cards by combining necessary data 
• The developers can specify the graphs and metrics needed to be 
displayed in the finished Model Card. 
Source:  Google Cloud
MACHINE LEARNING
• Using the model provenance data stored with ML Metadata 
(MLMD), the Model Card Toolkit automatically fills the performance 
statistics. 
• It also provides a Model Card data API to represent an instance of 
the JSON schema and visualize it as a Model Card.
Source:  Google Cloud
STEPS INVOLVED 1
• Model Card creators can choose which metrics and graphs to 
display in the final Model Card.
• They can also choose stats that highlight areas where the model’s 
performance could deviate from its overall performance
Source:  Google Cloud
STEPS INVOLVED 2
• Once the Model Card Toolkit has populated the Model Card with 
key metrics and graphs, developers can supplement this with 
information regarding 
– the model’s limitations
– intended usage
– trade-offs
– ethical considerations
Source:  Google Cloud
STEPS INVOLVED 3
• If a model underperforms for certain slices of data, the Model 
Cards’ limitations section offers a place to acknowledge that.
• It also provides mitigation strategies to help address the issues.
Source:  CNBC.com
DECISION MAKING
• Sometimes the information is critical in helping developers 
deciding the suitability of the model for their use case.
• It also helps Model Card creators provide context so that their 
models are used appropriately
Source:  The Wall Street journal
MODEL OF MICROSOFT
• Microsoft started the idea of Model Cards work on datasheets 
intended to foster trust and accountability through 
documenting data sets’ creation, composition, maintenance, 
and other properties.
Source:  GitHub
MODEL OF IBM
• Two years ago, IBM proposed its own 
model documentation in voluntary 
factsheets called “Supplier’s 
Declaration of Conformity” .
• It was intended to be completed and 
published by companies developing 
and providing AI. 
Source:  Forbes