Lecture 5 Additional Software Tools

• Python:
  • mlextend
  • PiML
  • SALib
  • themis-ml
• R:
  • DALEX
  • drifter
• Other:
  • manifold
  • What-If Tool

Lecture 5 Additional Software Examples

• Advanced residual analysis example
• Advanced sensitivity analysis example
• Basic sensitivity and residual analysis example
• Debugging a Machine Learning Model
• Machine Learning for High-risk Applications: Use Cases (Chapter 8)

Lecture 5 Additional Reading

• Introduction and Background:

  • AI Incident Database
  • Debugging Machine Learning Models
  • Overview of Debugging ML Models
  • Real-World Strategies for Model Debugging
  • Safe and Reliable Machine Learning
  • Why you should care about debugging machine learning models

• Debugging Approaches and Information:

  • A Comprehensive Study on Deep Learning Bug Characteristics
  • DQI: Measuring Data Quality in NLP
  • Identifying and Overcoming Common Data Mining Mistakes
  • PiML User Guide: Diagnostic Suite
  • Predicting Good Probabilities With Supervised Learning
  • Underspecification Presents Challenges for Credibility in Modern Machine Learning