A collection of in-depth tutorials on ML model evaluation and monitoring. Code included!
Our CTO Emeli Dral gave a tutorial on how to use Evidently at the Stanford Winter 2022 course CS 329S on Machine Learning System design. Here is the written version of the tutorial and a code example.
You can look at historical drift in data to understand how your data changes and choose the monitoring thresholds. Here is an example with Evidently, Plotly, Mlflow, and some Python code.
There is more to performance than accuracy. In this tutorial, we explore how to evaluate the behavior of a classification model before production use.