Examples of using Evidently to evaluate, test and monitor ML models.
Code tutorials showing specific use cases, Evidently functionality or example dataset analysis. Come with blog posts or detailed explanations.
If you are new to Evidently, explore the official Quickstart for Tests and Reports and Monitoring Quickstart.
Title | Code | Blog | Author | Tags |
---|---|---|---|---|
How to run and debug LLM regression tests | Jupyter notebook | - | Evidently team | test_suites , llm , text_descriptors |
How to create an LLM judge | Jupyter notebook | - | Evidently team | test_suites , llm , text_descriptors |
How to monitor LLM testing results | Jupyter notebook | Tutorial | Evidently team | test_suites , llm , text_descriptors |
How to run regression testing for LLMs | Jupyter notebook | Tutorial | Evidently team | test_suites , llm , text_descriptors |
How to create ML model cards | Jupyter notebook | Tutorial | Evidently team | reports , data_quality , model_quality , classification |
How to use descriptors to monitor text data | Jupyter notebook - with model training | Tutorial | Evidently team | reports , test_suites , text_data , nlp , data_drift , text_descriptors |
How to monitor NLP models in production | Colab - with model training | Tutorial | Evidently team | reports , text_data , nlp , data_drift , text_descriptors , classification |
How to break a model in 20 days. A tutorial on production model analytics. | Jupyter notebook | Tutorial | Evidently team | reports , data_drift , model_quality , regression |
How to compare models pre-deployment. | Jupyter notebook | Tutorial | Evidently team | reports , model_quality , classification |
How to design ML monitoring. Tutorial from CS 329S: Machine Learning Systems Design. | Jupyter notebook | Tutorial | Evidently team | reports , data_drift , model_quality , regression |
See more data stories in the main Evidently repository.
Code examples and how-tos on using Evidently and specific features.
If you are new to Evidently, see the entry-level sample notebooks with all Evidently metrics and tests.
Title | Code | Author | Tags |
---|---|---|---|
How to convert raw text data to embeddings and evaluate data drift. | Jupyter notebook | Sangam SwadiK | reports , text_data , nlp , data_drift , embeddings |
Comparing data drift tests for different distributions types. | Jupyter notebook | Antonis Stellas | reports , data_drift |
Examples of using Evidently with other tools.
See core deployment blueprints in the integrations folder in main Evidently repository.
Title | Code | Blog | Author | Tags |
---|---|---|---|---|
How to send email alerts on drift Evidently and AWS SES | Example repo | Tutorial | Marcello Victorino | data drift |
Examples from specific events, meetups or workshops using Evidently.
Title | Code | Video | Author | Tags |
---|
Blogs about Evidently, published on external platforms.
Title | Blog | Author | Tags |
---|
See the official Evidently blog for more articles.