We are excited to announce the release of MLflow 2.21.0! This release includes a number of significant features, enhancements, and bug fixes.

Major New Features

• 📚Documentation Redesign:MLflow documentation is fully revamped with a new MDX-based website that provides better navigation and makes it easier to find the information you need! (#13645,@daniellok-db)
• 🤖Prompt Registry:MLflow Prompt Registry is a powerful tool that streamlines prompt engineering and management in your GenAI applications. It enables you to version, track, and reuse prompts across your organization. (#14795,#14834,#14936,@B-Step62,#14960,#14984,@daniellok-db,#14909,@hubertzub-db)
• ⚡️FastAPI Scoring Server: TheMLflow inference serverhas been migrated from Flask to FastAPI, enabling ASGI-based scalable inference for improved performance and throughput. (#14307,@TomeHirata)
• 🔍Enhanced Tracing Capabilities:MLflow Tracing now supports synchronous/asynchronous generators and auto-tracing for Async OpenAI, providing more flexible and comprehensive tracing options. (#14459,#14400,#14793,@14792,@B-Step62)

Features:

• [Tracking] Support OpenAI Agent SDK Auto Tracing (#14987,@B-Step62)
• [Sqlalchemy / Tracking] Support mysql ssl connections with client certs (#14839,@aksylumoed)
• [Artifacts] Supports ADLS artifact repo (#14723,@serena-ruan)
• [Tracking] Add import and docs for txtai integration (#14712,@B-Step62)
• [Models] Introduce User Auth Policy for Pyfunc Models (#14538,@aravind-segu)
• [Tracking] Support new Google GenAI SDK (#14576,@TomeHirata)
• [Tracking] Support generating traces from DSPy built-in compilation and evaluation (#14400,@B-Step62)
• [Tracking] Add mlflow.log_trace API (#14418,@TomeHirata)
• [Models] ChatAgent LangGraph and LangChain Connectors (#14215,@bbqiu)

Bug fixes:

• [Models] Fix infinite recursion error with warning handler module (#14954,@BenWilson2)
• [Model Registry] Fix invalid type issue for ModelRegistry RestStore (#14980,@B-Step62)
• [Tracking] Fix:ExperimentViewRunsControlsActionsSelectTags doesn't set loading state tofalse whenset-tag request fails. (#14907,@harupy)
• [Tracking] Fix a bug in tag creation where tag values containing": " get truncated (#14896,@harupy)
• [Tracking] Fix false alert from AMD GPU monitor (#14884,@B-Step62)
• [Tracking] Fixmlflow.doctor to fall back tomlflow-skinny whenmlflow is not found (#14782,@harupy)
• [Models] Handle LangGraph breaking change (#14794,@B-Step62)
• [Tracking] Fix DSPy tracing in serving (#14743,@B-Step62)
• [Tracking] Add limit to the length of experiment artifact locations (#14416,@daniellok-db)
• [Build] Fix build.py to restore specific files#14444 (#14448,@arunkothari84)
• [Models] Fix false alert for ChatModel type hint (#14343,@B-Step62)
• [Model Registry] use aes256 to talk to s3 (#14354,@artjen)
• [Tracking] Fix LiteLLM autologging (#14340,@B-Step62)
• [Models] Fix ChatCompletionResponse for model serving Pydantic 1.x (#14332,@BenWilson2)

Documentation updates:

• [Tracking] Add guide about using MLflow tracing across thread (#14881,@B-Step62)
• [Docs] Add guide for tracing deepseek (#14826,@B-Step62)
• [Docs] Update llama Jupyter notebook source (#14754,@emmanuel-ferdman)
• [Docs] Replace Databricks Community Edition with Lighthouse [1] (#14642,@TomeHirata)
• [Docs] Update models from code guide and chat model guide to always recommend models from code (#14370,@smurching)
• [Artifacts] [DOC-FIX#14183] Improve documentation for 'artifact_uri' in 'download_artifacts' (#14225,@vinayakkgarg)

Small bug fixes and documentation updates:

#14994,#14992,#14990,#14979,#14964,#14969,#14944,#14948,#14957,#14958,#14942,#14940,#14935,#14929,#14805,#14876,#14833,#14748,#14744,#14666,#14668,#14664,#14667,#14580,#14475,#14439,#14397,#14363,#14361,#14377,#14378,#14337,#14324,#14339,#14259,@B-Step62;#14981,#14943,#14914,#14930,#14924,#14927,#14786,#14910,#14859,#14891,#14883,#14863,#14852,#14788,@Gumichocopengin8;#14946,#14978,#14956,#14906,#14903,#14854,#14860,#14857,#14824,#14830,#14767,#14772,#14770,#14766,#14651,#14629,#14636,#14572,#14498,#14328,#14265,@serena-ruan;#14989,#14895,#14880,#14878,#14866,#14821,#14817,#14815,#14765,#14803,#14773,#14783,#14784,#14776,#14759,#14541,#14553,#14540,#14499,#14495,#14481,#14479,#14456,#14022,#14411,#14407,#14408,#14315,#14346,#14325,#14322,#14326,#14310,#14309,#14320,#14308,@daniellok-db;#14986,#14904,#14898,#14893,#14861,#14870,#14853,#14849,#14813,#14822,#14818,#14802,#14804,#14814,#14779,#14796,#14735,#14731,#14728,#14734,#14727,#14726,#14721,#14719,#14716,#14692,#14683,#14687,#14684,#14674,#14673,#14662,#14652,#14650,#14648,#14647,#14646,#14639,#14637,#14635,#14634,#14633,#14630,#14628,#14624,#14623,#14621,#14619,#14615,#14613,#14603,#14601,#14600,#14597,#14570,#14564,#14554,#14551,#14550,#14515,#14529,#14528,#14525,#14516,#14514,#14486,#14476,#14472,#14477,#14364,#14431,#14414,#14398,#14412,#14399,#14359,#14369,#14381,#14349,#14350,#14347,#14348,#14342,#14329,#14250,#14318,#14323,#14306,#14280,#14279,#14272,#14270,#14263,#14222,@harupy;#14985,#14850,#14800,#14799,#14671,#14665,#14594,#14506,#14457,#14395,#14371,#14360,#14327,@TomeHirata;#14755,#14567,#14367,@bbqiu;#14892,@brilee;#14941,#14932,@hubertzub-db;#14913,@joelrobin18;#14756,@jiewpeng;#14701,@jaceklaskowski;#14568,#14450,@BenWilson2;#14535,@njbrake;#14507,@arunprd;#14489,@RuchitAgrawal;#14467,@seal07;#14460,@ManzoorAhmedShaikh;#14374,@wasup-yash;#14333,@singh-kristian;#14362,#14353,#14296,#13789,@dsuhinin;#14358,@apoxnen;#14335,@Fresnel-Fabian;#14178,@emmanuel-ferdman

Contributors