MLflow is a platform to streamline machine learning development, including tracking experiments, packaging code into reproducible runs, and sharing and deploying models. MLflow offers a set of lightweight APIs in that can used with any existing machine learning application or library (TensorFlow, PyTorch, XGBoost, etc), wherever you currently run ML code (e.g. in notebooks, standalone applications or the cloud). MLflow's current components are:
- MLflow Tracking: An API to log parameters, code, and results in machine learning experiments and compare them using an interactive UI.
- MLflow Projects: A code packaging format for reproducible runs using Conda and Docker, so you can share your ML code with others.
- MLflow Models: A model packaging format and tools that let you easily deploy the same model (from any ML library) to batch and real-time scoring on platforms such as Docker, Apache Spark, Azure ML and AWS SageMaker.
Install MLflow from PyPi via pip install mlflow
MLflow requires conda to be on the PATH for the projects feature.
Nightly snapshots of MLflow master are also available here.
Official documentation for MLflow can be found at https://mlflow.org/docs/latest/index.html.
To discuss MLflow or get help, please subscribe to our mailing list ([email protected]) or join us on Slack at https://tinyurl.com/mlflow-slack.
To report bugs, please use GitHub issues.
The programs in examples use the MLflow Tracking API. For instance, run:
python examples/quickstart/mlflow_tracking.py
This program will use MLflow Tracking API,
which logs tracking data in ./mlruns. This can then be viewed with the Tracking UI.
The MLflow Tracking UI will show runs logged in ./mlruns at http://localhost:5000.
Start it with:
mlflow ui
Note: Running mlflow ui from within a clone of MLflow is not recommended - doing so will
run the dev UI from source. We recommend running the UI from a different working directory,
specifying a backend store via the --backend-store-uri option. Alternatively, see
instructions for running the dev UI in the contributor guide.
The mlflow run command lets you run a project packaged with a MLproject file from a local path
or a Git URI:
mlflow run examples/sklearn_elasticnet_wine -P alpha=0.4 mlflow run https://github.com/mlflow/mlflow-example.git -P alpha=0.4
See examples/sklearn_elasticnet_wine for a sample project with an MLproject file.
To illustrate managing models, the mlflow.sklearn package can log scikit-learn models as
MLflow artifacts and then load them again for serving. There is an example training application in
examples/sklearn_logistic_regression/train.py that you can run as follows:
$ python examples/sklearn_logistic_regression/train.py
Score: 0.666
Model saved in run <run-id>
$ mlflow models serve --model-uri runs:/<run-id>/model
$ curl -d '{"columns":[0],"index":[0,1],"data":[[1],[-1]]}' -H 'Content-Type: application/json' localhost:5000/invocations
We happily welcome contributions to MLflow. Please see our contribution guide for details.