Netflix open-sources its Python Framework ‘Metaflow’ for building and managing data science projects

0
591
Image Source: https://medium.com/netflix-techblog/open-sourcing-metaflow-a-human-centric-framework-for-data-science-fa72e04a5d9
-Advertisement-

Netflix open-sources its human-friendly Python Framework ‘Metaflow’ to build and manage real-life data science projects with ease. Metaflow was originally developed at Netflix for addressing the needs of its data scientists who work on demanding real-life data science projects.

Metaflow provides a unified API to the infrastructure stack for the execution of data science projects (prototype to production).

-Advertisement-Python Specialization from University of Michigan

Key Features:

  1. Use Metaflow with Data Science Python tools like PyTorch, Tensorflow, SciKit Learn, etc.
  2. Metaflow helps to design workflow easily with higher scalability and deployment.
  3. It sets the versions and tracks data and experiments automatically.
  4. It lets you inspect results easily in notebooks.
  5. In terms of scalability, Metaflow provides built-in integrations to the storage, compute, and machine learning services in the Amazon Web Services (AWS).

Github: https://github.com/Netflix/metaflow

Documentation: https://docs.metaflow.org/

By design, Metaflow is a deceptively simple Python library as shown below:

Image source: https://medium.com/netflix-techblog/open-sourcing-metaflow-a-human-centric-framework-for-data-science-fa72e04a5d9

Installation

 Install metaflow from pypi:

pip install metaflow

You can access tutorial by typing

metaflow

Video: Human-Centric Machine Learning Infrastructure @Netflix

Source: https://www.youtube.com/watch?time_continue=6&v=XV5VGddmP24&feature=emb_logo

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.