This Lightweight, Python library ‘Steppy’ can be used for fast and reproducible data science/machine learning experimentation

Date:

‘Steppy’ is a light python-3 library that can be used for fast and reproducible data science/machine learning experimentation. It reduces the burden of data scientists from software development issues. The minimal interface does not impose constraints for ‘Steppy’; instead, it enables clean machine learning pipeline design.

‘Steppy’ solves some of the data science project problems with the help of minimal interface for building machine learning pipelines. It uses two simple abstractions: Step and Tranformer

Step: It is the execution wrapper over the transformer. Example: Checking intermediate results.

Tranformer: It represents the computation step and performs operation on data. Mostly, Transformers are neural networks, machine learning algorithms..

Installation

Steppy requires python3.5 or above.

pip3 install steppy

Getting started with steps (Code Source: https://github.com/neptune-ml/steppy-examples/blob/master/tutorials/1-getting-started.ipynb)

This notebook shows how to create steps, fit them to data, transform new data and take advantage of persistence

%load_ext autoreload
%autoreload 2

import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline

from steppy.base import Step, BaseTransformer

EXPERIMENT_DIR = './ex1'
import shutil

# By default pipelines will try to load previously trained models so we delete the cache to ba sure we're starting from scratch
shutil.rmtree(EXPERIMENT_DIR, ignore_errors=True)

Github: https://github.com/neptune-ml/steppy

Tutorial notebooks (their repository):

Asif Razzaqhttp://www.marktechpost.com
Asif Razzaq is an AI Journalist and Cofounder of Marktechpost, LLC. He is a visionary, entrepreneur and engineer who aspires to use the power of Artificial Intelligence for good. Asif's latest venture is the development of an Artificial Intelligence Media Platform (Marktechpost) that will revolutionize how people can find relevant news related to Artificial Intelligence, Data Science and Machine Learning. Asif was featured by Onalytica in it’s ‘Who’s Who in AI? (Influential Voices & Brands)’ as one of the 'Influential Journalists in AI' (https://onalytica.com/wp-content/uploads/2021/09/Whos-Who-In-AI.pdf). His interview was also featured by Onalytica (https://onalytica.com/blog/posts/interview-with-asif-razzaq/).

Share post:

Popular

More like this
Related

Recent Research on Manifolds in Commonly Used Atomic Fingerprints and Failure to Machine Learning Four-Body Interactions

Atomic fingerprints are often employed in machine learning situations...

A Neural Network for Solving and Generating University Level Mathematics Problems Using Program Synthesis

The AI research community widely believed that modern deep...

Increased Data Security Using ‘EzPC’ In The Machine Learning Model Validation Process

Artificial intelligence (AI) has revolutionized various industries in the...
Join the AI conversation and receive daily AI updates