Although there are many approaches and libraries presently in practice to analyze fairness in machine learning models, they all are still limited to some or other factors. These tools are either specifically not addressing large-scale problems (and the inherent challenges that come with such scale) or tied to a specific cloud environment.
To solve this issue, LinkedIn introduces an open-source tool called LiFT (LinkedIn Fairness Toolkit). LiFT is a Scala/Spark library that enables the measurement of fairness, according to a multitude of fairness definitions, in large-scale machine learning workflows.
The main features of LiFT include flexibility towards deployment in ML workflows and integration in different stages of ML training systems. It is designed as a reusable library at its core and can also be used for ad-hoc fairness analysis.. Apart from flexibility, LiFT is also scalable and can be distributed on several nodes to analyze and scale bias measurements in various machine learning models.