Neuropod: Uber ATG’s Open Source Deep Learning Inference Engine

Uber Advanced Technologies Group (ATG) recently open-sourced Neuropod, a framework that provides a uniform interface to run deep learning models from multiple frameworks in C++ and Python. It helps researchers build models easily in a framework of their choice along with simplifying the production of these models.. Neuropod is currently supported by TensorFlow, PyTorch, TorchScript, and Keras.

With Neuropod, the problem related to incompatibilities during the use of multiple frameworks for development is solved. It works by wrapping available models in a neuropod package. It makes the frameworks look the same when a model is run, with out-of-the-box support for PyTorch, Tensorflow, Keras, and TorchScript. Using Neuropod, you can run any model from any supported language.