MLEnv: Standardizing ML at Pinterest Under One ML Engine to Accelerate Innovation

Pinterest’s mission is to bring everyone the inspiration to create a life they love. We rely on an extensive suite of AI powered products to connect over 460M users to hundreds of billions of Pins, resulting in hundreds of millions of ML inferences per second, hundreds of thousands of ML training jobs per month by just a couple of hundreds of ML engineers. In 2021, ML was siloed at Pinterest with 10+ different ML frameworks relying on different deep learning frameworks, framework versions, and boilerplate logic to connect with our ML platform. It was a major bottleneck for ML innovation at Pinterest because the amount of engineering resources spent by each ML team to maintain their own ML stack was immense and there was limited knowledge sharing across teams. To fix these problems we introduced MLEnv — a standardized ML engine at Pinterest now leveraged by 95% of ML jobs at Pinterest (starting from <5% in 2021). Since launching our platform we have: <ul> <li>Observed a 300% increase in the number of training jobs, world-class 88 Net Promoter Score (NPS) for MLEnv and a 43% increase in ML Platform NPS</li> <li>Shifted the paradigm for ML innovations and delivered aggregate gains in Pinner engagement on the order of mid-double digit percentages</li> </ul> <a href="https://medium.com/pinterest-engineering/mlenv-standardizing-ml-at-pinterest-under-one-ml-engine-to-accelerate-innovation-e2b30b2f6768">Read More</a>