OctoML Raises $28 million for ML Deployment Optimisation


Studies like the 2020 State of AI report from McKinsey have found that businesses capable of deploying multiple AI models are considered high performers, but a survey of business leaders included in the report found fewer than 20 per cent have taken deep learning projects beyond the pilot stage. It’s well known that most businesses face challenges deploying AI in production, which has led to a rise in startups that serve needs like AIOps or auditing. In the latest news for such a company, OctoML raised a USD 28 million series B funding round.

OctoML helps businesses accelerate AI model inference and training and relies on the open-source Apache TVM machine learning compiler framework. TVM is currently being used by companies like Amazon, AMD, Arm, Facebook, Intel, Microsoft, and Qualcomm. OctoML will use the funding to continue building out products like its Octomizer platform and investing in its go-to-market strategy and customer service teams.

Also Read: Digital Transformation – Ready to Take Your First Step?

‘We started the TVM work as a research project at the University of Washington about five years ago, and all the key people in the project all got their Ph. D.s and are part of the company now,’ OctoML CEO and co-founder Luis Ceze said. ‘We’re focused on making inference fast on any hardware, and support cloud and edge deployments.’ 

The $28 million funding round was led by Addition, with participation from existing investors Madrona Venture Group and Amplify Partners.

OctoML has raised USD 47 million to date, including a USD 3.9 million seed funding round in October 2019, just months after the company was founded. OctoML is based in Seattle with remote employees across the United States.