Foundry seeks to overcome the GPU shortage by turning to existing GPUs that it claims are “vastly underutilised.”
Foundry has launched its GPU-based Foundry Cloud Platform for artificial intelligence (AI) workloads. Following the company’s emergence in March of this year with $80 million of funding, the AI cloud platform is now live.
The company claims that its cloud platform can reduce operational complexity and compute cost by up to six times. Foundry seeks to overcome the GPU shortage by turning to existing GPUs that it claims are “vastly underutilised.”
“The GPU compute market as it exists today is one of the most inefficient commodity markets in history, and it’s directly limiting critical AI innovations that will benefit society,” explains Jared Quincy Davis, Founder and CEO of Foundry.
“The majority of AI research and development teams struggle to access affordable and reliable compute for their workloads, while exceptionally well-funded organisations are forced to purchase long-term GPU reservations that they rarely utilise to maximum capacity. Foundry Cloud Platform addresses this market failure by aggregating and redistributing idle compute capacity to enable faster breakthroughs while improving return on GPU investments.”
Foundry is offering access to its GPU capacity via resealable reserved instances in which AI teams can reserve short-term capacity from Foundry’s virtual GPU machines, for periods as brief as three hours. Customers can also resell idle capacity from their reservations.
It can also be used via spot instances, which users can bid on for interrupt-tolerant workloads.
Additionally, Foundry offers Kubernetes workload orchestration, which eliminates manual scheduling by programmatically adding reserved and spot instances to a managed Kubernetes cluster.
Early adopters of the Foundry Cloud Platform include Infinite Monkey, an AI startup developing architectures for AGI, and Arc Institute, a nonprofit research organisation studying complex diseases, including cancer, neurodegeneration, and immune dysfunction.
