Yotta Data Services to collaborate with Nvidia for GPU computing infrastructure

Yotta Data Services today announced a collaboration with Nvidia to deliver GPU computing infrastructure and platforms for its Shakti-Cloud platform.

The collaboration will advance the development of AI solutions in India by bringing AI capabilities within reach of numerous organisations, businesses, AI researchers, and startups across the country, Nvidia said.

With this offering, Yotta customers will be able to train large language models and other AI workloads serving the growing needs of Indian, Asian, and broader global markets.


Yotta has already placed a large order for Nvidia H100 Tensor Core GPUs, a powerful GPU for AI and HPC workloads, and plans to go operational with 4096 GPUs by January 2024 and 16,384 GPUs by June 2024, it said.

With support from Nvidia, Yotta also plans to scale up its GPU stable to 32,768 by the end of 2025. This will address the demand for high-performance GPUs by research labs, enterprises, and startups for HPC and AI workloads, Nvidia said.

With this collaboration, Yotta becomes the first Nvidia Partner Network cloud partner (NCP) in India.

Further, Yotta is deploying an Nvidia-powered reference architecture with Nvidia InfiniBand networking that will allow GPU clusters to deliver performance at scale for large AI training and inferencing workloads, as well as HPC workloads.