2 min

Oracle Cloud Infrastructure (OCI) users can now train generative AI models with Nvidia hardware. They can use the Nvidia DGX Cloud AI supercomputing platform and Nvidia AI Enterprise.

DGX Cloud and AI Enterprise training functionality are now available in the Oracle Cloud Marketplace, both tech giants indicate. This makes it possible for OCI users to access the computing power and software needed to run secure, stable and supported AI capabilities that can be immediately put into production with simple actions.

OCI and Nvidia DGX Cloud AI environment

Companies can thus train their models in the Nvidia DGX Cloud AI environment directly from the Oracle Cloud Marketplace. The Nvidia DGX Cloud AI environment gives OCI users access to multi-node AI training functionality on Nvidia GPUs. Each instance includes eight Nvidia Tensor Core GPUs with network connectivity specifically suited for multi-node training.

Management is performed through the Nvidia Base Command Platform. This single dashboard gives users access to an AI supercomputer via a Web browser.

Nvidia AI Enterprise software capabilities.

Linking to the Nvidia AI Enterprise software allows previously trained models to be deployed directly on OCI.

To do this, the software includes Nvidia NeMo frameworks for building LLMs, Nvidia RAPIDS for data science applications and Nvidia TensorRT-LLM and Nvidia Triton Inference Server for “supercharging” production AI. Also added is Nvidia software for security, computer vision and voice AI.

OCI users can further use their universal cloud credits to integrate Nvidia’s AI training and deployment capabilities into their own development and deployment pipelines.

Also read: Nvidia lets customers rent AI supercomputer with DGX Cloud