Benchmarking ZeRO-Inference on the NVIDIA GH200 Grace Hopper Superchip
This blog explores the synergy of DeepSpeed’s ZeRO-Inference, a technology designed to make large AI model inference more accessible and cost-effective, with ...
Featured
MLPerf Inference v5.0: Lambda’s Clusters Prove Ready for Today and Tomorrow’s AI Inference Demands
Ensuring our customers’ success is a core value at Lambda, and MLPerf Inference v5.0 is a part of our commitment to providing the best compute platform for AI innovation. Today, we’re thrilled to share our first public-facing results on NVIDIA HGX B200 and NVIDIA HGX H200 platforms, showcasing how our innovative cloud infrastructure is setting new standards for AI inference performance.
Recent
Persistent storage now available for on-demand NVIDIA H100 GPU instances
Persistent storage for Lambda Cloud recently exited beta and became available in the majority of regions. We are excited to announce that filesystems are now ...
Lambda launches Vector One, a new single-GPU desktop PC
The Lambda Vector One is now available for order. The new single-GPU desktop PC is built to tackle demanding AI/ML tasks, from fine-tuning Stable Diffusion to ...
To top