The Lambda Deep Learning Blog

Published on August 24, 2023 by Chuan Li

How FlashAttention-2 Accelerates LLMs on NVIDIA H100 and A100 GPUs

This blog post walks you through how to use FlashAttention-2 on Lambda Cloud and outlines NVIDIA H100 vs NVIDIA A100 benchmark results for training GPT-3-style ...

Published on August 2, 2023 by Kathy Bui

Lambda Cloud Deploys On-Demand NVIDIA HGX H100 with 8x H100 SXM Instances

Lambda Cloud now offers on-demand HGX H100 systems with 8x NVIDIA H100 SXM Tensor Core GPU instances for only $2.59/hr/GPU. The newest addition to Lambda Cloud ...

Published on July 13, 2023 by David Hall

Considerations for Large-Scale NVIDIA H100 Cluster Deployments

Published on May 10, 2023 by Kathy Bui

Lambda Cloud Deploys NVIDIA H100 Tensor Core GPUs

We have some pretty big news to share! Lambda Cloud has deployed a fleet of NVIDIA H100 Tensor Core GPUs, making it one of the first to market with ...

Published on March 21, 2023 by Mitesh Agrawal

Lambda Cloud Adding NVIDIA H100 Tensor Core GPUs in Early April

Lambda has some exciting news to share around the arrival of NVIDIA H100 Tensor Core GPUs. In early April, Lambda will add this powerful, high-performance ...

Published on December 7, 2022 by Jeremy Hummel

NVIDIA Hopper: H100 and FP8 Support

With the release of the NVIDIA H100 Tensor Core GPU, one of the most exciting features is the native support for FP8 data types. Compared to 16-bit ...

Published on October 5, 2022 by Chuan Li

NVIDIA H100 Tensor Core GPU - Deep Learning Performance Analysis

We have seen groundbreaking progress in machine learning over the last couple of years. At the same time, massive usage of GPU infrastructure has become key to ...