The Lambda Deep Learning Blog

Published on December 12, 2023 by Samuel Park

Lambda launches Vector One, a new single-GPU desktop PC

The Lambda Vector One is now available for order. The new single-GPU desktop PC is built to tackle demanding AI/ML tasks, from fine-tuning Stable Diffusion to ...

Published on September 22, 2021 by Chuan Li

Tesla A100 Server Total Cost of Ownership Analysis

This post compares the Total Cost of Ownership (TCO) for Lambda servers and clusters vs cloud instances with NVIDIA A100 GPUs. We first calculate the TCO for ...

Published on October 6, 2020 by Stephen Balaban

Lambda Echelon – a turn key GPU cluster for your ML team

Introducing the Lambda Echelon Lambda Echelon is a GPU cluster designed for AI. It comes with the compute, storage, network, power, and support you need to ...

Published on April 7, 2020 by Stephen Balaban

Hyperplane-16 InfiniBand Cluster Total Cost of Ownership Analysis

In this post we'll walk through using our Total Cost of Ownership (TCO) calculator to examine the cost of a variety of Lambda Hyperplane-16 clusters. We have ...

Published on August 12, 2019 by Chuan Li

Tracking system resource (GPU, CPU, etc.) utilization during training with the Weights & Biases Dashboard

One of the most asked questions we get at Lambda Labs is, “how do I track resource utilization for deep learning jobs?” Resource utilization tracking can help ...

Published on May 31, 2019 by Stephen Balaban

A Gentle Introduction to Multi GPU and Multi Node Distributed Training

This presentation is a high-level overview of the different types of training regimes that you'll encounter as you move from single GPU to multi GPU to multi ...

Published on March 12, 2019 by Michael Balaban

Titan V Deep Learning Benchmarks with TensorFlow

In this post, Lambda Labs benchmarks the Titan V's Deep Learning / Machine Learning performance and compares it to other commonly used GPUs. We use the Titan V ...

Published on March 4, 2019 by Stephen Balaban

RTX 2080 Ti Deep Learning Benchmarks with TensorFlow

by Chuan Li, PhD

Published on February 17, 2019 by Stephen Balaban

Perform GPU, CPU, and I/O stress testing on Linux

CPU, GPU, and I/O utilization monitoring using tmux, htop, iotop, and nvidia-smi. This stress test is running on a Lambda GPU Cloud 4x GPU instance. Often ...

Published on December 26, 2018 by Michael Balaban

Titan RTX Deep Learning Benchmarks

Titan RTX vs. 2080 Ti vs. 1080 Ti vs. Titan Xp vs. Titan V vs. Tesla V100. For this post, Lambda engineers benchmarked the Titan RTX's deep learning ...

Published on October 12, 2018 by Stephen Balaban

Crowd Sourced Deep Learning GPU Benchmarks from the Community

We open sourced the benchmarking code we use at Lambda Labs so that anybody can reproduce the benchmarks that we publish or run their own. We encourage people ...

Published on October 8, 2018 by Stephen Balaban

Deep Learning GPU Benchmarks - V100 vs 2080 Ti vs 1080 Ti vs Titan V

At Lambda, we're often asked "what's the best GPU for deep learning?" In this post and accompanying white paper, we evaluate the NVIDIA RTX 2080 Ti, RTX 2080, ...