Choosing the Best GPU for Deep Learning in 2020
State-of-the-art (SOTA) deep learning models have massive memory footprints. Many GPUs don't have enough VRAM to train them. In this post, we determine which ...
Featured
Introducing NVIDIA SHARP on Lambda 1CC: Next-Gen Performance for Distributed AI Workloads
Lambda’s 1-Click Clusters(1CC) provide AI teams with streamlined access to scalable, multi-node GPU clusters, cutting through the complexity of distributed infrastructure. Now, we're pushing the envelope further by integrating NVIDIA's Scalable Hierarchical Aggregation and Reduction Protocol (SHARP) into our multi-tenant 1CC environments. This technology reduces communication latency and improves bandwidth efficiency, directly accelerating training speed of distributed AI workloads.
Recent
Training Neural Networks in Record Time with the Hyperplane-16
by Chuan Li, PhD
Setting up a Mellanox InfiniBand Switch (SB7800 36-port EDR)
The desired end-state of this tutorial, a running subnet manager on your switch. This tutorial will walk you through the steps required to set up a Mellanox ...
To top