OpenAI's GPT-3 Language Model: A Technical Overview
by Chuan Li, PhD
Featured
Introducing NVIDIA SHARP on Lambda 1CC: Next-Gen Performance for Distributed AI Workloads
Lambda’s 1-Click Clusters(1CC) provide AI teams with streamlined access to scalable, multi-node GPU clusters, cutting through the complexity of distributed infrastructure. Now, we're pushing the envelope further by integrating NVIDIA's Scalable Hierarchical Aggregation and Reduction Protocol (SHARP) into our multi-tenant 1CC environments. This technology reduces communication latency and improves bandwidth efficiency, directly accelerating training speed of distributed AI workloads.
Recent
NVIDIA A100 GPU Benchmarks for Deep Learning
Lambda customers are starting to ask about the new NVIDIA A100 GPU and our Hyperplane A100 server. The A100 will likely see the large gains on models like ...
Cutting the cost of deep learning — Lambda Cloud 8-GPU V100 instances
With most (if not all) machine learning and deep learning researchers and engineers now working from home due to COVID-19, we’ve seen a massive increase in the ...
To top