NVIDIA L40S Data Center 48GB
Experience breakthrough multi-workload performance with the NVIDIA L40S GPU. Combining powerful AI compute with best-in-class graphics and media acceleration, the L40S GPU is built to power the next generation of data center workloads—from generative AI and large language model (LLM) inference and training to 3D graphics, rendering, and video.
The NVIDIA L40S GPU is the most powerful universal GPU for the data center,delivering end-to-end acceleration for the next generation of AI-enabled applications—from generative AI and model training and inference to 3D graphics,rendering, and video applications.
Specifications
| GPU Features | NVIDIA L40S GPU |
| GPU Memory | 48 GB GDDR6 with ECC |
| Display Ports | 4 x DP 1.4a |
| Max Power Consumption | 350 W |
| Graphics Bus | PCI Express Gen 4 x 16 |
| Form Factor | 4.4″ (H) x 10.5″ (L) Dual Slot |
| Thermal | Passive |
| GPU Architecture | NVIDIA Ada Lovelace Architecture |
Universal Performance
Tensor
Performance
1,466
TFLOPS
RT Core
Performance
212
TFLOPS
Single-Precision Performance
91.6
TFLOPS
Powered by the NVIDIA Ada Lovelace architecture
CUDA Cores
Accelerated single precision floating point (FP32) throughput and improved power efficiency provide significant performance improvements for workflows like 3D model development and CAE simulation. Supports enhanced 16-bit math capabilities (BF16) for mixed precision workloads.
Third-Generation RT Cores
Enhanced throughput and concurrent ray tracing and shading capabilities improve ray tracing performance, accelerating renders for product design and architecture, engineering, and construction workflows. See lifelike designs in action with hardware accelerated motion blur to deliver stunning real-time animations. Fourth Generation Tensor Cores
Hardware support for structural sparsity and optimized TF32 format provides out of the box performance gains for faster AI and data science model training. Accelerate AI-enhanced graphics capabilities including DLSS, delivering upscaled resolution with better performance in select applications. 48 Gigabytes (GB) of GPU Memory
Transformer Engine dramatically accelerates AI performance and improves memory utilization for both training and inference. Harnessing the power of the Ada Lovelace fourth-generation Tensor Cores, Transformer Engine intelligently scans the layers of transformer architecture neural networks and automatically recasts between FP8 and FP16 precisions to deliver faster AI performance and accelerate training and inference. Virtualization-Ready
L40S GPU is optimized for 24/7 enterprise data center operations and designed, built, tested, and supported by NVIDIA to ensure maximum performance, durability, and uptime. The L40S GPU meets the latest data center standards, are Network Equipment-Building System (NEBS) Level 3 ready, and features secure boot with root of trust technology, providing an additional layer of security for data centers. PCIe Gen 4
L40S GPU enables ultra-fast rendering and smoother frame rates with NVIDIA DLSS 3. This breakthrough frame-generation technology leverages deep learning and the latest hardware innovations within the Ada Lovelace architecture and the L40S GPU, including fourth-generation Tensor Cores and an Optical Flow Accelerator, to boost rendering performance, deliver higher frames per second (FPS), and significantly improve latency.