Inspur NF5468A5

The NF5468A5 is the latest product in Inspur NF5468 series best-selling elastic cloud AI servers at home and abroad. It is the first to support the PCIe 4.0 technology, with 2 AMD EPYC processors using the advanced 7 nm process technology and 8 AI accelerator cards with PCIe Gen4 interfaces in the 4U ultimate space. The NF5468A5 supports the most leading AI computing technologies, provides superior performance, continues Inspur's high-quality and high-compatibility design, and matches the mature and outstanding ecosystem to provide powerful and reliable infrastructure support for professional AI customers worldwide.

Leading Technology

  • High-performance balanced design of 4U 8GPU to provide leading performance in the ultimate space
  • NVIDIA A40 graphics cards to double the performance of the previous generation
  • NVIDIA A100 GPUs to dramatically improve training inference performance with the MIG technology
  • AMD Instinct MI100 with the new Matrix Core technology

Consistent Quality

  • N+N redundant PSUs to allow 8 x 350 W GPUs to run at full speed
  • N+1 redundant fans to ensure stable machine operation at high ambient temperatures
  • RAID cache and the supercapacitor to provide power-off data protection
  • Intelligent remote management system BMC to provide zero-touch O&M, thus improving O&M efficiency

Unparalleled Performance

  • 2 AMD EPYC processors, 128 cores, and 3 xGMI links
  • CPU passthrough without the need of CPU-GPU communications via PCIe Switch
  • Memory capacity up to 8T, supporting 200G HDR IB network adapters
  • Adaptive to the latest AI accelerator cards of various brands on the PCIe Gen4 platform with doubled bandwidth

Excellent Ecosystem

  • Various global AI accelerator card partners like NVIDIA, AMD, Intel, Cambricon, and Enflame
  • Leading deep learning frameworks, such as TensorFlow, PyTorch, MXNet, and PaddlePaddle
  • Powerful Inspur AIStation resource platform, algorithm platform and application optimization services
  • Mature Meta Brain ecosystem to provide industry-wide, all-scenario application solutions


Product model





2 x AMD EYPC processors interconnected via three xGMIs, with a TDP of 280 W

GPU card

8 x A100, A40 or MI100 GPUs supporting PCIe interfaces, with a TDP of 350 W


32 x DDR4 RDIMMs at a transmission rate of 3200 MHz

Rear PCIe card

2 PCIe 4.0 x16 and 1 OCP NIC 3.0

Local storage:

24 x 2.5" or 12 x 3.5" SAS/SATA HDDs (up to 8 NVMe SSDs) and 2 M.2 SATA SSDs

RAID support

RAIDs 0, 1, 10, 5, 50, 6, and 60 in the optional configuration, as well as cache protection with the supercapacitor, RAID state transition and RAID configuration memory

Operating system

Mainstream operating systems such as Microsoft Windows Sever, Red Hat Enterprise Linux, Ubuntu Linux, and CentOS.

System heat dissipation

System fans in N+1 redundancy.

Power Supply

2+2 redundant 1600 W/2000 W/2200 W/ 3000W 80 Plus Platinum PSUs


478.8 mm (W) x 175.5 mm (H) x 830 mm (D)

Operating Temperature

5 - 35°C / 41°F - 95°F

Weight in full configuration:

≤70 kg

Inspur NF5468A5