The $1,000,000 Unboxing - Petabyte of Flash Part 1
Linus Tech Tips・18 minutes read
Unboxing the most expensive server with a petabyte of SSDs sponsored by Kioxia, featuring Nvidia A100 GPUs and detailed architecture for optimal performance. Collaboration with Supermicro, AMD, and Weka to balance SSD performance with CPU power and networking capabilities.
Insights
- The server sponsored by Kioxia showcases cutting-edge technology, including Nvidia A100 GPUs with 640GB of VRAM, dual 64-core EPYC processors, and high-density storage solutions, emphasizing the importance of performance optimization in data center design.
- Collaboration with industry leaders such as Supermicro, AMD, and Weka highlights the intricate setup process involving PCIe over fiber cards, Nvidia ConnectX-6 200GB cards, and NVMe drives, underscoring the significance of balancing SSD performance, CPU capabilities, and networking efficiency for seamless operation.
Get key ideas from YouTube videos. It’s free
Recent questions
What components are included in the expensive server?
The expensive server includes Nvidia A100 GPUs with 640GB of VRAM, dual 64-core EPYC processors, 256GB RAM, Nvidia ConnectX-6 cards, PCIe over fiber cards, and 10 NVMe drives.
How is the server architecture optimized for performance?
The server architecture is optimized for performance by balancing SSD performance with CPU power and networking capabilities, utilizing dual 64-core EPYC processors, Nvidia ConnectX-6 cards, and PCIe over fiber cards to maximize speed and efficiency.
What is the importance of density in data center design?
Density in data center design is crucial for maximizing space efficiency and server selection, ensuring that servers can accommodate multiple components like NVMe drives, GPUs, and PCIe cards without sacrificing performance.
What networking technology is used in the server setup?
The server setup utilizes direct detect for NVMe over fiber networking, ensuring high-speed and reliable connections between components like the Nvidia A100 GPUs, dual EPYC processors, and NVMe drives.
What are the key features of the Kioxia SSD drives?
The Kioxia SSD drives have a capacity of 15.36 terabytes each, delivering six gigabytes per second throughput and a million IOPS per drive, ensuring fast and efficient data storage and retrieval in the server setup.
Related videos
Summary
00:00
Ultimate Server Unboxing: High-Performance Tech Collaboration
- Unboxing the most expensive server with a petabyte of SSDs sponsored by Kioxia.
- The server includes Nvidia A100 GPUs with 640GB of VRAM, valued at $100,000 each.
- Collaboration with Supermicro, AMD, and Weka for the project.
- Detailed architecture and setup of the server to maximize performance.
- Server features PCIe over fiber cards and Nvidia ConnectX-6 200GB cards.
- Server can accommodate 10 NVMe drives and 8 PCIe 16x slots.
- Dual 64-core EPYC processors with 256GB RAM and Nvidia ConnectX-6 cards.
- Challenges in balancing SSD performance with CPU power and networking capabilities.
- Importance of density in data center design and server selection.
- Use of direct detect for NVMe over fiber networking in the setup.
11:13
High-speed server setup with powerful components.
- Thumb drive with a lock, featuring a USB Type-B port for running and rate purposes.
- AMD EPYC processors with 64 total cores, boosting up to 3.7 gigahertz, offering lightning-fast PCIe connectivity.
- 20-watt fans totaling 80 watts, ensuring maximum speed and no bottlenecks in the system.
- Servers equipped with 200 gigabit cards for high-speed connections, with multiple PCIe slots for additional components.
- Mellanox/Nvidia 3,700 series 200 gigabit switch with 12.8 terabit capacity, ensuring full-speed operation.
- Kioxia SSD drives with 15.36 terabytes each, delivering six gigabytes per second throughput and a million IOPS per drive.
- Server rack powered by L6-30 cords, requiring 240 volts and 30 amps each, with a hundred-meter 100 gig cable for connectivity.
