AGS8200 - AI Router - Intel Habana Gaudi 2

Product Detail

The Edgecore AGS8200 represents the forefront of GPU-based server technology, specifically engineered for AI/ML applications. It is optimized for high-demand tasks including training extensive language models, process automation, and improving object classification and recognition. The server delivers unparalleled performance and scalability, powered by eight Intel® Habana® Gaudi® 2 processors and dual Xeon® Sapphire-Rapids processors. Together, these elements form a robust computing platform capable of handling various deep learning tasks with outstanding efficiency and accuracy.

The Edgecore AGS8200 is perfectly suited for contemporary AI (Artificial Intelligence) and ML (Machine Learning) applications. It is equipped with the Intel® Gaudi® 2 AI accelerator, making it highly effective for training and inferencing Large Language Models (LLM). This capability allows users to effectively leverage the power of AI, enhancing efficiency across various applications.

The system incorporates eight Intel® Habana® Gaudi® 2 processors alongside dual Xeon® Sapphire-Rapids processors. Each Gaudi® 2 processor is equipped with 96GB of HBM2E memory and 24 NICs capable of 100Gbps RoCEv2 RDMA, ensuring robust data handling and transfer capabilities. The 24x 100Gbps NICs facilitate comprehensive internal and external all-to-all connectivity, scaling out for tasks such as training, fine-tuning, and other deep learning (DL) processes.

Furthermore, each Gaudi® 2 processor features 21x 100Gbps non-blocking, all-to-all connectivity with other Gaudi® 2 processors within the server. This setup allows for efficient training across all eight processors without the need for an external Ethernet switch. Additionally, each AGS8200 supports six QSFP-DD ports for further scale-out. The 400Gbps ports can connect to either 400Gbps switches or 100Gbps switches using breakout cables, facilitating integration in racks and clusters of Intel® Gaudi® 2-based nodes.