AMD Narrows AI Chip Gap for Large Models
MI355X Narrows H100 Gap on 100B+ Models
Spheron Network found that on the 671B-parameter DeepSeek R1 model, the MI355X achieves approximately 4,200 tokens/sec compared to the H100's approximately 4,500 tokens/sec. Spheron Network also determined that at higher batch sizes, typically 64-128 for high-throughput serving,