Marking a major investment in Meta’s AI future, we are announcing two 24k GPU clusters. We are sharing details on the hardware, network, storage, design, performance, and software that help us extract high throughput and reliability for various AI workloads. We use this cluster design for Llama 3 training. We are strongly committed to open [...]


Read More...


The post Building Meta’s GenAI Infrastructure appeared first on Engineering at Meta.


http://dlvr.it/T3z2gf

admin

Post a Comment

Post a Comment