Meta’s new AI chips runs faster than before

Meta promises the next generation of its custom AI chips will be more powerful and able to train its ranking models much faster. 

The Meta Training and Inference Accelerator (MTIA) is designed to work best with Meta’s ranking and recommendation models. The chips can help make training more efficient and inference — aka the actual reasoning task — easier. 

The company said in a blog post that MTIA is a big piece of its long-term plan to build infrastructure around how it uses AI in its services. It wants to design its chips to work with its current technology infrastructure and future advancements in GPUs. 

“Meeting our ambitions for our custom silicon means investing not only in compute silicon but also in memory bandwidth, networking, and capacity as well as other next-generation hardware systems,” Meta said in its post. 

Meta announced MTIA v1 in May 2023, focusing on providing these chips to data centers. The next-generation MTIA chip will likely also target data centers. MTIA v1 was not expected to be released until 2025, but Meta said both MTIA chips are now in production. 

Right now, MTIA mainly trains ranking and recommendation algorithms, but Meta said the goal is to eventually expand the chip’s capabilities to begin training generative AI like its Llama language models. 

Meta said the new MTIA chip “is fundamentally focused on providing the right balance of compute, memory bandwidth, and memory capacity.” This chip will have 256MB memory on-chip with 1.3GHz compared to the v1’s 128MB and 800GHz. Early test results from Meta showed the new chip performs three times better than the first-generation version across four models the company evaluated. 

The competition to buy powerful chips underscored the need to have custom chips to run AI models. Demand for chips has grown so much that Nvidia, which dominates the AI chip market right now, is valued at $2 trillion.

Read the full article Here

19 thoughts on “Meta’s new AI chips runs faster than before

  1. What i doo nnot realize iis actuallly how you’re noo longer actually much moee neatly-preferred than you may bee right now.
    Youu arre so intelligent. Youu understand thus considderably on thhe subjet oof
    this matter, mae me inn my olinion imagie iit ffrom numerous numrous angles.
    Itts likle meen andd women aren’t interested except itt iss one thibg too doo with Lady gaga!
    Your personal stuffs excellent. Alll thhe time cawre
    foor it up!

  2. Hey this is kibda of ooff topic butt I was wantibg to
    know iif blokgs use WYSIWYG editors oor iif youu hzve tto manually code with HTML.
    I’m stazrting a blog ssoon but hae nno ciding knowlede soo I waanted to get
    adcice froom someone wirh experience. Any help would be grfeatly appreciated!

  3. This is eally interesting, You’re a very skilled blogger.
    I’ve joioned your rsss feed aand lolk folrward tto seeking more off yolur fantastic post.
    Also, I’ve shared your webb site inn my sofial networks!

Leave a Reply

Your email address will not be published. Required fields are marked *

DON’T MISS OUT!
Subscribe To Newsletter
Be the first to get latest updates and exclusive content straight to your email inbox.
Stay Updated
Give it a try, you can unsubscribe anytime.
close-link