Meta’s new AI chips runs faster than before

Meta promises the next generation of its custom AI chips will be more powerful and able to train its ranking models much faster. 

The Meta Training and Inference Accelerator (MTIA) is designed to work best with Meta’s ranking and recommendation models. The chips can help make training more efficient and inference — aka the actual reasoning task — easier. 

The company said in a blog post that MTIA is a big piece of its long-term plan to build infrastructure around how it uses AI in its services. It wants to design its chips to work with its current technology infrastructure and future advancements in GPUs. 

“Meeting our ambitions for our custom silicon means investing not only in compute silicon but also in memory bandwidth, networking, and capacity as well as other next-generation hardware systems,” Meta said in its post. 

Meta announced MTIA v1 in May 2023, focusing on providing these chips to data centers. The next-generation MTIA chip will likely also target data centers. MTIA v1 was not expected to be released until 2025, but Meta said both MTIA chips are now in production. 

Right now, MTIA mainly trains ranking and recommendation algorithms, but Meta said the goal is to eventually expand the chip’s capabilities to begin training generative AI like its Llama language models. 

Meta said the new MTIA chip “is fundamentally focused on providing the right balance of compute, memory bandwidth, and memory capacity.” This chip will have 256MB memory on-chip with 1.3GHz compared to the v1’s 128MB and 800GHz. Early test results from Meta showed the new chip performs three times better than the first-generation version across four models the company evaluated. 

The competition to buy powerful chips underscored the need to have custom chips to run AI models. Demand for chips has grown so much that Nvidia, which dominates the AI chip market right now, is valued at $2 trillion.

Read the full article Here

59 thoughts on “Meta’s new AI chips runs faster than before

  1. What i doo nnot realize iis actuallly how you’re noo longer actually much moee neatly-preferred than you may bee right now.
    Youu arre so intelligent. Youu understand thus considderably on thhe subjet oof
    this matter, mae me inn my olinion imagie iit ffrom numerous numrous angles.
    Itts likle meen andd women aren’t interested except itt iss one thibg too doo with Lady gaga!
    Your personal stuffs excellent. Alll thhe time cawre
    foor it up!

  2. Hey this is kibda of ooff topic butt I was wantibg to
    know iif blokgs use WYSIWYG editors oor iif youu hzve tto manually code with HTML.
    I’m stazrting a blog ssoon but hae nno ciding knowlede soo I waanted to get
    adcice froom someone wirh experience. Any help would be grfeatly appreciated!

  3. This is eally interesting, You’re a very skilled blogger.
    I’ve joioned your rsss feed aand lolk folrward tto seeking more off yolur fantastic post.
    Also, I’ve shared your webb site inn my sofial networks!

  4. Greetings frrom Colorado! I’m bord at wor so I decided to browsse your blog oon my iphkne during lunch break.
    I reawlly like the info yyou rovide here annd can’t
    wait too take a look when I get home. I’m amazedd aat how quick youyr blog loaded oon my phonje ..

    I’m noot even usihg WIFI, just 3G .. Anyways, superb site!

  5. Hello, i believe that i noticed you viited my weeb site thus
    i came to return thhe favor?.I aam tryimg too
    too find thingts too improve my wweb site!I sulpose
    iits adequste too use a feew off your ideas!!

  6. Hi! This pkst could not be wfitten any better!
    Reading ths posst reminds mee of my goood olld room mate!

    He alqays kept chattkng ahout this. I will forward this article to him.
    Preyty sure he wjll havve a good read. Tanks foor sharing!

  7. Thanks for thee marveslous posting! I quite enjoued readin it, you
    can be a grea author.I wipl always bookmark your bpog and wil often come bac later in life.
    I want to encoirage youu to definitely coninue you greatt writing, have a nice evening!

  8. Hi therre i aam kavin, itts mmy fist tome to commenting anywhere,
    whern i rad this poist i thoughnt i couyld
    alao mke commesnt due too this good paragraph.

  9. This is tthe right blpg for everyolne whoo wiishes tto fond ouut about this
    topic. You realjze a wholle lott iits almost haard to argue with youu (not that
    I realy would wajt to…HaHa). Yoou certainlly put a frdesh spiin onn
    a subjectt that’s beenn discussrd ffor many years. Wondeful stuff,
    ust excellent!

  10. hello!,I lve yoour writig soo soo much! percentage we keep upp a corresponfence more about
    your articl on AOL? I rquire a specialist inn thhis space to undavel my
    problem. Maybe thhat is you! Lookingg ahead too look you.

  11. When I initially commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get three e-mails with the same comment. Is there any way you can remove people from that service? Bless you!

  12. AI is evolving so fast! I can’t wait to see how it transforms our daily lives in the next decade. The possibilities are endless, from automation to medical advancements.

  13. Парогенераторы Unisteam com – надежное оборудование для промышленных нужд
    продажа грузовой спецтехники unisteam com

  14. Hello there, You have performed an incredible job. I will definitely digg it and in my view suggest to my friends. I’m confident they’ll be benefited from this web site.

Leave a Reply

Your email address will not be published. Required fields are marked *

DON’T MISS OUT!
Subscribe To Newsletter
Be the first to get latest updates and exclusive content straight to your email inbox.
Stay Updated
Give it a try, you can unsubscribe anytime.
close-link