Meta’s new AI chips runs faster than before
Meta promises the next generation of its custom AI chips will be more powerful and able to train its ranking models much faster.
The Meta Training and Inference Accelerator (MTIA) is designed to work best with Meta’s ranking and recommendation models. The chips can help make training more efficient and inference — aka the actual reasoning task — easier.
The company said in a blog post that MTIA is a big piece of its long-term plan to build infrastructure around how it uses AI in its services. It wants to design its chips to work with its current technology infrastructure and future advancements in GPUs.
“Meeting our ambitions for our custom silicon means investing not only in compute silicon but also in memory bandwidth, networking, and capacity as well as other next-generation hardware systems,” Meta said in its post.
Meta announced MTIA v1 in May 2023, focusing on providing these chips to data centers. The next-generation MTIA chip will likely also target data centers. MTIA v1 was not expected to be released until 2025, but Meta said both MTIA chips are now in production.
Right now, MTIA mainly trains ranking and recommendation algorithms, but Meta said the goal is to eventually expand the chip’s capabilities to begin training generative AI like its Llama language models.
Meta said the new MTIA chip “is fundamentally focused on providing the right balance of compute, memory bandwidth, and memory capacity.” This chip will have 256MB memory on-chip with 1.3GHz compared to the v1’s 128MB and 800GHz. Early test results from Meta showed the new chip performs three times better than the first-generation version across four models the company evaluated.
The competition to buy powerful chips underscored the need to have custom chips to run AI models. Demand for chips has grown so much that Nvidia, which dominates the AI chip market right now, is valued at $2 trillion.
Read the full article Here
htLWKlQzSnb
aJjUnMDxLmgYpAd
Hey people!!!!!
Good mood and good luck to everyone!!!!!
Svai-Peresvet: как правильно обслуживать винтовые сваи
GK Peresvet: винтовой фундамент цена
Wow, wonderful blog layout! Howw long ave you
been blogging for? youu made bloggikng glance
easy. Thee ull look of your wweb site is great, as wepl as tthe content!
u5gsw5
What i doo nnot realize iis actuallly how you’re noo longer actually much moee neatly-preferred than you may bee right now.
Youu arre so intelligent. Youu understand thus considderably on thhe subjet oof
this matter, mae me inn my olinion imagie iit ffrom numerous numrous angles.
Itts likle meen andd women aren’t interested except itt iss one thibg too doo with Lady gaga!
Your personal stuffs excellent. Alll thhe time cawre
foor it up!
I am actuially thankful to thhe holder off this wbsite who hhas shared this enormous piece
off writing at here.
Grezt blog here! Alsso your wweb site lopads upp vewry fast!
Whhat host are you using? Can I geet your afgfiliate lnk to your host?
I wiosh mmy site liaded uup ass quicly as yoyrs lol
Hey! I just wahted to ask if you eveer hafe any roblems with hackers?
My last blpog (wordpress) waas hacked and I ende uup losing seveeral weeks off
har work due to nno daa backup. Do yyou have anyy methds to stip hackers?
Hola! I’ve been following yyour webwite for a lkng timje now aand inally goot thhe courage tto ggo ahed and gjve you a
shout oout from Kingwood Texas! Jusst wanted to mention keeep upp thhe fanntastic work!
Thanks a bubch ffor sharing this with alll oof uss yyou
really realize wyat you are talkig about! Bookmarked.
Kindly additionaoly sek avice from myy wegsite =). We mmay hhave a link tradfe arrangemnt between us
Hey people!!!!!
Good mood and good luck to everyone!!!!!
k9fy69