Meta CEO Mark Zuckerberg announced that he aims to develop and open source artificial general intelligence (AGI), and is also building a computing infrastructure including 350,000 H100s
View this post on Instagram
Meta's new goal is to build artificial general intelligence - The Verge
https://www.theverge.com/2024/1/18/24042354/mark-zuckerberg-meta-agi-reorg-interview
Zuckerberg's AGI remarks follow trend of downplaying AI dangers | Ars Technica
https://arstechnica.com/information-technology/2024/01/zuckerberg-says-meta-is-working-on-open-source-general-intelligence-for-ai/
AGI is an AI that can perform all intellectual tasks that humans can perform, and AI development companies such as OpenAI and Google have set the goal of developing AGI. Zuckerberg, CEO of Meta, also posted on Instagram and Threads that Meta's long-term goal is to build AGI, responsibly open source it, and benefit everyone in every aspect of their daily lives. I made a new point that we should do this. Zuckerberg said, ``It's become clear that the next generation of services requires building a complete AGI, including the best AI assistants, AI for creators, and AI for enterprises; It means progress.”
Meta is also training Llama 3, the next generation of large-scale language models, and is building a large-scale compute infrastructure, including 350,000 H100s, by the end of 2024 to support its future roadmap. It is said that they are doing so. Including the other GPUs owned by Meta, Mr. Zuckerberg claims that it is possible to calculate the equivalent of about 600,000 H100s in total.
Furthermore, Zuckerberg argued that people will eventually interact with AI frequently throughout the day, and new devices will be needed to connect AI and the metaverse. The ideal device for this purpose is a glass-shaped device, and although Meta's AI-powered smart glasses ' Ray-Ban Meta ' have gotten off to a very strong start, he said that it is only the beginning.
In an interview with overseas media The Verge, Zuckerberg said, ``Meta came to the idea that we needed to create AGI in order to create the products we wanted.Many talented researchers are more ambitious. I think it's important to communicate this because people want to address serious issues.'
Mr. Zuckerberg's remarks come as competition for talent in the AI field is becoming more intense than ever. AI development companies sometimes offer compensation packages exceeding $1 million a year (approximately 150 million yen) in order to hire the few outstanding engineers, and it is common for companies to poach and poach talent from other companies. is.
After human resources, the second most scarce resource in the AI field is the computational infrastructure required to train large-scale models. Meta has purchased 150,000 H100 units in 2023, which is an outstanding amount even in an industry comparable to Microsoft, and it plans to purchase even more H100s in the future to build its computing infrastructure. thing.
Because of AGI's high performance, the question of ``Who will ultimately control AGI?'' has been raised as an issue, and the controversy surrounding the ouster of OpenAI CEO Sam Altman, which has caused a stir in the industry in recent years, has raised concerns. was highlighted. In response, Meta has indicated a policy of releasing AGI as open source, similar to large-scale language models such as Llama 2.
Zuckerberg didn't mention OpenAI by name, but said, ``There used to be companies that were open and were publishing all their work and talking about how to open source it.'' 'I think I understand the dynamic where people think, 'Oh, it's going to turn into something, so let's not share it,'' he said, contrasting Meta and OpenAI.
CEO Zuckerberg said, ``I think one of the big challenges here is that when you create something truly valuable, it becomes concentrated in one point. If we can make this more open, we can open up opportunities and value.'' 'That's a big part of the open source vision.'
But Meta's policy of open sourcing the AI it develops isn't just in the public interest, it may also make sense as a business strategy.
Meta's platform already has more users and a highly profitable social media business than most companies on the planet, and its AI capabilities will help it strongly attract users to the platform. Also, if Meta's open sourcing of its models standardizes AI development and blurs the differences between companies, Meta's already huge ecosystem will become even more influential, according to The Verge. pointed out.
◆Forum now open
A forum related to this article has been set up on the GIGAZINE official Discord server . Anyone can write freely, so please feel free to comment! If you do not have a Discord account, please create one by referring to the article explaining how to create an account!
• Discord | 'Which company or research institution do you think will be the first to realize AGI (artificial general intelligence)?' | GIGAZINE
https://discord.com/channels/1037961069903216680/1197839937702199367
