Microsoft announces independently designed AI specialized chip 'Maia 100' and Arm processor 'Cobalt 100'



Microsoft announced its uniquely designed AI-specific chip `` Maia 100 '' and Arm architecture CPU `` Cobalt 100 '' on Wednesday, November 15, 2023. Both chips will be deployed to Microsoft data centers in 2024 and will be used to enhance the functionality of Microsoft Copilot and Azure OpenAI Service.

With a systems approach to chips, Microsoft aims to tailor everything 'from silicon to service' to meet AI demand - Source

https://news.microsoft.com/source/features/ai/in-house-chips-silicon-to-service-to-meet-ai-demand/

Maia 100 is an AI-specific chip designed to operate on Microsoft's cloud computing service 'Azure', and its design is optimized for 'the hardware that makes up Azure' to improve performance and efficiency. It is said that the maximum has been achieved. In addition, Maia 100 has received feedback from OpenAI, an AI development company known for developing ChatGPT, and its high performance in applications such as large-scale language models has been highlighted.



According to Microsoft, in order to operate AI-specific chips efficiently, a ``server rack with sufficient space for power cables and network cables'' is required. Since there were no server racks on the market that met the requirements of Maia 100, Microsoft ended up designing its own server rack.



In addition, the Maia 100 consumes a lot of power and cannot achieve sufficient performance with an air cooling system, so a liquid cooling system is used. In Maia 100, a cube-shaped part is installed at the top of the chip as shown in the photo below, and the chip is cooled by cold liquid flowing into the cube.



Cobalt 100 is an Arm architecture CPU designed to deliver high performance and efficiency in cloud-native products. Cobalt 100 also optimizes power efficiency, and it is said that deploying Cobalt 100 in Azure data centers will bring significant benefits to Microsoft.



In addition, Microsoft is already working on the development of the second generation Maia series and Cobalt series.

in Hardware, Posted by log1o_hf