Microsoft released "Project Brainwave" platform for deep learning that realizes "real-time AI"

Microsoft will hold a symposium on high-performance chipsHot Chips"As a system for realizing" real-time AI "Project BrainwaveWe announced.

Microsoft unveils Project Brainwave for real-time AI - Microsoft Research
https://www.microsoft.com/en-us/research/blog/microsoft-unveils-project-brainwave/


Intel Delivers 'Real-Time AI' in Microsoft's New Accelerated Deep Learning Platform | Intel Newsroom
https://newsroom.intel.com/news/intel-delivers-real-time-ai-microsofts-accelerated-deep-learning-platform/

Microsoft announces Project Brainwave for real-time artificial intelligence
https://www.neowin.net/news/microsoft-announces-project-brainwave-for-real-time-artificial-intelligence

Microsoft utilizes the FPGA infrastructure that has been deployed over the years to build the platform of Project Brainwave. FPGA stands for "Field-Programmable Gate Array", it means an integrated circuit that can be reprogrammed. In Microsoft, high-performance FPGA was directly connected to the data center, eliminating "request processing by CPU", and realizing high throughput.

Also equipped with a software DNN processing unit (DPU) integrated with FPGA. Normally, the DPU lacks flexibility because it selects operators and data types at design time, but Project Brainwave designed it to be able to select the required data type, and said that flexibility is given.

The embedded software stack supports a general deep learning framework. We have dealt with "Microsoft Cognitive Toolkit" and Google's "Tensorflow", and plan to respond to other things in the future.

Intel'sStratix 10With the demo that executed the request in less than 1 millisecond, we recorded 39.5 TFLOPS performance. By issuing a macro command once in 10 cycles, it is possible to maintain more than 130,000 operations per cycle.

Microsoft says it will improve the system over the next few quarters and aim for better performance.