Software giant Microsoft has announced its Project Brainwave deep learning acceleration platform for real-time artificial intelligence (AI).With the help of ultra-low latency, the system processes requests as fast as it receives them.<\/p>\n
\u201cReal-time AI is becoming increasingly important as cloud infrastructures process live data streams, whether they be search queries, videos, sensor streams, or interactions with users,\u201d said Doug Burger, an engineer at Microsoft, in a blog post late on Tuesday.<\/p>\n
The \u2018Project Brainwave\u2019 uses the massive field-programmable gate array (FPGA) infrastructure that Microsoft has been deploying over the past few years.<\/p>\n
\u201cBy attaching high-performance FPGAs directly to our datacentre network, we can serve DNNs as hardware microservices, where a DNN can be mapped to a pool of remote FPGAs and called by a server with no software in the loop,\u201d Burger said.<\/p>\n
He added that the system architecture reduces latency, since the CPU does not need to process incoming requests, and allows very high throughput, with the FPGA processing requests as fast as the network can stream them.<\/p>\n
The system has been architected to yield high actual performance across a wide range of complex models, with batch-free execution.<\/p>\n
Microsoft claimed that the system, designed for real-time AI, can handle complex, memory-intensive models such as Long Short Term Memories (LSTM), without using batching to juice throughput.<\/p>\n
\u201cProject Brainwave achieves unprecedented levels of demonstrated real-time AI performance on extremely challenging models. As we tune the system over the next few quarters, we expect significant further performance improvements,\u201d Burger noted.<\/p>\n
Microsoft is also planning to bring the real-time AI system to users in Azure.<\/p>\n
\u201cWith the \u2018Project Brainwave\u2019 system incorporated at scale and available to our customers, Microsoft Azure will have industry-leading capabilities for real-time AI,\u201d Burger noted.<\/p>\n
IANS<\/strong><\/p>\n Picture courtesy: Alamy<\/strong><\/p>\n <\/p>\n <\/p>\n","protected":false},"excerpt":{"rendered":" Software giant Microsoft has announced its Project Brainwave deep learning acceleration platform for real-time artificial intelligence (AI).<\/p>\n","protected":false},"author":7,"featured_media":4659,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[5,49],"tags":[],"_links":{"self":[{"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/posts\/4658"}],"collection":[{"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/comments?post=4658"}],"version-history":[{"count":1,"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/posts\/4658\/revisions"}],"predecessor-version":[{"id":4660,"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/posts\/4658\/revisions\/4660"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/media\/4659"}],"wp:attachment":[{"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/media?parent=4658"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/categories?post=4658"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kt10.khaleejtimes.ae\/index.php\/wp-json\/wp\/v2\/tags?post=4658"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}