Welcome to the Cloud Wars Minute — your daily news and commentary show, hosted by Cloud Wars Founder, Bob Evans. John Seifert fills in today to provide insights and perspectives around the “reimagination machine” that is the Cloud! Today’s topic: Microsoft and the Introduction of AI Singularity.
0:15 – Microsoft came out with a new paper regarding AI Singularity, which is known as a point in time in which technological growth becomes uncontrollable and irreversible, resulting in unforeseeable changes to human civilization.
0:54 – This paper shows that we are much closer to AI Singularity than we thought we were. Microsoft presents Singularity, the globally distributed scheduling service for highly efficient and reliable execution of deep learning training and inference workloads.
1:37 – The heart of Singularity is a novel workload aware scheduler that can transparently, preempt an elastically scale deep learning workloads to drive high utilization without impacting their correctness or performance across a global fleet of AI accelerators.
2:06 – Singularity is a full managed, globally distributed infrastructure service for AI workloads at Microsoft. This will provide support for diverse hardware accelerators. Singularity is designed from the ground up to scale across the global feed of hundreds of thousands of GPUs and other AI accelerators. It is built with one key goal: driving down the cost of AI.