Microsoft is putting a major focus on generative AI with its latest announcements at the Build developer conference. The company unveiled its new lineup of Windows machines called Copilot+ PCs, which are AI-first flagship devices. These PCs come with dedicated chips called NPUs to power AI experiences like Recall, a feature that helps users find apps, files, and other content they’ve viewed in the past. The first Copilot+ PCs will feature Qualcomm’s Snapdragon X Elite and Plus chips, offering long battery life and high performance.
In addition to the new hardware, Microsoft is bringing Windows Volumetric Apps to Meta Quest headsets through a partnership with Meta. These apps are spatially aware, interactive VR apps that allow developers to extend their apps into 3D space. Microsoft demonstrated this with a digital exploded 3D view of an Xbox controller that users can manipulate with their hands.
Microsoft is also introducing several AI-powered features exclusive to Copilot+ PCs. Super Resolution can automatically upscale old photos, while Copilot can analyze images to provide users with ideas for creative compositions. Live Captions with live translations can translate any audio passing through a PC into the user’s chosen language. Microsoft Edge will also offer real-time video translation on various sites.
Another significant announcement is the expansion of Microsoft’s Copilot suite of generative AI tech. Team Copilot integrates with Teams, Microsoft’s videoconferencing app, to help manage meeting agendas and take notes. It also extends to Loop and Planner, Microsoft’s collaboration and planning platforms, to create and assign tasks and track deadlines.
Underlying all of these AI-powered features is the Windows Copilot Runtime, a collection of generative AI models that make up a new layer of Windows. This runtime allows AI-powered apps to run without needing an internet connection. Popular video editor CapCut will use the Windows Copilot Runtime to speed up its AI features, and Meta will add Studio Effects to WhatsApp for features like background blur and eye contact during video calls.
Microsoft is also making advancements in AI development tools. Azure AI Studio will soon allow developers to create apps using pay-as-you-go inference APIs, enabling them to access and fine-tune generative AI models hosted on Azure infrastructure. In the Copilot Studio product suite, Microsoft is launching Copilot agents, which are AI bots that can independently orchestrate tasks tailored to specific roles and functions.
Finally, Microsoft announced the Phi-3-vision, an addition to its generative AI model family Phi. This model can perform general visual analysis and reasoning tasks, such as answering questions about charts and images. Microsoft is also partnering with Khan Academy to provide educators in the US with free access to AI-powered tools and explore opportunities to improve AI apps for math tutoring.
Overall, Microsoft’s focus on generative AI across its Windows devices and software demonstrates its commitment to integrating AI into everyday computing experiences. These advancements offer users new capabilities and enhance productivity in various areas, from VR apps to image editing and translation. With partnerships and collaborations, Microsoft is also expanding the reach and impact of its AI technologies.
