Windows is the Most Open Platform for AI: A Preliminary Report on Build 2018 at Build ’99 by B. F. Davuluri

All of these improvements inside Windows for developers are the very early building blocks for more AI-powered apps on top of its new Arm-powered systems and the NPUs coming from AMD and Intel soon. While Microsoft is building the platform for developers to create AI apps for Windows, it’s now banking on this being an important part of the next decade of Windows development. Onstage at Build today, Davuluri stood in front of a slide that read “Windows is the most open platform for AI,” signaling just how important this moment is for Microsoft.

The developers will be able to improve Windows’ new recall feature by adding contextual information to their apps that are fed into the database. “This integration helps users pick up where they left off in your app, improving app engagement and users’ seamless flow between Windows and your app,” says Davuluri.

Microsoft says Copilot AI agents can soon be used as something like virtual employees that businesses can use for menial tasks like monitoring emails, carrying out a series of automated tasks, helping with employee onboarding, or doing data entry, all without being prompted to do so. The Copilot abilities will not replace boring jobs according to the company. (Isn’t “data entry” a whole job description for some people?) Copilot studio will have a new capability later this year.

Windows Copilot Library will allow developers to integrate things like studio effects and filters into their apps. Meta is adding the Windows Studio Effects into WhatsApp, so you’ll get features like background blur and eye contact during video calls. Even Live Captions and the new AI-powered translation feature can be used by developers with little to no code.

Microsoft’s Advanced Paste feature for Windows 11, and it’s integrating Git with File Explorer for the development of Recall AI and other useful features

Microsoft demonstrated its Recall AI feature yesterday, allowing Copilot Plus PCs to document and store everything that you do on your PC so you can recall memories and search through a timeline. This is all powered by a new Windows Semantic Index that stores this data locally, and Microsoft plans to allow developers to build something similar.

This capability will be made available for developers to use in their applications and with their app data.

Microsoft’s new Advanced Paste feature is available now as part of the PowerToys suite for Windows 11, giving you the ability to convert the contents of your clipboard as you go. You’ll be able to trigger the Advanced Paste menu by pressing Windows Key + Shift + V and, from there, convert your paste to formats like plaintext, markdown, or JSON, using further keyboard shortcuts. You can also convert by typing into the prompt box, which has other capabilities like altering or summarizing the text before you paste it. You need an OpenAI key and credits in your account to use the program.

You’ll be able to use Microsoft’s File Explorer to keep track of your coding projects soon, as the company is integrating Git into the file system browser. The company says developers will be able to keep track of file status, commit messages, and their current branch from within File Explorer. Also, the app now supports 7-zip and TAR compression natively.

Real-Time Video Translation Powered by Artificial Intelligence (VII): A Windows-based AI development kit for mobile devices and a Phi-3 family of models

A version of the $899) Snapdragon development kit for Windows has a chip that is more powerful than the Mac Mini. It also has several ports, but it is not clear if anyone can buy it.

Microsoft Teams will soon include a feature that allows you to add your own symbols, like parrots and cutout teammates. Like in Slack, admins can limit who is allowed to add emojis, and they won’t be visible outside of your organization’s domain. They’re coming in July.

Microsoft’s Edge browser is getting an AI-powered real-time video translation feature that can dub videos from sites like YouTube, LinkedIn, Reuters, and Coursera. The feature works with a number of languages and can offer translation from Spanish to English or vice versa. Microsoft says the feature is “coming soon” and that more languages and video platforms will be added in the future.

In April the company introduced a new version of the AI model. It’s multimodal and can read text and look at pictures, but it’s a small language model that’s compact enough to work on a mobile device. Image analysis is one of the big use cases that AI companies have been pushing, and smartphones are about as ideal a place to use them as anywhere. Phi-3-vision is part of Microsoft’s Phi-3 family of models that the company announced in April and is available in preview now.