Microsoft Copilot for Windows 11 Gets GPT-4 Turbo and Dall-E 3

Copilot, the AI assistant baked into Windows 11, is getting some enhancements for more robust text and image generation, Microsoft said in a press release on Tuesday.

GPT-4 Turbo, the latest AI model by OpenAI, creators of ChatGPT, will be coming to Windows 11 in the coming weeks. Along with GPT-4 Turbo, Dall-E 3, a text-to-image generator also made by OpenAI, will be making its way to Microsoft’s operating system. Both of these new models will allow for smarter and more robust text and image generation with fewer errors.

Microsoft’s deep dive into AI comes after it upped its investment into OpenAI earlier this year. Last year, OpenAI grabbed headlines by releasing ChatGPT, an AI chatbot that could answer seemingly any question with a novel answer. With Microsoft’s investment into OpenAI, ChatGPT made its way to Bing, giving some heated competition to Google. Google was also quick to release its own AI chatbot, named Bard, and is currently experimenting with AI-generated answers in Google Search. Microsoft wasn’t satisfied with bringing AI to Bing, so it also integrated generative tech into Windows 11 via a tool called Copilot. It’s an AI assistant that can help you summarize documents or write emails, among many other things. Given how quickly AI is permeating tech, tech companies are planting their flags early as generative AI is estimated to bring in $4.4 trillion annually.

While OpenAI has attracted plenty of attention for its AI tech, it has also grabbed headlines for its corporate upheavals. OpenAI’s nonprofit board recently fired its CEO Sam Altman, only to rehire him days later after an internal revolt by employees. Microsoft quickly swooped in to hire Altman and offered to hire other engineers from OpenAI that were threatening to leave the company. This potential mass exodus put OpenAI in a precarious position, and the nonprofit board, which says it priorities human interest over profit interest, found itself in a bizarre quagmire: either maintain its ethical position or lose key talent to a multi-trillion dollar conglomerate. OpenAI’s board was reportedly concerned about the speed in which Altman was pushing AI tech without enough consideration for its potential downsides. 

Bing is also getting some search enhancements. Soon, Bing will be able to do “Deep Search.” This uses GPT-4 to “deliver optimized search results for complex topics.” First, Bing will help you figure out the deeper intent on your queries, interpreting your simple questions and figuring out if you need more in-depth information. Once that’s been established, then Bing will give you a comprehensive answer. Microsoft says Deep Search can rank websites better, filtering through information to sort based on usefulness and trustworthiness. Because Deep Search is, well, deep, Microsoft says it can take up to 30 seconds for it to load a complete result. So it’s best used for more complex queries. 

Multi-modal with Search Grounding is a more enhanced version of image search. You can feed an image into Bing and it’ll be able to understand the image and give you answers about it. 

And to the distress of teachers, Microsoft Edge users will also be able to rewrite text copied from websites via Copilot. 

For those that aren’t on windows 11, Microsoft also has a web version of Copilot that can be accessed from any device. 

Editors’ note: CNET is using an AI engine to help create some stories. For more, see this post.