Microsoft Copilot Can Now Browse the Web - AI Updates

Microsoft Enhances Copilot with New Capabilities

To commemorate its 50th anniversary, Microsoft is expanding the functionality of its Copilot AI chatbot with several new features.

Copilot now possesses the ability to execute actions across “most websites,” according to Microsoft, allowing users to accomplish tasks such as booking travel arrangements and making restaurant reservations. The chatbot has also been updated to retain specific user information, mirroring the functionality found in OpenAI’s ChatGPT, including preferences for food and movies.

Expanded Functionality and Potential Revamp

These improvements arrive as Microsoft is reportedly considering a significant overhaul of Copilot. Currently powered by AI models from OpenAI, the company aims to integrate more of its own internally developed technology. Copilot has, at times, been perceived as trailing competitors like ChatGPT and Google’s Gemini in terms of feature releases.

Beginning Friday, Copilot can perform web-based tasks in a manner similar to agentic tools such as OpenAI’s Operator. Microsoft has established partnerships with 1-800-Flowers.com, Booking.com, Expedia, Kayak, OpenTable, Priceline, Tripadvisor, Skyscanner, Viator, and Vrbo to ensure compatibility from launch.

Deal Tracking and Price Monitoring

Inspired by search engine Perplexity, Copilot can now monitor online deals for desired products. Users can request the bot to track price reductions and sales, receiving notifications and direct links to purchase when applicable.

The actual performance of Copilot in completing these tasks remains to be fully evaluated. Microsoft has provided limited details regarding the underlying mechanisms and has not released data outlining potential limitations or scenarios requiring human intervention.

Websites retain the ability to block Copilot, similar to their capacity to block OpenAI’s Operator. Companies may choose to do so if they anticipate a decrease in direct app traffic impacting advertising revenue.

New Features: Podcasts, Visual Analysis, and Deep Research

Beyond task execution, Copilot introduces several new features that are less complex. The chatbot can now generate “podcasts” resembling Google’s NotebookLM Audio Overviews.

Given a source like a website or study, Copilot will create a conversational exchange between two AI-generated hosts. Users can interrupt the discussion to pose questions, which the hosts will acknowledge and address.

On both Android and iOS, Copilot can analyze images from your camera or photo gallery, providing answers to questions about their content. On Windows, the updated Copilot app can access your desktop screen to facilitate searches, adjust settings, and organize files, initially available to Windows Insider program members next week.

It is hoped that adequate security measures are in place to prevent unauthorized access to private files or system-altering errors. However, detailed information regarding these safeguards was not readily available.

Pages, Deep Research, and Personalized Experiences

Copilot also features a new Pages function, designed to consolidate projects, drawing inspiration from ChatGPT Canvas and Anthropic’s Claude Artifacts. Pages provides a canvas for organizing notes and research, which Copilot can then assist in transforming into a cohesive document.

Complementing Pages, the Deep Research feature locates, analyzes, and synthesizes information from various sources – online content, documents, and images – to address complex inquiries, similar to ChatGPT and Gemini’s research capabilities.

Finally, Copilot can now retain more information about individual users. Microsoft states that the bot will learn user preferences through interaction, offering personalized solutions, proactive suggestions, and reminders.

User Control and Data Privacy

Users concerned about data privacy can delete individual “memories” or opt out of this feature entirely. Microsoft emphasizes user control over data retention through a dedicated dashboard.

“Copilot [gives] you control through the user dashboard and the option to choose which types of information it remembers about you or to opt out entirely,” Microsoft stated in a blog post. “You remain in control.”