All about the new artificial intelligence Microsoft 365 Copilot

At the beginning of the year, Microsoft announced a collaboration with OpenAI, the creator of ChatGPT. A fruitful collaboration enabled them to rapidly integrate Copilot's generative artificial intelligence (AI) into Microsoft 365, its suite of business productivity and collaboration applications. This innovation combines Word, Outlook, Teams, Excel, PowerPoint and many other applications with artificial intelligence that can automate routine tasks and generate content, potentially saving users time and improving their productivity.

Copilot wants to simplify work processes - such as writing electronic messages and creating slideshows - by automating tasks. When announcing the tool, Microsoft CEO Satya Nadella described it as "a key advance in the evolution of our interface with computing systems... By introducing work copilot, we expanded the possibilities for users to work and enable or easier access to technology through the most widespread interface – natural language."

With Microsoft 365 Copilot, Microsoft wants to create a "more useful, functional assistant" for work, said JP Gownder, vice president and principal analyst for Forrester's Future of Work team. "The concept is that you are the 'pilot', but the co-pilot is there to take over the tasks, which can make life a lot easier."

Nadella recently commented on the effectiveness of M365 Copilot, claiming that customers have seen an increase in productivity compared to GitHub Copilot (about 50 %), an AI assistant for developers that was introduced two years ago.

What is Microsoft 365 Copilot?

The Microsoft 365 Copilot system consists of three elements:

• Microsoft 365 applications such as Word, Excel and Teams, where users interact with an AI assistant,
• Microsoft Graph, which includes files, documents and data in the Microsoft 365 environment,
• OpenAI language models that process user prompts: OpenAI's ChatGPT-3, ChatGPT-4, DALL-E, Codex, and Embeddings.

All these models are hosted in Microsoft's Azure cloud environment.

Copilot is only part of Microsoft's general plan for generative artificial intelligence. There are plans for Copilot tailored to Microsoft's Dynamics 365 business applications, PowerPlatform, the enterprise security suite and the Windows operating system. A few years ago, Microsoft's subsidiary GitHub also developed GitHub Copilot with OpenAI, which basically provided a tool for auto-completion for coders.

A key component of Copilot, as with other generative AI tools, is Large Language Models (LLM). These language models are best thought of as a machine learning network that is trained over sets of input/output data. The model uses the methodology of self-supervised or partially supervised learning. Basically, the data is ingested and the LLM outputs a response based on what the algorithm predicts will be the next word. The data in LLM can be limited to the company's proprietary data or, as in the case of ChatGPT, it can include any data transmitted directly from the web.

To help companies implement generative AI tools into their data, Microsoft has created a semantic index for Copilot, a "refined map of your personal and business data" and a "prerequisite" for adopting Copilot in your organization. .

Using the index should provide more accurate searches of enterprise data, Microsoft said. For example: when a user requests “view last quarter earnings,” the semantic index will not only search for documents that include those specific terms, but will also consider additional context, such as which employees typically produces such reports.

Who else can use Copilot AI?

Starting November 1, Microsoft 365 Copilot is available for business customers with E3 and E5 subscriptions and a minimum investment of 300 licenses, and will be released later for M365 Business Standard and Business Premium customers. Its use costs US$30 per user per month, although it is likely that more customers will be able to negotiate a discount.

How does Microsoft 365 Copilot work and what is it used for?

Users can take advantage of Copilot in two main ways. Access to the Microsoft assistant is enabled directly within the individual application €“ such as creating slideshows in PowerPoint or drafting an email in Outlook. Copilot is also available as a Microsoft 365 Chat chatbot within Microsoft Teams, where it responds to prompts in natural language.

The method of interaction may depend on the application used. In Word, for example, Copilot will suggest improvements to the text, provide suggestions for the first draft, mark errors, and the like.

Users can ask Copilot to generate a draft in natural language based on specific information sources or a combination of sources. This may include creating a business proposal using notes from OneNote and product plans from another Word document. Once the draft is ready, it is possible to edit the text, adjust the style, or even order the AI tool to completely transform the document. Copilot's sidebar serves as a place for further interaction and suggestions for improvements, including adding images.

During a Teams video call, Copilot can summarize the discussion so far, allowing participants to get a quick overview of the topic being discussed. Users can also request from Copilot an insight into the opinions of participants or unanswered questions. If someone is unable to attend the meeting, they can send an AI assistant there to provide a summary of the missed and important meeting points.

In PowerPoint, Copilot can automatically convert a Word document into draft slides that can then be customized using natural language in the Copilot sidebar. It is also able to generate speaker note templates to complement the slides and allow the inclusion of additional images.

An alternative way of interaction is possible. through Microsoft 365 Chat, which works as a chatbot within Teams. There, the chatbot can serve as a search tool that combines information from a variety of sources, such as documents, calendars, e-mails and chats. For example, an employee can request an update on project information and receive a summary of relevant group communications and documents with links to original resources.

Microsoft also plans to extend Copilot to additional applications through "plugins," meaning integration with third-party software such as Atlassian, ServiceNow, and Mural. There are currently fifty such plugins available, and we can expect their number to increase to "thousands", Microsoft announced.

What are the challenges of using the new artificial intelligence Copilot?

Tools like M365 Copilot offer significant benefits, but there are risks that users and businesses should be aware of. One major concern is the propensity of large language models to “hallucinate” or produce false information.

To reduce hallucinations, users should provide more detailed prompts and always exercise caution with AI-provided responses. Microsoft warns that human review and fact-checking are indispensable.

Another risk is Copilot's ability to search a company's Microsoft 365 environment. You can find access files based on user permissions, but if sensitive documents are not properly tagged or secured, employees could inadvertently access confidential information such as payroll or customer information. The challenge is even greater with messy data, where sensitive information can be spread across various documents created by employees. Additionally, there is the issue of employees storing personal files on work devices – and those personal files could become accessible through tools like Copilot.

Data management is essential, and getting it right is a time-consuming process that involves establishing appropriate permissions across the organization. Many Microsoft 365 users have not yet adequately addressed these risks. When the aforementioned tools become more widespread, the efficiency of companies' data management will soon be put to the test.