Microsoft is gearing up to announce the integration of ChatGPT, the already famous AI-powered chatbot, into its Office productivity suite of apps, media reports.
This is according to a report on The Information (opens in new tab)the company was supposed to unveil the upgrade on Thursday, but it faces a major challenge: the lack of the proper hardware needed to run the tool at scale.
Citing some of the company’s employees, the publication said Microsoft is “facing an internal shortage of server hardware needed to run the AI”.
To keep up with demand, especially as it opened the floodgates for the new ChatGPT-powered Bing search engine, the company decided to ration access to the hardware for some Microsoft teams building other artificial intelligence tools.
A lack of GPU power could also mean that small and medium-sized businesses looking to jump on the AI bandwagon with Microsoft may find themselves crippled, as Microsoft will likely prioritize business users and the public sector.
It’s quite a conundrum that won’t be easily solved, especially considering that Microsoft should now be on the hunt for H100 and the A100, which aren’t your run-of-the-mill GPUs.
According to media reports, Office is supposed to be powered by GPT-4, the latest iteration of OpenAI’s chatbot, and one that’s a significant upgrade over previous versions. It seems that Bing has been running on GPT-4 for a while, without anyone knowing about the change.
Microsoft is holding an event on March 16 to outline its plan to add the chatbot to its Office productivity suite. The company should explain how adding GPT-4 to Teams, Word or Outlook can help people be more productive and spend less time on repetitive and menial tasks.
ChatGPT was first introduced late last year and gained worldwide fame almost overnight. It is one of the best AI-powered chatbots out there right now, capable of writing entire stories, engaging in lengthy discussions, and even writing malicious code and emails.