Microsoft’s Bing AI chatbot has received notable updates, improving its response time and expanding its sports-related knowledge base, according to the latest weekly update from the company.
The chatbot now demonstrates reduced latency spikes, resulting in faster responses for certain queries. This improvement is attributed to a complete overhaul of the chatbot’s backend, optimizing its thinking process and reducing the waiting time for users.
Additionally, the Bing AI chatbot now exhibits better handling of sports-related queries, offering a broader range of topics in the sports field, including coverage of events like the NHL and the FIFA Women’s World Cup.
Fun fact: internally, we are most excited about something majority of people find boring. Yesterday we released a completely reworked backend for inner monologue, reducing time to first token by ~25%, and, far more importantly, making latency more stable, reducing spikes: pic.twitter.com/E0zBZ3lHyY
— Mikhail Parakhin (@MParakhin) June 29, 2023
Another significant enhancement is the integration of Bing Image Creator in Skype conversations. This feature allows users to generate images directly within Skype while interacting with the Bing AI chatbot.
The responsiveness of the Bing AI chatbot is crucial for a satisfying user experience. Microsoft recognizes the importance of minimizing waiting times for responses, ensuring that users receive prompt and accurate information. While backend improvements contribute to faster replies, it’s worth noting that spikes in usage can still impact response times during peak hours.
Mikhail Parakhin, Microsoft’s head of Advertising and Web Services, further explained on Twitter that usage peaks occur during specific times when people arrive at work, namely when the US East coast, Europe, and the Far East begin their workdays, corresponding to 7 am, 5 pm, and 1 am PDT, respectively.
Microsoft’s continuous refinement of the Bing AI chatbot’s responsiveness showcases the company’s commitment to delivering efficient and useful conversational experiences to its users.
