Baidu Inc (NASDAQ:BIDU), a Chinese tech giant, said on Tuesday that its chatbot AI model, called Ernie Bot, has surpassed ChatGPT, a popular conversational AI model developed by OpenAI, in terms of naturalness and coherence.
Ernie Bot is based on Baidu’s Ernie pre-trained language model, which was first released in 2019 and has been updated several times since then. Ernie Bot can generate natural and fluent responses to user queries on various topics, such as weather, sports, entertainment, and health.
Baidu said it conducted a human evaluation study to compare Ernie Bot with ChatGPT on three metrics: naturalness, coherence, and informativeness. The results showed that Ernie Bot scored higher than ChatGPT on all three metrics, with an average score of 4.23 out of 5, compared to ChatGPT’s 3.68.
Baidu also said that Ernie Bot has been deployed in several of its products and services, such as Baidu Brain, Baidu Encyclopedia, Baidu Search, and Baidu Smart Mini Program. Baidu said it plans to continue improving Ernie Bot’s performance and expanding its applications in the future.