The bearable mediocrity of Baidu’s ChatGPT competitor

1 year ago 82

China Report is MIT Technology Review’s newsletter astir exertion developments successful China. Sign up to person it successful your inbox each Tuesday.

Did you enactment up precocious past week to ticker the merchandise of Ernie Bot, the archetypal Chinese rival to ChatGPT? It felt similar the astir anticipated lawsuit successful China’s tech satellite truthful acold this year, but I couldn’t unit myself to enactment awake till 3 a.m., truthful I watched a recorded mentation of the Baidu property league the pursuing morning. 

By that time, the motorboat had been met with an astir overwhelming question of disappointment. Chinese publications with investigating entree ridiculed the chatbot’s performance, societal media users mocked it with memes, and Baidu’s banal dropped by 6.4%. (If you missed the news, don’t worry: I wrote a story summarizing the day’s highlights and letdowns.)

But a funny happening has happened since past week’s launch: Ernie Bot’s estimation seems to person bounced back. Baidu’s banal terms rebounded by 15.7% connected Friday. More Chinese reporters gained entree to the chatbot and published much mean reviews.

“The marketplace rationalized and realized: Even [though] Ernie didn’t wow us, it’s astir apt bully capable for the Chinese market,” says Jennifer Zhu Scott, a Hong Kong–based deep-tech task superior capitalist and laminitis of IN. Capital.

I’ve warmed up to it too. I was beauteous disappointed astatine first, chiefly due to the fact that Baidu lone showed pre-recorded demonstrations of the chatbot astatine the event, which didn’t suggest a batch of assurance successful the technology. But the much I’ve work astir different testers’ interactions with Ernie Bot, the much it seems similar a decent upgrade connected Baidu’s erstwhile models and surely 1 fair-size measurement toward ChatGPT.  

It really performs precise overmuch the mode ChatGPT does: Ernie Bot besides likes to speech successful a weirdly ceremonial code and database answers successful slug points and numbered lists. It has a basal bid of humanities facts, works of literature, and net trends but sometimes gets the details wrong. When asked questions astir harmful accusation oregon politically sensitive topics, it awkwardly shies distant from giving an answer. But it besides has image-making capabilities, dissimilar ChatGPT. On that people it whitethorn not beryllium arsenic blase arsenic Stable Diffusion oregon Midjourney, but it does look overmuch amended than first-generation models similar DALL·E.

Is this a large capable measurement for the Chinese market? 

There’s a fashionable operation successful China’s subject and tech satellite today: 弯道超车, to overtake different car connected a bend. While it’s wide that the US is inactive the satellite person successful subject and innovation, the Chinese authorities and companies often anticipation that with the vantage of a ample market, much accessible data, and nonstop authorities support, they tin rapidly span the exertion spread successful a abbreviated magnitude of clip and adjacent overtake the US. Artificial quality is 1 country the Chinese tech manufacture is targeting, and adjacent the US broadside has go worried astir competition.

But Ernie Bot didn’t overtake ChatGPT. It fails successful galore of the aforesaid areas wherever ChatGPT failed: It excessively makes up facts and makes errors successful people schoolhouse math. The aforesaid questions tin befuddle some bots. (I emotion this example: When you inquire “Can my dada and ma get married?” successful Chinese, some bots archer you that they can’t legally wed due to the fact that they are first-degree relatives.) Ernie performs marginally worse than ChatGPT, making much mistakes and knowing little astir analyzable questions. At the aforesaid time, ChatGPT could beryllium getting amended quickly: past week Open AI unveiled GPT-4, an adjacent much precocious mentation of the ample connection exemplary that tin beryllium utilized to powerfulness the chatbot. 

Rather than becoming a root of nationalist pride, arsenic galore observers had hoped, the merchandise of Ernie Bot confirmed that Chinese companies are inactive trailing down their American peers by rather a distance. It’s a sobering reminder that Chinese AI companies and researchers inactive person a batch to drawback up on, adjacent arsenic they go progressively important successful this space. 

So what’s next? Many of Baidu’s home competitors, similar Alibaba and Tencent, person confirmed that they are moving connected akin products, but there’s nary denotation that they’re close. “I would not stake connected immoderate [other consumer-facing] applications coming retired anytime soon,” says Zhu. Enterprise products, connected the different hand, whitethorn travel sooner.

At the extremity of his presumption connected Thursday, Baidu’s CEO, Robin Li, tried to downplay the taxable of an AI arms contention betwixt the US and China. “Ernie Bot is not a instrumentality for China-US exertion confrontation,” helium said. 

But successful the existent geopolitical climate, it’s inevitable that radical connected some sides volition proceed to usage the Ernie Bot vs. GPT examination arsenic a proxy for the tech spread betwixt China and the US. Baidu conscionable announced that determination volition beryllium different property league connected Monday, erstwhile it’s expected to explicate much astir however different companies tin accommodate Ernie Bot for their ain businesses. And by then, there’s nary uncertainty radical volition comparison it with however GPT-4 is being utilized by Microsoft, Duolingo, oregon Morgan Stanley. 

Are you satisfied with Ernie Bot’s show truthful far? Tell maine your absorption astatine zeyi@technologyreview.com.

Catch up with China

1. TikTok has had a tumultuous week. First, it was reported that its genitor institution ByteDance is considering selling the app if it can’t scope a woody with the US authorities implicit nationalist information questions. (Bloomberg $)

  • But that program could besides beryllium rejected by the Chinese government, China-based lawyers and investors say. (The Information $)
  • It was reported this week that the US Justice Department started investigating ByteDance arsenic aboriginal arsenic precocious 2022 for surveilling American TikTok users, including 2 journalists. (New York Times $)
  • And a radical of Silicon Valley executives, including Peter Thiel, are secretly mobilizing successful Washington against TikTok. (Wall Street Journal $)

2. Chinese researchers uploaded familial samples from Wuhan successful 2020 that amusement links betwixt the coronavirus and raccoon dogs, boosting the likelihood that covid had a earthy origin. But the information was rapidly scraped from the database aft planetary academics reached retired to analyse it further. (New York Times $)

3. President Xi Jinping traveled to Russia to conscionable with Vladimir Putin this week. The economical narration betwixt the 2 countries has weakened successful caller years. (Wall Street Journal $)

4. A twelvemonth aft the China Eastern Airlines clang that killed 132 people, the Chinese authorities inactive doesn’t person a decision astir what went wrong. (Associated Press)

5. Jiang Yanyong, the Chinese doc who exposed the cover-up of the SARS outbreak successful 2003, died astatine the property of 91. (NPR)

6. Someone keeps cutting the undersea cables connecting a Taiwanese archipelago to the internet. Taiwanese authorities blasted accidental harm from Chinese ships. (Vice)

7. Guo Wengui, a arguable Chinese billionaire with adjacent ties to Steve Bannon, was arrested successful New York connected Wednesday for a $1 cardinal fraud scheme. (NBC News)

  • “The New Federal State of China,” an entity Guo and Bannon launched successful 2020, greatly exaggerated its relation successful helping to rescue Ukrainian refugees successful 2022 and utilized it for governmental promotion. (Mother Jones)

Lost successful translation

During the archetypal 2 years of the pandemic, Chinese security companies popularized “covid insurance”—people tin wage a one-time premium of a fewer bucks and get thousands of dollars backmost if they drawback covid. But arsenic writer Yu Meng wrote in the Chinese work Connecting, it tin beryllium highly hard to get that payout. 

Yu bought covid security astatine the opening of 2022 and tested affirmative connected an at-home antigen trial successful December, during a nationalist question of infections aft China loosened its pandemic power measures. The security institution gave her a fig to call, but nary 1 answered. Yu reports determination are astatine slightest 60,000 much radical who filed a assertion with the aforesaid company. Some called dozens of times a day, and immoderate sued the company. Some filed complaints with China’s security regulator. But precise fewer radical really got paid successful the end. 

At 1 constituent erstwhile she yet managed to scope the company, a lawsuit typical told Yu: “Do you cognize however galore claims we have? You deliberation the radical supra maine haven’t calculated the costs? Of course, they did. It tin scope billions and volition origin the institution to spell bankrupt. Do you deliberation the authorities volition let a state-owned institution to spell bankrupt? Can you ideate that?” In the end, Yu, who had expected to get 20,000 RMB ($2,900), accepted 5000 RMB. Her parents, who bought the aforesaid insurance, gave up connected getting immoderate wealth back.

One much thing

Even kids can’t flight the AI craze now. Recently, the section authorities successful China’s eastbound state Zhejiang announced it would incorporated much artificial-intelligence acquisition into the people schoolhouse and mediate schoolhouse curricula. How aggravated the lessons volition beryllium is inactive unclear, but I’m wondering: volition we travel afloat ellipse and spot Chinese kids utilizing Ernie Bot to bash their homework connected Ernie Bot?

Read Entire Article