Technologies

Google’s AI Overviews Explain Made-Up Idioms With Confident Nonsense

The latest meme around generative AI’s hallucinations proves you can’t lick a badger twice.

Language can seem almost infinitely complex, with inside jokes and idioms sometimes having meaning for just a small group of people and appearing meaningless to the rest of us. Thanks to generative AI, even the meaningless found meaning this week as the internet blew up like a brook trout over the ability of Google search’s AI Overviews to define phrases never before uttered.

What, you’ve never heard the phrase «blew up like a brook trout»? Sure, I just made it up, but Google’s AI overviews result told me it’s a «colloquial way of saying something exploded or became a sensation quickly,» likely referring to the eye-catching colors and markings of the fish. No, it doesn’t make sense.

The trend may have started on Threads, where the author and screenwriter Meaghan Wilson Anastasios shared what happened when she searched «peanut butter platform heels.» Google returned a result referencing a (not real) scientific experiment in which peanut butter was used to demonstrate the creation of diamonds under high pressure.

It moved to other social media sites, like Bluesky, where people shared Google’s interpretations of phrases like «you can’t lick a badger twice.» The game: Search for a novel, nonsensical phrase with «meaning» at the end.

Things rolled on from there.

This meme is interesting for more reasons than comic relief. It shows how large language models might strain to provide an answer that sounds correct, not one that is correct.

«They are designed to generate fluent, plausible-sounding responses, even when the input is completely nonsensical,» said Yafang Li, assistant professor at the Fogelman College of Business and Economics at the University of Memphis. «They are not trained to verify the truth. They are trained to complete the sentence.»

Like glue on pizza

The fake meanings of made-up sayings bring back memories of the all too true stories about Google’s AI Overviews giving incredibly wrong answers to basic questions — like when it suggested putting glue on pizza to help the cheese stick.

This trend seems at least a bit more harmless because it doesn’t center on actionable advice. I mean, I for one hope nobody tries to lick a badger once, much less twice. The problem behind it, however, is the same — a large language model, like Google’s Gemini behind AI Overviews, tries to answer your questions and offer a feasible response. Even if what it gives you is nonsense.

A Google spokesperson said AI Overviews are designed to display information supported by top web results, and that they have an accuracy rate comparable to other search features.

«When people do nonsensical or ‘false premise’ searches, our systems will try to find the most relevant results based on the limited web content available,» the Google spokesperson said. «This is true of search overall, and in some cases, AI Overviews will also trigger in an effort to provide helpful context.»

This particular case is a «data void,» where there isn’t a lot of relevant information available for the search query. The spokesperson said Google is working on limiting when AI Overviews appear on searches without enough information and preventing them from providing misleading, satirical or unhelpful content. Google uses information about queries like these to better understand when AI Overviews should and should not appear.

You won’t always get a made-up definition if you ask for the meaning of a fake phrase. When drafting the heading of this section, I searched «like glue on pizza meaning,» and it didn’t trigger an AI Overview.

The problem doesn’t appear to be universal across LLMs. I asked ChatGPT for the meaning of «you can’t lick a badger twice» and it told me the phrase «isn’t a standard idiom, but it definitely sounds like the kind of quirky, rustic proverb someone might use.» It did, though, try to offer a definition anyway, essentially: «If you do something reckless or provoke danger once, you might not survive to do it again.»

Read more: AI Essentials: 27 Ways to Make Gen AI Work for You, According to Our Experts

Pulling meaning out of nowhere

This phenomenon is an entertaining example of LLMs’ tendency to make stuff up — what the AI world calls «hallucinating.» When a gen AI model hallucinates, it produces information that sounds like it could be plausible or accurate but isn’t rooted in reality.

LLMs are «not fact generators,» Li said, they just predict the next logical bits of language based on their training.

A majority of AI researchers in a recent survey reported they doubt AI’s accuracy and trustworthiness issues would be solved soon.

The fake definitions show not just the inaccuracy but the confident inaccuracy of LLMs. When you ask a person for the meaning of a phrase like «you can’t get a turkey from a Cybertruck,» you probably expect them to say they haven’t heard of it and that it doesn’t make sense. LLMs often react with the same confidence as if you’re asking for the definition of a real idiom.

In this case, Google says the phrase means Tesla’s Cybertruck «is not designed or capable of delivering Thanksgiving turkeys or other similar items» and highlights «its distinct, futuristic design that is not conducive to carrying bulky goods.» Burn.

This humorous trend does have an ominous lesson: Don’t trust everything you see from a chatbot. It might be making stuff up out of thin air, and it won’t necessarily indicate it’s uncertain.

«This is a perfect moment for educators and researchers to use these scenarios to teach people how the meaning is generated and how AI works and why it matters,» Li said. «Users should always stay skeptical and verify claims.»

Be careful what you search for

Since you can’t trust an LLM to be skeptical on your behalf, you need to encourage it to take what you say with a grain of salt.

«When users enter a prompt, the model just assumes it’s valid and then proceeds to generate the most likely accurate answer for that,» Li said.

The solution is to introduce skepticism in your prompt. Don’t ask for the meaning of an unfamiliar phrase or idiom. Ask if it’s real. Li suggested you ask «is this a real idiom?»

«That may help the model to recognize the phrase instead of just guessing,» she said.

Technologies

Did Apple Just Save the iPhone From Extreme Tariff Price Hikes?

Technologies

Today’s NYT Mini Crossword Answers for Saturday, April 26

Here are the answers for The New York Times Mini Crossword for April 26.

Looking for the most recent Mini Crossword answer? Click here for today’s Mini Crossword hints, as well as our daily answers and hints for The New York Times Wordle, Strands, Connections and Connections: Sports Edition puzzles.

Today’s NYT Mini Crossword could be tricky. I, for one, did NOT know the country in which «the automobile, aspirin and the accordion were invented,» but as the other clues filled in, I figured it out. Need some help with today’s Mini Crossword? Read on. And if you could use some hints and guidance for daily solving, check out our Mini Crossword tips.

The Mini Crossword is just one of many games in the Times’ games collection. If you’re looking for today’s Wordle, Connections, Connections: Sports Edition and Strands answers, you can visit CNET’s NYT puzzle hints page.

Read more: Tips and Tricks for Solving The New York Times Mini Crossword

Let’s get at those Mini Crossword clues and answers.

Mini across clues and answers

1A clue: Fancy party
Answer: GALA

5A clue: Five ___ (discount store chain)
Answer: BELOW

6A clue: Bottom stripe on a pride flag
Answer: PURPLE

7A clue: Bedtime outfit, informally
Answer: JAMMIES

8A clue: Task to «run»
Answer: ERRAND

9A clue: Actress Keaton of «Father of the Bride»
Answer: DIANE

10A clue: Car ride game
Answer: ISPY

Mini down clues and answers

1D clue: Country in which the automobile, aspirin and the accordion were invented
Answer: GERMANY

2D clue: Mountain-related
Answer: ALPINE

3D clue: Was audibly amused, slangily
Answer: LOLED

4D clue: Really impresses
Answer: AWES

5D clue: Unfair reputation
Answer: BUMRAP

6D clue: Host of the 2024 Summer Olympics
Answer: PARIS

7D clue: «Warrior-monks who keep peace in the universe,» per George Lucas
Answer: JEDI

How to play more Mini Crosswords

The New York Times Games section offers a large number of online games, but only some of them are free for all to play. You can play the current day’s Mini Crossword for free, but you’ll need a subscription to the Times Games section to play older puzzles from the archives.

Technologies

Pope Francis’ Funeral: How to Stream Live or Watch the Replay

Here’s how to stream the pope’s funeral very early Saturday, and what you can expect to see during the service.

After a week of global mourning for Pope Francis, who died on Monday at age 88, the pope’s funeral will be celebrated on Saturday . Francis’ funeral will be held Saturday at 10 a.m. local time at St. Peter’s Square in Vatican City (which is very, very early if you’re tuning in from the US or Canada), and he will be laid to rest at the Papal Basilica of St. Mary Major in Rome.

The Vatican will be livestreaming the papal funeral and procession, though not the burial, on its YouTube channel as it happens. The funeral will also be televised live on CBS, NBC, ABC and Fox, as well as on streaming services like Disney Plus, Hulu, Peacock and Paramount Plus. Due to the time difference, it seems likely that many interested North American viewers will catch it when it’s replayed later on Saturday. Numerous networks will rebroadcast the service later that day.

If you choose to stay up, or get up early, here’s when the live broadcast of the pope’s funeral will air in your time zone in the continental US on April 26:

ET: 4 a.m.
CT: 3 a.m.
MT: 2 a.m.
PT: 1 a.m.

The papacy of Pope Francis was notable for the progressive reforms he brought to the Roman Catholic Church. He appointed more than half of the current College of Cardinals and attempted to foster more positive attitudes toward members of the LGBT community and migrants worldwide.

What to expect from the funeral

The funeral will follow many rituals, though not all traditional protocols will be followed. Most popes are buried in St. Peter’s Basilica or its grottoes, but the AP reports Francis chose the St. Mary Major Basilica to reflect his veneration of an icon of the Virgin Mary that is located there, the Salus Populi Romani (Salvation of the People of Rome).

His funeral will be less elaborate than those of other popes per his own wishes. Francis simplified papal funeral rites last year, permitting his burial outside the Vatican, and emphasizing his role as a bishop rather than as pope (the pope is also the Bishop of Rome).

Previous popes were buried in three coffins: one of cypress, one of lead and one of oak. Francis requested to be buried in a single wooden, zinc-lined coffin and not to be placed in an elevated bier as other popes were.

The coffin will be taken from St Peter’s Basilica and placed on a dais in St Peter’s Square, where Cardinal Giovanni Battista Re will lead the service. After the service, the coffin will return to St Peter’s Basilica before it is carried across the River Tiber and to the Papal Basilica of Saint Mary Major for burial. The ceremony is estimated to end around 2 p.m. local time, or four hours after it begins.

Pope Francis’ funeral Mass will be the first of nine Masses held daily at St. Peter’s until May 4. This is an ancient tradition of the Catholic Church that observes nine days of consecutive mourning. According to Vatican News, a different group of mourners will participate each day, though the Eucharistic celebrations are open to everyone.

Who will attend Pope Francis’ funeral?

Hundreds of people, including world leaders and royals, are expected to attend Pope Francis’ funeral.

US president Donald Trump confirmed on his Truth Social Platform that he and first lady Melania Trump will be at the funeral. This will be Trump’s first foreign trip in his second term. He is expected to have a seat in the third row, though the Vatican has yet to release an official seating chart. It is tradition for the first row of seats to go to Catholic royalty, and the second row to non-Catholic royals.

Prince William, who is attending on behalf of King Charles, will sit in the second row, which is reserved for non-Catholic royals. Former president Joe Biden and first lady Jill Biden, devout Catholics, will also attend the funeral.

Conclave: What happens next to choose the new pope

After Pope Francis’ funeral, the cardinals of the Roman Catholic Church will vote on his successor in an assembly of cardinals known as a conclave.

There are many matters for the cardinals to settle before the conclave begins, but once it does, it can take days or even weeks to conclude. Two-thirds of the cardinals’ votes are required to elect the next pope. The conclave occurs behind closed doors and the vote tally is never made public.

Read more: Where to Watch Conclave, the Vatican Thriller About Electing a New Pope

Look for the white smoke

The ballots are burned after each round, and chemicals are added to the flames to produce black smoke if there’s no majority. When a new pope has been selected, the chemicals will be added to the flames so they produce white smoke. Crowds gather in St. Peter’s Square to watch for the results.

If you’re fascinated by the process, you can watch a dramatized version of the events in 2024 film Conclave.

In the movie, Ralph Fiennes stars as Cardinal Thomas Lawrence, who spearheads the election of the next pope while investigating rumors about potential candidates. The film is based on the 2016 novel by Robert Harris and is completely fictional — though it does represent some of the events of how actual papal conclaves take place. In March, the film won the Academy Award for best adapted screenplay.

You can stream Conclave on Amazon Prime Video, or rent it for $6 on Apple TV, Fandango at Home, YouTube or Google Play Movies.