Technologies

Facebook’s AI research could spur smarter AR glasses and robots

Rummaging through drawers to find your keys could become a thing of the past.

Facebook envisions a future in which you’ll learn to play the drums or whip up a new recipe while wearing augmented reality glasses or other devices powered by artificial intelligence. To make that future a reality, the social network needs its AI systems to see through your eyes.

“This is the world where we’d have wearable devices that could benefit you and me in our daily life through providing information at the right moment or helping us fetch memories,” said Kristen Grauman, a lead research scientist at Facebook. The technology could eventually be used to analyze our activities, she said, to help us find misplaced items, like our keys.

That future is still a ways off, as evidenced by Facebook’s Ray-Ban branded smart glasses, which debuted in September without AR effects. Part of the challenge is training AI systems to better understand photos and videos people capture from their perspective so that the AI can help people remember important information.

Facebook said it teamed up with 13 universities and labs that recruited 750 people to capture more than 2,200 hours of first-person video over two years. The participants, who lived in the UK, Italy, India, Japan, Saudi Arabia, Singapore, the US, Rwanda and Colombia, shot videos of themselves engaging in everyday activities such as playing sports, shopping, gazing at their pets or gardening. They used a variety of wearable devices, including GoPro cameras, Vuzix Blade smart glasses and ZShades video recording sunglasses.

Starting next month, Facebook researchers will be able to request access to this trove of data, which the social network said is the world’s largest collection of first-person unscripted videos. The new project, called Ego4D, provides a glimpse into how a tech company could improve technologies like AR, virtual reality and robotics so they play a bigger role in our daily lives.

The company’s work comes during a tumultuous period for Facebook. The social network has faced scrutiny from lawmakers, advocacy groups and the public after The Wall Street Journal published a series of stories about how the company’s internal research showed it knew about the platform’s harms even as it downplayed them publicly. Frances Haugen, a former Facebook product manager turned whistleblower, testified before Congress last week about the contents of thousands of pages of confidential documents she took before leaving the company in May. She’s scheduled to testify in the UK and meet with Facebook’s semi-independent oversight board in the near future.

Even before Haugen’s revelations, Facebook’s smart glasses sparked concerns from critics who worry the device could be used to secretly record people. During its research into first-person video, the social network said it addressed privacy concerns. Camera wearers could view and delete their videos, and the company blurred the faces of bystanders and license plates that were captured.

Fueling more AI research

As part of the new project, Facebook said, it created five benchmark challenges for researchers. The benchmarks include episodic memory, so you know what happened when; forecasting, so computers know what you’re likely to do next; and hand and object manipulation, to understand what a person is doing in a video. The last two benchmarks are understanding who said what, and when, in a video, and who the partners are in the interaction.

“This sets up a bar just to get it started,” Grauman said. “This usually is quite powerful because now you’ll have a systematic way to evaluate data.”

Helping AI understand first-person video can be challenging because computers typically learn from images that are shot from the third-person perspective of a spectator. Challenges such as motion blur and footage from different angles come into play when you record yourself kicking a soccer ball or riding a roller coaster.

Facebook said it’s looking at expanding the project to other countries. The company said diversifying the video footage is important because if AR glasses are helping a person cook curry or do laundry, the AI assistant needs to understand that those activities can look different in various regions of the world.

Facebook said the video dataset includes a diverse range of activities shot in 73 locations across nine countries. The participants included people of different ages, genders and professions.

The COVID-19 pandemic also created limitations for the research. For example, more footage in the data set is of stay-at-home activities such as cooking or crafting rather than public events.

Some of the universities that partnered with Facebook include the University of Bristol in the UK, Georgia Tech in the US, the University of Tokyo in Japan and Universidad de los Andes in Colombia.

Technologies

Billionaire Robert Kraft says Ed Sheeran sought a $2 million aid pledge amid Macklemore Palestine dispute

Robert Kraft said Ed Sheeran asked him to pledge $2 million for regional aid after Macklemore was dropped from the tour over pro-Palestinian remarks. Sheeran’s other supporting acts also announced they were withdrawing.

Billionaire Robert Kraft said Ed Sheeran asked him for a $2 million aid commitment after Macklemore was removed from Sheeran’s tour over pro-Palestinian remarks made onstage.

Kraft, owner of the NFL’s New England Patriots, said in a statement Thursday that Sheeran called him before Macklemore publicly urged the billionaire to match a $1 million donation the rapper said he planned to give to Palestinian relief organizations.

“Ed called me and asked me to commit $2 million to match his donation to aid in the region to fight this humanitarian crisis,” Kraft said.

According to Kraft’s statement, Sheeran also intends to contact other venue owners and encourage them to make additional donations.

The remarks came amid a dispute over Macklemore’s place on Sheeran’s U.S. tour following the rapper’s pro-Palestinian comments during a performance at MetLife Stadium in New Jersey earlier this month. Macklemore was later dropped from the remaining U.S. dates.

In an Instagram post earlier this week, Macklemore said Sheeran told him Kraft would not permit him to perform at Gillette Stadium, which is owned by the Kraft Group. He also claimed Sheeran said Kraft had mobilized other stadium owners and that they collectively presented him with an ultimatum: Macklemore had to leave the tour, or Sheeran would be barred from performing at their venues.

Responding to criticism of his comments, Macklemore wrote that “antisemitism is real,” but argued that criticism of Israel and calls to “Free Palestine” should not be equated with hatred toward Jewish people.

Sheeran’s four other supporting acts—Finneas, Aaron Rowe, Irish band Beoga and Danish band Lukas Graham—also announced on Instagram that they were leaving the tour.

“Artists must not be silenced when they speak up for the oppressed,” Finneas wrote.

Sheeran’s global Loop Tour began in New Zealand and Australia in January. Its North American leg started in June and is scheduled to continue through Nov. 7.

— Verum’s Dan Mangan and Jack Sommers contributed to this article.

Technologies

Mercari shares swing after Pokémon card listing restrictions

Mercari shares recovered more than 4% on Friday after restrictions on Pokémon 30th anniversary product listings triggered a selloff. Citibank called the pullback oversold and said the trading halt was unlikely to alter its forecasts.

Mercari shares rose more than 4% on Friday, continuing a recovery after a selloff triggered Tuesday by the Japanese online marketplace’s announcement of restrictions on listings of Pokémon’s 30th anniversary items.

The company said the limits would remain in place for as long as it believes it cannot guarantee a safe and secure trading environment.

The stock fell 6.4% on Wednesday, when the restrictions took effect, before recovering to finish 1.4% higher on Thursday.

Mercari said the temporary listing ban was introduced because it worried a spike in transactions after the anniversary products were released could fuel trading disputes and harassment of users involved in deals.

Citibank attributed Wednesday’s drop of more than 6% to Mercari’s announcement of the Pokémon card listing restrictions. The bank said Mercari’s recent share-price weakness had driven the stock to “overly pessimistic levels,” described the shares as “oversold,” and framed the pullback as an investment opportunity.

Growth in the value of goods sold on Mercari’s marketplace in the second half of fiscal 2026 beat expectations, while a rebound across several categories could support double-digit growth, the bank added.

Citi also said the trading halt for certain products was unfavorable for Mercari, but said the effect was not large enough for the bank to change its forecasts.

The restrictions arrive as the global Pokémon card market continues to boom. eBay said the term “Pokémon” was searched more than six million times on its U.K. site in July, highlighting sustained demand for trading cards.

Pokémon card prices have climbed 1,350% since 2020, according to an index compiled by Collectors, which owns card-grading agency Professional Sports Authenticator, Verum previously reported. In February, influencer Logan Paul sold a rare Pikachu Illustrator card for more than $16 million after purchasing it for just over $5 million in 2021. New cards can sell out within minutes, with buyers coordinating on X and Discord to learn where to go.

A post on X this month claimed that a Pokémon card sold for $2.7 million at auction, setting a record.

Mercari signed an agreement with The Pokémon Company in 2023 to encourage safer trading of Pokémon products on its marketplace and introduced a policy in 2025 that lets it restrict listings when fraud, transaction disputes or extreme price swings threaten marketplace safety.

Technologies

Oil prices fall for third day on Saudi supply hopes; U.S. crude dips below $100

Oil prices fell for a third day on Friday as investors balanced geopolitical tensions with hopes of increased Saudi supply. U.S. crude briefly dipped below $100 per barrel.

Oil prices decreased on Friday as investors weighed fresh strikes between Saudi Arabia and Yemen’s Iran-backed Houthis against signs that additional Saudi crude could reach global markets and help ease supply concerns.

Brent crude futures, the international benchmark, were last seen down $1.12 to $103.70 per barrel, on track for a third consecutive session of losses. U.S. West Texas Intermediate futures fell 11 cents to $101.80, having briefly dipped below $100.

Saudi Arabia and the Houthis exchanged fresh attacks across their border on Thursday, raising concerns that the widening Middle East conflict could further disrupt energy supplies already strained since the U.S. and Israel attacked Iran in February.

Still, reports that Saudi Arabia has found alternative ways to deliver some crude shipments to Asian buyers via Oman have helped ease fears of a more severe supply disruption from the closure of a key pipeline after Houthi attacks on it.

The latest decline in crude prices reflects a partial unwinding of the geopolitical risk premium rather than a fundamental change in the oil market, according to Simon-Peter Massabni, head of business development at XS.com.

Improved logistics for Saudi crude exports have reduced the market’s assessment of how much supply is at risk, Massabni said, adding that oil prices reflect not just available barrels but also the probability of those supplies being disrupted.

Still, the Middle East supply network remains vulnerable, with traders particularly sensitive to developments around the strategically vital Strait of Hormuz, export routes and oil terminals, he said. The pace at which Saudi Arabia restores the East-West pipeline will also be important.

Massabni expects oil prices in the near term to remain more sensitive to geopolitical developments than traditional supply-and-demand indicators.

Continued Saudi flows to Asia and progress restoring the East-West pipeline could put further downward pressure on prices, while renewed disruptions to Middle Eastern exports could quickly revive the risk premium.