Technologies

Facebook’s AI research could spur smarter AR glasses and robots

Rummaging through drawers to find your keys could become a thing of the past.

Facebook envisions a future in which you’ll learn to play the drums or whip up a new recipe while wearing augmented reality glasses or other devices powered by artificial intelligence. To make that future a reality, the social network needs its AI systems to see through your eyes.

«This is the world where we’d have wearable devices that could benefit you and me in our daily life through providing information at the right moment or helping us fetch memories,» said Kristen Grauman, a lead research scientist at Facebook. The technology could eventually be used to analyze our activities, she said, to help us find misplaced items, like our keys.

That future is still a ways off, as evidenced by Facebook’s Ray-Ban branded smart glasses, which debuted in September without AR effects. Part of the challenge is training AI systems to better understand photos and videos people capture from their perspective so that the AI can help people remember important information.

Facebook said it teamed up with 13 universities and labs that recruited 750 people to capture more than 2,200 hours of first-person video over two years. The participants, who lived in the UK, Italy, India, Japan, Saudi Arabia, Singapore, the US, Rwanda and Colombia, shot videos of themselves engaging in everyday activities such as playing sports, shopping, gazing at their pets or gardening. They used a variety of wearable devices, including GoPro cameras, Vuzix Blade smart glasses and ZShades video recording sunglasses.

Starting next month, Facebook researchers will be able to request access to this trove of data, which the social network said is the world’s largest collection of first-person unscripted videos. The new project, called Ego4D, provides a glimpse into how a tech company could improve technologies like AR, virtual reality and robotics so they play a bigger role in our daily lives.

The company’s work comes during a tumultuous period for Facebook. The social network has faced scrutiny from lawmakers, advocacy groups and the public after The Wall Street Journal published a series of stories about how the company’s internal research showed it knew about the platform’s harms even as it downplayed them publicly. Frances Haugen, a former Facebook product manager turned whistleblower, testified before Congress last week about the contents of thousands of pages of confidential documents she took before leaving the company in May. She’s scheduled to testify in the UK and meet with Facebook’s semi-independent oversight board in the near future.

Even before Haugen’s revelations, Facebook’s smart glasses sparked concerns from critics who worry the device could be used to secretly record people. During its research into first-person video, the social network said it addressed privacy concerns. Camera wearers could view and delete their videos, and the company blurred the faces of bystanders and license plates that were captured.

Fueling more AI research

As part of the new project, Facebook said, it created five benchmark challenges for researchers. The benchmarks include episodic memory, so you know what happened when; forecasting, so computers know what you’re likely to do next; and hand and object manipulation, to understand what a person is doing in a video. The last two benchmarks are understanding who said what, and when, in a video, and who the partners are in the interaction.

«This sets up a bar just to get it started,» Grauman said. «This usually is quite powerful because now you’ll have a systematic way to evaluate data.»

Helping AI understand first-person video can be challenging because computers typically learn from images that are shot from the third-person perspective of a spectator. Challenges such as motion blur and footage from different angles come into play when you record yourself kicking a soccer ball or riding a roller coaster.

Facebook said it’s looking at expanding the project to other countries. The company said diversifying the video footage is important because if AR glasses are helping a person cook curry or do laundry, the AI assistant needs to understand that those activities can look different in various regions of the world.

Facebook said the video dataset includes a diverse range of activities shot in 73 locations across nine countries. The participants included people of different ages, genders and professions.

The COVID-19 pandemic also created limitations for the research. For example, more footage in the data set is of stay-at-home activities such as cooking or crafting rather than public events.

Some of the universities that partnered with Facebook include the University of Bristol in the UK, Georgia Tech in the US, the University of Tokyo in Japan and Universidad de los Andes in Colombia.

Technologies

Australians Flock to VPNs in the Wake of Online Age-Restriction Laws

App downloads for VPN services increase sharply as websites in Australia go behind age-restriction walls.

A new set of laws in Australia requiring adult websites and app stores to age-restrict content for those under 18, and requiring AI companies to restrict chatbot offerings from displaying certain types of sensitive or adult content to minors, is apparently driving many to download Virtual Private Network apps there.

Major adult sites have closed their virtual doors to those who aren’t age-confirmed in Australia, and these changes follow a nationwide ban on social media use by teenagers and young children that went into effect in December.

According to reports from Reuters, The Guardian and others, in response to the bans, downloads of VPN-related apps, which people can use to circumvent location-based restrictions, are sharply on the rise. According to Reuters, three of the 15 most downloaded free iPhone apps in the country were VPN-related as the new laws went into effect on Monday.

Lawmakers in some regions, including the US, are well aware that people use VPNs in this way. In states such as Michigan and Wisconsin, laws are being proposed to limit or outright ban VPN use. Wisconsin’s proposed law would require adult sites to block VPN traffic, while Michigan’s proposal would ban VPN use entirely in the state.

There is also a proposal in England under consideration to ban VPN use by minors. That proposal is currently under review.

Technologies

Here’s How to Track the Artemis II Mission in Real Time With NASA’s New Tool

The tool will let you track NASA’s modern lunar program during its 10-day flight around the moon and back again.

More than half a century after astronauts last left footprints on the lunar surface, humanity is preparing to return to the moon. The excitement surrounding NASA’s Apollo program once captivated the world, and now NASA hopes to rekindle that same sense of wonder with its modern lunar effort, the Artemis program.

NASA’s Artemis II launch is scheduled for the first week of April. It’ll be the first human mission to the moon since 1972, and it should be quite the achievement for the Artemis program. Now, NASA has released a new tool that lets the public track Artemis II in real time.

The Artemis program is NASA’s long-term effort to return humans to the moon and establish a sustained presence there for the first time since the Apollo program. The program aims to land astronauts near the lunar south pole, develop new technologies for long-term exploration and use the moon as a stepping stone for future missions to Mars.

The Artemis Real-time Orbit Website, dubbed AROW, is already available to the public, although there isn’t much to see since the launch is still a few weeks away. It’s also available directly from the NASA app if you’re using a mobile device. The site lets the public visualize data collected by sensors on Orion and sent to the Mission Control Center at NASA’s Johnson Space Center in Houston.

The website is simple to navigate. You’ll see a visual representation of Artemis II’s progress, including its speed, distance from Earth and distance to the moon. Mobile app users get all of the above, along with an extra augmented reality tracker that lets you point your phone at the sky and see where Artemis II is relative to your position on Earth. It works much like Google Star Map and other stargazing apps that use similar technology.

According to NASA, tracking will be available once the Orion capsule separates from the rocket’s upper stage, which is expected about 3 hours after the upcoming April launch. The site will then update its information in real time for the entire 10-day mission.

NASA is also making flight data available for download so that people interested in creating their own content, such as visualizations or tracking apps, can do so. The data will include all sorts of things, including state vectors, which are data that «describe precisely where Orion is located and how it moves.» That same data will be used by NASA to study Orion and make improvements for future Artemis missions.

An exact launch date for Artemis II hasn’t been set, but the agency plans on launching the mission no earlier than April 1. The launch was originally scheduled for February, but it was delayed multiple times due to a hydrogen leak and a helium flow issue. NASA says it has since fixed both issues.

Technologies

Today’s NYT Connections Hints, Answers and Help for March 10, #1003

Here are some hints and the answers for the NYT Connections puzzle for March 10, No. 1,003

Looking for the most recent Connections answers? Click here for today’s Connections hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle, Connections: Sports Edition and Strands puzzles.

Today’s NYT Connections puzzle is a fun and diverse mix. If you know your US states, you’ll surely solve the blue category early. Read on for clues and today’s Connections answers.

The Times has a Connections Bot, like the one for Wordle. Go there after you play to receive a numeric score and to have the program analyze your answers. Players who are registered with the Times Games section can now nerd out by following their progress, including the number of puzzles completed, win rate, number of times they nabbed a perfect score and their win streak.

Read more: Hints, Tips and Strategies to Help You Win at NYT Connections Every Time

Hints for today’s Connections groups

Here are four hints for the groupings in today’s Connections puzzle, ranked from the easiest yellow group to the tough (and sometimes bizarre) purple group.

Yellow group hint: Think Julia Child.

Green group hint: Also, Bro and Sis.

Blue group hint: Minn. and Ore. are two others.

Purple group hint: Hit with your fist.