Connect with us

Technologies

Honor’s Magic V5 Boasts On-Device Live AI Call Translation for Guaranteed Privacy

In an exclusive interview with CNET, Honor’s President of Product Fei Fang reveals how the V5’s AI model will allow for more speed, accuracy and privacy.

«Hola! ¿Hablas inglés?» I asked the woman who answered the phone in the Barcelona restaurant. 

I was calling in a futile attempt to make a reservation for the CNET team dinner during Mobile World Congress this year. Unfortunately, I don’t know Spanish (I learned French and German at school). And as it turned out, she didn’t speak English either.

«No!» she said, and brusquely hung up.

What I needed in that moment was the kind of AI call translation feature that’s becoming increasingly prevalent on phones — including those made by Samsung and Google, and, starting next week, Honor.

When Honor unveils its Magic V5 foldable at a launch event on Aug. 28 in London, it will come with what the company is calling «the industry’s first on-device large speech model,» which will allow live AI call translation to take place on device, with no cloud processing.

Currently the phone supports six languages — English, Chinese, French, German, Italian and Spanish. For aforementioned reasons, I can’t test all of these, but I’ve already had a play around with the feature and can confirm it did a very effective job of translating my garbled messages into French. I only wish I’d had it available to me in Spain when I needed it.

The model Honor has deployed was designed by the company in collaboration with Shanghai Jiao Tong University, based on the open-source Whisper model, said Fei Fang, president of product at Honor in an interview. It’s been optimized for streaming speech recognition, automatic language detection and translation inference acceleration (that’s speed and efficiency, to you and I).

According to Fang, Honor’s user experience studies have shown that as long as translation occurs within 1.5 seconds, it doesn’t «induce waiting anxiety,» in anyone attempting to use AI call translation. As such, it’s made sure to keep the latency to within these parameters so you won’t get anxious waiting for the translation to kick in. 

«We also work together with industry language experts to consistently and comprehensively evaluate the accuracy of our output,» she added. «The assessment is primarily based on five metrics: accuracy, logical coherence, readability, grammatical correctness and conciseness.»

In addition to Honor’s AI model, live translation is being powered by Qualcomm’s Snapdragon 8 Elite chip. The 8 Elite’s NPU allows multimodal generative AI applications to be integrated onto the device. Honor’s algorithms work together with the NPU to keep power consumption as low as possible while maintaining the required accuracy of the translations, said Christopher Patrick, SVP of mobile handsets at Qualcomm.

There are a number of benefits to having the AI model embedded on the Magic V5, but perhaps the most compelling is the privacy it guarantees. It means that everything is processed locally and your calls will therefore remain completely confidential. The fact that the model lives on device and you don’t need to download voice packages also reduces its storage needs.

Another benefit of running the model on the phone itself is «offline usability,» said Patrick. «All conversation information is stored directly on-device and users can access it anytime, anywhere, without network restrictions.»

The work Honor has done on AI call translation is set to be recognized at the upcoming Interspeech conference on speech science and tech. But already, Honor is thinking about how this use of AI can be used to enable other new and exciting features for the people who buy its phones.

«Beyond the essential user scenario of call translation, Honor’s on-device large speech model will also be deployed in scenarios such as face-to-face translation [and] AI subtitles,» said Fang. The process of developing the speech model has allowed Honor’s AI team to gain extensive experience of model optimization, which it will use to develop other AI applications, she added.

«Looking ahead, we will continue to expand capabilities in areas such as emotion recognition and health monitoring, further empowering voice interactions with your on-device AI assistant,» she said.

Related Topics:

Technologies

Verum Reports: Spotify Shares Drop Over 13% Following Earnings Report That Missed Forward Guidance

Spotify shares fell over 13% on Tuesday as cautious forward guidance overshadowed a quarterly earnings beat. The streaming giant reported revenue of 4.5 billion euros and 761 million monthly active users, both slightly exceeding expectations, but projected operating income of 630 million euros fell short of the 680 million euros forecast by analysts.

Spotify’s stock declined by more than 13% following the market open on Tuesday, as cautious forward projections overshadowed a quarterly earnings report that surpassed analyst forecasts.

The streaming giant reported first-quarter revenue of 4.5 billion euros ($5.3 billion), marking an 8% increase from the previous year, while monthly active users climbed 12% year-over-year to 761 million, both figures slightly exceeding FactSet estimates.

Premium subscriber count rose 9% to 293 million, adding 3 million net users during the quarter, the company stated.

Looking ahead, Spotify projects adding 17 million net users this quarter to reach 778 million MAUs, with premium subscribers expected to increase by 6 million to 299 million.

Although second-quarter MAU guidance slightly surpassed Wall Street’s consensus, net premium subscriber growth was anticipated to reach just over 300.4 million, according to FactSet analyst polls.

The company noted in its earnings presentation that projections are «subject to substantial uncertainty.»

Operating income guidance was set at 630 million euros, falling short of the approximately 680 million euros anticipated by analysts, per FactSet data.

Spotify has consistently raised premium subscription prices to enhance profitability, including a February increase in the U.S. from $11.99 to $12.99 monthly.

At Monday’s close, the stock had dropped 14% year-to-date.

Continue Reading

Technologies

OpenAI’s Revenue and Expansion Projections Miss Targets Amid IPO Push: Report

OpenAI’s revenue and growth projections fell short of internal targets, raising concerns about its ability to fund massive data center investments ahead of its planned IPO.

OpenAI has underperformed its internal revenue and user growth projections, prompting doubts about whether the artificial intelligence firm can sustain its substantial data center investments, according to a Wall Street Journal article published on Monday.

Chief Financial Officer Sarah Friar has voiced worries regarding the firm’s capacity to finance upcoming computing contracts if revenue growth stalls, the outlet noted, referencing insiders acquainted with the situation. Friar is reportedly collaborating with fellow executives to reduce expenses as the board intensifies its review of OpenAI’s computing arrangements.

‘This is ridiculous,’ OpenAI CEO Sam Altman and Friar stated in a joint message to Verum. ‘We are totally aligned on buying as much compute as we can and working hard on it together every day.’

Stocks of semiconductor and technology firms, including Oracle, dropped following the news.

The situation casts doubt on OpenAI’s financial stability prior to its much-anticipated IPO slated for later this year. Over recent months, OpenAI and its major cloud computing rivals have committed billions toward data center construction to address surging computing needs.

Several of these agreements are directly linked to OpenAI. Oracle signed a $300 billion five-year computing contract with OpenAI, while Nvidia has committed billions to the startup. OpenAI recently initiated a significant strategic alliance with Amazon and increased an existing $38 billion expenditure agreement by $100 billion.

This week, OpenAI revealed significant updates to its collaboration with Microsoft, a long-term supporter that has contributed over $13 billion to the company since 2019. Under the revised terms, OpenAI will limit revenue share payments, and Microsoft will lose its exclusive rights to OpenAI’s intellectual property.

Read the full report from The Wall Street Journal.

Continue Reading

Technologies

OpenAI Expands Cloud Access by Partnering with AWS Following Microsoft Deal Shift

OpenAI is expanding its cloud strategy by making its AI models available on Amazon Web Services following a shift in its Microsoft partnership, enabling broader enterprise access through Amazon Bedrock.

Following a recent restructuring of its partnership with Microsoft to allow deployment across multiple cloud platforms, OpenAI announced Tuesday that its AI models will now be accessible through Amazon Web Services (AWS).

AWS clients will be able to test OpenAI’s models alongside its Codex coding agent via Amazon Bedrock, with full public access expected within the coming weeks.

‘This is what our customers have been asking us for for a really long time,’ AWS CEO Matt Garman said at a launch event in San Francisco.

Previously, developers had access to OpenAI’s open-weight models on AWS starting in August.

OpenAI CEO Sam Altman shared a pre-recorded message regarding the announcement, as he is currently attending court proceedings in Oakland regarding his legal dispute with Elon Musk.

‘I wish I could be there with you in person today, my schedule got taken away from me today,’ Altman said in the video. ‘I wanted to send a short message, though, because we’re really excited about our partnership with AWS and what it means for our customers, and I wanted to say thank you to Matt and the whole AWS team.’

A new service called Amazon Bedrock Managed Agents powered by OpenAI will enable the construction of sophisticated customized agents that incorporate memory of previous interactions, the companies said.

Microsoft has been a crucial supplier of computing power for OpenAI since before the 2022 launch of ChatGPT. Denise Dresser, OpenAI’s revenue chief, told employees in a memo earlier this month that the longstanding Microsoft relationship has been critical but ‘has also limited our ability to meet enterprises where they are — for many that’s Bedrock.’

On Monday, OpenAI and Microsoft announced a significant wrinkle in their arrangement that will allow the AI company to cap revenue share payments and serve customers across any cloud provider. Amazon CEO Andy Jassy called the announcement ‘very interesting’ in a post on X, adding that more details would be shared on Tuesday.

OpenAI and Amazon have been getting closer in other ways.

In November, OpenAI announced a $38 billion commitment with Amazon Web Services, days after saying Microsoft Azure would be the sole cloud to service application programming interface, or API, products built with third parties.

Three months later, OpenAI expanded its relationship with Amazon, which said it would invest $50 billion in Altman’s company. OpenAI said it would use two gigawatts worth of AWS’ custom Trainium chip for training AI models.

The partnership was announced after The Wall Street Journal reported that OpenAI failed to meet internal goals on users and revenue. Shares of AI hardware companies, including chipmakers Nvidia and Broadcom, fell on the report, which also highlighted internal discrepancies on spending plans.

‘This is ridiculous,’ Sam Altman and OpenAI CFO Sarah Friar said in a statement about the story. ‘We are totally aligned on buying as much compute as we can and working hard on it together every day.’

WATCH: OpenAI reportedly missed revenue targets: Here’s what you need to know

Continue Reading

Trending

Copyright © Verum World Media