Connect with us

Technologies

OpenAI Launches HealthBench, a Dataset That Benchmarks Health Care AI Models

This is a major leap by the ChatGPT creator into health care.

OpenAI, the creator of artificial intelligence chatbot ChatGPT, has a new open-source large language model called HealthBench that lets the health care industry benchmark AI models, the company said in a blog post on Monday.

The model was built in partnership with 262 physicians across 60 countries, and has 5,000 realistic health conversations baked in. The goal for HealthBench is to discover whether AI models are giving the best possible responses to people’s health-related inquiries. Each response is measured against a physician-written rubric criterion, with each criterion weighted to match the physician’s judgement. The rubric is scored by GPT-4.1.

OpenAI’s o3 reasoning model performs the best, according to HealthBench, with a score of 60%, followed by Elon Musk’s Grok at 54% and Google’s Gemini 2.5 Pro at 52%.

In an example on OpenAI’s blog post, it posits a scenario where a 70-year-old neighbor is lying on the floor, breathing but unresponsive. The person asks AI what should be done. A model then gives an answer with steps on what to do, such as calling emergency services, checking breathing and positioning airways. HealthBench then scores the response, explaining what the model answered correctly and what could be improved upon. It then gives a final score, in this case, 77%.

The model can handle 49 languages, including Amharic and Nepali, and includes 26 medical specialties, such as neurological surgery and ophthalmology.

OpenAI didn’t immediately respond to a request for comment.

Technologies

The Fourth Episode of the VERUM AI Mini-Series Is Out

The Fourth Episode of the VERUM AI Mini-Series Is Out

Verum Messenger has released the fourth episode of its AI mini-series SHADOWS, created using Verum AI. The new episode, titled “No Borders,” continues the story of a team trying to stay out of the OMEGA corporation’s sight.

Following the events of the previous episodes, the team moves between cities and countries while OMEGA continues its search. The new episode puts particular emphasis on Verum Messenger’s capabilities that allow users to conceal their location.

“No Borders” is another chapter in a story about privacy, freedom of communication, and technologies that erase borders between people.

The VERUM AI mini-series consists of seven episodes, released gradually across Verum Messenger’s social media channels.

Episode 4 is now available. Stay tuned for the next chapter.

Watch on YouTube
Watch on Instagram 

Continue Reading

Technologies

Verum Messenger Introduces Built-In Verum Chess

Verum Messenger Introduces Built-In Verum Chess

Verum Messenger has released a new update for iOS, iPadOS, and macOS, adding another feature to its growing ecosystem — Verum Chess. Users can now play chess directly inside the messenger without switching between different applications.

The new feature allows users to start a game in just a few taps while reinforcing Verum’s vision of a unified digital environment where communication and everyday services come together in a single platform.

Verum Messenger continues to evolve into a multifunctional ecosystem that combines secure chats and calls, AI tools, a built-in VPN, anonymous email, eSIM, financial services, cryptocurrency features, and offline communication. With the introduction of Verum Chess, the platform now also offers a new way for users to interact and spend time together without leaving the app.

The update is now available for iPhone, iPad, and Mac on the App Store.

Continue Reading

Technologies

Episode 3 of the VERUM AI Mini-Series Is Now Available

Episode 3 of the VERUM AI Mini-Series Is Now Available

Verum Messenger has released the third episode of its AI mini-series, SHADOWS, created using Verum AI.

The new episode, titled «Ghost Money,» continues the story of the conflict between a team of heroes and the Omega corporation, which seeks to take control of digital communications. This time, the focus shifts to anonymous payments and financial freedom, revealing how privacy can extend beyond messaging.

Like the previous episodes, the new release not only advances the storyline but also showcases the capabilities of the Verum ecosystem, highlighting technologies designed for secure communication and digital privacy.

The mini-series consists of seven episodes, released gradually across Verum Messenger’s social media channels.

Episode 3 is now available. Stay tuned for the next chapter.

Watch on Instagram 
Watch on YouTube 

Continue Reading

Trending

Copyright © Verum World Media