OpenAI announces GPT
OpenAI announced on Monday a new generative AI model called GPT-4o with the ability to handle text, speech, and video.
OpenAI CTO Mira Murati said during a streamed presentation on Monday that GPT-4o provides "GPT-4-level" intelligence but improves on GPT-4's capabilities across multiple modalities and media.
The "o" stands for "omni," referring to the model's ability to handle text, speech, and video. It is set to roll out "iteratively" across the company's products over the next few weeks, OpenAI said.
"GPT-4o reasons across voice, text, and vision," Murati said. "And this is incredibly important because we're looking at the future of interaction between ourselves and machines."
GPT-4 Turbo, OpenAI's previous leading model, was trained in a combination of images and text and could analyze images and text and even describe the content of the images. But GPT-4o adds speech to the mix, thus greatly improving the experience in OpenAI's AI-powered ChatGPT with voices in "a range of different emotive styles."
GPT-4o upgrades ChatGPT's vision capabilities in addition. Given a photo, ChatGPT can quickly answer related questions, according to the presentation.
"We know that these models are getting more and more complex, but we want the experience of interaction to actually become more natural, and easy, and for you not to focus on the UI at all, but just focus on the collaboration with ChatGPT," Murati said. "For the past couple of years, we've been very focused on improving the intelligence of these models ... But this is the first time that we are really making a huge step forward when it comes to the ease of use."
GPT-4o is also more multilingual with enhanced performance in around 50 languages, the company said.
It plans to first launch support for GPT-4o's new audio capabilities to "a small group of trusted partners" in the coming weeks.
Related articles
Missouri candidate with ties to the KKK can stay on the Republican ballot, judge rules
JEFFERSON CITY, Mo. (AP) — A longshot Missouri gubernatorial candidat e with ties to the Ku Klux Kla2024-05-19Colombia's capital announces new measures to cut water consumption as dry weather persists
BOGOTA, Colombia (AP) — The mayor of Colombia’s capital on Monday announced new measures to reduce w2024-05-19Asbestos victim's dying words aired in wrongful death case against Buffet's railroad
HELENA, Mont. (AP) — Thomas Wells ran a half-marathon at age 60 and played recreational volleyball u2024-05-19Women's soccer coach accused of sexual harassment in Brazil resigns after protests
SAO PAULO (AP) — The male coach of a Brazilian women’s soccer team resigned on Monday after accusati2024-05-19706 people named Kyle got together in Texas. It wasn’t enough for a world record.
KYLE, Texas (AP) — How many people named Kyle can fit in one place? For one Texas city, not enough.A2024-05-19Royals catcher Salvador Perez sidelined by mild groin strain
CHICAGO (AP) — Kansas City Royals catcher Salvador Perez had an MRI on Monday that showed a mild gro2024-05-19
atest comment