OpenAI's ChatGPT-4o can summarize charts, spot coding errors, and solve math problems, potentially making it a useful work tool.
OpenAI
The latest version of ChatGPT could turn the AI tool into a personal assistant — including at work.
Among the new features that OpenAI highlighted on Monday: You can pull up ChatGPT-4o (that's the letter "o," not zero) on your computer desktop or smartphone screen and show the model whatever you're looking at, whether it's a math problem on a whiteboard or a screen full of code.
In one demo during OpenAI's presentation on the new version, GPT-4o suggested changes to code in real time on a user's computer, for example.
At first, ChatGPT was known for its command prompt-like interface, which allows users to type in questions or requests for images. Last fall, OpenAI added Voice mode to GPT, allowing users to ask questions a la Alexa or Siri — albeit with a more sophisticated model responding.
But with 4o, users can now show ChatGPT what they're working on and get real-time feedback.
In another example, ChatGPT-4o gave a one-sentence summary of a line graph when an OpenAI employee pulled it up on his desktop:
Damn... the idea of being able to just share your screen natively using the new ChatGPT Mac app and have gpt work with you is freaking awesome ???? pic.twitter.com/mwZvZWVP1u
— Josh Cohenzadeh (@jshchnz) May 13, 2024
For anyone who codes or handles data for a living, it's not hard to imagine how the latest version of ChatGPT could make work easier.
Holy shit ChatGPT can help you fix and write codes in real freaking time, it can see your screen and can talk to you in real time.
— Kuldeep Lather (@Kullthegreat) May 13, 2024
I hope you got an idea about how crazy this shit is pic.twitter.com/ZxqsL2TOje
ChatGPT can also give feedback on work in the real world. In Monday's demo, OpenAI employees showed the tool a simple algebra problem written on a whiteboard using a smartphone camera.
Eventually, ChatGPT gave them hints on how to solve an unknown variable, giving them feedback at different stages.
GPT-4o marks "the first time that we are really making a huge step forward when it comes to the ease of use," OpenAI CTO Mira Murati told an audience at the company's offices as Monday's presentation kicked off.
Axel Springer, Business Insider's parent company, has a global deal to allow OpenAI to train its models on its media brands' reporting.
