ChatGPT adds more PC and Mac application integrations, bringing your PC experience closer to home

OpenAI has expanded the number of applications its desktop applications can work with, including allowing advanced audio mode to work with other applications, and is moving closer to ChatGPT using PCs.

Desktop application introduced Integration in November With four initial applications. During the 11th day of the “12 Days of OpenAI” event, OpenAI announced several new integrated development environments (IDEs), terminals, and scripted applications that it will support.

ChatGPT now supports BBEdit, MatLab, Nova, Script Editor, TextMate as IDEs, VS Code for VSCode Insiders, VSCodium, Cursor, WindSurf, the JetBrains family of IDEs for Android Studio, AppCode, CLion, DataGrip, GoLand, IntelliJ IDEA, PHPStorm, PyCharm, RubyMine, RustRover, and WebStorm. It also added Warp and Prompt terminal applications as integration. These apps join VS Code, Xcode, Terminal, iTerm 2, and TextEdit as integrated apps.

But programming applications won’t be the only applications that ChatGPT desktop applications can access. OpenAI has also added Apple Notes, Notion, and Quip to its integrations. Advanced audio mode can work with these applications, taking into account the context of the projects in integrations.

OpenAI stressed that users must grant ChatGPT permission to access these applications.

Allow ChatGPT to use your computer for you

Integrating apps with AI-powered chatbots is nothing new, of course. In October, github The co-pilot added Coding platform integration. Connecting apps to ChatGPT or Copilot brings context from those platforms into the chat experience. Developers can ask ChatGPT for some programming help for a project they have on VS Code, and the chatbot will understand what they were working on.

Kevin Weil, chief product officer at OpenAI, said during the live stream that improving the desktop app will help the company get closer to a more effective user experience for ChatGPT.

“We put a lot of effort into our desktop applications,” Will said. “As our models get more powerful, ChatGPT will become more and more of an agent. This means we will go beyond just questions and answers; ChatGPT will start doing things for you.

Desktop applications “make up a big part” of this shift, he added.

“Being a desktop app, you can do a lot more than you can from just a browser tab,” he said. “That includes things like, with your permission, the ability to see what’s on your screen and the ability to automate a lot of the work you do on your desktop. We’ll have a lot more to say about that as we get into 2025.”

If OpenAI lets ChatGPT see more of your computer, ChatGPT will come closer to Anthropic’s Claude Use of computer The feature, which allows Claude to click around a person’s computer, navigate between screens, and even type text.

OpenAI has already announced a limit Similar feature for mobile ChatGPT version, although the chatbot can’t yet access computers or phones in the same way. Users can share their screens with the chatbot so it can “see” what they are reading or looking at. Microsoft and Google It has also developed features that are comparable to See the co-pilot and Astra Project.

How to reach

On MacOS, users who want to open ChatGPT while using other applications can use Option + Space to drag ChatGPT and select the application they need from a button on the chat screen. Another shortcut, “Option + Shift + 1”, displays on top of a user’s application.

From that window, users can also access advanced audio mode in the same way. Voice mode automatically detects context from the app.

Integrations are available for ChatGPT Plus, Pro, Team, Enterprise, and Edu users. However, Enterprise and Edu subscribers must ask their IT administrators to turn this feature on.

Daily insights into business use cases with VB Daily

If you want to impress your boss, VB Daily has you covered. We give you the inside scoop on what companies are doing with generative AI, from organizational transformations to hands-on deployments, so you can share insights to maximize ROI.

Read our privacy policy

Thanks for subscribing. Check more VB Newsletters are here.

An error occurred.