OpenAI has presented new possibilities for the desktop application of ChatGPT. With the “Work with Apps” function, the AI chatbot’s macOS app is intended to work more closely with running applications on the Mac, thus making work processes easier. Users can target applications that ChatGPT then interacts with to receive contextual support.
The extended function now supports Apple's Notes, the terminal emulator iTerm, the Jetbrains apps, Notion, Prompt, Quip, Terminal, TextEdit, VS Code, Warp and Apple's development environment Xcode.
Collaboration with apps
“Work with Apps” makes it possible to integrate content from running programs such as the Warp terminal tool or the Xcode development environment directly into ChatGPT. For example, AI can generate commands or automate programming tasks based on visible data.
ChatGPT not only evaluates the visible screen content, based on the integration into programming interfaces that enable close collaboration between ChatGPT and the supporting applications. Technically, ChatGPT not only accesses visible content, but also non-displayed elements and metadata of the apps.
In addition to coding applications, ChatGPT also supports note-taking and text-processing applications such as Apple's Notes or Notion. Here the AI content can be revised, completed or linguistically adapted. If necessary, content will be corrected or sources provided.
Security and control
OpenAI emphasizes that no content will be analyzed without explicit approval from the user. Users explicitly choose which applications are integrated into ChatGPT and which data is visible to the AI.
The functions are primarily intended to increase productivity by automating common tasks and making it easier to switch between different programs. OpenAI plans to further expand this integration in the future.