Image Source: Andrew Mayne
OpenAI is developing plugins for ChatGPT, extending its capabilities to include third-party tools, browsing plugins, and the Code Interpreter. The Code Interpreter allows users to generate code, run code, upload and download files, and evaluate the output, all within the ChatGPT interface. Currently, it supports Python with a small selection of libraries.
Code Interpreter’s Unique Features
The Code Interpreter can analyze output and use it in another function, allowing users to string together different sections of code. This creates a powerful tool for coding and research, enabling users to carry out development without leaving the ChatGPT UI. The article demonstrates this by showing how the Code Interpreter generates a Pac-Man gif using multiple algorithms.
Exploring Audio and Visual Capabilities
The Code Interpreter’s abilities extend to generating audio and visual content. Examples include creating a Shepard tone (an audio illusion), turning a Conway’s Game of Life simulation into music, and generating an album cover for a song. The article also showcases the creation of QR codes and the possibility of using ChatGPT to create a Game of Life simulation ending in a QR code.
Image Manipulation and Generative Animation
The Code Interpreter can manipulate images using basic libraries like OpenCV, as shown in the face-finding example. It can also convert images into ASCII format and generate animated gifs, like bouncing blocks and snowstorms. Moreover, it’s capable of working with Optical Character Recognition (OCR) libraries.
Calendar Invites, Drawing, and Simple Machine Learning Models
The Code Interpreter can create calendar invites in plain text and save them as .ics files. It can also generate simple SVG drawings, such as a cat with a hat and pipe. While it doesn’t currently support machine learning libraries, the Code Interpreter can create basic statistical text generation models using n-grams.
Simulations and Gaming
The Code Interpreter can create various simulations and games, such as a Pac-Man simulator, a visualization of planetary orbits, and simplified versions of checkers and chess. These examples highlight the potential of ChatGPT and the Code Interpreter plugin for generating a wide range of content.