OpenAI has released an updated version of their text-to-image tool, DALL-E, which makes use of ChatGPT — OpenAI’s viral AI chatbot — to alleviate some of the pain of prompting.
Most cutting-edge, AI-powered picture-generating technologies now accept prompts — image descriptions — and transform them into artwork in a variety of styles ranging from photorealistic to fantastical. However, creating the correct prompt can be difficult, so much so that “prompt engineering” is becoming a legitimate profession.
ChatGPT is used by OpenAI’s latest tool, DALL-E 3, to help fill in prompts. Subscribers to OpenAI’s premium ChatGPT plans, ChatGPT Plus and ChatGPT Enterprise can use ChatGPT to enter in an image request and hone it through discussions with the chatbot, obtaining the results right within the chat app.
ChatGPT will take a few-word suggestion and make it more descriptive, providing more direction to the DALL-E 3 model.
DALL-E 3 includes more than only ChatGPT connectivity. According to OpenAI, DALL-E 3 also generates higher-quality graphics that more closely depict instructions, especially when dealing with lengthy prompts. It also handles material that has typically tripped up image-generating models, such as text and human hands, better.
DALL-E 3 also has new mechanisms to reduce algorithmic bias and improve safety, according to OpenAI. DALL-E 3, for example, will reject requests for images that are in the manner of living artists or depict public people. Artists can now choose whether or not to have some or all of their work utilized to train future generations of OpenAI text-to-image models. (OpenAI and some of its competitors are being sued for allegedly exploiting artists’ copyrighted work to train their generative AI image models.)
The release of DALL-E 3 coincides with the intensification of the generative AI race, notably in the image-synthesizing area. Competitors such as Midjourney and Stability AI are refining their image-generation models, putting pressure on OpenAI to keep up.
DALL-E 3 will be available to premium ChatGPT users in October, followed by research laboratories and API clients. The company has not stated when or if it intends to issue a free web tool, as it did with DALL-E 2 and the original DALL-E model.