{"id":3122,"date":"2024-04-01T11:38:04","date_gmt":"2024-04-01T11:38:04","guid":{"rendered":"https:\/\/favtutor.com\/articles\/?p=3122"},"modified":"2024-04-01T11:39:59","modified_gmt":"2024-04-01T11:39:59","slug":"dall-e-3-editor-interface-inpainting","status":"publish","type":"post","link":"https:\/\/favtutor.com\/articles\/dall-e-3-editor-interface-inpainting\/","title":{"rendered":"DALL-E 3 Inpainting Update: New Features coming to their Editor"},"content":{"rendered":"\n<p>Looks like OpenAI is moving too fast with all the new updates and technologies they are revealing! Recently, they have been working on <a href=\"https:\/\/favtutor.com\/articles\/openai-voice-engine\/\">Voice Engine<\/a> to clone voices, and now the new features coming to DALL-E 3 Edtior Interface.<\/p>\n\n\n\n<p><strong>Highlights:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>OpenAI unveiled new features to the DALL-E 3 Editor Interface, improving Inpainting capabilities.<\/li>\n\n\n\n<li>Allows to update ChatGPT-generated images; can also add, remove and update parts of the generated image.<\/li>\n\n\n\n<li>Comes with a few limitations which may be resolved soon.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>DALL-E 3 Editor Interface Update<\/strong><\/h2>\n\n\n\n<p>The <a href=\"https:\/\/help.openai.com\/en\/articles\/9055440-editing-your-images-with-dall-e\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">latest update to OpenAI&#8217;s help article<\/a> for DALL-E 3 Editor Interface revealed that inpainting features are coming to their AI Image Tool.<\/p>\n\n\n\n<p><strong>Using the DALL\u00b7E editor interface, we can now edit an image by selecting a specific area and then prompting about the modifications we need. We can also just use the prompting in the conversational panel,  without utilizing the selection tool.<\/strong><\/p>\n\n\n\n<p>With the aid of these upgrades for inpainting and outpainting, the interface can now modify photographs more creatively and with greater control. <\/p>\n\n\n\n<p>Currently, the updated Editor Interface feature is being rolled out to Desktop users at the moment. OpenAI plans to release advanced features to smartphones, tablets, etc soon.<\/p>\n\n\n\n<p>Desktop users who wish to access this tool can perform either of the following steps:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Editing a Generated Image:<\/strong> Generate an image using GPT-4\u2019s DALL-E 3, and after clicking on it, we will be taken to the image editor interface as shown below:<\/li>\n<\/ul>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" width=\"763\" height=\"539\" src=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-470-1.png\" alt=\"DALL-3 Editor Interface\" class=\"wp-image-3124\" srcset=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-470-1.png 763w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-470-1-300x212.png 300w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-470-1-120x86.png 120w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-470-1-750x530.png 750w\" sizes=\"(max-width: 763px) 100vw, 763px\" \/><\/figure>\n<\/div>\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Editing from a Blank Canvas:<\/strong> We can also choose to generate and edit an image from scratch. Note that we will need credits to generate and edit images here. Each prompt you give will cost a credit.<\/li>\n<\/ul>\n\n\n\n<p>A ChatGPT Plus subscription which offers DALL-E 3 through GPT-4. though mobile users aren&#8217;t able to use sophisticated editing functions like outpainting, they can still inpaint photographs by selecting &#8220;Edit&#8221; when they&#8217;ve already created or uploaded an image.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Exploring the Inpainting in DALL-3<\/strong><\/h2>\n\n\n\n<p>A variety of choices are available in the editor interface to help pinpoint areas of the created image that we would like to improve. Let\u2019s explore these features in detail:<\/p>\n\n\n\n<p><strong>The Editor Interface offers a selection tool on the top right corner of the editor. We can use it to select\/highlight any parts of the generated image you wish to edit.<\/strong><\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" width=\"761\" height=\"443\" src=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-471-1.png\" alt=\"select or highlight tool in DALL-E 3 Editor\" class=\"wp-image-3125\" srcset=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-471-1.png 761w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-471-1-300x175.png 300w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-471-1-750x437.png 750w\" sizes=\"(max-width: 761px) 100vw, 761px\" \/><\/figure>\n<\/div>\n\n\n<p>We can adjust the selection tool&#8217;s size in the upper-left corner of the editor to make it easier to choose the area that has to be edited. To improve the outcome, it is advisable to choose a sizable region surrounding the section you want to alter. <\/p>\n\n\n\n<p>The Undo and Redo buttons above the image can also be used to undo and redo selections. Alternatively, you can choose Clear Selection to start over from scratch.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" width=\"761\" height=\"438\" src=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-472-1.png\" alt=\"size\" class=\"wp-image-3126\" srcset=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-472-1.png 761w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-472-1-300x173.png 300w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/Screenshot-472-1-750x432.png 750w\" sizes=\"(max-width: 761px) 100vw, 761px\" \/><\/figure>\n<\/div>\n\n\n<p>The below video from Tibor Blaho, one of the few people who got access to the updated interface:<\/p>\n\n\n\n<div align=center><blockquote class=\"twitter-tweet\" data-media-max-width=\"560\"><p lang=\"en\" dir=\"ltr\">Preview: one step closer to DALL-E 3 editor &amp; inpainting using ChatGPT<br><br>1. Select area of the image to edit<br><br>2. Highlight the area and describe changes in chat <a href=\"https:\/\/t.co\/CApjlbccT6\" target=\"_blank\">https:\/\/t.co\/CApjlbccT6<\/a> <a href=\"https:\/\/t.co\/20ij3QMKvm\" target=\"_blank\">pic.twitter.com\/20ij3QMKvm<\/a><\/p>&mdash; Tibor Blaho (@btibor91) <a href=\"https:\/\/twitter.com\/btibor91\/status\/1772384726461903056?ref_src=twsrc%5Etfw\" target=\"_blank\" rel=\"noopener\">March 25, 2024<\/a><\/blockquote> <script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/div>\n\n\n\n<p>As we can see, parts of the generated image can be updated, deleted, and added to using the editor interface.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>1) Adding an Object<\/strong><\/h3>\n\n\n\n<p><strong>To add an object to the generated image simply, we can give the prompt \u201cadd &lt;desired object&gt;\u2019\u201d<\/strong>. And the editor will do the rest.<\/p>\n\n\n\n<p>For example, the editor successfully adds cherry blossoms to highlighted parts of a generated image when given the prompt \u201cAdd cherry blossoms\u201d.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"746\" height=\"1024\" src=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/WhatsApp-Image-2024-04-01-at-15.37.58_c6901ca0-1-746x1024.jpg\" alt=\"inpainting features example to DALL E 3 Editor Interface\" class=\"wp-image-3127\" srcset=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/WhatsApp-Image-2024-04-01-at-15.37.58_c6901ca0-1-746x1024.jpg 746w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/WhatsApp-Image-2024-04-01-at-15.37.58_c6901ca0-1-219x300.jpg 219w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/WhatsApp-Image-2024-04-01-at-15.37.58_c6901ca0-1-768x1054.jpg 768w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/WhatsApp-Image-2024-04-01-at-15.37.58_c6901ca0-1-750x1030.jpg 750w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/WhatsApp-Image-2024-04-01-at-15.37.58_c6901ca0-1.jpg 864w\" sizes=\"(max-width: 746px) 100vw, 746px\" \/><\/figure>\n<\/div>\n\n\n<h3 class=\"wp-block-heading\"><strong>2) Removing an Object<\/strong><\/h3>\n\n\n\n<p><strong>The editor interface can also remove an object from parts of a generated image. All we have to do is simply give the command \u201cremove \u2018your desired object\u2019\u201d.<\/strong><\/p>\n\n\n\n<p>In the image below, we can see that the highlighted birds have been removed by the editor interface when given the prompt \u201cremove birds\u201d.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"773\" height=\"1024\" src=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/birds-1-773x1024.jpg\" alt=\"remove objects in DALL E\" class=\"wp-image-3129\" srcset=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/birds-1-773x1024.jpg 773w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/birds-1-226x300.jpg 226w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/birds-1-768x1018.jpg 768w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/birds-1-750x994.jpg 750w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/birds-1.jpg 873w\" sizes=\"(max-width: 773px) 100vw, 773px\" \/><\/figure>\n<\/div>\n\n\n<h3 class=\"wp-block-heading\"><strong>3) Updating an Object<\/strong><\/h3>\n\n\n\n<p><strong>We can also update parts of a generated image with the help of the editor interface. <\/strong>In the example image below, the kitten&#8217;s face was highlighted and the prompt &#8220;change the cat&#8217;s expression to happy&#8221; was given. The result was amazing:<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" width=\"771\" height=\"1024\" src=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/happy-cat-1-771x1024.jpg\" alt=\"update objects in DALL E 3\" class=\"wp-image-3130\" srcset=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/happy-cat-1-771x1024.jpg 771w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/happy-cat-1-226x300.jpg 226w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/happy-cat-1-768x1020.jpg 768w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/happy-cat-1-750x996.jpg 750w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/04\/happy-cat-1.jpg 874w\" sizes=\"(max-width: 771px) 100vw, 771px\" \/><\/figure>\n<\/div>\n\n\n<p>Make sure to click on the Save button in the upper-right corner of the editor, as currently, expanded photos are not automatically stored. Users must be sure to frequently download the incremental work to prevent losing any data.<\/p>\n\n\n\n<p>We can also just use prompts to edit the images, without the need for highlighting specific parts in them. Simply include the precise location of the edit in the prompt, or just apply it to the desired part of the image.<\/p>\n\n\n\n<p>OpenAI also recommends using the inpainting only for a relatively smaller area in the original image, and using muted colors if inpainting in the corners.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Are there any Limitations?<\/strong><\/h2>\n\n\n\n<p>OpenAI has accepted some of the limitations of the Editor Interface feature and has asked users to keep them in mind.<\/p>\n\n\n\n<p>Firstly, users can\u2019t yet entirely view the extended image in their history or save it to a collection. This is quite a drawback as till now ChatGPT has stored all data of previous conversations entirely in the left side \u201cHistory\u201d panel, but not yet with edited images.<\/p>\n\n\n\n<p> OpenAI has stated that they will come up with a fix to this in the days to come.<\/p>\n\n\n\n<p>Secondly, they also stated that users can experience freezes in their browsers while editing and working with large images.<\/p>\n\n\n\n<p> They didn\u2019t provide any upcoming solution to this problem instead they advised users to download the edited images instantly, to avoid losing track of their work.<\/p>\n\n\n\n<p>Whenever a new technology arrives, it&#8217;s bound to have bugs and shortcomings, so we can be hassle-free and expect OpenAI to come up with solutions to these problems soon.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>The Future of Editing Images With AI<\/strong><\/h2>\n\n\n\n<p>All things considered, the use of AI for image editing\u2014whether with DALL-E or other models\u2014shows promise for developing more potent and user-friendly tools that will increase creative possibilities.<\/p>\n\n\n\n<p>To make them even more appropriate for image editing tasks, future updates of DALL-E might concentrate on producing more realistic photos with more attention to detail, texture, and lighting. <\/p>\n\n\n\n<p>Users may be able to edit several parts of the image, such as object placement, size, orientation, and style, with greater control over the image-generating process thanks to AI models.<\/p>\n\n\n\n<p>More sophisticated AI models might be able to comprehend the semantic meaning of textual descriptions more fully, which would improve their ability to analyze user input accurately and produce images that more closely represent the intended idea.<\/p>\n\n\n\n<p><strong> It might become possible to combine AI image editing capabilities with currently available image editing software so that users could take advantage of AI support in well-known programs like GIMP or Adobe Photoshop.<\/strong><\/p>\n\n\n\n<p>However, when looked at the other side of the coin, an advanced editing tool like OpenAI\u2019s Editor Interface and Midjourney may give rise to more such advanced tools in the future that can fully encapsulate the editing details with enhanced natural language processing capabilities. <\/p>\n\n\n\n<p>This raises the question of deepfakes, a highly concerning matter in the world of AI today. When such a highly powerful tool gets widespread access, it indeed raises an eyebrow regarding ethics and safety for the society.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Conclusion<\/strong><\/h2>\n\n\n\n<p>All these new improvements to OpenAI\u2019s DALL-E 3 Editor Interface are here to disrupt the image editing landscape. The tool lays a strong foundation for more advanced image editing tools in the days to come. Only time will tell, how the tool performs in the days to come!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Find out about the new updates to DALL-E 3 Editor Interface to add, remove or update selected areas in the image, also called inpainting.<\/p>\n","protected":false},"author":15,"featured_media":3139,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jnews-multi-image_gallery":[],"jnews_single_post":null,"jnews_primary_category":{"id":"","hide":""},"footnotes":""},"categories":[57],"tags":[56,61,144,60],"class_list":["post-3122","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","tag-ai","tag-chatgpt","tag-dall-e","tag-openai"],"_links":{"self":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/3122","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/comments?post=3122"}],"version-history":[{"count":10,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/3122\/revisions"}],"predecessor-version":[{"id":3143,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/3122\/revisions\/3143"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/media\/3139"}],"wp:attachment":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/media?parent=3122"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/categories?post=3122"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/tags?post=3122"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}