{"id":1980,"date":"2024-02-26T09:15:02","date_gmt":"2024-02-26T09:15:02","guid":{"rendered":"https:\/\/favtutor.com\/articles\/?p=1980"},"modified":"2024-05-01T13:24:35","modified_gmt":"2024-05-01T13:24:35","slug":"stable-diffusion-3-new","status":"publish","type":"post","link":"https:\/\/favtutor.com\/articles\/stable-diffusion-3-new\/","title":{"rendered":"Stable Diffusion 3 Is Here: But What&#8217;s New?"},"content":{"rendered":"\n<p>Stability AI introduced the Generative AI world to its latest generation of image-generating AI model, Stable Diffusion 3.&nbsp;How good is it? What&#8217;s that they fixed? What are the new updates? With this blog, we will provide you with the latest insights into Stable Diffusion 3.<\/p>\n\n\n\n<p><strong>Highlights:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Stability AI announced Stable Diffusion 3, its latest addition to the family of text-to-image models.<\/li>\n\n\n\n<li>Leverages Diffusion Transformers and Flow Matching as a part of its working model.<\/li>\n\n\n\n<li>Improves the ability to write text and provides superior image quality.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>What&#8217;s new in Stable Diffusion 3?<\/strong><\/h2>\n\n\n\n<p>Stability AI has <a href=\"https:\/\/stability.ai\/news\/stable-diffusion-3\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">unveiled Stable Diffusion 3<\/a> which they claim has better capabilities in terms of spelling and quality.  The biggest fix is how the model will handle text generation. The new upgrade will also provide more accurate images for multiple subjects.<\/p>\n\n\n\n<p>Here is an example to show how the text problem is fixed:<\/p>\n\n\n\n<div align=\"center\"><blockquote class=\"twitter-tweet\"><p lang=\"en\" dir=\"ltr\">Prompt: cinematic photo of a red apple on a table in a classroom, on the blackboard are the words &quot;go big or go home&quot; written in chalk <a href=\"https:\/\/t.co\/R67JMIRHJw\" target=\"_blank\">pic.twitter.com\/R67JMIRHJw<\/a><\/p>&mdash; Stability AI (@StabilityAI) <a href=\"https:\/\/twitter.com\/StabilityAI\/status\/1760657168364097674?ref_src=twsrc%5Etfw\" target=\"_blank\" rel=\"noopener\">February 22, 2024<\/a><\/blockquote> <script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/div>\n\n\n\n<p>They haven\u2019t released the model worldwide yet, however, it is available for preview via a waitlist which you can sign up to join.&nbsp;People have just seen the power of <a href=\"https:\/\/favtutor.com\/articles\/sora-ai-video-generator-openai\/\">Sora AI video generation<\/a> this month, so a lot of happening and it is happening very fast.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Stable Diffusion 3 is now available via API<\/strong><\/h3>\n\n\n\n<p>Stable Diffusion 3 and Stable Diffusion 3 Turbo are now available on the <a href=\"https:\/\/platform.stability.ai\/docs\/api-reference?_gl=1*1cgpb9s*_ga*MTgzODY4MTc1Ny4xNzA4NzA1OTg4*_ga_W4CMY55YQZ*MTcxMzQ0NDEzNS4xMy4xLjE3MTM0NDQyOTEuMC4wLjA.#tag\/Generate\/paths\/~1v2beta~1stable-image~1generate~1sd3\/post\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Stability AI Developer Platform API.<\/a> Stability AI has partnered with Fireworks AI, the fastest and most reliable API platform in the market, to deliver Stable Diffusion 3 and Stable Diffusion 3 Turbo.<\/p>\n\n\n\n<p>To get help on how to use the Stability AI API, visit <a href=\"https:\/\/platform.stability.ai\/docs\/getting-started\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">this documentation<\/a>.<\/p>\n\n\n\n<p>Stability also announced that they would soon make the model weights available for self-hosting with a Stability AI Membership.<\/p>\n\n\n\n<p>A limited number of users are also getting preview access to Stable Assistant Beta in its early release featuring Stable Diffusion 3. In its limited release, Stable Assistant enables content creation with Stability AI\u2019s cutting-edge image and language models.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Looking Into Stable Diffusion 3&#8217;s Build<\/strong><\/h3>\n\n\n\n<p><strong>While the exact details of Stable Diffusion 3\u2019s model architecture haven\u2019t been released yet to the public, we do know that it uses an updated diffusion transformer, a principle also followed by Open AI\u2019s Sora who has left all of us in a daze with its cutting-edge text-to-video generation technology.<\/strong><\/p>\n\n\n\n<p>This is a change in the technical approach for Stability\u2019s models. Just earlier this month they announced a preview of Stable Cascade which uses the W\u00fcrstchen architecture for improved performance and correctness. With diffusion transformers Stability is looking forward to changing the entire landscape of text-to-image generation techniques.<\/p>\n\n\n\n<p>The company stated that SD3\u2019s suite of models ranges from 800M to 8B parameters. The main goal behind this strategy is to have a range of scalability and quality options to suit users&#8217; creative demands. This strategy seeks to democratize access and be consistent with the company\u2019s basic principles. <\/p>\n\n\n\n<p><strong>Stability is also leveraging the Flow Matching technique for SD3\u2019s working.<\/strong> Flow matching is a novel technique for teaching Continuous Normalising Flows (CNFs) to simulate intricate data distributions. In comparison to diffusion paths, it was found that Conditional Flow Matching (CFM) with optimal transport paths results in faster training, more effective sampling, and superior performance.<\/p>\n\n\n\n<p>A pre-insight into these techniques quite gives us an idea of how potentially well SD3\u2019s model is architected to provide users with the best image generation content and experience, meeting all their creative needs across a widespread scale.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Safety Concerns Surrounding SD3<\/strong><\/h3>\n\n\n\n<p>Although this Image Generation model seems promising, its safety measures shouldn\u2019t be overlooked. Stability AI has put up a lot of safeguarding tools coming into SD3\u2019s early preview phase. They have taken measures to prevent the misuse of the tool by bad audiences.<\/p>\n\n\n\n<p>Here is what they say in an official announcement:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Our commitment to ensuring generative AI is open, safe, and universally accessible remains steadfast. With Stable Diffusion 3, we strive to offer adaptable solutions that enable individuals, developers, and enterprises to unleash their creativity, aligning with our mission to activate humanity\u2019s potential.<\/p>\n<\/blockquote>\n\n\n\n<p>They are also in collaboration with a team of researchers and experts in the field of Generative AI, going into the official public release of SD3. This will help them integrate several potential innovations and discover potential use cases keeping in mind several safety principles.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Conclusion<\/strong><\/h2>\n\n\n\n<p>Stable Diffusion 3 holds the potential for a major surge in the field of AI Image Generation technology. Users and developers worldwide can\u2019t wait to get their hands on the latest tool and experience the benefits firsthand. Stay tuned to our blogs to keep yourself updated on Stable Diffusion 3 and all the latest tools surrounding the world of Generative AI.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Stability AI announced an upgrade of their text-to-image generator with Stable Diffusion 3 with new updates and fixes.<\/p>\n","protected":false},"author":15,"featured_media":1981,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jnews-multi-image_gallery":[],"jnews_single_post":null,"jnews_primary_category":{"id":"","hide":""},"footnotes":""},"categories":[57],"tags":[59,74,73],"class_list":["post-1980","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","tag-generative-ai","tag-stability-ai","tag-stable-diffusion"],"_links":{"self":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/1980","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/comments?post=1980"}],"version-history":[{"count":3,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/1980\/revisions"}],"predecessor-version":[{"id":4398,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/1980\/revisions\/4398"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/media\/1981"}],"wp:attachment":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/media?parent=1980"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/categories?post=1980"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/tags?post=1980"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}