Stability AI Release Notes

November 10th, 2023

Overview

We're excited to announce the release of the Stable Diffusion v1.6 in the REST API! This model is designed to be a higher quality, more cost-effective alternative to stable-diffusion-v1-5 and is ideal for users who are looking to replace it in their workflows. stable-diffusion-v1-6 has been optimized to provide higher quality 512px generations when compared to stable-diffusion-v1-5.

Prompt:A wolf in Yosemite National Park, chilly nature documentary film photography

Dimensions:512x512

Steps:50

Seed:1

CFG Scale:7

Sampler:DDIM

Please note however, that image-to-image is not currently supported via stable-diffusion-v1-6.

What's New

API

• Introduced support for the stable-diffusion-v1-6 engine to the REST API.

Deprecations

• A number of our legacy models will be deprecated by the 15th of November. Please visit the API Parameters page for additional information.

---

July 26th, 2023

Overview

We're excited to announce the release of Stable Diffusion XL v1.0, the first major version release in the SDXL series!

What's New

Building upon the success of the SDXL v0.9 release, SDXL v1.0 brings with it a number of image detail improvements. Specifically, SDXL v1.0 offers enhanced vibrancy and overall color tone accuracy, including deeper black and brighter white tones.

Prompt:A wolf in Yosemite National Park, chilly nature documentary film photography

Negative Prompt:3d render, smooth, plastic, blurry, grainy, low-resolution, anime, deep-fried, oversaturated

Steps:50

Seed:992446758

CFG Scale:8

Left Model: stable-diffusion-xl-1024-v0-9 AKA SDXL v0.9 Right Model: stable-diffusion-xl-1024-v1-0 AKA SDXL v1.0

API

• Introduced support for the stable-diffusion-xl-1024-v1-0 model engine to the API (gRPC SDK + REST), which brings with it new pricing considerations. Please check out the Pricing page for additional information.
• stable-diffusion-xl-1024-v1-0 is now the default engine for the API. If you wish to use a different engine, you must specify it in your request.
• stable-diffusion-xl-1024-v1-0 supports a variety of aspect ratios. Please check the API Parameters page for additional information.

---

June 27th, 2023

Overview

We're excited to announce the release of Stable Diffusion XL v0.9, the newest model in the SDXL series! Building on the successful release of the Stable Diffusion XL beta, SDXL v0.9 brings marked improvements in image quality and composition detail. Please be sure to check out our blog post for more comprehensive details on the SDXL v0.9 release.

What's New

SDXL v0.9, trained at a base resolution of 1024 x 1024, produces massively improved image and composition detail over its predecessor.

Prompt:A wolf in Yosemite National Park, chilly nature documentary film photography

Negative Prompt:3d render, smooth, plastic, blurry, grainy, low-resolution, anime, deep-fried, oversaturated

Left Model: stable-diffusion-xl-beta-v2-2-2 AKA SDXL v0.8 Right Model: stable-diffusion-xl-1024-v0-9 AKA SDXL v0.9

SDXL v0.9 has also been trained to handle multiple aspect ratios, a clear improvement over previous models that would often see repeated subjects / concepts in wide or tall aspect ratio generations.

Prompt:A wolf in Yosemite National Park, chilly nature documentary film photography

Negative Prompt:3d render, smooth, plastic, blurry, grainy, low-resolution, anime, deep-fried, oversaturated

Dimensions: 1344x768 …

May 11th, 2023

Overview

We are excited to announce the release of the Stable Animation SDK, a powerful tool designed to empower artists and developers by leveraging Stable Diffusion to creating stunning animations!

Explore the possibilities by generating animations using various inputs: text prompts (without images), source images, or source videos. Animate with all of our Stable Diffusion models, including Stable Diffusion XL, at your fingertips.

Check out the three ways to create animations:

1. Text to Animation: Input a text prompt and adjust various parameters to generate an animation.
2. Text Input + Initial Image Input: Provide an initial image as the starting point for the animation, combined with a text prompt to generate the final output animation.
3. Input video + Text input: Use an initial video as the basis for the animation, fine-tuning parameters to create the final output animation guided by a text prompt.

What's New

API

• Added support for the Stable Animation SDK to the API (gRPC SDK only). Check out the docs to learn more.

Breaking Changes

We've introduced a minor breaking change with this release. The utility function image_to_prompt has been moved from stability_sdk.client to stability_sdk.utils, and its parameters have been updated: …

Apr. 17th 2023

Overview

We're excited to announce that we've released support for style presets to our API!

Style presets are a way to apply pre-defined styles to your images. These are the same style presets available in DreamStudio. Style presets are currently only available in our REST API, with support in Stability for Blender and gRPC coming soon.

We're excited to see what you create with them in your own integrations!

Dog in a forest, generated with the digital-art style preset using SDXL.

Dog in a forest, generated with the cinematic style preset using SDXL.

If you're using our REST API, you can now use style presets by passing the style_preset parameter to the text-to-image, image-to-image and image-to-image/masking endpoints. Check out the REST API docs for more information.

What's New

API

• Added support for style presets via the REST API. Check out the docs to learn more.
• Added support for the Extras field in REST. This field allows you to pass additional information to the generation service for certain beta features. …

Apr. 14th 2023

Overview

We're excited to announce that we've released support for SDXL to our API! Please be sure to check out our blog post on SDXL's release for more information.

What's New

API

• Added support for the stable-diffusion-xl-beta-v2-2-2 model engine to the API (gRPC SDK + REST). This engine comes with special pricing considerations, please visit the API Parameters page to learn more.

Here's a short summary of some of SDXL's capabilities, taken as an excerpt from our blog post on SDXL's release:

• Next-level photorealism capabilities.

• Enhanced image composition and face generation.

• Rich visuals and jaw-dropping aesthetics.

• Use of shorter prompts to create descriptive imagery.

• Greater capability to produce legible text.

Note: stable-diffusion-xl-beta-v2-2-2 comes with some special considerations with regard to the dimensions it can generate images at: …

Mar. 21st 2023

Overview

We are excited to announce that support for image upscaling has been added to our API! The Image Upscaler is a tool that allows you to upscale images and animation frames using our ESRGAN-based upscaler. It is currently available in our Stability for Blender and Stability for Photoshop plugins, as well as our gRPC and REST APIs. This update also brings a number of other fixes and improvements in each integration.

Check out the docs to learn how to use the Upscaler in Photoshop, Blender, and via our API.

If you are using our gRPC SDK, you can now use the Upscaler by calling the Upscale method on the Stability service. Check out the gRPC docs for more information. REST support for the upscaler is also available here.

What's New

API

• Added support for image upscaling via the API. Check out the docs to learn more.

Photoshop

• Added the Stability Upscaler - this is a new feature that lets you upscale your layers and documents in Photoshop using the Stability SDK. Click on the 'Upscaler' tab to try it out.
• Fixed some issues related to inpainting with DALL-E 2.
• Updated the Stability SDK version to latest. …

Mar. 21st 2023

Overview

We are excited to announce the REST API v1 is officially live! The documentation has been integrated directly into this site and can be viewed here.

If you encounter any issues or have any feedback for us please stop by the #official-rest-api channel in our community Discord and/or open a GitHub issue.

If you're using /v1alpha or /v1beta please take a look at the Deprecations section below.

What's New

Upscaling is now available!

It is now possible to upscale images using the REST API. Check out the upscaling docs for more information.

Improved error handling

We've added more error handling, improved error messages, and all errors should now include an id field for troubleshooting. If you encounter an issue please drop a message in the #official-rest-api channel in our community Discord and include the id field from the response.

Breaking Changes …

Feb. 2nd 2023

Overview

We are excited to announce the v1beta release candidate for the REST API is officially live! Check out the new and improved documentation here.

For this release we've taken your feedback into consideration and have implemented some changes based on suggestions shared with us via the #api channel in our community Discord and GitHub issues.

The majority of the changes relate to standardizing input parameters and tweaks to input validation, but this release is a big step towards our goal of making the API as straightforward and easy to use as possible.

We are looking for feedback from the community to help us improve the API before we release the final version, so please stop by the #api channel in our community Discord and/or open a GitHub issue.

What's New

Height and Width Validation (v1alpha,v1beta)

Height and width validation now allows for a wider range of resolutions, spawned by this issue on GitHub. …

Dec. 14th 2022

Overview

We have been hard at work on the REST API for the past few weeks and are excited to announce that the v1 release candidate is officially live!

We are looking for feedback from the community to help us improve the API before we release the final version, so please stop by the API channel in the Stable Diffusion Discord and let us know what you think!

What's New

• /image-to-image/masking endpoint with two options for specifying the mask:
  1. mask_image where lighter or darker pixels influence the diffusion process.
  2. init_image where transparent pixels influence the diffusion process.
• Improved HTTP error codes:
  • 400s for bad requests.
  • 401s for unauthorized requests.
  • 403s for insufficient privileges.
  • 404s for things like trying to use an engine that doesn't exist.
  • Relegated 500s back to internal server errors (where they belong!)
• Improved error messages for all endpoints:
  • Magic decoder ring no longer required.
• Fixed small bug causing null values to show up in the response when Accept header was set to application/json.
• Addressed some CORS-related issues …

Dec. 7th 2022

Overview

In this release of the Stability API, we are introducing Stable Diffusion 2.1 (512px + 768px), including multi-prompting with prompt weighting.

What's New

New Models

• Stable Diffusion 2.1 - 512px
• Stable Diffusion 2.1 - 768px

With the Stable Diffusion 2.1 release, we have updated our training strategy and reintroduced much of the artistic flair our users felt was lost in 2.0. Check out the official announcement on the Stability AI blog to learn more.

Our existing documentation has been updated to reflect the addition of Stable Diffusion 2.1 as an optional model accessible via the API.

Multi-prompting

Multiple weighted prompts can now be passed to the API in this release.

Multi-prompting allows users to combine concepts to create new and unique results. The model will also attempt to eliminate or avoid concepts in the resulting image when a negative value is assigned to an additional prompt, colloquially known as "negative prompting."

For functional examples, please refer to our new documentation on multi-prompting.

Open Source Releases

Stable Diffusion 2.1 model checkpoints are now available via our open source repositories on Hugging Face.

---

Nov. 25th 2022

Overview

In this release of the Stability API, we are introducing Stable Diffusion 2.0 (512px + 768px), including two new samplers, and an improved inpainting model (Stable Inpainting 2.0).

What's New

New Models

• Stable Diffusion 2.0 - 512px
• Stable Diffusion 2.0 - 768px
• Stable Inpainting 2.0 - 512px

Stable Diffusion 2.0 is all-new, trained from the ground up with safety in mind.

The 2.0 models are trained on an aesthetic subset of LAION-5B and further filtered via LAION’s NSFW filter, meaning high quality images are available with far less intrusive safety filtering.

Stable Diffusion 2.0 models include a new text encoder trained by LAION with support from Stability AI, which improves the quality of generated images when compared to Stable Diffusion 1.x models.

The new 768px model offers greater coherence at larger dimensions as it was trained on higher resolution samples (768 x 768). This helps mitigate common issues such as doubling and mosaic effects in larger dimension images generated by 512px models.

New Samplers

Optimized and backwards compatible with 1.4, 1.5 and 2.0, we’re introducing two new samplers: k_dpmpp_2m and k_dpmpp_2s_ancestral.

The benefit of these new samplers is their ability to resolve high quality images at lower required step counts, enabling your users to achieve better results with fewer steps. …