Cohere Release Notes

Command Model Updated
The Command model has been updated. Expect improved code and conversational capabilities, as well as reasoning skills on various tasks.

Co.rerank()
co.rerank(), a new API that sorts a list of text inputs by semantic relevance to a query. Learn more here.

Streaming Now Part of Generate API
Token streaming is now supported via the Co.generate() api. Learn more here.

Usage and Billing Table Improvements
The usage and billing table in the Cohere dashboard now has filtering and sorting capabilities. See here.

We are updating the names of our models to bring consistency and simplicity to our product offerings. As of today, you will be able to call Cohere’s models via our API and SDK with the new model names, and all of our documentation has been updated to reflect the new naming convention.

These changes are backwards compatible, so you can also continue to call our models with the Previous Names found in the table below until further notice.

Model Type

Previous Name

New Name

Endpoint

Generative

command-xlarge

command

co.generate

Generative

command-medium

command-light

co.generate

Generative

command-xlarge-nightly

command-nightly

co.generate

Generative

command-medium-nightly

command-light-nightly

co.generate

Generative

xlarge

base

co.generate

Generative

medium

base-light

co.generate

Embeddings

large

embed-english-v2.0

co.embed

Embeddings

small

embed-english-light-v2.0

co.embed

Embeddings

multilingual-22-12

embed-multilingual-v2.0

co.embed

See the latest information about our models here: /docs/models

If you experience any issues in accessing our models, please reach out to support@cohere.com.

Nightly versions of our Common models are now available. This means that every week, you can expect the performance of command-nightly to improve as we continually retrain them.

Command-nightly will be available in two sizes - medium and xlarge. The xlarge model demonstrates better performance, and medium is a great option for developers who require fast response, like those building chatbots. You can find more information here.

If you were previously using the command-xlarge-20221108 model, you will now be redirected to the command-xlarge-nightly model. Please note that access to the command-xlarge-20221108 model will be discontinued after January 30, 2023. The command-xlarge-nightly model has shown enhancements in all generative tasks, and we anticipate you will notice an improvement.

We're pleased to announce the release of Command R+, our newest and most performant large language model. Command R+ is optimized for conversational interaction and long-context tasks, and it is the recommended model for use cases requiring high performance and accuracy.

Command R+ has been trained on a massive corpus of diverse texts in multiple languages, and can perform a wide array of text-generation tasks. You'll find it especially strong for complex RAG functionality, as well as workflows that lean on multi-step tool use to build agents.

Multi-step Tool Use

Speaking of multi-step tool use, this functionality is now available for Command R+ models.

Multi-step tool use allows the model to call any number of tools in any sequence of steps, using the results from one tool call in a subsequent step until it has found a solution to a user's problem. This process allows the model to reason, perform dynamic actions, and quickly adapt on the basis of information coming from external sources.

[NOTE: co.detect_language() is deprecated.]

Cohere's multilingual text understanding model is now available! The multilingual-22-12 model can be used to semantically search within a single language, as well as across languages. Compared to keyword search, where you often need separate tokenizers and indices to handle different languages, the deployment of the multilingual model for search is trivial: no language-specific handling is needed — everything can be done by a single model within a single index.

In addition to our new model, you can now detect the language of a data source using co.detect_language() endpoint.

For more information, see our multilingual docs.

Effective December 2, 2022, we will be consolidating our generative models and only serving our Medium (focused on speed) and X-Large (focused on quality). We will also be discontinuing support for our Medium embedding model.

This means that as of this date, our Small and Large generative models and Medium embedding model will be deprecated.

If you are currently using a Small or Large generative model, then we recommend that you proactively change to a Medium or X-Large model before December 2, 2022. Additionally, if you are currently using a Medium embed model, we recommend that you change to a Small embed model.

Calls to Generate large-20220926 and xlarge-20220609 will route to the new and improved X-Large model (xlarge-20221108). Calls to Generate small-20220926 will route to the new and improved Medium model (medium-20221108).

If you have any questions or concerns about this change, please don’t hesitate to contact us at: team@cohere.com.

New & Improved Medium & Extremely Large

The new and improved medium and x-large outperform our existing generation models on most downstream tasks, including summarization, paraphrasing, classification, and extraction, as measured by our internal task-based benchmarks.
At this time, all baseline calls to x-large and medium will still route to previous versions of the models (namely, xlarge-20220609 and medium-20220926). To access the new and improved versions, you’ll need to specify the release date in the Playground or your API call: xlarge-20221108 and medium-20221108.

Older versions of the models (xlarge-20220609 & medium-20220926) will be deprecated on December 2, 2022.

NEW Command Model (Beta)

We’re also introducing a Beta of our new Command model, a generative model that’s conditioned to respond well to single-statement commands. Learn more about how to prompt command-xlarge-20221108. You can expect to see command-xlarge-20221108 evolve dramatically in performance over the coming weeks.

• Free, rate limited Trial Keys for experimentation, testing, and playground usage
• Production keys with no rate limit for serving Cohere in production applications
• Flat rate pricingfor Generate and Embed endpoints
• Reduced pricing for Classify endpoint
• New UI for dashboard including sign up and onboarding - everything except playground
• New use-case specific Quickstart Guides to learn about using Cohere API
• Replacing "Finetune" nomenclature with "Custom Model"
• Inviting team members is now more intuitive. Teams enable users to share custom models with each other
• Generative custom models now show accuracy and loss metrics alongside logs
• Embed and Classify custom models now show logs alongside accuracy, loss, precision, f1, recall
• Custom model details now show number of each label in dataset