Cohere Rerank 3 Nimble Model - Multi

We adopted Cohere primarily for their command model to support enterprise-grade text generation and NLP workflows.

There was a use case for one of our customers where they required automated text generation and summarization of long documents and draft creation for internal content, so we used Cohere's command model with AWS  Bedrock.

For another customer, there was a similar use case but they also wanted semantic search and RAG, and instruction-based responses for chat and workflow automation were required, so we used Cohere's command model for that.

Cohere's command model is particularly useful for scenarios where consistent controlled output is more important, especially where we need creative responses, so I think Cohere's command model fits better in that case. We also found it well suited for structured enterprise tasks such as policy drafting, knowledge extraction, and generating standardized text for operational workflows.

It struck a good balance between fluency and predictability, which helps our team and is valuable for our business-critical applications, giving better insight to our team.

One of the major benefits I saw was data isolation and governance since Cohere has been implemented.

Consistent output quality, strong instruction following, and excellent embedding performance for retrieval tasks have benefited our organization. It was also offered from Amazon Bedrock , so this complete offering and strength from Cohere's command model helped our customers, and it is enterprise-friendly with deployment options such as VPC and data isolation that helped significantly.

Data privacy was a major concern because we operate from Asia-Pacific, and there is strong governance for data privacy in our country, so data privacy is the major compliance that helped us here.

Cohere could improve in areas where the command model is not as creative as some larger LLMs available in the market, which is expected but noticeable in open-ended generative tasks.

Reporting  and analytics in the dashboard could be more detailed and fine-tuned, which would enhance the experience.

Fine-tuning could be simplified to support broader teams without deep ML expertise.

For speeding up, what I have already suggested is that it can be more creative, and their reporting and analytics can be improved, as this would help teams without machine learning expertise and speed up their end goals.

The dashboard reporting can be improved.

We have been using Cohere for around one year.

Cohere is stable.

The scalability and performance are quite good.

We have not reached out to customer support yet, but once we encounter an issue and need to raise a ticket, we will provide feedback.

Negative

Cohere helped us with all three aspects: money is saved, time is saved, and we needed fewer resources to meet our end goals.

Compared to models available in the market, Cohere's pricing, setup cost, and licensing are better.

We have tried multiple models, but we found that Cohere's command was a better fit for our needs.

We explored models from Anthropic and AWS  native models such as AWS Titan Text before choosing Cohere.

Data privacy was a major concern because we operate from Asia-Pacific, and there is strong governance for data privacy in our country, so data privacy is a major compliance that helped us here.

Cohere offers great customization options.

If governance, consistency, and data privacy are priorities, Cohere meets our organization's requirements well.

I recommend that anyone, especially in environments where governance, consistency, and data privacy are priorities, should choose Cohere, particularly the command model for teams looking for a controlled enterprise-safe alternative for text generation, summarization, and instruction automation.

Currently, we have used Cohere from the AWS Bedrock offering only, but since AWS has changed their third-party model availability from partner accounts, in the future, we are going to be a reseller for Cohere.

The documentation and learning resources were very helpful.

Our overall review rating for Cohere is 8 out of 10.

My main use case for Cohere is Retrieval Augmented Generation.

A specific example of how I use Retrieval Augmented Generation with Cohere is for information retrieval systems.

The best feature Cohere offers is the Reranking model.

What stands out for me about the ranking model is that it improved performance in my work.

Cohere positively impacted my organization by improving the performance of my RAG system.

I noticed a 10% improvement in my log system after using Cohere.

Cohere is good enough, and I think it can be improved.

I have been using Cohere for two years.

Cohere is stable.

The scalability of Cohere is good.

The customer support for Cohere is good.

Negative

My experience with pricing, setup cost, and licensing for Cohere is good.

I have not seen metrics for return on investment, and I have no metrics to share.

My experience with pricing, setup cost, and licensing for Cohere is good.

My advice to others looking into using Cohere is to try it.

My company does not have a business relationship with this vendor other than being a customer.

I gave this review a rating of 8.

I have used Cohere in a RAG use case where I had to vectorize some data. I used multiple models in RAG to find a better model that could give superior results. I was trying to find a cloud-hosted model, and Cohere's Embed English v3.0 is a cloud-hosted model that took less time to embed the textual data. When I was trying to get the similarity search after embedding that data, Cohere provided much better results.

Let's suppose I had to embed 100 documents at a time. Most other models, including all-MiniLM-L6-v2, took more time when I was trying to embed using that model. When I tried Cohere, it was much faster. I would say it was more than 50 to 60% faster than those models. It was even somewhat faster than text-embedding-3, which is from OpenAI. So Cohere helped to reduce the development time and embedding times.

I believe Cohere offers excellent features, especially the cloud-hosted model and the API calls. The number of times I can call the API within a minute is very good. The ping is great; I have started a request to Cohere model, and it was very quick to respond. The best part was the free tier because most models do not provide a free tier.

Regarding benefits, Cohere is less costly than other models. If I talk about OpenAI or Google embedding models, they charge highly compared to Cohere. Regarding the training data, Cohere has the most data embedded or trained with the most English. Cohere's Embed English v3.0 has been trained with much more data than other models, including OpenAI. This gives an extra benefit to my organization.

One thing that Cohere can improve is related to some distances when I am trying similarity search. Let's suppose I have provided textual data that has been embedded. I have to use some extra process from numpy after embedding the model. In the case of OpenAI embedding models, I do not have to use that extra process, and they provide lower distances compared to my results from Cohere. I was getting distances of approximately 0.005 sometimes, but in the case of Cohere, I was getting distances around 0.5 or sometimes more than that. I think that can be improved. It was possibly because of some configuration or the way I was using it, but I am not exactly sure about that.

I have been using Cohere for the last seven or eight months.

The scalability was very good because of the response time. Even though I do not need that much processing at a time, I have had a good experience with Cohere so far.

Previously, I was using all-MiniLM-L6-v2 and switched to Cohere because all-MiniLM-L6-v2 needed to be locally deployed. That model was processing locally, and the results I was getting from that model, even though it was open source, I was not satisfied. That is why I switched to Cohere.

I can highlight two benefits. Cohere charges less than OpenAI, so it saves cost. In the second use case, the timing is significant. Cohere's Embed English model took less time to embed than OpenAI's embedding ada-002 model. In this case, it also saves time. These two benefits I can highlight.

I have evaluated OpenAI's Embed English v3 and text-embedding-3 models. I have evaluated multiple models, and I even evaluated some models from Hugging Face .

Cohere provides a free tier, and any developer who is starting their journey can use Cohere for RAG use cases. They can utilize the model benefits. After using Cohere, I got distances after the similarity search that were much lower compared to other vectorization and embedding models. The only model that performed better than Cohere was OpenAI's text-embedding-3-large. It was good, but Cohere was the second-best performing model in my use case.

I think Cohere's use cases are excellent, and I would suggest Cohere to others because of the less response time and time-saving in the process. It is also cheaper than other models. I would give this review a rating of eight out of ten.

Neutral