Azure OpenAI Embeddings vs OpenAI Embeddings

1.6k views Asked by At

Is anyone getting different results from Azure OpenAI embeddings deployment using text-embedding-ada-002 than the ones from OpenAI? Same text, same model, and the results are considerably far in the vector space.

What's recommended for embeddings?

1

There are 1 answers

0
Ram On BEST ANSWER

Current AOAI's text-embedding-ada-002 is somewhat different from OAI's. Our model currently supports only 2K tokens, while OAI can support 8K tokens.

Azure OpenAI doesn’t allow batched embeddings. You need to use multiple simultaneous requests. If you hit the maximum req/min, you will need to ask Azure a quota increase.