Missing required model_version with AzureOpenAiGenerativeModel

[wnijmeijer]

Azure requires the default_headers={"model-version": "2024-07-18"}. But we cannot set it in the AzureOpenAiGenerativeModel

[galshubeli]

Hi @wnijmeijer t thank you for your question. Based on Microsoft's documentation, the only credentials you need are api_key, api_version, and azure_endpoint.

You can also use our Litellm integration, and the configuration there is the same.

Are you sure you mean "model-version" and not "api_version"?
Would you like to share your exception?"

[wnijmeijer]

When i use this:

    def _connect_to_model(self) -> None:
        """
        Establish a connection to the Azure OpenAI model by initializing the AzureOpenAI client.
        """
        self.client = AzureOpenAI(azure_endpoint=self.azure_endpoint,
                                api_version=self.api_version,
                                api_key=self.api_key,default_headers={"model-version": "2024-07-18"}
                                )

it works.

Else i get this error message:
Chyper error Error code: 400 - {'statusCode': 400, 'message': 'Missing model-version in header'}

[galshubeli]

You’re right. Thanks for this, I’ll fix it.

In the meantime, it looks like you know how to modify this function for your use.
Until I release the fix, do you need any more help?

[wnijmeijer]

No all good, thanks