Issue with voice agent api, failing with STT when configuring the listen language #1119
Replies: 2 comments
-
Thanks for asking your question. Please be sure to reply with as much detail as possible so the community can assist you efficiently. |
Beta Was this translation helpful? Give feedback.
-
Hey there! It looks like you haven't connected your GitHub account to your Deepgram account. You can do this at https://community.deepgram.com - being verified through this process will allow our team to help you in a much more streamlined fashion. |
Beta Was this translation helpful? Give feedback.
-
For voice agent if i am configuring the agent listen language (STT) to hindi ( i tried with english - india and us too) i am getting the following error message from the deepgram -> Text message received from client did not match any of the formats we expect
reqid for failed voice agent : 26dd1a98-3d9c-4407-99e4-84e3887b1144
PFB Settings configured :
config_message = {
"type": "SettingsConfiguration",
"audio": {
"input": {
"encoding": "linear16",
"sample_rate": 8000,
},
"output": {
"encoding": "mulaw",
"sample_rate": 8000,
"container": "none",
},
},
"agent": {
"listen": {"model": "nova-2","language":"hi"},
"think": {
"provider": {
"type": "anthropic",
},
"model": "claude-3-haiku-20240307",
"instructions": prompt,
},
"speak": {
"provider": "eleven_labs",
"voice_id": "cgSgspJ2msm6clMCkdW9",
},
},
}
message recieved:
{"type":"Error","message":"Text message received from client did not match any of the formats we expect."}
But if i remove the agent listen language then i am getting the output and voice agent is working fine,
reqid for success voice agent : 2cf668c0-3901-474f-989c-c4af0a765fa2
PFB Settings configured :
config_message = {
"type": "SettingsConfiguration",
"audio": {
"input": {
"encoding": "linear16",
"sample_rate": 8000,
},
"output": {
"encoding": "mulaw",
"sample_rate": 8000,
"container": "none",
},
},
"agent": {
"listen": {"model": "nova-2"},
"think": {
"provider": {
"type": "anthropic",
},
"model": "claude-3-haiku-20240307",
"instructions": prompt,
},
"speak": {
"provider": "eleven_labs",
"voice_id": "cgSgspJ2msm6clMCkdW9",
},
},
}
message recieved:
{"type":"SettingsApplied"}
FYI, I am facing this issue since past few days. It will be really helpful if you guys come up with any fix. And looking forward for the early reply.
Beta Was this translation helpful? Give feedback.
All reactions