You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To enable automatic speech recognition(ASR) capabilities in Studio, we need to create a Whisper backend class that implements the base Backend class in the appnexus library. The Whisper backend class should be able to make a request to any whisper model hosted anywhere, for example Hugging Face, Open AI, Assembly AI, etc. As a start, it will perform transcription requests for Studio.
Description and outcomes
Create a new class Whisper that implements Backend:
CLASSWhisperIMPLEMENTSBackend:
METHODmake_request(params):
# make request to DeepLearning models hosted as services(e.g via Hugging Face)METHODconnect(params):
# Implement the connect method for hosted service if anyCLASSMETHOD_create_instance(cls)
# initialize a Whisper Backend instance
The class should connect to whichever backend the whisper model is being hosted(if required) by implementing connect().
Implement the make_request() method that performs transcription requests. It should return the result of a transcription
Accessibility requirements
Not applicable
Acceptance criteria
The Whisper backend is created and it implements the Backend class.
The class connects to whichever service(Hugging Face, Open AI, etc) the Whisper model is being hosted(if required).
The make_request method is implemented correctly and performs transcriptions as expected
Tests are written to validate correctness of the Whisper backend logic.
Documentation has been added to the backend class, explaining its purpose, inputs and outputs.
Resources
The text was updated successfully, but these errors were encountered:
Overview
To enable automatic speech recognition(ASR) capabilities in Studio, we need to create a
Whisper
backend class that implements the baseBackend
class in theappnexus
library. TheWhisper
backend class should be able to make a request to any whisper model hosted anywhere, for example Hugging Face, Open AI, Assembly AI, etc. As a start, it will perform transcription requests for Studio.Description and outcomes
Whisper
that implementsBackend
:connect()
.make_request()
method that performs transcription requests. It should return the result of a transcriptionAccessibility requirements
Not applicable
Acceptance criteria
Whisper
backend is created and it implements theBackend
class.make_request
method is implemented correctly and performs transcriptions as expectedWhisper
backend logic.Resources
The text was updated successfully, but these errors were encountered: