Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

List available models #298

Open
kieran-mace opened this issue Feb 4, 2025 · 5 comments
Open

List available models #298

kieran-mace opened this issue Feb 4, 2025 · 5 comments
Milestone

Comments

@kieran-mace
Copy link

When using the package, I don't know what to ask for when specifying a model.

For example, if I want to start chat with openAI's o3 model, I don't know if I should specify:

chat = chat_openai(model = 'o3')

or something else.

What may be useful is some sort of available_models('openai') function to help a user navigate this option.

@zilinskyjan
Copy link

Well, the models accessible via the API change over time, so my first reaction was that it may not be a natural ellmer functionality to scrape the provider's website and look for model names.

By perhaps something like current_models('openai') could print a message such as: "See the current list at: https://platform.openai.com/docs/models#current-model-aliases " (though again these URLs could change...)

@hadley
Copy link
Member

hadley commented Feb 12, 2025

@zilinskyjan most of the providers have an API for listing the available models.

@ries9112
Copy link

This would be a great feature not only for knowing what models are available, but also for ellmer to allow for other models. I'm trying to use sonnet 3.7 and it's not supported yet, but I would think in this case if it just allowed for the text 3.7 instead of 3.5 it would likely not need any other code changes to support it. And I think reducing the overhead and not having to push constant updates to support new models would be really desirable here.

Would the team welcome a PR going in this direction or is that a path that would not be desirable?

@hadley
Copy link
Member

hadley commented Feb 28, 2025

@ries9112 sonnet 3.7 is already supported.

I don't think there's much point in doing a PR until #331 is complete, because that sketches out a lot of the infrastructure that needs to happen first.

@ries9112
Copy link

Yes sorry I just came back to say I just had the wrong model name apologies. And sounds great. Super small note but this page doesn't have the #> Using model = "gpt-4o". part like chat_openai reference which I would have found helpful. Thank you for the work on ellmer, finding it to be a really fantastic package 🙌

@hadley hadley added this to the 0.1.2 milestone Mar 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants