New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

adding gpt-4-turbo-2024-04-09 to tested models #18

Merged

haesleinhuepf merged 1 commit into main from add-gpt-4-turbo-20240409-to-tested-models

Apr 11, 2024

Owner

haesleinhuepf commented Apr 10, 2024 •

edited

Loading

This PR contains:

a new test-case for the benchmark
- I hereby confirm that NO LLM-based technology (such as github copilot) was used while writing this benchmark
new generator-functions allowing to sample from other LLMs
new samples (sample_....jsonl files)
new benchmarking results (..._results.jsonl files)
documentation update
bug fixes

Related github issue (if relevant): closes #0

Short description:

This adds gpt-4-turbo-2024-04-09 to the list of tested models. Here are preliminary benchmarking results:

How do you think will this influence the benchmark results?

It adds a new model and does not change the other models results.

Why do you think it makes sense to merge this PR?

Now that we know how good the new model is, it would be wrong to not show it in the paper.


          adding gpt-4-turbo-2024-04-09 to tested models

0eaf4cd

haesleinhuepf merged commit 54d4041 into main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet