You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
An ensemble to generate more comments, with a filtering step to only output actually unique ones.
For example, GPT-4o + Mistral. Or, GPT-4o with the patch in the default order + GPT-4o with the patch in random order.
We have this as part of the experimental mode but without the filtering step. We return the results generated by each of the models/configurations to the user for evaluation.
The following are the configurations in the experimental mode:
gpt-4o temp 0.2
gpt-4o temp 0.8
claude-3-5 temp 0.2
gemini-1.5-pro temp 0.2 (disabled due to a quota limitation error)
An ensemble to generate more comments, with a filtering step to only output actually unique ones.
For example, GPT-4o + Mistral. Or, GPT-4o with the patch in the default order + GPT-4o with the patch in random order.
4028e2d was the first step for this.
This depends on #4580 for the evaluation.
This also depends on #4582 and #4587 to choose what to put in the mix.
The text was updated successfully, but these errors were encountered: