Skip to content

Commit

Permalink
Update benchmark visualizations (#271)
Browse files Browse the repository at this point in the history 
Co-authored-by: slobentanzer <[email protected]>
  • Loading branch information
@github-actions @slobentanzer
github-actions[bot] and slobentanzer authored Feb 21, 2025
1 parent d93028e commit 96f7514
Show file tree
Hide file tree
Showing 47 changed files with 393 additions and 393 deletions.
6 changes: 3 additions & 3 deletions benchmark/results/processed/correlations.txt
View file
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
Size vs accuracy Pearson correlation: 0.23390145037154594
Size vs accuracy Pearson correlation p-value: 1.2198001457703588e-11
Quantisation vs accuracy Pearson correlation: 0.23577777304999908
Quantisation vs accuracy Pearson correlation p-value: 8.269650238065426e-12
Size vs accuracy Pearson correlation p-value: 1.2198001457703617e-11
Quantisation vs accuracy Pearson correlation: 0.23577777304999906
Quantisation vs accuracy Pearson correlation p-value: 8.269650238065093e-12
92 changes: 46 additions & 46 deletions benchmark/results/processed/end_to_end_query_generation.csv
View file
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,9 @@ llama-3.1-instruct:8:ggufv2:Q6_K,66.0,90.0,0.0,0.7333333333333333,3
gpt-4o-mini-2024-07-18,119.0,173.0,1.54265871051029,0.6878612716763006,5
claude-3-opus-20240229,59.0,90.0,3.2145502536643185,0.6555555555555556,3
gpt-4-turbo-2024-04-09,110.0,173.0,0.0,0.6358381502890174,5
llama-3.1-instruct:70:ggufv2:IQ2_M,54.0,90.0,0.0,0.6,3
llama-3.1-instruct:70:ggufv2:IQ4_XS,54.0,90.0,0.0,0.6,3
llama-3.1-instruct:70:ggufv2:Q3_K_S,54.0,90.0,3.4641016151377544,0.6,3
llama-3.1-instruct:70:ggufv2:IQ4_XS,54.0,90.0,0.0,0.6,3
llama-3.1-instruct:70:ggufv2:IQ2_M,54.0,90.0,0.0,0.6,3
openhermes-2.5:7:ggufv2:Q3_K_M,63.0,219.0,1.0,0.2876712328767123,5
openhermes-2.5:7:ggufv2:Q6_K,60.0,219.0,1.7320508075688776,0.273972602739726,5
openhermes-2.5:7:ggufv2:Q5_K_M,58.0,219.0,0.5773502691896257,0.2648401826484018,5
Expand All @@ -24,54 +24,54 @@ openhermes-2.5:7:ggufv2:Q8_0,52.0,219.0,1.1547005383792517,0.2374429223744292,5
openhermes-2.5:7:ggufv2:Q2_K,35.0,219.0,2.309401076758503,0.1598173515981735,5
gpt-4o-2024-05-13,20.0,173.0,0.0,0.11560693641618497,5
gpt-4-0125-preview,19.0,173.0,0.0,0.10982658959537572,5
llama-2-chat:7:ggufv2:Q6_K,0.0,219.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
llama-3-instruct:8:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
llama-3-instruct:8:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
llama-3-instruct:8:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
llama-3-instruct:8:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q8_0,0.0,219.0,0.0,0.0,5
chatglm3:6:ggmlv3:q4_0,0.0,150.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q5_K_M,0.0,219.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q4_K_M,0.0,219.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q2_K,0.0,219.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q6_K,0.0,219.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q5_K_M,0.0,219.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q4_K_M,0.0,219.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q3_K_M,0.0,219.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q2_K,0.0,219.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
llama-3-instruct:8:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
llama-3-instruct:8:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
llama-2-chat:7:ggufv2:Q8_0,0.0,219.0,0.0,0.0,5
llama-3-instruct:8:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
llama-3-instruct:8:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q5_K_M,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q4_K_M,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q3_K_M,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q2_K,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
mistral-instruct-v0.2:7:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q6_K,0.0,150.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q8_0,0.0,150.0,0.0,0.0,5
60 changes: 30 additions & 30 deletions benchmark/results/processed/entity_selection.csv
View file
Original file line number Diff line number Diff line change
@@ -1,26 +1,26 @@
Full model name,Score achieved,Score possible,Score SD,Accuracy,Iterations
llama-3.1-instruct:70:ggufv2:IQ4_XS,24.0,24.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q5_K_M,24.0,24.0,0.0,1.0,3
gpt-4o-2024-05-13,70.0,70.0,0.0,1.0,5
gpt-4-turbo-2024-04-09,64.0,64.0,0.0,1.0,5
claude-3-5-sonnet-20240620,22.0,22.0,0.0,1.0,3
llama-3.1-instruct:70:ggufv2:IQ2_M,24.0,24.0,0.0,1.0,3
claude-3-opus-20240229,24.0,24.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q5_K_M,24.0,24.0,0.0,1.0,3
openhermes-2.5:7:ggufv2:Q3_K_M,279.0,279.0,0.0,1.0,5
llama-3.1-instruct:70:ggufv2:IQ4_XS,24.0,24.0,0.0,1.0,3
llama-3.1-instruct:70:ggufv2:Q3_K_S,24.0,24.0,0.0,1.0,3
llama-3.1-instruct:70:ggufv2:IQ2_M,24.0,24.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q3_K_L,132.0,132.0,0.0,1.0,3
gpt-4o-2024-08-06,42.0,42.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q6_K,24.0,24.0,0.0,1.0,3
gpt-4o-2024-05-13,70.0,70.0,0.0,1.0,5
gpt-4-turbo-2024-04-09,64.0,64.0,0.0,1.0,5
gpt-4o-2024-08-06,42.0,42.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q8_0,186.0,186.0,0.0,1.0,3
openhermes-2.5:7:ggufv2:Q3_K_M,279.0,279.0,0.0,1.0,5
claude-3-opus-20240229,24.0,24.0,0.0,1.0,3
gpt-3.5-turbo-0125,45.0,46.0,0.0,0.9782608695652174,5
gpt-4o-mini-2024-07-18,70.0,76.0,0.0,0.9210526315789473,5
gpt-4-0613,58.0,63.0,0.0,0.9206349206349206,5
llama-3.1-instruct:8:ggufv2:Q4_K_M,138.0,150.0,0.0,0.92,3
llama-3.1-instruct:8:ggufv2:IQ4_XS,59.0,66.0,0.0,0.8939393939393939,3
gpt-3.5-turbo-0613,40.0,45.0,0.0,0.8888888888888888,5
llama-3-instruct:8:ggufv2:Q5_K_M,35.0,40.0,0.0,0.875,5
llama-3-instruct:8:ggufv2:Q6_K,35.0,40.0,0.0,0.875,5
llama-3-instruct:8:ggufv2:Q8_0,35.0,40.0,0.0,0.875,5
llama-3-instruct:8:ggufv2:Q6_K,35.0,40.0,0.0,0.875,5
llama-3-instruct:8:ggufv2:Q5_K_M,35.0,40.0,0.0,0.875,5
llama-3-instruct:8:ggufv2:Q4_K_M,31.0,36.0,0.0,0.8611111111111112,5
gpt-4-0125-preview,47.0,57.0,0.0,0.8245614035087719,5
openhermes-2.5:7:ggufv2:Q6_K,307.0,400.0,0.0,0.7675,5
Expand All @@ -29,49 +29,49 @@ chatglm3:6:ggmlv3:q4_0,30.0,40.0,0.0,0.75,5
openhermes-2.5:7:ggufv2:Q4_K_M,223.0,333.0,0.0,0.6696696696696697,5
openhermes-2.5:7:ggufv2:Q8_0,277.0,441.0,0.0,0.6281179138321995,5
openhermes-2.5:7:ggufv2:Q2_K,136.0,225.0,0.0,0.6044444444444445,5
llama-2-chat:7:ggufv2:Q5_K_M,77.0,135.0,0.0,0.5703703703703704,5
llama-2-chat:7:ggufv2:Q4_K_M,77.0,135.0,0.0,0.5703703703703704,5
llama-2-chat:7:ggufv2:Q5_K_M,77.0,135.0,0.0,0.5703703703703704,5
llama-2-chat:7:ggufv2:Q6_K,72.0,130.0,0.0,0.5538461538461539,5
mistral-instruct-v0.2:7:ggufv2:Q6_K,20.0,40.0,0.0,0.5,5
code-llama-instruct:7:ggufv2:Q3_K_M,20.0,40.0,0.0,0.5,5
llama-2-chat:7:ggufv2:Q8_0,65.0,135.0,0.0,0.48148148148148145,5
mixtral-instruct-v0.1:46_7:ggufv2:Q6_K,19.0,40.0,0.0,0.475,5
code-llama-instruct:13:ggufv2:Q3_K_M,18.0,40.0,0.0,0.45,5
mistral-instruct-v0.2:7:ggufv2:Q5_K_M,20.0,45.0,0.0,0.4444444444444444,5
llama-2-chat:70:ggufv2:Q5_K_M,20.0,45.0,0.0,0.4444444444444444,5
llama-2-chat:70:ggufv2:Q4_K_M,20.0,45.0,0.0,0.4444444444444444,5
llama-2-chat:70:ggufv2:Q5_K_M,20.0,45.0,0.0,0.4444444444444444,5
mistral-instruct-v0.2:7:ggufv2:Q5_K_M,20.0,45.0,0.0,0.4444444444444444,5
llama-2-chat:7:ggufv2:Q3_K_M,51.0,117.0,0.0,0.4358974358974359,5
mixtral-instruct-v0.1:46_7:ggufv2:Q5_K_M,19.0,45.0,0.0,0.4222222222222222,5
llama-2-chat:7:ggufv2:Q2_K,48.0,117.0,0.0,0.41025641025641024,5
mixtral-instruct-v0.1:46_7:ggufv2:Q4_K_M,15.0,45.0,0.0,0.3333333333333333,5
mixtral-instruct-v0.1:46_7:ggufv2:Q3_K_M,15.0,45.0,0.0,0.3333333333333333,5
mistral-instruct-v0.2:7:ggufv2:Q3_K_M,15.0,45.0,0.0,0.3333333333333333,5
mistral-instruct-v0.2:7:ggufv2:Q4_K_M,15.0,45.0,0.0,0.3333333333333333,5
mistral-instruct-v0.2:7:ggufv2:Q8_0,15.0,45.0,0.0,0.3333333333333333,5
code-llama-instruct:7:ggufv2:Q4_K_M,15.0,45.0,0.0,0.3333333333333333,5
mixtral-instruct-v0.1:46_7:ggufv2:Q4_K_M,15.0,45.0,0.0,0.3333333333333333,5
llama-2-chat:70:ggufv2:Q3_K_M,15.0,45.0,0.0,0.3333333333333333,5
mistral-instruct-v0.2:7:ggufv2:Q4_K_M,15.0,45.0,0.0,0.3333333333333333,5
mistral-instruct-v0.2:7:ggufv2:Q3_K_M,15.0,45.0,0.0,0.3333333333333333,5
code-llama-instruct:7:ggufv2:Q4_K_M,15.0,45.0,0.0,0.3333333333333333,5
mixtral-instruct-v0.1:46_7:ggufv2:Q8_0,14.0,45.0,0.0,0.3111111111111111,5
code-llama-instruct:7:ggufv2:Q2_K,10.0,40.0,0.0,0.25,5
code-llama-instruct:34:ggufv2:Q8_0,10.0,40.0,0.0,0.25,5
code-llama-instruct:7:ggufv2:Q2_K,10.0,40.0,0.0,0.25,5
mistral-instruct-v0.2:7:ggufv2:Q2_K,10.0,45.0,0.0,0.2222222222222222,5
code-llama-instruct:34:ggufv2:Q5_K_M,5.0,40.0,0.0,0.125,5
code-llama-instruct:34:ggufv2:Q6_K,5.0,40.0,0.0,0.125,5
code-llama-instruct:7:ggufv2:Q5_K_M,5.0,45.0,0.0,0.1111111111111111,5
code-llama-instruct:13:ggufv2:Q8_0,0.0,40.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q2_K,0.0,45.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q2_K,0.0,40.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q4_K_M,0.0,45.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q4_K_M,0.0,40.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q2_K,0.0,40.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q4_K_M,0.0,40.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q3_K_M,0.0,40.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q2_K,0.0,40.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q8_0,0.0,40.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q6_K,0.0,40.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q5_K_M,0.0,40.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q5_K_M,0.0,45.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q6_K,0.0,40.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q8_0,0.0,45.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q8_0,0.0,45.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q6_K,0.0,40.0,0.0,0.0,5
code-llama-instruct:7:ggufv2:Q6_K,0.0,40.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q2_K,0.0,45.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q3_K_M,0.0,45.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q4_K_M,0.0,40.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q3_K_M,0.0,40.0,0.0,0.0,5
code-llama-instruct:34:ggufv2:Q2_K,0.0,40.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q2_K,0.0,45.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q3_K_M,0.0,45.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q4_K_M,0.0,45.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q8_0,0.0,45.0,0.0,0.0,5
llama-2-chat:13:ggufv2:Q6_K,0.0,40.0,0.0,0.0,5
llama-2-chat:70:ggufv2:Q2_K,0.0,45.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q2_K,0.0,45.0,0.0,0.0,5
102 changes: 51 additions & 51 deletions benchmark/results/processed/explicit_relevance_of_single_fragments.csv
View file
Original file line number Diff line number Diff line change
@@ -1,77 +1,77 @@
Full model name,Score achieved,Score possible,Score SD,Accuracy,Iterations
claude-3-5-sonnet-20240620,18.0,18.0,0.0,1.0,3
llama-2-chat:13:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
llama-2-chat:70:ggufv2:Q2_K,30.0,30.0,0.0,1.0,5
gpt-4o-2024-08-06,18.0,18.0,0.0,1.0,3
code-llama-instruct:7:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
gpt-3.5-turbo-0125,30.0,30.0,0.0,1.0,5
gpt-3.5-turbo-0613,30.0,30.0,0.0,1.0,5
gpt-4-0125-preview,30.0,30.0,0.0,1.0,5
gpt-4-0613,30.0,30.0,0.0,1.0,5
gpt-4-turbo-2024-04-09,30.0,30.0,0.0,1.0,5
gpt-4o-2024-05-13,30.0,30.0,0.0,1.0,5
code-llama-instruct:7:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
mistral-instruct-v0.2:7:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
mistral-instruct-v0.2:7:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
mistral-instruct-v0.2:7:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
mistral-instruct-v0.2:7:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q2_K,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
llama-3.1-instruct:8:ggufv2:Q3_K_L,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q4_K_M,18.0,18.0,0.0,1.0,3
llama-2-chat:13:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q2_K,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:70:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:70:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
llama-3-instruct:8:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:70:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
llama-3.1-instruct:8:ggufv2:IQ4_XS,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:70:ggufv2:Q3_K_S,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:70:ggufv2:IQ4_XS,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:70:ggufv2:IQ2_M,18.0,18.0,0.0,1.0,3
llama-3-instruct:8:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
llama-3-instruct:8:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
llama-3-instruct:8:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
llama-3-instruct:8:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
llama-2-chat:70:ggufv2:Q2_K,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:7:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
claude-3-5-sonnet-20240620,18.0,18.0,0.0,1.0,3
llama-2-chat:70:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
llama-3.1-instruct:8:ggufv2:IQ4_XS,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q3_K_L,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q4_K_M,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q5_K_M,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q6_K,18.0,18.0,0.0,1.0,3
openhermes-2.5:7:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
llama-3.1-instruct:8:ggufv2:Q8_0,18.0,18.0,0.0,1.0,3
mistral-instruct-v0.2:7:ggufv2:Q2_K,30.0,30.0,0.0,1.0,5
llama-3.1-instruct:8:ggufv2:Q5_K_M,18.0,18.0,0.0,1.0,3
llama-3.1-instruct:8:ggufv2:Q6_K,18.0,18.0,0.0,1.0,3
mistral-instruct-v0.2:7:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
mistral-instruct-v0.2:7:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
mistral-instruct-v0.2:7:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
mistral-instruct-v0.2:7:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
mistral-instruct-v0.2:7:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q2_K,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
llama-2-chat:70:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
openhermes-2.5:7:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
gpt-4o-2024-05-13,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q6_K,30.0,30.0,0.0,1.0,5
code-llama-instruct:7:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
code-llama-instruct:7:ggufv2:Q8_0,30.0,30.0,0.0,1.0,5
gpt-3.5-turbo-0125,30.0,30.0,0.0,1.0,5
gpt-3.5-turbo-0613,30.0,30.0,0.0,1.0,5
gpt-4-0125-preview,30.0,30.0,0.0,1.0,5
gpt-4-turbo-2024-04-09,30.0,30.0,0.0,1.0,5
gpt-4-0613,30.0,30.0,0.0,1.0,5
gpt-4o-2024-08-06,18.0,18.0,0.0,1.0,3
llama-2-chat:13:ggufv2:Q2_K,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q3_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q4_K_M,30.0,30.0,0.0,1.0,5
llama-2-chat:13:ggufv2:Q5_K_M,30.0,30.0,0.0,1.0,5
code-llama-instruct:13:ggufv2:Q8_0,25.0,30.0,0.0,0.8333333333333334,5
gpt-4o-mini-2024-07-18,25.0,30.0,0.0,0.8333333333333334,5
llama-2-chat:7:ggufv2:Q2_K,25.0,30.0,0.0,0.8333333333333334,5
code-llama-instruct:7:ggufv2:Q6_K,25.0,30.0,0.0,0.8333333333333334,5
code-llama-instruct:7:ggufv2:Q5_K_M,25.0,30.0,0.0,0.8333333333333334,5
code-llama-instruct:7:ggufv2:Q3_K_M,25.0,30.0,0.0,0.8333333333333334,5
claude-3-opus-20240229,15.0,18.0,0.0,0.8333333333333334,3
code-llama-instruct:13:ggufv2:Q6_K,25.0,30.0,0.0,0.8333333333333334,5
code-llama-instruct:13:ggufv2:Q8_0,25.0,30.0,0.0,0.8333333333333334,5
claude-3-opus-20240229,15.0,18.0,0.0,0.8333333333333334,3
code-llama-instruct:7:ggufv2:Q3_K_M,25.0,30.0,0.0,0.8333333333333334,5
llama-2-chat:7:ggufv2:Q2_K,25.0,30.0,0.0,0.8333333333333334,5
gpt-4o-mini-2024-07-18,25.0,30.0,0.0,0.8333333333333334,5
chatglm3:6:ggmlv3:q4_0,22.0,30.0,0.0,0.7333333333333333,5
code-llama-instruct:13:ggufv2:Q5_K_M,20.0,30.0,0.0,0.6666666666666666,5
code-llama-instruct:34:ggufv2:Q4_K_M,15.0,30.0,0.0,0.5,5
code-llama-instruct:34:ggufv2:Q3_K_M,15.0,30.0,0.0,0.5,5
code-llama-instruct:34:ggufv2:Q2_K,15.0,30.0,0.0,0.5,5
code-llama-instruct:34:ggufv2:Q8_0,10.0,30.0,0.0,0.3333333333333333,5
code-llama-instruct:34:ggufv2:Q3_K_M,15.0,30.0,0.0,0.5,5
code-llama-instruct:34:ggufv2:Q4_K_M,15.0,30.0,0.0,0.5,5
code-llama-instruct:13:ggufv2:Q4_K_M,10.0,30.0,0.0,0.3333333333333333,5
code-llama-instruct:34:ggufv2:Q5_K_M,10.0,30.0,0.0,0.3333333333333333,5
code-llama-instruct:34:ggufv2:Q6_K,10.0,30.0,0.0,0.3333333333333333,5
code-llama-instruct:34:ggufv2:Q8_0,10.0,30.0,0.0,0.3333333333333333,5
code-llama-instruct:7:ggufv2:Q2_K,10.0,30.0,0.0,0.3333333333333333,5
mixtral-instruct-v0.1:46_7:ggufv2:Q2_K,10.0,30.0,0.0,0.3333333333333333,5
code-llama-instruct:34:ggufv2:Q6_K,10.0,30.0,0.0,0.3333333333333333,5
code-llama-instruct:34:ggufv2:Q5_K_M,10.0,30.0,0.0,0.3333333333333333,5
mixtral-instruct-v0.1:46_7:ggufv2:Q4_K_M,5.0,30.0,0.0,0.16666666666666666,5
mixtral-instruct-v0.1:46_7:ggufv2:Q8_0,4.0,30.0,0.0,0.13333333333333333,5
code-llama-instruct:13:ggufv2:Q2_K,1.0,30.0,0.0,0.03333333333333333,5
mixtral-instruct-v0.1:46_7:ggufv2:Q3_K_M,0.0,30.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q6_K,0.0,30.0,0.0,0.0,5
code-llama-instruct:13:ggufv2:Q3_K_M,0.0,30.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q3_K_M,0.0,30.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q5_K_M,0.0,30.0,0.0,0.0,5
mixtral-instruct-v0.1:46_7:ggufv2:Q6_K,0.0,30.0,0.0,0.0,5
Loading

0 comments on commit 96f7514

Please sign in to comment.