Code

K shift2#320

Code

Merged

Nexesenex merged 16 commits intoNexesenex:lcpp_pr_k_shift_samplerNexesenex/croco.cpp:lcpp_pr_k_shift_samplerfrom MaggotHATE:k-shift2MaggotHATE/llama.cpp-greedy-rework:k-shift2Copy head branch name to clipboardOct 26, 2024

+1,832-668

Commits

Commits on Oct 24, 2024

• ci : fix cmake flags for SYCL

  ggerganov

  committed
  40f2555

  Copy full SHA for 40f2555

• server : refactor slot input data, move tokenizer to HTTP thread (ggerganov#10023)

  Show description for 958367b
  ngxson

  authored
  958367b

  Copy full SHA for 958367b

Commits on Oct 25, 2024

• server : check that the prompt fits in the slot's context (ggerganov#10030)

  Show description for bc5ba00
  ggerganov

  authored
  bc5ba00

  Copy full SHA for bc5ba00

• llamafile : extend sgemm.cpp support for Q5_0 models (ggerganov#10010)

  Srihari-mcw

  authored
  2f8bd2b

  Copy full SHA for 2f8bd2b

• llama: string_split fix (ggerganov#10022)

  Show description for d80fb71
  Xarbirus

  authored
  d80fb71

  Copy full SHA for d80fb71

• llama : add DRY sampler (ggerganov#9702)

  Show description for ff252ea
  

  3 peopleauthored
  ff252ea

  Copy full SHA for ff252ea

• K-Shift commit

  MaggotHATE

  committed
  87384fb

  Copy full SHA for 87384fb

• Fixed style

  MaggotHATE

  committed
  070f954

  Copy full SHA for 070f954

• metal : support permuted matrix multiplicaions (ggerganov#10033)

  Show description for 6687503
  ggerganov

  authored
  6687503

  Copy full SHA for 6687503

• Merge branch 'ggerganov:master' into k-shift2

  MaggotHATE

  authored
  5237aa4

  Copy full SHA for 5237aa4

Commits on Oct 26, 2024

• Fixes and tests

  MaggotHATE

  committed
  48b715d

  Copy full SHA for 48b715d

• Merge branch 'k-shift2' of https://github.com/MaggotHATE/llama.cpp-greedy-rework into k-shift2

  MaggotHATE

  committed
  6101797

  Copy full SHA for 6101797

• scripts : fix amx sync [no ci]

  ggerganov

  committed
  9e4a256

  Copy full SHA for 9e4a256

• increase cuda_cpy block size (ggml/996)

  Show description for 8c60a8a
  

  2 peopleauthored and

  ggerganov

  committed
  8c60a8a

  Copy full SHA for 8c60a8a

• sync : ggml

  ggerganov

  committed
  cc2983d

  Copy full SHA for cc2983d

• Merge branch 'ggerganov:master' into k-shift2

  MaggotHATE

  authored
  ee95274

  Copy full SHA for ee95274