Code

Adding IQ6_K#14

Code

Merged

ikawrakow merged 10 commits intomainikawrakow/ik_llama.cpp:mainfrom ik/iq6_kikawrakow/ik_llama.cpp:ik/iq6_kCopy head branch name to clipboardAug 9, 2024

+998-30

Commits

Commits on Aug 7, 2024

• iq6_k: WIP (nothing works)

  Kawrakow

  committed
  54ce23b

  Copy full SHA for 54ce23b

• iq6_k: WIP (quantize/dequantize)

  Kawrakow

  committed
  85f448e

  Copy full SHA for 85f448e

• iq6_k: CUDA dequantize

  Show description for b3d6e10
  Kawrakow

  committed
  b3d6e10

  Copy full SHA for b3d6e10

• iq6_k: CUDA dot product

  Show description for 07d3b4c
  Kawrakow

  committed
  07d3b4c

  Copy full SHA for 07d3b4c

Commits on Aug 8, 2024

• iq6_k: Zen4 iqk_mul_mat

  Show description for f3a823c
  Kawrakow

  committed
  f3a823c

  Copy full SHA for f3a823c

• iq6_k: slightly better Zen4 iqk_mul_mat

  Show description for 0d55d5f
  Kawrakow

  committed
  0d55d5f

  Copy full SHA for 0d55d5f

• iq6_k: NEON

  Show description for b8abe10
  Kawrakow

  committed
  b8abe10

  Copy full SHA for b8abe10

• iq6_k: Metal

  Show description for c9c5ed5
  Kawrakow

  committed
  c9c5ed5

  Copy full SHA for c9c5ed5

Commits on Aug 9, 2024

• iq6_k: AVX2

  Kawrakow

  committed
  3ef9f7a

  Copy full SHA for 3ef9f7a

• Fix Zen4 implementation of iq3_k, iq4_k, iq5_k

  Show description for bf74535
  Kawrakow

  committed
  bf74535

  Copy full SHA for bf74535