Skip to content

Commit

Permalink
Update ggml/src/ggml-cpu/ggml-cpu-quants.c
Browse files Browse the repository at this point in the history
change to use K_SCALE_SIZE

Co-authored-by: Georgi Gerganov <[email protected]>
  • Loading branch information
fj-y-saito and ggerganov authored Jan 15, 2025
1 parent 5f98b7c commit 964f811
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion ggml/src/ggml-cpu/ggml-cpu-quants.c
Original file line number Diff line number Diff line change
Expand Up @@ -5582,7 +5582,7 @@ void ggml_vec_dot_q4_K_q8_K(int n, float * restrict s, size_t bs, const void * r

const int16x8_t q8sums = vpaddq_s16(vld1q_s16(y[i].bsums), vld1q_s16(y[i].bsums + 8));

memcpy(utmp, x[i].scales, 12);
memcpy(utmp, x[i].scales, K_SCALE_SIZE);

uint32x2_t mins8 = { 0 };
mins8 = vset_lane_u32(utmp[1] & kmask1, mins8, 0);
Expand Down

0 comments on commit 964f811

Please sign in to comment.