Code

Improve decoding#291

Code

Merged

ggerganov merged 23 commits intomasterggerganov/whisper.cpp:masterfrom decodingggerganov/whisper.cpp:decodingCopy head branch name to clipboardJan 15, 2023

+1,540-793

Commits

Commits on Jan 8, 2023

• whisper : prepare infra for new decoding strategies

  ggerganov

  committed
  abe104b

  Copy full SHA for abe104b

• whisper : apply logit filters and compute logprobs

  ggerganov

  committed
  2d8d372

  Copy full SHA for 2d8d372

• whisper : add whisper_get_logits()

  ggerganov

  committed
  2155953

  Copy full SHA for 2155953

• whisper : separate self and cross attention memory

  Show description for 523e049
  ggerganov

  committed
  523e049

  Copy full SHA for 523e049

Commits on Jan 9, 2023

• whisper : move probs_id buffer to whisper_context

  ggerganov

  committed
  1163f26

  Copy full SHA for 1163f26

• whisper : refactor kv cache into separate struct

  ggerganov

  committed
  ee58108

  Copy full SHA for ee58108

Commits on Jan 11, 2023

• whisper : move self-attention kv cache to whisper_decoder

  ggerganov

  committed
  628843c

  Copy full SHA for 628843c

• whisper : wip decoding parameters + strategies

  ggerganov

  committed
  9551d7f

  Copy full SHA for 9551d7f

Commits on Jan 12, 2023

• whisper : wip decoding parameters + strategies (part 2)

  ggerganov

  committed
  3d723d0

  Copy full SHA for 3d723d0

Commits on Jan 14, 2023

• whisper : wip decoding parameters + strategies (part 3)

  ggerganov

  committed
  116dd67

  Copy full SHA for 116dd67

• whisper : wip decoding parameters + strategies (part 4)

  ggerganov

  committed
  bd6e70b

  Copy full SHA for bd6e70b

• whisper : fix prompt_past update to not include prompt_init

  ggerganov

  committed
  712bc4b

  Copy full SHA for 712bc4b

• whisper : temperature + best_of support

  ggerganov

  committed
  34c5110

  Copy full SHA for 34c5110

• whisper : support for compression_ration_threshold

  Show description for c67716f
  ggerganov

  committed
  c67716f

  Copy full SHA for c67716f

• command : fix example to use logits instead of obsolete probs

  ggerganov

  committed
  7ea1b73

  Copy full SHA for 7ea1b73

• whisper : handle empty sequence ranking

  ggerganov

  committed
  c6a8a47

  Copy full SHA for c6a8a47

• whisper : add WHISPER_DEBUG + diagnostic prints + new main args

  ggerganov

  committed
  c301a79

  Copy full SHA for c301a79

• whisper : minor fixes

  ggerganov

  committed
  5e97f80

  Copy full SHA for 5e97f80

• whisper : add beam-search support

  ggerganov

  committed
  5548a19

  Copy full SHA for 5548a19

• whisper : bug fix when there no previous context

  ggerganov

  committed
  6700cd5

  Copy full SHA for 6700cd5

Commits on Jan 15, 2023

• whisper : add comments

  ggerganov

  committed
  d83e475

  Copy full SHA for d83e475

• stream : disable temperature fallback

  Show description for 3fe33d6
  ggerganov

  committed
  3fe33d6

  Copy full SHA for 3fe33d6

• whisper.swiftui : update example - fix paths + add empty folders

  ggerganov

  committed
  6a2f4db

  Copy full SHA for 6a2f4db