Code

Implement own BERT score#473

Code

Merged

Borda merged 46 commits intoLightning-AI:masterLightning-AI/torchmetrics:masterfrom stancld:own_bert-scorestancld/metrics:own_bert-scoreCopy head branch name to clipboardAug 30, 2021

+1,175-131

Commits

Commits on Aug 18, 2021

• [WIP] Start adding own BERTScore implementation

  stancld

  committed
  f72661a

  Copy full SHA for f72661a

• [WIP] Prepare the basic backbone for own BERTScore

  stancld

  committed
  2620b36

  Copy full SHA for 2620b36

Commits on Aug 19, 2021

• [WIP] Make working BERTScore with all_layers=True + init bert_score in torchmetrics

  stancld

  committed
  a79b091

  Copy full SHA for a79b091

• Fix cuda device placing

  stancld

  committed
  b145470

  Copy full SHA for b145470

Commits on Aug 20, 2021

• Use IDF only if asked

  stancld

  committed
  f1c66b1

  Copy full SHA for f1c66b1

• Add data collators

  stancld

  committed
  3b741cb

  Copy full SHA for 3b741cb

• Add some docs and clean code

  stancld

  committed
  6a65526

  Copy full SHA for 6a65526

• Update docs, write new tests, clean the code

  Show description for 9a1b275
  stancld

  committed
  9a1b275

  Copy full SHA for 9a1b275

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 97f6796
  pre-commit-ci[bot]

  committed
  97f6796

  Copy full SHA for 97f6796

Commits on Aug 21, 2021

• Fix IDF rescaling and add new tests + fix type

  Show description for f544c70
  stancld

  committed
  f544c70

  Copy full SHA for f544c70

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for aec66b1
  pre-commit-ci[bot]

  committed
  aec66b1

  Copy full SHA for aec66b1

• Adjust code to work with the DDP plus some changes

  Show description for 4cd7ea3
  stancld

  committed
  4cd7ea3

  Copy full SHA for 4cd7ea3

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 10a63a6
  pre-commit-ci[bot]

  committed
  10a63a6

  Copy full SHA for 10a63a6

• Fix a bug with tokenizer and add hash_code

  stancld

  committed
  8f32421

  Copy full SHA for 8f32421

• Fix transformers import

  stancld

  committed
  8c68e01

  Copy full SHA for 8c68e01

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 474baf7
  pre-commit-ci[bot]

  committed
  474baf7

  Copy full SHA for 474baf7

• Fix some mypy, flake8 and logic errors

  stancld

  committed
  89b49d8

  Copy full SHA for 89b49d8

• Add support for the user's own model

  Show description for d97153e
  stancld

  committed
  d97153e

  Copy full SHA for d97153e

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 31abcf0
  pre-commit-ci[bot]

  committed
  31abcf0

  Copy full SHA for 31abcf0

• [WIP] Fix error raised by default tokenizer

  stancld

  committed
  af98261

  Copy full SHA for af98261

Commits on Aug 22, 2021

• Add support for the rescale with baseline

  stancld

  committed
  3c07bf0

  Copy full SHA for 3c07bf0

• black formatting

  stancld

  committed
  a42cdc7

  Copy full SHA for a42cdc7

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 6052525
  pre-commit-ci[bot]

  committed
  6052525

  Copy full SHA for 6052525

• Updare requirements + clean a bit

  stancld

  committed
  77474ad

  Copy full SHA for 77474ad

• Try to fix recursive-import issue + decrease tqdm version

  stancld

  committed
  947fcca

  Copy full SHA for 947fcca

Commits on Aug 24, 2021

• Merge branch 'master' into own_bert-score

  stancld

  committed
  50158f1

  Copy full SHA for 50158f1

• Apply Borda's suggestions

  stancld

  committed
  e20307f

  Copy full SHA for e20307f

• Clean some code + add some docstirngs

  stancld

  committed
  61506a3

  Copy full SHA for 61506a3

• Do some refactoring

  stancld

  committed
  54c492e

  Copy full SHA for 54c492e

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 1caea8a
  pre-commit-ci[bot]

  committed
  1caea8a

  Copy full SHA for 1caea8a

• Merge branch 'master' into own_bert-score

  stancld

  committed
  741f36d

  Copy full SHA for 741f36d

Commits on Aug 25, 2021

• Merge branch 'master' into own_bert-score

  stancld

  committed
  5d198ed

  Copy full SHA for 5d198ed

• Apply suggestions from code review

  Borda

  authored
  5e24e17

  Copy full SHA for 5e24e17

Commits on Aug 26, 2021

• Merge branch 'master' into own_bert-score

  Borda

  authored
  aa3e6a8

  Copy full SHA for aa3e6a8

• Apply some borda's suggestions

  stancld

  committed
  cb66482

  Copy full SHA for cb66482

• Merge branch 'master' into own_bert-score

  stancld

  committed
  1df2bca

  Copy full SHA for 1df2bca

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for e2262d2
  pre-commit-ci[bot]

  committed
  e2262d2

  Copy full SHA for e2262d2

• Merge verbose/tqdm_available if statements

  stancld

  committed
  88655b7

  Copy full SHA for 88655b7

• Add docstring

  stancld

  committed
  eb234c7

  Copy full SHA for eb234c7

• Change docstring

  stancld

  committed
  4b12107

  Copy full SHA for 4b12107

Commits on Aug 27, 2021

• Merge branch 'master' into own_bert-score

  stancld

  committed
  4e5c1da

  Copy full SHA for 4e5c1da

• Run bert-ddp tests only if torch.distributed.is_available()

  stancld

  committed
  d0d1419

  Copy full SHA for d0d1419

• Simplify a condition

  stancld

  committed
  9759298

  Copy full SHA for 9759298

• Merge branch 'master' into own_bert-score

  mergify[bot]

  authored
  a8dda94

  Copy full SHA for a8dda94

• Use smaller model, 'albert-base-v2', for testing because of OOM issues

  stancld

  committed
  64e0863

  Copy full SHA for 64e0863

Commits on Aug 29, 2021

• Set join=False for mp_spawn in the ddp_test

  stancld

  committed
  f23451e

  Copy full SHA for f23451e