Code

Build Archives more robustly#8135

Code

Merged

macneale4 merged 17 commits intomaindolthub/dolt:mainfrom macneale4/archive-builddolthub/dolt:macneale4/archive-buildCopy head branch name to clipboardJul 25, 2024

+591-172

Commits

Commits on Jul 21, 2024

• Don't store all chunks in memory while building archive

  macneale4

  committed
  b8880d0

  Copy full SHA for b8880d0

• Bring back the --no-grouping flag

  macneale4

  committed
  fb7d78b

  Copy full SHA for fb7d78b

• Parralellize chunk group creation, but with one thread

  Show description for e411ca3
  macneale4

  committed
  e411ca3

  Copy full SHA for e411ca3

• Print archive build progress messages

  macneale4

  committed
  a95de36

  Copy full SHA for a95de36

• Use a buffered channel for the progress

  macneale4

  committed
  0a7b4c5

  Copy full SHA for 0a7b4c5

• more progress on progress

  macneale4

  committed
  04169cd

  Copy full SHA for 04169cd

• Thread through stats to avoid panic in lower layers

  macneale4

  committed
  c32aee6

  Copy full SHA for c32aee6

• Improved progress reporting

  macneale4

  committed
  7094d19

  Copy full SHA for 7094d19

• Write some useful information into the archive metadata

  macneale4

  committed
  834983e

  Copy full SHA for 834983e

Commits on Jul 22, 2024

• Properly handle signals to cancel the task

  macneale4

  committed
  06b20ca

  Copy full SHA for 06b20ca

• Odds and ends cleanup

  macneale4

  committed
  6ee2664

  Copy full SHA for 6ee2664

• Fix the golang tests for archives. Make more robust to randomness

  macneale4

  committed
  0ea272d

  Copy full SHA for 0ea272d

• Make no grouping the default

  Show description for 8f0f55a
  macneale4

  committed
  8f0f55a

  Copy full SHA for 8f0f55a

Commits on Jul 23, 2024

• [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

  macneale4

  committed
  672c882

  Copy full SHA for 672c882

• Attempt to make shallow clone less flaky

  macneale4

  committed
  b444a34

  Copy full SHA for b444a34

• Broaden the archive test range a little bit to improve chance of success

  macneale4

  committed
  a001e1e

  Copy full SHA for a001e1e

Commits on Jul 24, 2024

• PR Feedback

  macneale4

  committed
  23ea4fd

  Copy full SHA for 23ea4fd