Code

Add checkpoint writer#280

Code

Merged

xianwill merged 22 commits intodelta-io:maindelta-io/delta-rs:mainfrom xianwill:checkpointsxianwill/delta-rs:checkpointsCopy head branch name to clipboardJun 11, 2021

+671-64

Commits

Commits on Jun 2, 2021

• Add checkpoint writer (wip)

  xianwill

  committed
  2f7d3c8

  Copy full SHA for 2f7d3c8

• Remove unnecessary code line

  xianwill

  committed
  c7caaec

  Copy full SHA for c7caaec

• fix checkpoint file name

  xianwill

  committed
  5c0186d

  Copy full SHA for 5c0186d

Commits on Jun 5, 2021

• Add DeltaLogSchemaFactory

  xianwill

  committed
  a5c05e9

  Copy full SHA for a5c05e9

• merge main

  xianwill

  committed
  1d7ea53

  Copy full SHA for 1d7ea53

• Adding tests

  xianwill

  committed
  794bab3

  Copy full SHA for 794bab3

• Fix clippy errors

  xianwill

  committed
  34d8c07

  Copy full SHA for 34d8c07

• Remove unnecessary error sources

  xianwill

  committed
  8fff84c

  Copy full SHA for 8fff84c

Commits on Jun 6, 2021

• Add checkpoint_for_version method

  xianwill

  committed
  ec9c5ff

  Copy full SHA for ec9c5ff

Commits on Jun 8, 2021

• Fix debug statement

  xianwill

  committed
  503cd61

  Copy full SHA for 503cd61

• avoid unnecessary clones

  

  Qingping Hou

  committed
  ea1c442

  Copy full SHA for ea1c442

Commits on Jun 9, 2021

• Merge pull request #1 from delta-io/qp_clone

  Show description for dca5728
  xianwill

  authored
  dca5728

  Copy full SHA for dca5728

• Remove redundant clones

  xianwill

  committed
  0f7dba5

  Copy full SHA for 0f7dba5

• Move CheckPointWriter to checkpoints mod

  xianwill

  committed
  3bfb2ca

  Copy full SHA for 3bfb2ca

• Stop calling URIs as paths in checkpoint writer

  xianwill

  committed
  5d5d26d

  Copy full SHA for 5d5d26d

• Change checkpoint writer action serialization to use decoder

  xianwill

  committed
  5451274

  Copy full SHA for 5451274

Commits on Jun 10, 2021

• Write Arrow schema for delta log directly instead of deserializing from json

  xianwill

  committed
  ef16674

  Copy full SHA for ef16674

• Fix clippy warnings

  xianwill

  committed
  68217dd

  Copy full SHA for 68217dd

• Add unit test for delta log schema and issue links for checkpoint enhancements

  xianwill

  committed
  44340e5

  Copy full SHA for 44340e5

• Remove commented code from schema.rs

  xianwill

  committed
  7f878a8

  Copy full SHA for 7f878a8

Commits on Jun 11, 2021

• Remove unnecessary collect when building checkpoint

  xianwill

  committed
  0b22619

  Copy full SHA for 0b22619

• Remove useless into_iter

  xianwill

  committed
  e6a0fc4

  Copy full SHA for e6a0fc4