Code

[Python] Initial PyArrow writer#566

Code

Merged

houqp merged 28 commits intodelta-io:maindelta-io/delta-rs:mainfrom wjones127:pyarrow-writerwjones127/delta-rs:pyarrow-writerCopy head branch name to clipboardMar 20, 2022

+882-44

Commits

Commits on Mar 20, 2022

• Sketch writer implementation

  wjones127

  committed
  16f21a5

  Copy full SHA for 16f21a5

• Draft writer implementation

  wjones127

  committed
  e6ffab0

  Copy full SHA for e6ffab0

• start testing

  wjones127

  committed
  ca05201

  Copy full SHA for ca05201

• Refactor to create version 0

  wjones127

  committed
  599b23b

  Copy full SHA for 599b23b

• Implement stats writer; get first new test to pass

  wjones127

  committed
  f196ce9

  Copy full SHA for f196ce9

• Refactor and add skip for fs blocker

  wjones127

  committed
  69a7b5a

  Copy full SHA for 69a7b5a

• Add basic partitioning support

  wjones127

  committed
  823206e

  Copy full SHA for 823206e

• Test different modes

  wjones127

  committed
  7342386

  Copy full SHA for 7342386

• Improve code coverage

  wjones127

  committed
  87d5238

  Copy full SHA for 87d5238

• Get RBR working

  wjones127

  committed
  28dd5ad

  Copy full SHA for 28dd5ad

• Reference pyarrow writer umbrella issue in readme

  wjones127

  committed
  86883cd

  Copy full SHA for 86883cd

• Update docs and link to other projects

  wjones127

  committed
  7b2a8e9

  Copy full SHA for 7b2a8e9

• Add Pandas support

  wjones127

  committed
  1c68d57

  Copy full SHA for 1c68d57

• Test writer stats and partitioning

  wjones127

  committed
  1bba642

  Copy full SHA for 1bba642

• Test statistics

  wjones127

  committed
  2a77c34

  Copy full SHA for 2a77c34

• Simplify tests since we can now roundtrip

  wjones127

  committed
  237dff3

  Copy full SHA for 237dff3

• Enforce protocol version

  wjones127

  committed
  919a8f0

  Copy full SHA for 919a8f0

• Fix docs

  wjones127

  committed
  3bd74ed

  Copy full SHA for 3bd74ed

• Add experimental to docstring

  wjones127

  committed
  9db9d74

  Copy full SHA for 9db9d74

• Fix rust issues

  wjones127

  committed
  922a87e

  Copy full SHA for 922a87e

• Address mypy checks

  wjones127

  committed
  f7be374

  Copy full SHA for f7be374

• Fix formatting

  wjones127

  committed
  e0a0cc3

  Copy full SHA for e0a0cc3

• Remove unnecessary clone

  wjones127

  committed
  4cf415a

  Copy full SHA for 4cf415a

• Skip tests on unsupported platforms

  wjones127

  committed
  59028ef

  Copy full SHA for 59028ef

• Make sphinx happy

  wjones127

  committed
  6bfefa4

  Copy full SHA for 6bfefa4

• Need tying extensions for checking now

  wjones127

  committed
  39044c5

  Copy full SHA for 39044c5

• Add nipick ignore for typing_extensions

  wjones127

  committed
  ea6b954

  Copy full SHA for ea6b954

• cleanup

  wjones127

  committed
  a4ebf7f

  Copy full SHA for a4ebf7f