Skip to content

Commit

Permalink
Add support for DICTIONARY encoding to PrestoSerializer (facebookincu…
Browse files Browse the repository at this point in the history
…bator#6686)

Summary:
Extend PrestoSerializer to support deserializing dictionary-encoded data.

The format of dictionary-encoded columns is:
- 4 bytes: number of rows
- N bytes: dictionary column
- 4*numRows bytes: indices
- 24 bytes: 'instance id' (used by Presto, but not present in Velox)

Part of facebookincubator#6595

Pull Request resolved: facebookincubator#6686

Reviewed By: pedroerp

Differential Revision: D49532000

Pulled By: mbasmanova

fbshipit-source-id: 8f3adb3c9e61d842b1bc00ecced9f972892952a6
  • Loading branch information
mbasmanova authored and ericyuliu committed Oct 12, 2023
1 parent c0a7216 commit 1c7b779
Show file tree
Hide file tree
Showing 3 changed files with 278 additions and 119 deletions.
Loading

0 comments on commit 1c7b779

Please sign in to comment.