Skip to content

Takes a parquet file and outputs a script to create an AWS Glue table

License

Notifications You must be signed in to change notification settings

kevoriordan/parquet-to-glue-schema

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

parquet-to-glue-schema

Takes a parquet file and generate an AWS Glue table from it and load the partitions.

Usage:

python3 generate.py <command line arguments>

Command line arguments or omit command line arguments and type answers at prompt

--s3-location : Location of your parquet files

--database : Name of the glue database where you want to create the table

--tablename : The name you want to give the table in Glue.

--results-bucket : Can be any S3 location. Athena will dump script results here after recreating partitions.

About

Takes a parquet file and outputs a script to create an AWS Glue table

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages