[go: nahoru, domu]

Skip to content

Converts the output of a MySQL query to parquet

Notifications You must be signed in to change notification settings

in4it/mysql2parquet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MySQL to parquet

Converts the output of a MySQL query to parquet

Usage mysql2parquet

Usage of ./mysql2parquet:
  -all
    	migrate all tables in database
  -compression string
    	compression to apply (snappy/bzip/gzip) (default "none")
  -connectionString string
    	MySQL connectionstring (requred)
  -debug
    	enable debug
  -out string
    	outputfile or output directory when used with '-all' (requred)
  -query string
    	query

Usage parquetreader

Usage of ./parquetreader:
  -column string
        column to read
  -filename string
        input to read

Examples

Connect to MySQL with login root and password secret on 127.0.0.1. Select everything from table test on database test. Write the output to filename.parquet

./mysql2parquet -connectionString "root:secret@tcp(127.0.0.1:3306)/test" -query "select * from test" -out filename.parquet -debug true

Read column "Id" from a parquet file:

./parquetreader -filename filename.parquet -column Id

About

Converts the output of a MySQL query to parquet

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published