Parquet to CSV convert problem

[ahmadhega]

Hi ,
Creating Parquet for CSV file using parquet-go library and reconvert it by the library success for me, but creating parquet by python tool :
import pandas as pd df = pd.read_parquet(“file.csv”) df.to_parquet(“file.parquet”)

trying to convert it to CSV file failed.
To be more specified function (self *ParquetReader) Read(dstInterface interface{}) error failed for me and the error was : "runtime error: index out of range [74] with length 4"

Any idea?

[xitongsys]

hi, @ahmadhega
Could you provide a sample parquet file ? It's hard to know what happened just from this error.

[ahmadhega]

@xitongsys sent you by mail ([email protected]) more details.

[xitongsys]

hi, @ahmadhega
I used the following code to read your parquet file, no error found. Maybe there are some errors in your codes.

package main

import (
	"log"

	"github.com/xitongsys/parquet-go-source/local"
	"github.com/xitongsys/parquet-go/reader"
)

type Shoes struct {
	Name    *string  `parquet:"name=Name, type=UTF8, encoding=PLAIN_DICTIONARY"`
	Size    *int64   `parquet:"name=Size, type=INT32, encoding=PLAIN"`
}

func main() {
	///read
	fr, err := local.NewLocalFileReader("shoes_orders.parquet")
	if err != nil {
		log.Println("Can't open file")
		return
	}

	pr, err := reader.NewParquetReader(fr, new(Shoes), 1)
	if err != nil {
		log.Println("Can't create parquet reader", err)
		return
	}
	num := int(pr.GetNumRows())
	stus := make([]Shoes, num) //read 10 rows
	if err = pr.Read(&stus); err != nil {
		log.Println("Read error", err)
	}
	log.Println(stus)
	pr.ReadStop()
	fr.Close()

}