Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

not support jsonb when read_sql postgre table to arrow #331

Closed
wonb168 opened this issue Aug 23, 2022 · 2 comments
Closed

not support jsonb when read_sql postgre table to arrow #331

wonb168 opened this issue Aug 23, 2022 · 2 comments

Comments

@wonb168
Copy link

wonb168 commented Aug 23, 2022

I use duckdb as OLAP plugin for postgre.
I need export data from pg to duckdb, and there have jsonb column in my pg table, when I use connectorx to read_sql to arrow, raise error:
RuntimeError: No conversion rule from JSONB(true) to connectorx::destinations::arrow::typesystem::ArrowTypeSystem.
So,I want:

  1. support jsonb when etl pg to arrow (duckdb can read arrow)
  2. directly add duckdb as return_type for read_sql()
@wangxiaoying
Copy link
Contributor

Hi @wonb168 , thanks for the issue. For jsonb, can you try to set the return type as arrow2?

For adding duckdb, I think it will be the same with supporting to_sql #213, will add your request into the discussion.

@wonb168
Copy link
Author

wonb168 commented Sep 2, 2022

but int[] in my greeplun(int array column,like {1,2,3}) etl to arrow2 also error:
RuntimeError: No conversion rule from Int4Array(true) to connectorx::destinations::arrow::typesystem::ArrowTypeSystem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants