You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
vaex 4.0.0 includes the ability to open parquet files in an out of core context. This means that the arrow file will no longer be required when this is released.
However from testing it is still beneficial to create a measurements.arrow file that contains all the association information already merged - as this can still take a few minutes to generate with vaex, but is negligible in the context of a pipeline run.
vaex 4.0.0 is currently at the alpha stage, so will wait for a more stable version.
The text was updated successfully, but these errors were encountered:
vaex 4.0.0 includes the ability to open parquet files in an out of core context. This means that the arrow file will no longer be required when this is released.
However from testing it is still beneficial to create a
measurements.arrow
file that contains all the association information already merged - as this can still take a few minutes to generate with vaex, but is negligible in the context of a pipeline run.vaex 4.0.0 is currently at the alpha stage, so will wait for a more stable version.
The text was updated successfully, but these errors were encountered: