Skip to content

Commit

Permalink
fmt
Browse files Browse the repository at this point in the history
  • Loading branch information
Henry Harbeck committed Jan 31, 2025
1 parent 0356c65 commit f5dec3d
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions docs/source/user-guide/plugins/io_plugins.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
# IO Plugins

Besides [expression plugins](./expr_plugins.md), we also support IO plugins. These allow you to register
different file formats as sources to the Polars engines. Because sources can move data zero copy via
Arrow FFI and sources can produce large chunks of data before returning, we've decided to interface
to IO plugins via Python for now, as we don't think the short time the GIL is needed should lead to
any contention.
Besides [expression plugins](./expr_plugins.md), we also support IO plugins. These allow you to
register different file formats as sources to the Polars engines. Because sources can move data zero
copy via Arrow FFI and sources can produce large chunks of data before returning, we've decided to
interface to IO plugins via Python for now, as we don't think the short time the GIL is needed
should lead to any contention.

E.g. an IO source can read their dataframe's in rust and only at the rendez-vous move the data
zero-copy having only a short time the GIL is needed.
Expand Down

0 comments on commit f5dec3d

Please sign in to comment.