-
|
there are run vortex with datafusion in rust exmaples in the document. But I didn't see a python example. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
These benchmarks (which are really out of date) just invoke a rust binary. The way to use Vortex and DataFusion together right now through python is by building your own datafusion-python bindings that also include Depending on your usecase, maybe duckdb makes for a better experience? It does have Vortex as a core extension, so it should be pretty seamless. |
Beta Was this translation helpful? Give feedback.
These benchmarks (which are really out of date) just invoke a rust binary.
The way to use Vortex and DataFusion together right now through python is by building your own datafusion-python bindings that also include
vortex-datafusionand set up the Vortex file format so it can work with a similar experience as any of the other built-in file formats.Depending on your usecase, maybe duckdb makes for a better experience? It does have Vortex as a core extension, so it should be pretty seamless.