Does Streamz support modin/vaex/koalas? #428 #887
-
|
Does Streamz support modin or vaex? Besides pandas/dask, I'm thinking of trying a few more solutions. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 1 reply
-
|
With streamz, do you refer to this package? If yes, I think this question is better suited for the streamz repository - this is the repository of tsfresh, a feature extraction library on time series. (From my knowledge on streamz: the lower level building blocks are framework independent, however the higher-level convenience functions are tailored to dask) |
Beta Was this translation helpful? Give feedback.
-
|
I see! Thanks so much! My question is indeed "if you can use tsfresh with those libraries". |
Beta Was this translation helpful? Give feedback.
-
|
Ok, I see. So yes, you can probably expert into pandas dataframes and feed them into tsfresh, but you will loose the parallelism that these libraries have. It is not impossible to build something better also for those libraries, similar to what we have for dask, but I am unfortunately not an expert in those tools. Spark is already supported, so koalas should be easier (but I have never tried) |
Beta Was this translation helpful? Give feedback.
With streamz, do you refer to this package? If yes, I think this question is better suited for the streamz repository - this is the repository of tsfresh, a feature extraction library on time series. (From my knowledge on streamz: the lower level building blocks are framework independent, however the higher-level convenience functions are tailored to dask)
If your question was if you can use tsfresh with those libraries: the input format of tsfresh is pandas tables, however as far as I know all of the mentioned libraries have a pandas export.