I'm loading parquet file with tabular data. I wanted to process this data and load it to Redis. My initial approach was to do redis SET per row, but it's suboptimal as redis supports MSET. I was trying to figure out how to batch df and be able to call function on whole batch rather than single row. Is it possible with Dask?
Donate. I desperately need donations to survive due to my health
Get paid by answering surveys Click here
Click here to donate
Remote/Work from Home jobs
Comments
Post a Comment