Skip to content Skip to sidebar Skip to footer
Showing posts with the label Dask

Dask Rolling Function By Group Syntax

I struggled for a while with the syntax to work for calculating a rolling function by group for a d… Read more Dask Rolling Function By Group Syntax

Dask: Is It Safe To Pickle A Dataframe For Later Use?

I have a database-like object containing many dask dataframes. I would like to work with the data, … Read more Dask: Is It Safe To Pickle A Dataframe For Later Use?

Creating A Dask Bag From A Generator

I would like to create a dask.Bag (or dask.Array) from a list of generators. The gotcha is that the… Read more Creating A Dask Bag From A Generator

Load Images Into A Dask Dataframe

I have a dask dataframe which contains image paths in a column (called img_paths). What I want to d… Read more Load Images Into A Dask Dataframe

Slicing A Dask Dataframe

I have the following code where I like to do a train/test split on a Dask dataframe df = dd.read_c… Read more Slicing A Dask Dataframe

Including Keyword Arguments (kwargs) In Custom Dask Graphs

Am building a custom graph for one operation with Dask. Am familiar with how to pass arguments to a… Read more Including Keyword Arguments (kwargs) In Custom Dask Graphs

Reading Csv With Separator In Python Dask

I am trying to create a DataFrame by reading a csv file separated by '#####' 5 hashes The … Read more Reading Csv With Separator In Python Dask

Can I Use Functions Imported From .py Files In Dask/distributed?

I have a question about serialization and imports. should functions have their own imports? like … Read more Can I Use Functions Imported From .py Files In Dask/distributed?