Skip to content Skip to sidebar Skip to footer
Showing posts with the label Dask

Dask Rolling Function By Group Syntax

I struggled for a while with the syntax to work for calculating a rolling function by group for a d… Read more Dask Rolling Function By Group Syntax

Dask: Is It Safe To Pickle A Dataframe For Later Use?

I have a database-like object containing many dask dataframes. I would like to work with the data, … Read more Dask: Is It Safe To Pickle A Dataframe For Later Use?

Creating A Dask Bag From A Generator

I would like to create a dask.Bag (or dask.Array) from a list of generators. The gotcha is that the… Read more Creating A Dask Bag From A Generator

Load Images Into A Dask Dataframe

I have a dask dataframe which contains image paths in a column (called img_paths). What I want to d… Read more Load Images Into A Dask Dataframe

Slicing A Dask Dataframe

I have the following code where I like to do a train/test split on a Dask dataframe df = dd.read_c… Read more Slicing A Dask Dataframe

Including Keyword Arguments (kwargs) In Custom Dask Graphs

Am building a custom graph for one operation with Dask. Am familiar with how to pass arguments to a… Read more Including Keyword Arguments (kwargs) In Custom Dask Graphs

Reading Csv With Separator In Python Dask

I am trying to create a DataFrame by reading a csv file separated by '#####' 5 hashes The … Read more Reading Csv With Separator In Python Dask

Can I Use Functions Imported From .py Files In Dask/distributed?

I have a question about serialization and imports. should functions have their own imports? like … Read more Can I Use Functions Imported From .py Files In Dask/distributed?

Basic Groupby Operations In Dask

I am attempting to use Dask to handle a large file (50 gb). Typically, I would load it in memory an… Read more Basic Groupby Operations In Dask

How To Use Dask To Run Python Code On The Gpu?

I have some code that uses Numba cuda.jit in order for me to run on the gpu, and I would like to la… Read more How To Use Dask To Run Python Code On The Gpu?

Assign (add) A New Column To A Dask Dataframe Based On Values Of 2 Existing Columns - Involves A Conditional Statement

I would like to add a new column to an existing dask dataframe based on the values of the 2 existin… Read more Assign (add) A New Column To A Dask Dataframe Based On Values Of 2 Existing Columns - Involves A Conditional Statement

Dask Distributed Memory Error

I got the following error on the scheduler while running Dask on a distributed job: distributed.cor… Read more Dask Distributed Memory Error

Using Dask Throws Importerror When Sagemath Code Is Run In Python

This question is very similar to my earlier question and was prompted by one of the comments. Recen… Read more Using Dask Throws Importerror When Sagemath Code Is Run In Python

Unpacking Result Of Delayed Function

While converting my program using delayed, I stumbled upon a commonly used programming pattern that… Read more Unpacking Result Of Delayed Function