Dask

Install

Install ibis and dependencies for the Dask backend:

pipcondamamba

pip install 'ibis-framework[dask]'

conda install -c conda-forge ibis-dask

mamba install -c conda-forge ibis-dask

Connect

API

Create a client by passing in a dictionary of paths to ibis.dask.connect.

See ibis.backends.dask.Backend.do_connect for connection parameter information.

ibis.dask.connect is a thin wrapper around ibis.backends.dask.Backend.do_connect.

Connection Parameters

do_connect(dictionary=None)

Construct a Dask backend client from a dictionary of data sources.

Parameters:

Name	Type	Description	Default
dictionary	MutableMapping[str, dd.DataFrame] | None	An optional mapping from str table names to Dask DataFrames.	None

Examples:

>>> import ibis
>>> import dask.dataframe as dd
>>> data = {
...     "t": dd.read_parquet("path/to/file.parquet"),
...     "s": dd.read_csv("path/to/file.csv"),
... }
>>> ibis.dask.connect(data)

Backend API

Backend

Bases: BasePandasBackend

Functions

compile(query, params=None, **kwargs)

Compile expr.

Returns:

Type	Description
dask.dataframe.core.DataFrame | dask.dataframe.core.Series | das.dataframe.core.Scalar	Dask graph.

---

Last update: January 4, 2023