Skip to content

Dask

Experimental

The Dask backend is experimental and is subject to backwards incompatible changes.

Install

Install ibis and dependencies for the Dask backend:

pip install 'ibis-framework[dask]'
conda install -c conda-forge ibis-dask
mamba install -c conda-forge ibis-dask

Connect

API

Create a client by passing in a dictionary of paths to ibis.dask.connect.

See ibis.backends.dask.Backend.do_connect for connection parameter information.

ibis.dask.connect is a thin wrapper around ibis.backends.dask.Backend.do_connect.

Connection Parameters

do_connect(self, dictionary)

Construct a Dask backend client from a dictionary of data sources.

Parameters

dictionary Mapping from str table names to Dask DataFrames.

Examples

import ibis data = {"t": "path/to/file.parquet", "s": "path/to/file.csv"} ibis.dask.connect(data)

Backend API

Backend (BasePandasBackend)

Attributes

version property readonly

Return the version of the backend engine.

For database servers, return the server version.

For others such as SQLite and pandas return the version of the underlying library or application.

Returns

str The backend version

Methods

compile(self, query, params=None, **kwargs)

Compile expr.

Notes

For the dask backend returns a dask graph that you can run .compute on to get a pandas object.

create_table(self, table_name, obj=None, schema=None)

Create a table.

execute(self, query, params=None, limit='default', **kwargs)

Execute an expression.


Last update: March 1, 2022