Dask

https://www.dask.org

Install

Install Ibis and dependencies for the Dask backend:

pip

Install with the dask extra:

pip install 'ibis-framework[dask]'

And connect:

import ibis

con = ibis.dask.connect()

1

Adjust connection parameters as needed.

conda

Install for Dask:

conda install -c conda-forge ibis-dask

And connect:

import ibis

con = ibis.dask.connect()

1

Adjust connection parameters as needed.

mamba

Install for Dask:

mamba install -c conda-forge ibis-dask

And connect:

import ibis

con = ibis.dask.connect()

1

Adjust connection parameters as needed.

dask.Backend

compile

compile(self, query, params=None, **kwargs)

Compile expr.

Returns

Type	Description
dask.dataframe.core.DataFrame | dask.dataframe.core.Series | dask.dataframe.core.Scalar	Dask graph.

execute

execute(self, query, params=None, limit='default', **kwargs)

Execute an expression.

read_csv

read_csv(self, source, table_name=None, **kwargs)

Register a CSV file as a table in the current session.

Parameters

Name	Type	Description	Default
source	str | pathlib.Path	The data source. Can be a local or remote file, pathlike objects also accepted.	required
table_name	str | None	An optional name to use for the created table. This defaults to a generated name.	None
**kwargs	Any	Additional keyword arguments passed to Pandas loading function. See https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_csv.html for more information.	{}

Returns

Type	Description
ir.Table	The just-registered table

read_parquet

read_parquet(self, source, table_name=None, **kwargs)

Register a parquet file as a table in the current session.

Parameters

Name	Type	Description	Default
source	str | pathlib.Path	The data source(s). May be a path to a file, an iterable of files, or directory of parquet files.	required
table_name	str | None	An optional name to use for the created table. This defaults to a generated name.	None
**kwargs	Any	Additional keyword arguments passed to Pandas loading function. See https://pandas.pydata.org/docs/reference/api/pandas.read_parquet.html for more information.	{}

Returns

Type	Description
ir.Table	The just-registered table

table

table(self, name, schema=None)