Dask

https://www.dask.org

Install

Install Ibis and dependencies for the Dask backend:

Install with the dask extra:

pip install 'ibis-framework[dask]'

And connect:

import ibis

con = ibis.dask.connect()
1
Adjust connection parameters as needed.

Install for Dask:

conda install -c conda-forge ibis-dask

And connect:

import ibis

con = ibis.dask.connect()
1
Adjust connection parameters as needed.

Install for Dask:

mamba install -c conda-forge ibis-dask

And connect:

import ibis

con = ibis.dask.connect()
1
Adjust connection parameters as needed.

dask.Backend

compile

compile(self, query, params=None, **kwargs)

Compile expr.

Returns

Type Description
dask.dataframe.core.DataFrame | dask.dataframe.core.Series | dask.dataframe.core.Scalar Dask graph.

execute

execute(self, query, params=None, limit='default', **kwargs)

Execute an expression.

read_csv

read_csv(self, source, table_name=None, **kwargs)

Register a CSV file as a table in the current session.

Parameters

Name Type Description Default
source str | pathlib.Path The data source. Can be a local or remote file, pathlike objects also accepted. required
table_name str | None An optional name to use for the created table. This defaults to a generated name. None
**kwargs Any Additional keyword arguments passed to Pandas loading function. See https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_csv.html for more information. {}

Returns

Type Description
ir.Table The just-registered table

read_parquet

read_parquet(self, source, table_name=None, **kwargs)

Register a parquet file as a table in the current session.

Parameters

Name Type Description Default
source str | pathlib.Path The data source(s). May be a path to a file, an iterable of files, or directory of parquet files. required
table_name str | None An optional name to use for the created table. This defaults to a generated name. None
**kwargs Any Additional keyword arguments passed to Pandas loading function. See https://pandas.pydata.org/docs/reference/api/pandas.read_parquet.html for more information. {}

Returns

Type Description
ir.Table The just-registered table

table

table(self, name, schema=None)

Back to top