Dask
Install
Install Ibis and dependencies for the Dask backend:
Install with the dask
extra:
pip install 'ibis-framework[dask]'
And connect:
import ibis
= ibis.dask.connect() con
- 1
- Adjust connection parameters as needed.
Install for Dask:
conda install -c conda-forge ibis-dask
And connect:
import ibis
= ibis.dask.connect() con
- 1
- Adjust connection parameters as needed.
Install for Dask:
mamba install -c conda-forge ibis-dask
And connect:
import ibis
= ibis.dask.connect() con
- 1
- Adjust connection parameters as needed.
dask.Backend
compile
compile(self, query, params=None, **kwargs)
Compile expr
.
Returns
Type | Description |
---|---|
dask.dataframe.core.DataFrame | dask.dataframe.core.Series | dask.dataframe.core.Scalar | Dask graph. |
execute
execute(self, query, params=None, limit='default', **kwargs)
Execute an expression.
read_csv
read_csv(self, source, table_name=None, **kwargs)
Register a CSV file as a table in the current session.
Parameters
Name | Type | Description | Default |
---|---|---|---|
source |
str | pathlib.Path | The data source. Can be a local or remote file, pathlike objects also accepted. | required |
table_name |
str | None | An optional name to use for the created table. This defaults to a generated name. | None |
**kwargs |
Any | Additional keyword arguments passed to Pandas loading function. See https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_csv.html for more information. | {} |
Returns
Type | Description |
---|---|
ir.Table | The just-registered table |
read_parquet
read_parquet(self, source, table_name=None, **kwargs)
Register a parquet file as a table in the current session.
Parameters
Name | Type | Description | Default |
---|---|---|---|
source |
str | pathlib.Path | The data source(s). May be a path to a file, an iterable of files, or directory of parquet files. | required |
table_name |
str | None | An optional name to use for the created table. This defaults to a generated name. | None |
**kwargs |
Any | Additional keyword arguments passed to Pandas loading function. See https://pandas.pydata.org/docs/reference/api/pandas.read_parquet.html for more information. | {} |
Returns
Type | Description |
---|---|
ir.Table | The just-registered table |
table
table(self, name, schema=None)