Extending Ibis

Users typically want to extend ibis in one of two ways:

1. Add a new expression

2. Add a new backend

Below we provide notebooks showing how to extend ibis in each of these ways.

Adding a New Expression

Note

Make sure you’ve run the following commands before executing the notebook

docker-compose up -d --no-build postgres dns
docker-compose run waiter
docker-compose run ibis ci/load-data.sh postgres

Here we show how to add a sha1 method to the PostgreSQL backend as well as how to add a new bitwise_and reduction operation:

• Extending Ibis Part 1: Adding a New Elementwise Expression
• Extending Ibis Part 2: Adding a New Reduction Expression

Adding a New Backend

Run test suite for separate Backend

Note

By following the steps below, you get the opportunity to run tests with one command: make test BACKEND=’[your added backend]’

1. you need to add a new backend to BACKENDS variable in Makefile.

2. if backend needs to start services (implemented as docker containers and added into docker-compose.yml file) then add the services to SERVICES variable in Makefile, add case for switch-case construction inside ./ci/dockerize.sh for proper waiting the services.

3. if backend needs to load some data then add the backend to LOADS variable in Makefile and implement necessary functionality in ./ci/load-data.sh

4. the necessary markers for pytest will be generated inside ./ci/backends-markers.sh. By default, a marker will be generated that matches the name of the backend (you can manually correct the generated name for the marker inside the file)