Skip to main content

Ibex Query Engine Lib

The ibex-query-engine-lib is a specialized Python library designed to handle the low-level mechanics of connecting to Apache Iceberg and executing complex queries via DuckDB.

Architectural Role

Similar to the ajna-cloud-sdk, this repo is packaged as a pure Python dependency (setup.py / pyproject.toml). It is deeply integrated into the ibex-analytics-service to abstract away the complexity of REST catalog communication and Parquet file parsing.

High-Level Working

  • Execution Abstractions: It provides wrappers that allow developers to formulate queries without worrying about whether the underlying data is stored in Iceberg, a raw CSV in S3, or an active Postgres database.
  • Robust Testing: Contains heavily fleshed-out test suites (run_inline_test.py, test_with_docker.py) ensuring the physical mapping between DuckDB and Iceberg metadata remains consistent during upgrades.