Explore the Open Data & AI Hub

Welcome to Dremio’s Open Data and AI hub, your resource for exploring the open technologies and interfaces powering modern data and AI architectures, including Apache Parquet, Apache Iceberg, Apache Polaris, MCP, A2A, and more.

Build a Lakehouse Locally Explore Free Books

Explore the ecosystem

Apache IcebergApache ArrowApache PolarisApache Ossie

Go deeper

Free books from Experts

Download full-length architectural reference books authored by engineering leaders in the open source data and AI communities.

Table Formats

Apache Iceberg:
The Definitive Guide

By Tomer Shiran, Jason Hughes, and Alex Merced

Learn how Apache Iceberg brings reliable, scalable data management to data lakes.

Download free
Open Catalog

Apache Polaris:
The Definitive Guide

By Alex Merced, Andrew Madson, and Tomer Shiran

Learn how Apache Polaris enables open catalog governance, security, and interoperability across data engines.

Download free

Live events

Join Us for an Open Source Event

Meet maintainers and practitioners at live meetups and webinars on Apache Iceberg, Polaris, Arrow, and open AI standards. Browse the calendar and reserve your seat.

View the event calendar
Interactive Tutorial

Build an Open Lakehouse
on Your Laptop

Launch Docker containers for RustFS or Ceph storage, create Apache Iceberg tables, and query them with Dremio on your own machine. Submit your screenshots to claim a $100 gift card.

  • Launch Docker containers
  • Create Apache Iceberg tables
  • Claim a $100 gift card
Start Laptop Exercise
Preview of the hands-on lab: a terminal running docker compose up and a CREATE TABLE in Dremio, over RustFS or Ceph storage, Apache Iceberg and Dremio.

Community directory

Dremio Open Lakehouse & AI Community.

Every channel and resource available to help you learn, connect, and build in the open.

Newsletter

Weekly Open Data and AI updates delivered to your inbox.

 Community

Connect with practitioners on Slack.

 Blog

Open Data Architecture insights and articles.

 YouTube

Watch video tutorials and community playlists.

 Events

Join upcoming Open Data and AI meetups and webinars.

 Reddit

Join discussions on r/datalakehouseandai.

 Laptop Quickstart

Experience the Open Lakehouse on your laptop.

 Books

Download Iceberg and Polaris Definitive Guides.

Open by design

Open Data & AI Knowledge Base

Deep architectural guides, format specifications, and interface standards powering modern open data lakehouse and AI systems.

Open Data

Apache Parquet

The standard columnar storage file format providing efficient encoding, dictionary compression, and predicate pushdown.
Open Data

Apache Iceberg

High performance table format offering ACID transactions, snapshot isolation, hidden partitioning, and schema evolution.
Open Data

Apache Polaris

Open source catalog for Apache Iceberg implementing the REST catalog standard with central RBAC and credential vending.
Open Data

Apache Arrow

In-memory columnar format and compute framework eliminating serialization overhead across analytic engines and clients.
Open Data

Apache Ossie

Open specification standardizing semantic metadata and business metrics across data platforms, BI tools, and AI models.
Open AI

MCP (Model Context Protocol)

Open standard defining how AI applications and agents securely connect to lakehouse data, tools, and prompts.
Open AI

A2A (Agent2Agent)

Protocol facilitating discovery, capability negotiation, and task delegation between autonomous, distributed AI agents.
Open AI

Apache APISIX

Cloud-native API gateway handling dynamic traffic routing, security, and LLM proxying for AI agents and lakehouse services.

Get the Weekly Open Lakehouse and AI Newsletter

Subscribe to receive weekly architecture deep dives, open source updates, and best practices covering Apache Iceberg, Polaris, Arrow, MCP, and AI interfaces.

Subscribe