Lakehouse foundations that scale with the business

"Lakehouse" stopped being an architectural debate two years ago. Almost every Fortune 1000 we work with has either Databricks, Snowflake or both. The new question is no longer which platform, but how to build on it without creating a new generation of legacy.

Medallion is a means, not an end

Bronze, silver, gold. Every team draws the diagram. Few enforce the contract. The pattern only delivers when each layer has a specific guarantee:

• Bronze is raw, immutable and replayable. Schema-on-read, no business logic.
• Silver is conformed, deduplicated and quality-checked. One version of each entity.
• Gold is shaped for a consumer — a dashboard, a model, an API. Optimized for read.

Governance you can actually live with

Unity Catalog, Snowflake Horizon and similar tools have made fine-grained governance practical. The hard part is not the tooling — it is the operating model. We push clients toward a federated approach: a central platform team owns the primitives (catalog, lineage, masking policies); domain teams own their data products end-to-end.

"Centralized governance fails because it becomes the bottleneck. Federated governance fails when there are no shared primitives. The trick is to centralize the primitives, not the decisions."

Cost control without slowing delivery

The biggest lakehouse bills we have seen come from three sources: over-provisioned warehouses left running, full-table scans against poorly partitioned tables, and ML notebooks that quietly turned into production pipelines. Three habits keep costs predictable:

1. Tag every workload with team, environment and use case from day one. You cannot optimize what you cannot attribute.
2. Auto-suspend aggressively — 60 seconds is fine for interactive warehouses, longer queues for serving.
3. Promote pipelines explicitly from notebook to job — with code review, tests and SLAs. No more ghost workloads.

AI-ready by accident is rare

Every client we work with wants AI on top of their data. The ones who get there first are not the ones with the best models — they are the ones whose lakehouse is already curated, governed and addressable. The foundations decide the ceiling.