AI · Article
Query Databricks Iceberg Tables from BigQuery Without Copying Data Using Google Cloud
Google Cloud ·

At a glance
With Google Cloud's boundaryless Lakehouse, BigQuery can directly query Apache Iceberg tables managed by Databricks without replicating the data. Both platforms read the same files, which can reduce storage costs and latency. Security settings can also be managed in one place.
Key points
- Iceberg is an open table format that lets multiple analytics tools read the same data files.
- Data is read where it is originally stored, so no replication pipeline is needed.
- Table information comes from Databricks Unity Catalog, and storage is read using temporary access tokens.
- Queries read only the needed files by using metadata, which improves execution speed and reduces costs.
Why it matters
Organizations that use several data platforms together can manage costs and security without copying data.
Original source
경계 없는 Lakehouse를 활용한 Databricks Apache Iceberg 테이블 쿼리
Google Cloud · Nov 6, 11:56 KST
Read on Google Cloud ↗AI summarized the original article. Check the original for accuracy. Copyright belongs to Google Cloud.
Gemini · Ranking and more news
More from this field
- Google Brings Duplex Calling to Gemini, Letting AI Phone Businesses for You
Google has moved its Duplex phone-calling technology into the Gemini app, so Gemini can now call businesses for you. The system has changed a lot since 2018, shifting from narrow custom models to a single stack built on Gemini.
Google Research blog · Nov 21, 08:30 KST - Google Releases Project Genie, an AI That Generates Explorable Worlds
Google has released Project Genie, an AI tool that creates interactive worlds you can explore. The video shows how to access it, walks through a generated world and a T-Rex demo, and discusses why this early technology matters.
The AI Advantage · Nov 21, 08:21 KST - Anthropic Employee Says Claude Helped Prove Riemann Hypothesis
An Anthropic employee and mathematician, Levent Alpöge, says he used the company's Claude chatbot to create a detailed proof of the Riemann hypothesis over about six weeks. The proof has not yet been checked, and it is over 250,000 lines long in Lean, a computer language used to confirm maths proofs.
BBC News · Nov 21, 08:08 KST - Cole Medin Live-Streams His AI Software Factory Turning Ideas Into Working Software
Cole Medin runs his AI software factory live, taking rough requests from viewers through planning, building, and checking until working software runs on screen. He explains how it works and what he learned building it. The stream also shows a game the system built.
Cole Medin · Nov 21, 08:08 KST