ICEBERG_META
Description
iceberg_meta table-valued-function(tvf), Use for read iceberg metadata, operation history, snapshots of table, file metadata etc.
Syntax
ICEBERG_META(
"table"="<table>",
"query_type"="<query_type>"
);
Required Parameters
Each parameter in the iceberg_meta table function (tvf) is a "key"="value" pair.
| Field | Description |
|---|---|
<table> | The full table name, which must be specified in the format of database_name.table_name for the Iceberg table that you want to view. |
<query_type> | The type of metadata you want to view. Currently, only snapshots is supported. |
Examples
-
Read and access the iceberg tabular metadata for snapshots.
select*from iceberg_meta("table"="ctl.db.tbl","query_type"="snapshots"); -
Can be used with
desc function:descfunction iceberg_meta("table"="ctl.db.tbl","query_type"="snapshots"); -
Inspect the iceberg table snapshots :
select*from iceberg_meta("table"="iceberg_ctl.test_db.test_tbl","query_type"="snapshots");+------------------------+----------------+---------------+-----------+-------------------+------------------------------+
| committed_at | snapshot_id | parent_id | operation | manifest_list | summary |
+------------------------+----------------+---------------+-----------+-------------------+------------------------------+
| 2022年09月20日 11:14:29 | 64123452344 | -1 | append | hdfs:/path/to/m1 | {"flink.job-id":"xxm1", ...} |
| 2022年09月21日 10:36:35 | 98865735822 | 64123452344 | overwrite | hdfs:/path/to/m2 | {"flink.job-id":"xxm2", ...} |
| 2022年09月21日 21:44:11 | 51232845315 | 98865735822 | overwrite | hdfs:/path/to/m3 | {"flink.job-id":"xxm3", ...} |
+------------------------+----------------+---------------+-----------+-------------------+------------------------------+ -
Filtered by snapshot_id :
select*from iceberg_meta("table"="iceberg_ctl.test_db.test_tbl","query_type"="snapshots")where snapshot_id =98865735822;+------------------------+----------------+---------------+-----------+-------------------+------------------------------+
| committed_at | snapshot_id | parent_id | operation | manifest_list | summary |
+------------------------+----------------+---------------+-----------+-------------------+------------------------------+
| 2022年09月21日 10:36:35 | 98865735822 | 64123452344 | overwrite | hdfs:/path/to/m2 | {"flink.job-id":"xxm2", ...} |
+------------------------+----------------+---------------+-----------+-------------------+------------------------------+