Apache ORC
From Wikipedia, the free encyclopedia
Column-oriented data storage format
This article has multiple issues. Please help improve it or discuss these issues on the talk page . (Learn how and when to remove these messages)
(Learn how and when to remove this message)The topic of this article may not meet Wikipedia's notability guidelines for products and services . Please help to demonstrate the notability of the topic by citing reliable secondary sources that are independent of the topic and provide significant coverage of it beyond a mere trivial mention. If notability cannot be shown, the article is likely to be merged, redirected, or deleted.
Find sources: "Apache ORC" – news · newspapers · books · scholar · JSTOR (February 2019) (Learn how and when to remove this message)
Find sources: "Apache ORC" – news · newspapers · books · scholar · JSTOR (February 2019) (Learn how and when to remove this message)
This article may rely excessively on sources too closely associated with the subject , potentially preventing the article from being verifiable and neutral. Please help improve it by replacing them with more appropriate citations to reliable, independent sources. (February 2019) (Learn how and when to remove this message)
| Apache ORC | |
|---|---|
| Initial release | 20 February 2013; 12 years ago (2013年02月20日)[1] |
| Stable release | |
| Repository | ORC Repository |
| Operating system | Cross-platform |
| Type | Database management system |
| License | Apache License 2.0 |
| Website | orc |
Apache ORC (Optimized Row Columnar) is a free and open-source column-oriented data storage format.[3] It is similar to the other columnar-storage file formats available in the Hadoop ecosystem such as RCFile and Parquet. It is used by most of the data processing frameworks Apache Spark, Apache Hive, Apache Flink, and Apache Hadoop.
In February 2013, the Optimized Row Columnar (ORC) file format was announced by Hortonworks in collaboration with Facebook.[1] A calendar month later, the Apache Parquet format was announced, developed by Cloudera and Twitter.[4]
Apache ORC format is widely supported including Amazon Web Services' Glue [5] ,Google Cloud Platform's BigQuery,[6] and Pandas (software).[7]
History
[edit ]| Version | Original release date | Latest version | Release date |
|---|---|---|---|
| Unsupported: 1.0 | 2016年01月25日 | 1.0.0 | 2016年01月25日 |
| Unsupported: 1.1 | 2016年06月10日 | 1.1.2 | 2016年07月08日 |
| Unsupported: 1.2 | 2016年08月25日 | 1.2.3 | 2016年12月12日 |
| Unsupported: 1.3 | 2017年01月23日 | 1.3.4 | 2017年10月16日 |
| Unsupported: 1.4 | 2017年05月08日 | 1.4.5 | 2019年12月09日 |
| Unsupported: 1.5 | 2018年05月14日 | 1.5.13 | 2021年09月15日 |
| Unsupported: 1.6 | 2019年09月03日 | 1.6.14 | 2022年04月14日 |
| Unsupported: 1.7 | 2021年09月15日 | 1.7.8 | 2023年01月21日 |
| Supported: 1.8 | 2022年09月03日 | 1.8.9 | 2025年05月06日 |
| Supported: 1.9 | 2023年06月28日 | 1.9.6 | 2025年05月06日 |
| Supported: 2.0 | 2024年03月08日 | 2.0.5 | 2025年05月06日 |
| Latest version: 2.1 | 2025年01月09日 | 2.1.2 | 2025年05月06日 |
Legend: Unsupported Supported Latest version Preview version Future version | |||
See also
[edit ]- Apache Arrow
- Apache Hive
- Apache NiFi
- Apache Parquet
- Apache Spark
- Pig (programming tool)
- Trino (SQL query engine)
- Presto (SQL query engine)
References
[edit ]- ^ a b Alan Gates (February 20, 2013). "The Stinger Initiative: Making Apache Hive 100 Times Faster". Hortonworks blog. Archived from the original on March 28, 2013.
- ^ "Apache ORC - Releases" . Retrieved 15 May 2025.
- ^ Yin Huai, Siyuan Ma, Rubao Lee, Owen O'Malley, and Xiaodong Zhang (2013). "Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters ". VLDB' 39. pp. 1750–1761. CiteSeerX 10.1.1.406.4342 . doi:10.14778/2556549.2556559.
{{cite conference}}: CS1 maint: multiple names: authors list (link) - ^ Justin Kestelyn (March 13, 2013). "Introducing Parquet: Efficient Columnar Storage for Apache Hadoop". Cloudera blog. Archived from the original on September 19, 2016. Retrieved May 4, 2017.
- ^ "Using the ORC format in AWS Glue". docs.aws.amazon.com. Retrieved August 21, 2024.
- ^ "Load an ORC file". cloud.google.com/bigquery/docs. Retrieved May 15, 2025.
- ^ "pandas.read_orc". pandas.pydata.org. Retrieved May 15, 2025.