Home
Hasso-Plattner-Institut
Hasso-Plattner-Institut
Prof. Dr. h.c. mult. Hasso Plattner
schließen
schließen

Our team is giving a series of lectures and seminars with a focus on enterprise systems design and in-memory data management. Strong links to the industry ensure a close connection between theory and its implementation in the real world.

schließen
schließen
schließen

If you are having questions regarding one of our publications, please contact the authors.

schließen
  1. HOME
  2. > Projects
  3. > Project Archive
  4. > ESPBench

The Enterprise Stream Processing Benchmark

Motivation

Why another benchmark?

The ever increasing amount of data that is produced nowadays, from smart homes to smart factories, gives rise to completely new challenges and opportunities. Terms like "Internet of Things" (IoT) and "Big Data" have gained traction to describe the creation and analysis of these new data masses. Furthermore, new technologies and systems were developed that are able to handle and analyze data streams, i.e., data arriving with high frequency and in large volume.

In recent years, e.g., a lot of distributed Data Stream Processing Systems were developed, whose usage represents one way of analyzing data streams. Although a broad variety of systems or system architectures is generally a good thing, the bigger the choice, the harder it is to choose.

Benchmarking is a common and proven approach to identify the best system for a specific set of needs. However, currently, no satisfying benchmark for modern data stream processing architectures exists. Particularly when an enterprise context, i.e., where data streams have to be combined with historical and transactional data, existing benchmarks have shortcomings. The Enterprise Streaming Benchmark (ESB), which is to be developed, will attempt to tackle this issue.

Objectives

We aim to create a relevant, real-world application benchmark with a focus on data stream processing architectures in an enterprise context. This involves including business or transactional data stored in a traditional database into the analysis process. In order to ease usage of the developed benchmark, we will develop a comprehensive toolkit for supporting implementation as well as setup and execution. Particularly, it will comprise tools for system setup, data ingestion, data validation and benchmark result analysis.

With regard to the domain, we will focus on an industrial manufacturing context. So the defined benchmark queries will answer questions in that area. Our primary data source will be sensor data from, e.g., industrial machinery. Therefore, we aim to work with real-world data.

Selected Publications

  • ESPBench: The Enterprise Stream Processing Benchmark. Hesse, Guenter; Matthies, Christoph; Perscheid, Michael; Uflacker, Matthias; Plattner, Hasso (2021). 201–212.
    [ ] [ Download ]
  • How Fast Can We Insert? An Empirical Performance Evaluation of Apache Kafka. Hesse, Guenter; Matthies, Christoph; Uflacker, Matthias (2021). 641–648.
    [ ] [ Download ]
  • Application of Data Stream Processing Technologies in Industry 4.0: What is Missing?. Hesse, Guenter; Sinzig, Werner; Matthies, Christoph; Uflacker, Matthias (2019). 304–310.
    [ ] [ Download ]
  • Quantitative Impact Evaluation of an Abstraction Layer for Data Stream Processing Systems. Hesse, Guenter; Matthies, Christoph; Glass, Kelvin; Huegle, Johannes; Uflacker, Matthias (2019). 1381–1392.
    [ ] [ Download ]
  • Adding Value by Combining Business and Sensor Data: An Industry 4.0 Use Case. Hesse, Guenter; Matthies, Christoph; Sinzig, Werner; Uflacker, Matthias G. Li, J. Yang, J. Gama, J. Natwichai, Y. Tong (reds.) (2019). (Vol. 11448) 528–532.
    [ ] [ Download ]
  • Senska - Towards an Enterprise Streaming Benchmark. Hesse, Guenter; Reissaus, Benjamin; Matthies, Christoph; Lorenz, Martin; Kraus, Milena; Uflacker, Matthias (2018). 25–40.
    [ ] [ Download ]
  • A New Application Benchmark for Data Stream Processing Architectures in an Enterprise Context: Doctoral Symposium. Hesse, Guenter; Matthies, Christoph; Reissaus, Benjamin; Uflacker, Matthias in DEBS ’17 (2017). 359–362.
    [ ] [ Download ]
  • Conceptual Survey on Data Stream Processing Systems. Hesse, Guenter; Lorenz, Martin in IEEE International Conference on Parallel and Distributed Systems (ICPADS) (2015). 797–802.
    [ ] [ Download ]

News

22.09.2023 | Trends and Concepts in the Softwareindustry Seminar offered in WiSe 2023/2024

Trends and Concepts in the Softwareindustry Seminar offered in WiSe 2023/2024 > Zum Artikel

22.05.2023 | Christopher Hagedorn Successfully Defended His PhD Thesis

Christopher Hagedorn Successfully Defended His PhD Thesis > Zum Artikel

03.03.2023 | Last Trends and Concepts course of Prof. Hasso Plattner

After more than 20 years of teaching, our founder and benefactor Prof. Hasso Plattner visited the HPI this week for his … > Zum Artikel

01.03.2023 | Jan Kossmann Successfully Defended His PhD Thesis

Last week, Jan Kossmann another PhD student of our EPIC group successfully defended his thesis on the topic of … > Zum Artikel

26.02.2023 | Paper on Data Tiering in Hyrise Published in BTW Proceedings

Our latest paper on data tiering in Hyrise "Workload-Driven Data Placement for Tierless In-Memory Database Systems" by … > Zum Artikel

24.02.2023 | Paper on EPIC Research Group Published in SIGMOD Record

Our report "Enterprise Platform and Integration Concepts Research at HPI" has been published in the December issue of … > Zum Artikel

30.11.2022 | Paper on Database Optimizations for Spatio-Temporal Data published in PVLDB

Our paper "Robust and Budget-Constrained Encoding Configurations for In-Memory Database Systems" has been published in … > Zum Artikel

04.10.2022 | Günter Hesse Successfully Defended His PhD Thesis

Last week, Günter Hesse another PhD student of our EPIC group successfully defended his thesis on the topic of "A … > Zum Artikel

08.07.2022 | Successful PhD Defense by Markus Dreseler

Markus Dreseler has successfully defended his PhD thesis on Automatic Tiering for In-Memory Database Systems. > Zum Artikel

Literature

"A Course in In-Memory Data Management" by Prof. Dr. h.c. Hasso Plattner. This book is the culmination of six years work of in-memory research. As such, it provides the technical foundation for combined transactional and analytical workloads inside one single database as well as examples of new applications that are now possible given the availability of the new technology. The book is available at Springer.

Contact

Dr. Michael Perscheid

Chair Representative

Tel.: +49 (331) 5509-566

E-Mail:


Office:

Room: V-2.12

Tel.: +49 (331) 5509-560

Fax: +49 (331) 5509-579

E-Mail:

Follow us on Twitter

Contact Details

AltStyle によって変換されたページ (->オリジナル) /