InfoQ Homepage Streaming Content on InfoQ
-
Posted by
Jiangjie Qin
on
Jul 29, 2025
Stream and Batch Processing Convergence in Apache Flink
Jiangjie Qin discusses stream and batch processing convergence in Apache Flink, explaining how Flink unifies computing and execution models for enhanced efficiency & reduced data infrastructure costs.
on Jul 29, 2025Icon39:12 -
Posted by
Adi Polak
on
May 08, 2025
Stream All the Things — Patterns of Effective Data Stream Processing
Adi Polak shares effective data stream processing patterns, common mistakes, and exactly-once semantics.
on May 08, 2025Icon41:25 -
Posted by
Alana Marzoev
on
Mar 06, 2025
Powering User Experiences with Streaming Dataflow
Alana Marzoev discusses the fundamentals of streaming dataflow and the architecture of ReadySet, a streaming dataflow system designed specifically for operational workloads.
on Mar 06, 2025Icon53:21 -
Posted by
Alana Marzoev
on
Dec 11, 2024
Dataflow-Based Query Caching with Readyset
Alana Marzoev discusses the fundamentals of streaming dataflow and the architecture of ReadySet, a streaming dataflow system designed for operational workloads.
on Dec 11, 2024Icon51:45 -
Posted by
Gunnar Morling
on
Oct 25, 2024
1BRC–Nerd Sniping the Java Community
Gunnar Morling discusses some of the tricks employed by the fastest solutions for processing a 13 GB input file within less than two seconds through parallelization and efficient memory access.
on Oct 25, 2024Icon50:07 -
Posted by
Jeremy Saenz
on
Aug 21, 2024
Rethinking Connectivity at the Edge: Scaling Fleets of Low-Powered Devices Using NATS.io
Jeremy Saenz discusses NATS, an open-source project for services communication, and how to leverage NATS to streamline communication and fleet management for devices at the edge.
on Aug 21, 2024Icon40:14 -
Posted by
Saketh Chintapalli
on
Aug 16, 2024
Incremental Data Processing with Apache Hudi
The presenters discuss an introduction to incremental data processing, contrasting it with the two prevalent processing models of today - batch and stream data processing.
on Aug 16, 2024Icon41:53 -
Posted by
Yingjun Wu
on
May 17, 2024
Streaming Databases: Embracing the Convergence of Stream Processing and Databases
Yingjun Wu discusses the evolution of streaming databases, and the features and design principles that set streaming databases apart from conventional database systems and stream processing engines.
on May 17, 2024Icon46:05 -
Posted by
Chao Chu
on
Mar 21, 2024
Building a Large Scale Real-Time Ad Events Processing System
Chao Chu provides insights and practical knowledge for building streaming pipelines for an ad platform.
on Mar 21, 2024Icon41:21 -
Posted by
Michał Maślanka
on
Mar 06, 2024
Multi-Region Data Streaming with Redpanda
Michał Maślanka introduces the design of Redpanda’s Multi-Region feature, and describes how they leveraged Raft’s properties, a constraint solver, automatic data balancing, and tiered storage.
on Mar 06, 2024Icon41:44 -
Posted by
Sid Anand
on
Oct 18, 2023
Building High-Fidelity Data Streams
Sid Anand discusses how they built a lossless streaming data system that guarantees sub-second (p95) event delivery at scale with better than three nines availability.
on Oct 18, 2023Icon41:40 -
Posted by
Steven Wu
on
Jul 24, 2023
Streaming from Apache Iceberg - Building Low-Latency and Cost-Effective Data Pipelines
Steven Wu discusses the design of the Flink Iceberg, comparing the Kafka and Iceberg sources for streaming and how the Iceberg streaming source can power many common stream processing use cases.
on Jul 24, 2023Icon48:48