Introduction
Laminar is a distributed stream processing engine written in Rust, designed to continuously transform and analyze streaming data at scale. Data flows in, gets transformed, and lands in your lakehouse—all within seconds of arrival.
Features
- Pipelines defined in SQL, with support for complex analytical queries
- Scales up to millions of events per second
- Exactly-once semantics with automatic checkpointing for fault-tolerance
- Event time processing with watermark support
Why Laminar
There are already a number of existing streaming engines out there, including Apache Flink, Spark Streaming, and Kafka Streams. Why create a new one?
- Serverless operations: Laminar pipelines are designed to run in modern cloud environments, supporting seamless scaling, recovery, and rescheduling
- High performance SQL: SQL is a first-class concern, with consistently excellent performance
- Designed for everyone: Laminar cleanly separates the pipeline APIs from its internal implementation. You don't need to be a streaming expert to build real-time data pipelines.