StreamPark: a streaming application development framework and cloud-native real-time computing platform.
StreamPark is a streaming application development framework and cloud-native real-time computing platform. Designed to simplify the development and management of streaming applications, StreamPark provides a development framework for constructing stream processing applications using Apache Flink and Apache Spark, along with a professional streaming application management platform. The platform encompasses application development, debugging, interactive querying, deployment, operation, maintenance, and more. Originally named StreamX, the project was renamed StreamPark in August 2022 and officially graduated as an Apache Top-Level Project (TLP) in January 2025.
- Streaming Application Development Framework
- StreamPark provides a Streaming application framework to simplify Apache Flink and Apache Spark application development, offering plug-and-play connectors to reduce the learning curve and development complexity.
- Real-Time Computing Platform
- StreamPark delivers a one-stop real-time computing platform with core capabilities including application development, deployment, management and monitoring, etc.
- Supports Batch & Streaming
- Supports both Apache Flink and Apache Spark, enabling seamless integration of streaming and batch processing, with multi-engine/multi-version support on a single platform.
- Supports multi-engine/multi-version
- StreamPark supports multiple versions of Apache Flink and Apache Spark, enabling users to develop and manage applications for different versions of these streaming engines within a single framework.
- Multi-environment Compatibility
- Compatible with various cluster environments, users can submit Flink and Spark applications to standalone clusters, YARN (Hadoop 2.x/3.x), and Kubernetes.
- Rich Ecosystems
- Compatible with mainstream open-source technologies (e.g., Apache Flink, Apache Spark, Apache Paimon, Apache Doris) and ML/AI ecosystems, ensuring flexible technology adoption.
- Easy to use
- StreamPark is designed to lower the learning curve and entry barrier. Only one service, deployment easy, allowing even beginners to get started within minutes.
curl -L https://streampark.apache.org/quickstart.sh | sh
StreamPark.QuickStart.mp4
more:
./build.sh
π how to Development
Please head to the releases page to download a release of Apache StreamPark.
Various companies and organizations use Apache StreamPark for research, production and commercial products. Are you using this project? Welcome to add your company!
You can submit any ideas as pull requests or as issues.
If you're new to posting issues, we ask that you read How To Ask Questions The Smart Way (This guide does not provide actual support services for this project!), How to Report Bugs Effectively prior to posting. Well written bug reports help us help you!
We welcome your suggestions, comments (including criticisms), comments and contributions. See How to Contribute and Code Submission Guide
Thank you to all the people who already contributed to Apache StreamPark!
Contact us through the following mailing list.
Name | Mailing list |
---|---|
[email protected] | SubscribeγUnsubscribe γArchives |
- X (Twitter)
- Zhihu (in Chinese)
- bilibili (in Chinese)
- WeChat Official Account (in Chinese, scan the QR code to follow)
Licensed under the Apache License, Version 2.0