Movatterモバイル変換


[0]ホーム

URL:


Jump to content
WikipediaThe Free Encyclopedia
Search

Apache Beam

From Wikipedia, the free encyclopedia
Unified programming model for data processing pipelines
Apache Beam
Original author(s)Google
Developer(s)Apache Software Foundation
Initial releaseJune 15, 2016; 8 years ago (2016-06-15)
Stable release2.58.0 (August 6, 2024; 7 months ago (2024-08-06)[1]) [±]
RepositoryBeam Repository
Written inJava,Python,Go
Operating systemCross-platform
LicenseApache License 2.0
Websitebeam.apache.org

Apache Beam is anopen source unified programming model to define and execute data processingpipelines, includingETL,batch andstream (continuous) processing.[2] Beam Pipelines are defined using one of the providedSDKs and executed in one of the Beam’s supportedrunners (distributed processing back-ends) includingApache Flink,Apache Samza,Apache Spark, andGoogle Cloud Dataflow.[3]

History

[edit]

Apache Beam[3] is one implementation of the Dataflow model paper.[4] The Dataflow model is based on previous work on distributed processing abstractions at Google, in particular on FlumeJava[5] and Millwheel.[6][7]

Google released an open SDK implementation of the Dataflow model in 2014 and an environment to execute Dataflows locally (non-distributed) as well as in theGoogle Cloud Platform service.

Timeline

[edit]

Apache Beam makes minor releases every 6 weeks.[8]

VersionRelease date
Latest version:2.59.02024-09-11
Old version, not maintained: 2.58.12024-08-15
Old version, not maintained: 2.58.02024-08-06
Old version, not maintained: 2.57.02024-06-26
Old version, not maintained: 2.56.02024-05-01
Old version, not maintained: 2.55.02024-03-25
Old version, not maintained: 2.54.02024-02-14
Old version, not maintained: 2.53.02024-01-04
Old version, not maintained: 2.52.02023-11-17
Old version, not maintained: 2.51.02023-10-11
Old version, not maintained: 2.50.02023-08-30
Old version, not maintained: 2.49.02023-07-17
Old version, not maintained: 2.48.02023-05-31
Old version, not maintained: 2.47.02023-05-10
Old version, not maintained: 2.46.02023-03-10
Old version, not maintained: 2.45.02023-02-15
Old version, not maintained: 2.44.02023-01-12
Old version, not maintained: 2.43.02022-11-17
Old version, not maintained: 2.42.02022-10-17
Old version, not maintained: 2.41.02022-08-23
Old version, not maintained: 2.40.02022-06-27
Old version, not maintained: 2.39.02022-05-25
Old version, not maintained: 2.38.02022-04-20
Old version, not maintained: 2.37.02022-03-04
Old version, not maintained: 2.36.02022-02-07
Old version, not maintained: 2.35.02021-12-29
Old version, not maintained: 2.34.02021-11-11
Old version, not maintained: 2.33.02021-10-07
Old version, not maintained: 2.32.02021-08-25
Old version, not maintained: 2.31.02021-07-08
Old version, not maintained: 2.30.02021-06-09
Old version, not maintained: 2.29.02021-04-27
Old version, not maintained: 2.28.02021-02-22
Old version, not maintained: 2.27.02021-01-08
Old version, not maintained: 2.26.02020-12-11
Old version, not maintained: 2.25.02020-10-23
Old version, not maintained: 2.24.02020-09-18
Old version, not maintained: 2.23.02020-07-29
Old version, not maintained: 2.22.02020-06-08
Old version, not maintained: 2.21.02020-05-27
Old version, not maintained: 2.20.02020-04-15
Old version, not maintained: 2.19.02020-02-04
Old version, not maintained: 2.18.02020-01-23
Old version, not maintained: 2.17.02020-01-06
Old version, not maintained: 2.16.02019-10-07
Old version, not maintained: 2.15.02019-08-22
Old version, not maintained: 2.14.02019-08-01
Old version, not maintained: 2.13.02019-05-22
Old version, not maintained: 2.12.02019-04-25
Old version, not maintained: 2.11.02019-02-26
Old version, not maintained: 2.10.02019-02-01
Old version, not maintained: 2.9.02018-12-13
Old version, not maintained: 2.8.02018-10-29
Old version, not maintained: 2.7.0 (LTS)2018-10-03
Old version, not maintained: 2.6.02018-08-08
Old version, not maintained: 2.5.02018-06-26
Old version, not maintained: 2.4.02018-03-20
Old version, not maintained: 2.3.02018-01-30
Old version, not maintained: 2.2.02017-12-02
Old version, not maintained: 2.1.02017-08-23
Old version, not maintained: 2.0.02017-05-17
Old version, not maintained: 0.6.02017-03-11
Old version, not maintained: 0.5.02017-02-02
Old version, not maintained: 0.4.02016-12-29
Old version, not maintained: 0.3.02016-10-31
Old version, not maintained: 0.2.02016-08-08
Old version, not maintained: 0.1.02016-06-15
Legend:
Old version, not maintained
Old version, still maintained
Latest version
Latest preview version
Future version

See also

[edit]

References

[edit]
  1. ^"Blogs".beam.apache.org. The Apache Software Foundation. Retrieved2024-08-06.
  2. ^Woodie, Alex (22 April 2016)."Apache Beam's Ambitious Goal: Unify Big Data Development".Datanami. Retrieved4 August 2016.
  3. ^ab"Cloud Dataflow - Batch & Stream Data Processing".
  4. ^Akidau, Tyler; Schmidt, Eric; Whittle, Sam; Bradshaw, Robert; Chambers, Craig; Chernyak, Slava; Fernández-Moctezuma, Rafael J.; Lax, Reuven; McVeety, Sam; Mills, Daniel; Perry, Frances (1 August 2015)."The dataflow model"(PDF).Proceedings of the VLDB Endowment.8 (12):1792–1803.doi:10.14778/2824032.2824076. Retrieved4 August 2016.
  5. ^Chambers, Craig; Raniwala, Ashish; Perry, Frances; Adams, Stephen; Henry, Robert R.; Bradshaw, Robert; Weizenbaum, Nathan (1 January 2010). "FlumeJava: Easy, efficient data-parallel pipelines".Proceedings of the 31st ACM SIGPLAN Conference on Programming Language Design and Implementation(PDF). ACM. pp. 363–375.doi:10.1145/1806596.1806638.ISBN 9781450300193.S2CID 14888571. Archived fromthe original(PDF) on 23 September 2016. Retrieved4 August 2016.
  6. ^Akidau, Tyler; Whittle, Sam; Balikov, Alex; Bekiroğlu, Kaya; Chernyak, Slava; Haberman, Josh; Lax, Reuven; McVeety, Sam; Mills, Daniel; Nordstrom, Paul (27 August 2013)."MillWheel"(PDF).Proceedings of the VLDB Endowment.6 (11):1033–1044.doi:10.14778/2536222.2536229. Archived fromthe original(PDF) on 1 February 2016. Retrieved4 August 2016.
  7. ^Pointer, Ian (14 April 2016)."Apache Beam wants to be uber-API for big data". InfoWorld. Retrieved4 August 2016.
  8. ^"Policies".beam.apache.org. Retrieved21 April 2022.
Top-level
projects
Commons
Incubator
Other projects
Attic
Licenses
Google free and open-source software
Software
Applications
Programming languages
Frameworks and
development tools
Operating systems
Related
Retrieved from "https://en.wikipedia.org/w/index.php?title=Apache_Beam&oldid=1245253799"
Categories:
Hidden categories:

[8]ページ先頭

©2009-2025 Movatter.jp