Skip to content

spark-http-streaming 0.9.1

Latest

Choose a tag to compare

@bluejoe2008 bluejoe2008 released this 04 Jan 13:36
· 3 commits to master since this release

spark-http-stream transfers Spark structured stream over HTTP protocol. Unlike tcp streams, Kafka streams and HDFS file streams, http streams often flow across distributed big data clusters on the Web. This feature is very helpful to build global data processing pipelines across different data centers (scientific research institutes, for example) who own separated data sets.