Skip to content

v2.0a2

Choose a tag to compare

@peter-quix peter-quix released this 08 Nov 14:26
· 613 commits to main since this release

This is the first alpha release of the new Quix Streams 2.0.
It's a complete rewrite, providing a different API to work with streaming data in Python.

What's Changed

Introduced Streaming DataFrames - a primary API to define the processing pipeline

  1. It provides a pandas.DataFrame-like API to structure the message transformations.
    For the full description of StreamingDataFrame API please see StreamingDataFrame: Detailed Overview

  2. It supports stateful operations backed by RocksDB state storage. The details regarding work with state are outlined here - Stateful Processing

  3. It supports different message serialization formats like strings, integers, doubles, JSON and Quix formats.
    Detailed overview of serialization in 2.0 can be found here - Serialization

Removed a dependency on .NET

The 2.0 version doesn't depend on .NET anymore and is pure Python.
It makes the library code more stable, safe, and easier to maintain and update.

Compatibility with Quix Streams 0.5.7

Although 2.0 introduces a totally new API, both 0.5.7 and 2.0 are mostly compatible on the data level - both 0.5.7 and 2.0a consumers and producers may exchange messages in the same format.

There are some limitations to the types of messages supported in 2.0.
Please see Upgrading from Legacy Quixstreams for more details

Full Changelog: v0.5.7...v2.0alpha2