Serializable ACID Transactions on Streaming Data
data Artisans Streaming Ledger, available in the River Edition of data Artisans Platform, works as a library for processing event streams across multiple shared states/ tables with serializable ACID semantics.
data Artisans Platform provides a highly efficient, scalable runtime for the streaming ledger, to execute millions of transactions per second on the Flink streaming engine. It relies on a patent-pending technology for efficient scheduling of state accesses.
This allows the implementation of use cases going beyond today’s exactly-once processing, accessing multiple states in an atomic, consistent way. For example, workloads currently running on traditional database systems, financial transaction processing, and multiway joins.
data Artisans Streaming Ledger is available in two components:
– An open source API, available on GitHub, including a non-parallel runner for local development and testing.
– A runner for distributed, scalable execution on clusters.
The parallel runner, available in data Artisans Platform, relies on technology different from the transaction processing techniques used by traditional database management systems. The implementation uses neither distributed locks nor multi-version concurrency control with conflict detection.
data Artisans Streaming Ledger achieves high pipelined throughput with the use of conflict-free scheduling of state access and lightweight logical clocks.
More details about the performance and how it’s achieved are available in the whitepaper.
Maintaining a real-time market position across the organization in order to manage risk and continuously and accurately report to regulators using the latest data is crucial for the modern financial services industry.
Streaming Ledger is an excellent fit for consolidating and keeping a consistent ground truth of data that comes from a variety of disparate front-office data sources. All in real-time with transactional guarantee.
Streaming Ledger serves as a great solution for consistent and accurate bookkeeping of inventories for companies from the logistics and e-commerce industries.
Interested in more use cases? Download the Whitepaper »
Fill out the form and we’ll have a data Artisans expert contact you. Our experts can answer questions, provide more information, and help you understand what our solutions can do for your business.