data Artisans Platform

Streaming Ledger

Serializable ACID Transactions on Streaming Data

data Artisans Streaming Ledger, available in the River Edition of data Artisans Platform, works as a library for processing event streams across multiple shared states/ tables with serializable ACID semantics.

data Artisans Platform provides a highly efficient, scalable runtime for the streaming ledger, to execute millions of transactions per second on the Flink streaming engine. It relies on a patent-pending technology for efficient scheduling of state accesses.

This allows the implementation of use cases going beyond today’s exactly-once processing, accessing multiple states in an atomic, consistent way. For example, workloads currently running on traditional database systems, financial transaction processing, and multiway joins.

Benefits

No-compromise, scalable transaction processing

Mission-critical workloads, such as financial data or logistics, require serializable ACID semantics for data processing. data Artisans Streaming Ledger can now execute such use-cases on data Artisans Platform while providing the highest class of correctness guarantees for multi-state access.

Application development with build-in data consistency

data Artisans Streaming Ledger allows users to develop streaming applications requiring consistent access to multiple states in an intuitive, modern way. Rather than worrying about consistency models, programmers can focus on application logic.

Parallel, distributed execution of streaming transactions

Until now, it hasn't been possible to scale transaction processing across large, distributed clusters. data Artisans Streaming Ledger features a patent-pending conflict-free scheduling mechanism for efficient execution of transactions, in parallel and at scale.

How does it work?

  • Streaming Ledger

data Artisans Streaming Ledger is available in two components:

– An open source API, available on
GitHub, including a non-parallel runner for local development and testing.
– A runner for distributed, scalable execution on clusters.

The parallel runner, available in data Artisans Platform, relies on technology different from the transaction processing techniques used by traditional database management systems. The implementation uses neither distributed locks nor multi-version concurrency control with conflict detection.
data Artisans Streaming Ledger achieves high pipelined throughput with the use of conflict-free scheduling of state access and lightweight logical clocks.

More details about the performance and how it’s achieved are available in the whitepaper.

data Artisans Streaming Ledger: Use Cases

Regulatory Compliance and Risk Management

Maintaining a real-time market position across the organization in order to manage risk and continuously and accurately report to regulators using the latest data is crucial for the modern financial services industry.

Back Office Operations in Financial Services

Streaming Ledger is an excellent fit for consolidating and keeping a consistent ground truth of data that comes from a variety of disparate front-office data sources. All in real-time with transactional guarantee.

Inventory Management

Streaming Ledger serves as a great solution for consistent and accurate bookkeeping of inventories for companies from the logistics and e-commerce industries.

Interested in more use cases? Download the Whitepaper »

data Artisans Streaming Ledger Resources to Get You Started

Set up a Meeting

Fill out the form and we’ll have a data Artisans expert contact you. Our experts can answer questions, provide more information, and help you understand what our solutions can do for your business.

Please send me updates about products and services of data Artisans via my email address. I understand that I may withdraw this marketing consent at any time via email dataprotection@data-artisans.com or via the link implemented in each marketing e-mail. Data Artisans will process my personal data in accordance with the dA Privacy Policy.

Your personal data submitted via the contact form will be processed in accordance with the dA Privacy Policy.