Open3

Duck DB

yoshixiyoshixi

この記事では、duckdbがjoinアルゴリズムをどのように扱うかを説明します。 joinアルゴリズムの計算は大量の計算を必要とする傾向があります。

https://duckdb.org/2022/05/27/iejoin.html

english

This article explains the how duckdb deal with join algorithm. The join alogrithm calculation tends to require high amount of calculations.

yoshixiyoshixi

The paper of DuckDB. According to this paper, DuckDB is an embedded OLAP. What is OLAP?
https://mytherin.github.io/papers/2019-duckdbdemo.pdf

https://aws.amazon.com/compare/the-difference-between-olap-and-oltp/

The primary purpose of online analytical processing (OLAP) is to analyze aggregated data, while the primary purpose of online transaction processing (OLTP) is to process database transactions.

OLAP database architecture prioritizes data read over data write operations. You can quickly and efficiently perform complex queries on large volumes of data. Availability is a low-priority concern as the primary use case is analytics.
On the other hand, OLTP database architecture prioritizes data write operations. It’s optimized for write-heavy workloads and can update high-frequency, high-volume transactional data without compromising data integrity.

OLAP = online analytical processing. It focuses on reading data. It can execute complex queries.
OTAP = online transaction processing. It focuses on writing data. It can handle large volumes of write data operation without compromising data integrity.