Delta lake 란

 

In computer science, ACID (atomicity, consistency, isolation, durability) is a set of properties of database transactions intended to guarantee data validity despite errors, power failures, and other mishaps. In the context of databases, a sequence of database operations that satisfies the ACID properties (which can be perceived as a single logical operation on the data) is called a transaction. For example, a transfer of funds from one bank account to another, even involving multiple changes such as debiting one account and crediting another, is a single transaction.

 

Delta Lake는 데이터 레이크에 안정성을 제공하는 오픈 소스 스토리지 계층입니다. Delta Lake는 ACID 트랜잭션을 제공하고, 확장 가능한 메타데이터를 처리하고, 스트리밍 및 일괄 처리 데이터 처리를 통합합니다. Delta Lake는 기존 데이터 레이크를 기반으로 하여 실행되며 Apache Spark API와 완벽하게 호환됩니다.

 

 

https://docs.microsoft.com/ko-kr/azure/databricks/delta/

Delta Lake - Azure Databricks

 

 

https://docs.microsoft.com/ko-kr/azure/synapse-analytics/spark/apache-spark-what-is-delta-lake

Delta Lake란? - Azure Synapse Analytics

 

 

https://github.com/delta-io

Delta Lake

 

 

https://github.com/aravinthsci/Spark_Delta_Lake

aravinthsci/Spark_Delta_Lake

 

 

https://github.com/databricks/delta-live-tables-notebooks

databricks/delta-live-tables-notebooks

 

 

 

https://databricks.com/discover/demos/delta-lake

Delta Lake on Databricks Demo

 

 

https://github.com/delta-io/delta

delta-io/delta