ducklake - Interact with 'DuckLake' from R
A 'tidyverse'-friendly interface to 'DuckLake' <https://ducklake.select/>, the 'DuckDB' lakehouse format. Attach versioned data lakes from R and work with them using familiar 'dplyr' verbs, with support for ACID transactions, time travel queries, snapshot audit trails, data inlining, encrypted storage, multiple catalog backends ('DuckDB', 'PostgreSQL', 'SQLite', 'MySQL'), and remote access over the 'Quack' protocol from 'DuckDB'.
Last updated
data-engineeringdata-lakedbplyrdplyrduckdbducklakelakehouseparquettidyverse
8.20 score 26 stars 28 scripts 121 downloads
dplyneage - Column Lineage Visualization for 'dplyr' Pipelines
Extracts column-level lineage from 'dplyr' and 'dbplyr' pipelines and from SQL queries, and renders it as an interactive 'React Flow' diagram. The same lineage is available as plain data for impact analysis, for comparing pipeline versions (including a continuous-integration check that fails on breaking provenance changes), and for export to JSON, 'GraphML', 'Mermaid', and 'OpenLineage' interchange formats.
Last updated
data-lineagedbplyrdplyrhtmlwidgetssqlglot
5.83 score 5 stars 30 downloads