duckdb-parquet-lab-workflow
Use DuckDB to query Parquet files, inspect metadata, join tables, and convert results to pandas for analysis; commonly precedes ydata-eda-profiling for EDA on extracted tables.
Installation
Follow the repository instructions for this skill and your agent. Review the files and dependencies before adding it to your workflow.
View source ↗GuidesSkill instructions
DuckDB Parquet Lab Workflow
Purpose
Standardize the pattern of loading Parquet files into DuckDB, inspecting schema, running SQL joins, and converting results to pandas DataFrames.
Usage
- "load Parquet with DuckDB and join tables"
- "describe DuckDB table schema"
- "convert DuckDB query to pandas"
Instructions
- Read Parquet data with
duckdb.queryorduckdb.sqlusing SQL strings. - Inspect schema using
DESCRIBE SELECT * FROM <table>and display with.show(). - Use explicit joins with clear
LEFTorRIGHTsemantics to preserve row counts. - Convert results to pandas with
.to_df()for downstream modeling. - Use
./templates/duckdb_snippets.mdfor the standard SQL patterns.
Examples
Read the usage examples in the source repository.
View source ↗Source history
- Indexed on
- 2026-01-20
- Index updated
- 2026-01-26
- Branch
- main
Index and sync dates describe this directory. View the source repository for code history.
GitHub ↗chat Comments (0)
Sign in to join the discussion and leave a comment.
No comments yet. Be the first to share your thoughts!