GitHub
duckdb-quadruple-interleave
Chaotic interleaving across local DuckDB databases modeled as coupled quadruple pendula. Random walks both BETWEEN databases and WITHIN tables for context injection.
☆ 5View skill
tools data engineering AI Skills
Discover tools data engineering skills, compare source repositories and read the instructions for each workflow.
Categories: tools data engineering
tools data engineering Clear filters
Browse skills
GitHub
fswatch-duckdb
FileSystemWatcher over /tmp with DuckDB/DuckLake persistence. Auto-starts on Amp sessions for resilient file monitoring with temporal queries.
☆ 5View skill
GitHub
bluesky-jetstream
Bluesky Jetstream Firehose Skill
☆ 5View skill
GitHub
pulse-mcp-stream
Layer 1 Real-Time Social Stream Monitoring via MCP with DuckDB persistence
☆ 5View skill
GitHub
entropy-sequencer
Layer 5 Interaction Interleaving for Maximum Information Gain with DuckDB
☆ 5View skill
GitHub
data-transformation
データ変換パイプラインの設計・実装・検証を整理するスキル。 スキーママッピング、ETL設計、品質確認までの実務フローを提供する。 Anchors: • Designing Data-Intensive Applications / 適用: データモデリング / 目的: 変...
☆ 5View skill
GitHub
database-seeding
データベースの初期データ投入を安全に設計・実装・検証するスキル。 開発/テスト/本番のデータ分離、シード戦略、再現性の確保を整理する。 Anchors: • Designing Data-Intensive Applications / 適用: データ整合性 / 目的:...
☆ 5View skill
GitHub
kafka-stream-designer
Design Kafka topics, partitions, consumer groups, producers with idempotency, retry strategies, dead letter queues, exactly-once semantics, and schema registry integration
☆ 5View skill
GitHub
database-schema-designer
Design PostgreSQL, MongoDB, or Redis schemas with entities, relationships, indexes, constraints, migrations, query optimization, and backward-compatible schema evolution
☆ 5View skill
GitHub
policyengine-simulation-mechanics
Advanced simulation patterns with policyengine.py - ensure(), output_dataset.data, and map_to_entity()
☆ 5View skill
GitHub
timescaledb
MANDATORY when working with time-series data, hypertables, continuous aggregates, or compression - enforces TimescaleDB 2.24.0 best practices including lightning-fast recompression, UUIDv7 continuous aggregates...
☆ 5View skill
GitHub
litestream
SQLite disaster recovery and streaming replication to cloud storage (S3, GCS, Azure, SFTP, NATS). Use this skill for configuring Litestream, deploying to cloud platforms, troubleshooting WAL replication issues,...
☆ 5View skill
GitHub
activerecord-query-patterns
Complete guide to ActiveRecord query optimization, associations, scopes, and PostgreSQL-specific patterns. Use this skill when writing database queries, designing model associations, creating migrations, optimi...
☆ 5View skill
GitHub
activerecord-query-patterns
Complete guide to ActiveRecord query optimization, associations, scopes, and PostgreSQL-specific patterns. Use this skill when writing database queries, designing model associations, creating migrations, optimi...
☆ 5View skill
GitHub
timescaledb
MANDATORY when working with time-series data, hypertables, continuous aggregates, or compression - enforces TimescaleDB 2.24.0 best practices including lightning-fast recompression, UUIDv7 continuous aggregates...
☆ 5View skill
GitHub
data-engineering
ETL pipelines, Apache Spark, data warehousing, and big data processing. Use for building data pipelines, processing large datasets, or data infrastructure.
☆ 5View skill
GitHub
effect-sql-db
Effect patterns for SQL databases (Drizzle/Kysely/Prisma): services, transactions, retries, streaming, and observability.
☆ 5View skill
GitHub
effect-streams-pipelines
Stream creation, transformation, sinks, batching, and resilience. Use when building data pipelines with concurrency and backpressure.
☆ 5View skill
GitHub
effect-collections-datastructs
Value-based data structures (Data.struct, tuple, array) and high-performance collections (Chunk, HashSet). Use for safe comparisons and pipelines.
☆ 5View skill
GitHub
drizzle-orm
Expert guidance for Drizzle ORM including schema definition, queries, relations, migrations, TypeScript integration with SQLite/PostgreSQL, and Drizzle Studio. Use this when working with type-safe database oper...
☆ 5View skill
GitHub
database-migration
ゼロダウンタイム戦略、データ変換、ロールバック手順を使用して、ORM間およびプラットフォーム間でデータベース移行を実行します。データベースの移行、スキーマの変更、データ変換の実行、またはゼロダウンタイムデプロイメ...
☆ 5View skill
GitHub
dynamodb-toolbox
DynamoDB single-table design using dynamodb-toolbox v2. Use when creating entities, defining key patterns, designing GSIs, writing queries, implementing pagination, or working with any DynamoDB data layer in Ty...
☆ 4View skill
GitHub
build-only-validate-capability-flow
Validate a capability flow specification against schema constraints. Use after designing a process to ensure it conforms to framework rules. Triggers on "validate capability flow", "check process spec", "verify...
☆ 4View skill
GitHub
altinity-expert-clickhouse-replication
Diagnose ClickHouse replication health, Keeper connectivity, replica lag, and queue issues. Use for replication lag and readonly replica problems.
☆ 4View skill
The default order uses GitHub repository stars from our indexed data. Stars belong to the source repository and may be shared by multiple skills. They indicate repository interest, not skill installs or an independent quality score.