GitHub
data-cleaning-pipeline
Build robust processes for data cleaning, missing value imputation, outlier handling, and data transformation for data preprocessing, data quality, and data pipeline automation
☆ 84View skill
devops data engineering AI Skills
Discover devops data engineering skills, compare source repositories and read the instructions for each workflow.
Categories: devops data engineering
devops data engineering Clear filters
Browse skills
GitHub
event-sourcing
Implement event sourcing and CQRS patterns using event stores, aggregates, and projections. Use when building audit trails, temporal queries, or systems requiring full history.
☆ 84View skill
GitHub
sql-query-optimization
Analyze and optimize SQL queries for performance. Use when improving slow queries, reducing execution time, or analyzing query performance in PostgreSQL and MySQL.
☆ 84View skill
GitHub
api-pagination
Implement efficient pagination strategies for large datasets using offset/limit, cursor-based, and keyset pagination. Use when returning collections, managing large result sets, or optimizing query performance.
☆ 84View skill
GitHub
aws-rds-database
Deploy and manage relational databases using RDS with Multi-AZ, read replicas, backups, and encryption. Use for PostgreSQL, MySQL, MariaDB, and Oracle.
☆ 84View skill
GitHub
nosql-database-design
Design NoSQL database schemas for MongoDB and DynamoDB. Use when modeling document structures, designing collections, or planning NoSQL data architectures.
☆ 84View skill
GitHub
ml-pipeline-automation
Build end-to-end ML pipelines with automated data processing, training, validation, and deployment using Airflow, Kubeflow, and Jenkins
☆ 84View skill
GitHub
database-performance-debugging
Debug database performance issues through query analysis, index optimization, and execution plan review. Identify and fix slow queries.
☆ 84View skill
GitHub
database-schema-design
Design database schemas with normalization, relationships, and constraints. Use when creating new database schemas, designing tables, or planning data models for PostgreSQL and MySQL.
☆ 84View skill
GitHub
cloud-migration-planning
Plan and execute cloud migrations with assessment, database migration, application refactoring, and cutover strategies across AWS, Azure, and GCP.
☆ 84View skill
GitHub
database-monitoring
Monitor database performance and health. Use when setting up monitoring, analyzing metrics, or troubleshooting database issues.
☆ 84View skill
GitHub
data-migration-scripts
Create safe, reversible database migration scripts with rollback capabilities, data validation, and zero-downtime deployments. Use when changing database schemas, migrating data between systems, or performing l...
☆ 84View skill
GitHub
database-migration-management
Manage database migrations and schema versioning. Use when planning migrations, version control, rollback strategies, or data transformations in PostgreSQL and MySQL.
☆ 84View skill
GitHub
database-query-optimization
Improve database query performance through indexing, query optimization, and execution plan analysis. Reduce response times and database load.
☆ 84View skill
GitHub
sanity-schema-manager
Manages schema lifecycle including scaffolding, safe field deprecation, and data migrations. Use when modifying existing schemas.
☆ 79View skill
GitHub
sanity-groq
Expert assistance for writing, optimizing, and debugging GROQ queries. Use when writing queries or debugging performance.
☆ 79View skill
GitHub
python-data-classes
Use when Python data modeling with dataclasses, attrs, and Pydantic. Use when creating data structures and models.
☆ 75View skill
GitHub
ecto-changesets
Use when validating and casting data with Ecto changesets including field validation, constraints, nested changesets, and data transformation. Use for ensuring data integrity before database operations.
☆ 75View skill
GitHub
tensorflow-data-pipelines
Create efficient data pipelines with tf.data
☆ 75View skill
GitHub
graphql-performance
Use when optimizing GraphQL API performance with query complexity analysis, batching, caching strategies, depth limiting, monitoring, and database optimization.
☆ 75View skill
GitHub
java-streams-api
Use when Java Streams API for functional-style data processing. Use when processing collections with streams.
☆ 75View skill
GitHub
scala-collections
Use when scala collections including immutable/mutable variants, List, Vector, Set, Map operations, collection transformations, lazy evaluation with views, parallel collections, and custom collection builders f...
☆ 75View skill
GitHub
discover-database
Automatically discover database skills when working with SQL, PostgreSQL, MongoDB, Redis, database schema design, query optimization, migrations, connection pooling, ORMs, or database selection. Activates for d...
☆ 75View skill
GitHub
discover-data
Automatically discover data pipeline and ETL skills when working with ETL. Activates for data development tasks.
☆ 75View skill
The default order uses GitHub repository stars from our indexed data. Stars belong to the source repository and may be shared by multiple skills. They indicate repository interest, not skill installs or an independent quality score.