Data Engineering Pipeline
Build a modern data pipeline from ingestion to analytics-ready warehouse.
data-engineer
Build scalable data pipelines, modern data warehouses, and real-time streaming architectures. Implements Apache Spark, dbt, Airflow, and cloud-native data platforms.
DAT-047-etl-script-builder
Generated Analytical skill for Data Science. Focuses on execution and intent intelligence.
Change Data Capture (CDC) Implementation
High-power architectural assistant specializing in syncing databases in real-time without polling using modern infrastructure patterns.
DAT-046-data-quality-checker
Generated Generative skill for Data Science. Focuses on execution and intent intelligence.
DAT-018-anomaly-detector
Generated Agentic skill for Data Science. Focuses on execution and intent intelligence.
DAT-003-outlier-detector
Generated Agentic skill for Data Science. Focuses on execution and intent intelligence.
dbt-transformation-patterns
Production-ready patterns for dbt (data build tool) including model organization, testing strategies, documentation, and incremental processing.
data-quality-frameworks
Implement data quality validation with Great Expectations, dbt tests, and data contracts. Use when building data quality pipelines, implementing validation rules, or establishing data contracts.
spark-optimization
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
grafana-dashboards
Create and manage production-ready Grafana dashboards for comprehensive system observability.
Dashboard & Data Visualization Designer
High-power UI/UX strategist specializing in visualizing complex metrics with absolute clarity with an eye for premium aesthetics.
data-storytelling
Transform raw data into compelling narratives that drive decisions and inspire action.
Data Lake vs Data Warehouse Architect
High-power architectural assistant specializing in building scalable analytics pipelines using modern infrastructure patterns.
snowflake-development
Comprehensive Snowflake development assistant covering SQL best practices, data pipeline design (Dynamic Tables, Streams, Tasks, Snowpipe), Cortex AI functions, Cortex Agents, Snowpark Python, dbt integration, performance tuning, and security hardening.
database-design
Database design principles and decision-making. Schema design, indexing strategy, ORM selection, serverless databases.
ingestion
- 01data-engineer
- 02etl-script-builder
- 03change-data-capture-cdc
quality checks
- 01data-quality-checker
- 02anomaly-detector
- 03outlier-detector
transformation
- 01dbt-transformation-patterns
- 02data-quality-frameworks
- 03spark-optimization
visualization
- 01grafana-dashboards
- 02dashboard-dataviz-designer
- 03data-storytelling
warehousing
- 01data-lake-warehouse-architect
- 02snowflake-development
- 03database-design