Summary
- Use this skill when building real-time or near-real-time data pipelines.
- Covers Kafka, Flink, Spark Streaming, Snowpipe, BigQuery streaming, materialized views, and batch-vs-streaming decisions.
- Common phrases: "real-time pipeline", "Kafka consumer", "streaming vs batch", "low latency ingestion".
- Do NOT use for batch integration patterns (use data-integration) or pipeline orchestration (use data-pipelines).