Explanation
Data refresh operations are executed more frequently, or with more compute resources, than the actual downstream business usage requires. Organizations waste credits when refresh schedules do not align with actual data consumption patterns in tools like Tableau or Sigma.
Relevant Billing Model
Snowflake charges depend on active compute time of warehouses executing pipeline tasks. Increased refresh frequencies, larger data volumes, and bigger warehouse sizes elevate credit consumption.
Detection
- Review execution frequency and resource consumption of scheduled pipelines
- Map data lineage to understand downstream asset dependencies
- Analyze BI tool usage metrics to assess downstream data access frequency
- Identify pipelines where refresh costs exceed business consumption value
Remediation
- Align refresh frequencies with actual data access patterns
- Right-size warehouse resources to minimize overprovisioning
- Implement usage monitoring frameworks correlating costs with consumption
- Periodically review pipeline operational costs and business value