Slowly Changing Dimensions Without Corrupting Your Facts
Should last year's revenue move when a customer changes segment? Pick an SCD type per column, write a replay-safe Type 2 MERGE, and join facts correctly.
18 articles
Should last year's revenue move when a customer changes segment? Pick an SCD type per column, write a replay-safe Type 2 MERGE, and join facts correctly.
Late data is a distribution you can measure, not an edge case. How to set a waiting policy, handle what arrives after it, and say when a number is final.
Grain is what one row of a table means. Most wrong numbers come from a join or aggregation that quietly changed it. How to declare grain and test it.
How to stop metric drift in Fabric by giving every metric one home layer and one named owner, then enforcing both rules with schemas, grants and versions.
How I design an analyst-facing schema in Fabric Data Warehouse: views as the contract, permissions scoped to it, and SQL checks that catch breaks first.
Why fact table grain, not clustering or statistics, sets the performance ceiling in Fabric Data Warehouse, and how to declare and test it in T-SQL.
AI-assisted modeling reduces design time while improving schema quality.
Use GPT-4o structured outputs to draft a star schema from requirements, check it with plain code, and generate Fabric Warehouse DDL that respects its limits.
Graph databases unlock powerful relationship-based queries that would be complex or impossible with traditional relational approaches.
Traditional single partition keys can lead to hot partitions in scenarios where data is naturally hierarchical. Hierarchical partition keys solve this by…
The distribution column (also called the shard key) determines how data is partitioned across nodes. Citus uses consistent hashing on this column to assign…
How Power BI automatic aggregations train on a DirectQuery dataset's query log, what the preview requires, and when hand-built aggregations still win.
How Power BI hybrid tables add a DirectQuery partition to an incremental refresh policy, what the preview requires, and when Import alone is the better call.
How DirectQuery for Power BI datasets lets teams extend a certified model with their own data, what the preview limits are, and when not to chain.
How to set storage modes table by table in a Power BI composite model, when Dual earns its place, and how aggregations keep DirectQuery facts fast.
A status check on Power BI's newer modelling, performance and ALM features as of January 2022, with my view on which to adopt now and which to pilot.
Tables you create for your specific business needs. Connect to external data sources without importing data.
A semantic model sits between raw data and end user tools, providing: Business friendly names and descriptions Calculated measures and KPIs Row level…