94 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
2
votes
1
answer
87
views
Merging SCD-2 intervals from two tables
I have two historical (SCD-2) tables, that should be merged in a new one as shown below, using HiveQL.
The earliest dates does match on both tables!
1st table
PK var1 start_dt end_dt
123 false ...
0
votes
0
answers
47
views
Unable to Select a Variable that sets date values in SSIS SCD Wizard, SCD Type 2
I am creating a SCD type 2 dimension and using start and end dates to identify current and expired records. In my destination table, there are start date and end date columns. I am unable to select ...
1
vote
1
answer
279
views
Implement Slowly Changing Dimensions (SCD) - Type 2 Using DuckDB
I want to implement SCD-Type2, and keep track of historized data, I am using for this task DuckDB, but I found out that DuckDB does not support Merge Statement.
The idea I have is to have two separate ...
0
votes
2
answers
1k
views
Implementing SCD Type 2 with merge statement
I have two tables in SQL server, the first table Source, has two columns: ID, attribute1, attribute2, and attribute3. The second table, Target, has the same columns as Source but with two additional ...
0
votes
1
answer
77
views
Get latest values from a SCD dimension table
I have a requirement where I maintain type 2 SCD in my dimension table as below.
For example on day_1 the material code M-01 has a name mat_1_old - now the transactions on day_1 are mapped with ...
0
votes
0
answers
95
views
Slowly Changing Dimensions - capture for ETL to a Dimensionalised Data Warehouse
Starting point: On premises relational Data Warehouse
Target: GCP Dimensionally modelled Big Query
Does anyone know of a Tool which can distinguish/recognise a pattern of attributes making up a Slowly ...
1
vote
2
answers
301
views
How to create an SCD2 type table from partitioned table PostgreSQL/Clickhouse?
I have a table partitioned by date-type column ds, with many fields.
Not all columns change every day, therefore most rows are just duplicates of the previous rows.
I want to create an SCD2 table from ...
0
votes
1
answer
205
views
Combine two Interleave Slowly Changing Dimension Tables (SCD) Type 2 in Oracle SQL
Data Structure
I have two tables in Oracle SQL: dt_cust (customer data) and dt_adre (address data). Both tables use a Slowly Changing Dimension (SCD) Type 2 design to track historical changes.
Table ...
1
vote
1
answer
155
views
SCD type 2 in Delta table using databricks
I want to implement SCD type 2 in databricks, I know this can be handled with MERGE. But I have historical data which is appended and am not sure how to implement SCD type 2 since the target table is ...
1
vote
0
answers
228
views
How to handle multiple SCD2 rows out-of-order with SQL
I am looking for a solution on how to handle rows that should be placed in a SCD2 table. In DLT (Delta Live Tables) this is easily solved by using apply_changes with sequence_by and primary key ...
0
votes
1
answer
189
views
Slowly Changing Dimension Type 2
I am trying to create an SCD type 2 data warehouse with Pentaho. I don't actually know how to load surrogate_ids and other data simultaneously and properly. I'd be glad if someone helps.
I'm trying to ...
0
votes
1
answer
439
views
Snowflake Change Tracking to implement SCD2
Has anyone used change tracking feature in Snowflake to track DML changes on a table and create SCD2 tables in a Snowflake data warehouse? Not talking about using streams and tasks but specifically ...
-1
votes
2
answers
1k
views
Implement SCD Type 2 on periodic snapshot table
Currently I have a very big table that have a snapshot of data for each month.
ID
other
Team
Period
1
.....
A
2020年04月30日
1
.....
A
2020年05月31日
1
.....
A
2020年06月30日
1
.....
A
2020年07月31日
1
.....
B
2020-...
1
vote
1
answer
312
views
ERROR: Unrecognized name in Google Cloud BigQuery
I am implementing SCD 2 dimensions using MERGE statement in google cloud BigQuery.
In target table, is_active column indicates whether the record is the latest record. address_ref is the business key ...
1
vote
0
answers
1k
views
Snowflake SCD type 2 Merge statement
I have a source and target table as below:
Source table:
Target table:
Desired Output:
Scenario:
When ID's in both tables matches, value1 & value2 matches do nothing
When ID's in both tables ...