I am new to ssis and i am a little bit confused about the SCD_Start_Date and SCD_End_Date when we use the SCD dimension wizard. on many examples that i have searched online people always use the "system start time" or "system container " start time. but i am implementing a data warehouse from a scratch but our company have multiple data sources from two or three years ago. so when i upload our data source from these two years into our dw after running the package it will obviously show that, for example, a seller (seller Dimension) changed from department in the day i ran that package but this is wrong because i want to have a reference date that is in the data source (each row has a data_Ref) . isn't this the logic or am i missing something? how do you guys in BI upload old data source with a reference date?
Related Questions in SSIS
- Skip null rows in SSIS of excel file
- SSIS error: delimiter for column "X" is not found - started happening after migrating package to newer SSIS
- Copy or Move Data from one Database to other Database and have one more destination option
- Odata source inside ForEach loop
- Extracting data from SAP ERP into SQL Server
- Get the URL from C# script used in ssis
- Write rows on destination even when an error occurs?
- Visual Studio 2022 Task script editor : Impossible to modify
- SSIS package writes empty CSV file
- SSIS flat file destination generating more digits than in the database
- SSIS remove $ format from csv
- Handling inconsistent record delimeters in ssis
- SSIS Data Conversion Error: Overflow Issue in Automated Job Execution
- SSIS to Snowflake connection
- SSIS - OData Connection to Sharepoint List Failed Validation Error 0xC020801F
Related Questions in DATA-WAREHOUSE
- How to blind data in data warehouse when sending from preanonymized layer to anonymized layer while keeping referential integrity of all key columns
- Run Pyspark job using Matillion
- the right grain of a fact table in data warehouse
- Model the number of available spots in dimension or fact table?
- What is the most efficient way to generate a change data set given two SQL Server backup files?
- Does it make sense to use an IDENTITY column in a raw layer?
- Power BI star (constellation) schema: 2 fact tables with relation between each other
- Rolling Period Table or CTE
- Representation of sequential rules in data mining (sequence pattern mining)
- Snowflake Bulk Inserts vs. Single Row Inserts
- Data not showing in power bi report
- Data Warehouse to Power BI Desktop
- Error initialize process greenplum major upgrade 5.29.12 to 6.25.2 on centos 7
- Modify column type in Parquet file with ruby (using parquet Gem)
- Translating Snowflake warehouse usage to BigQuery
Related Questions in BUSINESS-INTELLIGENCE
- Does Power BI provide an OOTB Geographical Dimension Table
- Customer Churn Calculation
- Data Looks good in Power Query Editor but only showing cells with 0 values in Table View
- Rebuilding fact tables with over 30 million rows takes over 1hr
- If there a way to determine if a set of values contains a single instance of a string and create a new variable with only that string?
- Indexed parent-child hierarchy table to fact table
- the right grain of a fact table in data warehouse
- Donut Chart and percentage visualisation in Tableau
- Data vault 2.0 hub end date
- Cumulative Total of DAX Measure without Date Filters
- Create a graph for the previous weeks using postgres
- Many-to-many relationship database design
- PowerBI remember filters when opening new report from another report
- BigQuery : Time Stamp of Next Events are Lesser Than Previous Event's Time Stamp
- Download file in AWS S3 bucket using SSIS
Related Questions in SCD
- JAXB generated classes of certain types implementing a custom interface
- Slowly Changing Dimension Transform in SSIS won't update
- SQL Server SCD II implementation quandary
- How to map varchar(max) column in SCD transform while doing ETL process in SSIS project?
- Slowly changing dimension by date only
- Implementing SCD2 in Azure Data Factory: Duplicate Issue on Row Update
- Capture Bigquery data changes
- Create table with effective_from_date and effective_to_date from history table in BigQuery
- Implement SCD Type 2 on periodic snapshot table
- How to pivot down the results of a SCD type 2?
- Slow changing dimension | SCD type 1 deleting rows from prior date data
- Slowly changing dimension type 2 implementation in SSIS
- How can I specify the start and end dates for SSIS SCD type 2 wizard instead of variables
- How to turn SCD type 4 into type 6
- SCD Start and End Date
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)

SCD Start and End dates are the dates that a version of the record became (or stopped being) the current version in your source system - they have nothing to do with when data was moved between environments (unless that movement was part of a transaction that changed the state of a record).
Going forward, it is relatively easy to create new SCD records and you insert a new version of a record (and update the previous current version of the record) every time there is a change in the source system.
Loading historic data is entirely dependent on your source system. If it only holds the current version of a record then you can only load that single version into your DWH. If the source system, contains a history of the changes made (or, for example, an audit trail of changes made) then you should be able to re-construct the history in a way that allows you to load multiple versions of a record into your DWH