Definition: Reconciliation (Migration)
Reconciliation in the context of data migration is the process of verifying and validating that all data intended for migration has been accurately, completely, and successfully transferred from the source repository(ies) to the target system(s).
Key Aspects in the Helix Context:
- Purpose: To ensure data integrity, prevent data loss, and provide auditable proof of a successful migration.
- Methodology: Often involves:
- Establishing a baseline count or inventory from the source system (e.g., using directory listings).
- Organizing data into manageable batches (Move Groups).
- Tracking record counts, byte counts, and unique identifiers (like hash codes or Helix GUIDs) through each stage of the ETL (Extract, Transform, Load) process.
- Comparing source metrics against target metrics for each Move Group.
- Utilizing tracking spreadsheets or databases (like the MARS SQL database mentioned) to monitor progress and confirm success before removing source data or decommissioning systems.