Skip to content

Watcher Reconciliation and Processing

Beyond simply receiving data, MARS Watcher plays an active role in orchestrating the subsequent processing and reconciliation of ingested content. It ensures data integrity and manages the workflow before final delivery or archival.

Key Processing and Reconciliation Functions:

  • Workflow Orchestration: After receiving a file or data feed, Watcher can trigger a series of predefined processing steps based on the source, data type, or other metadata.
  • Reconciliation Features: Implements checks to ensure data completeness and consistency. This may involve:
  • Verifying expected file counts or record counts against manifests or historical patterns.
  • Performing checksum validation to detect data corruption during transfer.
  • Integrating with the MARS Audit Database to log processing steps and maintain chain of custody.
  • Invoking MARS Utilities: Watcher can programmatically call other MARS platform components as needed for processing:
  • MARS Split Service: To break down large print streams or consolidated files into smaller, manageable units or individual documents.
  • MARS Consolidation Service: To merge related data arriving from different feeds or at different times.
  • MARS Data Mining Studio (MDMS): To perform complex data extraction, transformation, or structuring on the ingested data.
  • GUID Assignment: Often coordinates with the MARS GUID Service to assign unique identifiers to processed batches or documents for tracking purposes.
  • Status Tracking: Monitors the progress of these downstream processing steps and updates internal logs or databases (like the MARS Watcher DB).

Through these capabilities, Watcher acts as more than just an ingestion point; it serves as a control center ensuring that incoming data is processed correctly, validated, and prepared for its final destination according to defined business rules.