The horror stories all rhyme: the consultant ran the import on Thursday, the system said "2,000 rows processed," and by Monday the payroll preview showed employees with negative leave balances, duplicated national IDs, and departments that existed only in the old system's imagination. The root cause is never the import; it is the absence of validation as a first-class step. A properly designed bulk upload inverts the order: the file is parsed and validated before anything touches the database — every row checked against the org structure, the level definitions, the classification lists — and the import dashboard shows live progress with row counts and error counters, so the operator sees row 1,412 fail on an unknown department code while the upload is still running, not after it has poisoned the ledger.
The pre-flight validation checklist #
- Structural references: every department, level, and position code exists in the target org — unknown codes are errors, not new records.
- Uniqueness: national IDs, employee codes, and emails deduplicated before load, with the duplicate rows listed, not merged silently.
- Type and format checks: dates parsed, amounts numeric, phone formats normalized — garbage rejected at the door.
- Cross-field logic: contract dates ordered, salary bands consistent with levels, probation before start — the lies spreadsheets tell.
The operator experience is where validation lives or dies: progress bars with error counts per category (not a log file), failed rows exportable as a corrected-retry file, and reprocessing that purges the failed batch cleanly before retrying. When the retry file round-trips in minutes, operators iterate fearlessly — fix forty rows, re-upload, watch the error counter fall to zero, done by lunch. The skill-import side deserves the same discipline: bulk skill imports from spreadsheets should validate target values against level definitions and flag approvals that reference reviewers who do not exist, because a skills framework corrupted at import becomes a year of calibration meetings.