Blog

Dataset updates: name the baseline and change scope

Identify the baseline and meaning of each data change. A Läderach reference explains why a missing observation does not establish a deletion.

PandaBuyNow editorial teamPublished

scandiweb’s Läderach case describes a Pimcore enrichment layer connected to Magento. The provider reports scheduled delta synchronization that sends only changed data, alongside product and category data management and CSV import profiles. Its account describes the connection as implemented. It does not publish the update files, deletion markers or replay rules. This is scandiweb’s project account; the following PandaBuyNow proposal concerns the interpretation of a separately delivered dataset.

Name the dataset an update belongs to

When an update is included in an agreed data delivery, PandaBuyNow proposes identifying the earlier dataset it is intended to revise. Record both delivery versions, the row’s product or variant key, the source reference and the observation time. State the selection scope and any limits on the source material collected.

Define what each change label means. A new row, a changed field and a record outside the later collection scope require different explanations. Keep the earlier source value available beside the revised value and the reason for the change. An unresolved identity match should remain a data-quality note.

Test a fictional update against its baseline

Consider fictional snapshot S1 containing records ITEM-A and ITEM-B. A later collection contains a changed description for ITEM-A and a newly observed ITEM-C. ITEM-B was not observed in that collection. The proposed update can identify A’s changed field and C’s new row while marking B’s status unresolved.

The missing observation alone supplies no deletion instruction for B. If a reviewed removal instruction is later included, state which dataset and record it affects, with its own basis and scope. Keep the earlier snapshot and the instruction together. These invented labels describe neither Läderach’s data nor a completed PandaBuyNow project.

Deliver an interpretable change package

Review a sample that includes a new record, a revised field, an uncertain match and an explicitly scoped removal instruction. Confirm the recipient can identify the intended baseline and distinguish a missing observation from an agreed change. Define how a repeated package is recognized so the same change is not interpreted as a second new event.

For a PandaBuyNow discussion, provide representative marketplace links, an earlier dataset where available and the required JSON or CSV structure. Agree the baseline references, change labels, source evidence and treatment of unresolved data through a sample and written scope. The endpoint is an agreed dataset or change file with field definitions and quality notes; its use in a recipient’s running systems is a separate activity.