Key takeaways
- Ecommerce platforms accept far less than a good catalog needs: Shopify, for example, requires only a title to import a new product, so quality has to be enforced before the import.
- Automation is strongest at rule checks that humans skip under time pressure: GTIN check digits, missing attributes, image quality, unit conversions and price against cost.
- AI is useful for reading unstructured supplier files and drafting enrichment, such as normalized attribute values and first draft descriptions, but every generated claim needs a source.
- Merchandisers should approve classification, pricing changes, restricted or regulated product claims and any enrichment that describes the product to a customer.
- Start with one supplier or one category and measure first pass acceptance rate and time to live, not the number of checks run.
A supplier sends a spreadsheet of 400 new items. Some weights are in pounds and some in kilograms, a handful of barcodes are one digit short, three images are the supplier logo on a white square, and the cost on a dozen rows is higher than the suggested retail price. A merchandiser can catch most of this, but only by reading every row, and the launch date does not move. The usual result is that the data goes live with the problems still in it, and they surface later as returns, wrong shipments and customer service tickets. This guide is for retailers of roughly 20 to 200 people with a few hundred to a few thousand SKUs on Shopify, Adobe Commerce or a PIM.
Why does supplier product data go wrong?
Supplier data is written for the supplier's own systems, not yours. Each supplier names columns differently, packs several facts into one cell, changes formats between seasons and sends images from whatever folder was handy. Your own catalog adds a second layer of rules: required attributes by category, naming conventions, approved values and channel requirements.
The ecommerce platform is rarely the safety net people assume. Shopify's product CSV import, for example, treats Title as the only required column for a new product, which means an item with no barcode, no weight and no category can import without complaint (Shopify Help Center). The platform checks that the file is structurally valid. Whether the product is complete enough to sell is your job.
What should you check before a product goes live?
Product data validation is the set of tests a record must pass before it is published. The tests fall into a few groups, and each has a different owner when it fails.
| Check group | What is tested | Typical failure |
|---|---|---|
| Identifiers | GTIN length and check digit, SKU uniqueness, supplier part number matches the item master | Barcode one digit short, duplicate of an existing item |
| Attributes | Required fields by category, approved values, units, case and pack sizes | Color "Navy/Blue", weight with no unit, missing material |
| Dimensions and weight | Plausible ranges for the category, consistent units, case versus each | A 12 ounce item recorded at 12 kilograms |
| Images | Present, readable, correct product, size and background rules, no watermarks or placeholders | Supplier logo in place of a product photo |
| Pricing | Cost, suggested retail price and margin against rules, currency, effective dates | Cost above retail price, price in the wrong currency |
| Compliance fields | Country of origin, hazardous material flags, age restrictions, required warnings, certifications on file | Missing warning text on a regulated category |
| Duplicates and conflicts | Same product already in the catalog under another name or code | Two listings for one item |
Seven check groups cover most supplier data problems. Some are fully mechanical, while others need a document or a picture to be read, and that is where AI earns its place.
How do you validate a GTIN?
A GTIN is valid when its length is right and its last digit matches a check digit calculated from the digits before it. Following the GS1 US manual method (GS1 US):
- Check the length. Google Merchant Center accepts GTINs of 8, 12, 13 or 14 digits.
- Set aside the last digit, which is the check digit, and take the digits before it.
- Multiply those digits by 3 and 1 in alternating order, starting with 3 on the rightmost of them.
- Add the results to get a sum.
- Subtract the sum from the nearest equal or higher multiple of ten. The result is the check digit, and it must equal the last digit of the GTIN.
For the GTIN-13 6291041500213, the digits before the last one are 629104150021. Multiplying from the right by 3, 1, 3, 1 and so on gives a sum of 57, and 60 minus 57 is 3, which matches the last digit.
Which product data checks are rules, and which need AI?
Plain rules handle more than people expect. A GTIN, the global trade item number printed as a UPC or EAN barcode, ends in a check digit calculated from the other digits, so a script can reject a mistyped code instantly. Google Merchant Center, for example, accepts GTINs of 8, 12, 13 or 14 digits (plus formats it converts) and asks that the check digit be present and correct, noting that missing or incorrect values can limit a product's visibility (Google Merchant Center Help). Required-field tests, approved-value lists and margin thresholds work the same way: fixed logic, no AI needed, and cheaper and more predictable for it. AI helps where the input is messy or the judgment is fuzzy. Google's own image guidance, for example, excludes watermarks, added logos, placeholder images that say "coming soon" and generic graphics that do not show the actual product (Google Merchant Center Help), which takes an image reader to enforce.
| Check | Rule or AI | Why | Owner when it fails |
|---|---|---|---|
| GTIN length and check digit | Rule | Fixed arithmetic on the code | Supplier, through a returned request |
| Required fields, approved values, margin thresholds | Rule | Lists and limits defined in advance | Merchandiser or buyer |
| Reading PDF line sheets, spec documents and email bodies | AI | Unstructured input that must be mapped onto your template, the same document intelligence covered in AI document processing for invoices, contracts and forms | Merchandiser reviews the mapping |
| Normalizing values such as "Navy", "navy blue" and "Dk Blue" | Rule for known mappings, AI for new ones | A stored mapping handles repeats, and AI proposes the new ones | Merchandiser approves new mappings |
| Inspecting images for placeholders, watermarks, wrong product or low resolution | AI | The check depends on what the picture shows | Supplier or merchandiser |
| Spotting a title that says stainless steel while the material field says aluminum | AI | Fuzzy judgment across fields | Merchandiser |
| Drafting descriptions and keywords from verified source facts | AI | Generation, with every line traceable to supplier data | Merchandiser approves before publishing |
A sensible design runs the rules first, then uses AI only on what the rules cannot decide, and records which check produced each finding. That keeps results explainable when a supplier asks why a row was rejected.
What should AI do with a failed record?
Rejecting a file and emailing the supplier is the cheapest option and sometimes the right one. But many failures have a likely fix, and the workflow can prepare it.
A good validation workflow sorts each finding into one of three outcomes:
- Auto-correct. A deterministic fix with no ambiguity, such as trimming spaces, converting pounds to kilograms when the unit is stated, or standardizing case. These are logged but need no review.
- Propose and review. A likely fix that changes meaning, such as mapping a color, filling a category from the title, or splitting a combined size field. The merchandiser sees the original value, the proposed value and the reason.
- Return to supplier. Missing or contradictory facts that only the supplier can resolve, with a drafted request that lists exactly which rows and fields need attention.
Returning a record to the supplier matters more than it looks. A request that names the row, the field and the problem gets answered faster than "please review your file," and the answers come back in a form the next run can check.
What should a merchandiser still approve?
Validation should shrink the merchandiser's review to the decisions that need judgment. Five categories belong with a named person.
Classification and taxonomy. Which category a product sits in affects search, filters, tax treatment and sometimes shipping rules. A workflow can suggest a category and show the reasoning, but the merchandiser confirms it.
Pricing exceptions. Rules can flag a margin below threshold or a cost change beyond tolerance. Whether to accept the cost, negotiate or adjust the retail price is a commercial decision.
Regulated and restricted products. Claims such as organic, hypoallergenic, child safe or flame resistant, along with age-restricted and hazardous items, need documentary proof and a person accountable for publishing them.
Customer-facing copy. Generated descriptions can save hours, but they describe the product to a buyer. Every line should trace to supplier data, and a person approves it.
Overrides. When a supplier insists a barcode is correct or an image is final, someone with authority decides whether to make an exception, and the override is recorded.
Illustrative example: Consider a specialty retailer that adds a few hundred items each season from about thirty suppliers, each using a different spreadsheet layout. A workflow reads each supplier's file, maps it to the retailer's template and runs the checks. Eleven barcodes fail the check digit and are returned to the supplier with the row numbers. Forty color values are normalized automatically, and six are proposed for review because the supplier's name does not match any approved color. Four images are flagged as placeholders. Two items show cost above the planned retail price and go to the buyer for a pricing decision. The merchandiser opens one review queue with the proposed changes, approves most in a few minutes, and the clean records are published to the platform without being retyped.
How does validated data reach the platform?
Where the checks sit in the flow decides how much they save. The best position is between the supplier submission and your system of record, not inside the ecommerce platform after the data has already been imported.
A typical flow has a staging area where supplier files land, the validation and enrichment workflow, a review queue for proposed changes, and an approved record that is written to the PIM, ERP item master or ecommerce platform through its API or import tool. The workflow should keep the original supplier value beside the approved value, so you can answer "where did this number come from" months later.
Decide early which system owns each attribute. If the ERP owns cost and the PIM owns descriptions, the workflow must not write cost into the PIM just because it is in the supplier file. Ownership rules are boring to define and expensive to skip.
How do you know product data validation is working?
Three measures tell you more than the number of rules you have built.
First pass acceptance rate is the share of supplier records that pass all checks without correction. It tells you where supplier education or template changes would help most.
Time from submission to live shows whether the review queue is shortening or lengthening the launch cycle, and where items wait.
Downstream errors traced to catalog data counts the returns, wrong shipments and customer contacts that start with a bad weight, size or description. This is the number that connects catalog work to money, and it overlaps with the exceptions covered in Retail order exceptions: how to automate the triage without losing the customer.
Record a baseline before you start. Without one, a lower error count after launch could just reflect a quieter season.
How do you start with product data validation?
- Pick one supplier or one category with enough volume to matter and a known history of data problems.
- Write down the rules your merchandisers apply in their heads, and agree which ones are hard failures and which are warnings.
- Run the checks in shadow mode on the next incoming file, comparing the findings with what the team catches by hand.
- Add the review queue and the supplier feedback message once the findings look right, and name who approves each category of change.
- Test the whole path on real files, including the awkward ones, before publishing anything automatically. How to test AI before it touches your operations lays out that testing approach.
- Expand to the next supplier only when the first is running with few corrections.
How Kastling approaches catalog data checks
Kastling treats catalog validation as one workflow to understand before anything is built, as part of the AI Integration & Automation service. That starts with a free discovery call. For retail operations, a separately scoped paid audit is common next, reviewing how supplier data arrives today, which systems hold the catalog and where errors are costing time.
The checks connect to the ecommerce platform, PIM or ERP you already use rather than replacing them. Rule-based tests handle what can be decided mechanically, AI handles messy inputs, and a named merchandiser approves classification, pricing exceptions and customer-facing claims. We agree up front how success will be measured, such as first pass acceptance rate or time from submission to live, and we test the workflow against real supplier files before it goes into daily use.
AI data readiness check
Check the data behind one workflow across five areas, and get the three steps that would make it ready for AI.
Questions
What is the difference between product data validation and product data enrichment?
Validation tests whether the data you received meets your rules: required fields are present, values are in range and identifiers are correct. Enrichment adds or improves data, for example mapping a supplier color name to your standard color list or drafting a description from the spec sheet. Validation should run first, because enriching a record that fails basic checks just produces more polished bad data.
Do we need a PIM before we automate supplier data checks?
Not necessarily. A product information management (PIM) system gives validated data a home and a history, but the checks themselves can run against supplier files before they reach a PIM, an ERP item master or the ecommerce platform directly. If you have no PIM, a shared staging table and a defined approval step still give you the main benefit.
Can AI generate product descriptions and attributes safely?
It can draft them from supplier specs, and many teams find that useful. The risk is a fluent statement that the supplier never made, such as a material, a certification or a compatibility claim. Restrict drafts to facts present in the source data, show the source beside each generated line, and have the merchandiser approve anything customer facing.
How do we handle suppliers who send data in different formats every time?
Treat format differences as an extraction problem, not a supplier training problem. A workflow can map each supplier’s columns, PDFs and spreadsheets onto your standard template and flag anything it cannot map confidently. Over time, the mapping for each supplier is stored, so only new or changed fields reach a person.
How do I validate a GTIN check digit?
Multiply the digits before the last one by 3 and 1 in alternating order, starting with 3 on the rightmost of those digits, add the results, and subtract the sum from the nearest equal or higher multiple of ten. The result should equal the last digit of the GTIN. A script can run this on every incoming code, and any mismatch goes back to the supplier.