AI customer segmentation for e-commerce

The segment audit: the monthly check that finds the segment mailing people who left

Segments do not go stale all at once. They rot one member at a time, and the audit is the check that finds the rot before the campaign does.

A segment is a rule, and the rule keeps running after the people it describes have moved on. The buyer who was engaged 30 days ago is now 90 days silent. The customer who bought twice is now a one-time buyer. The segment does not notice, because nobody asked it to. The audit is the asking: a monthly check of membership, overlap, and freshness that finds the people who should no longer be in the segment, and the segments that should no longer exist.

What the audit checks

Four things, in order. Membership freshness: does every person in the segment still meet the rule, or have some drifted past the recency window. Overlap: how many shoppers qualify for two or more segments, and are they getting duplicate campaigns. Size drift: has the segment grown or shrunk past the point where its rule still describes a real group. And criteria validity: does the rule still describe a buyer who exists, or has the market moved on.

The audit is a checklist, not a judgment. Each check has a number attached, and the numbers are what get reviewed, because a segment audit argued from feelings is a meeting, not a control.

The overlap problem

Overlap is the audit finding that matters most, because it is the one the shopper sees. A shopper who qualifies for three segments gets three versions of the same campaign, and the shopper does not think the brand is thorough. They think the brand is sloppy. The reports double-count the same person, the campaigns cannibalize each other, and the segment that looks like it is performing is performing on the same people as two other segments.

The audit measures overlap as a percentage: what share of each segment's members also qualify for another segment. Overlap under 10 percent is normal. Overlap over 30 percent means the segments are describing the same buyer three times, and at least two of them should be merged or retired.

The monthly cadence

Monthly is the cadence that survives contact with a real calendar. Weekly is too often to see drift. Quarterly is too slow to catch it. A monthly audit has a fixed shape: pull the membership, measure the overlap, check the size, and flag the segments that fail. The flags go to the segment owner, with a date for the fix, because a flag without a date is a note, not a control.

Run the audit on the same day each month, and keep the results. A series of audits is a history, and the history shows which segments drift every month and which ones hold steady. The drifters are the segments whose rules are wrong, and the history is the evidence.

What a clean audit looks like

A clean audit is not an audit with no flags. It is an audit where the flags are small and the fixes are routine. Segments that match their rules, sizes that hold within a range, overlap under 10 percent, and criteria that still describe a buyer who exists. The segments that fail are the ones whose rules are stale, and the audit is the mechanism that catches them before the campaign does.

Keep the audit results with the segment definitions. A segment with a year of clean audits is a segment that can be trusted. A segment with a year of flags and no fixes is a segment that should be retired, and the audit history is the record of why.

Keep reading

Frequently asked questions

How often should segments be audited?

Monthly, at minimum, and after any big change: a new product, a new campaign, a list import. A segment that has not been audited in six months is a rule running on old assumptions, and the assumptions are the part that rots.

What is segment overlap, and why does it matter?

Overlap is when one shopper qualifies for two or more segments at once, and gets two or three versions of the same campaign. It matters because the shopper sees the duplication, the campaigns cannibalize each other, and the reports double-count the same person. An overlap audit is the first step of any segment audit.

Who should run the segment audit?

The person who owns the segments, with a second pair of eyes from whoever mails the campaigns. Marketing builds the segments, but the campaign owner sees the overlap, the duplication, and the complaints. The audit needs both views.

What do I do with a segment that fails the audit?

Three options: fix the rule, merge the segment into a larger one, or retire it. A segment that fails because its members moved on gets a new rule. A segment that fails because it is too small gets merged. A segment that fails because the buyer it described no longer exists gets retired, and the retirement is recorded so nobody rebuilds it next quarter.