Three Segments Worth Naming, and Most of Your Base in None of Them.
← Chapter 195
Capstone 33 · Marketing
Plain-language Brief

Three Segments Worth Naming, and Most of Your Base in None of Them.

The brief asked for four or five segments. There are three that behave distinctly, one group that looks like a segment and is not, and 55 percent of customers who belong to nothing.

To  Marketing Director
From  Analysis
Re  Customer segmentation for next year's plan, 5,693 loyalty accounts
Where this comes from
Chapter Chapter 195 · Clustering: Choosing k Honestly
Part Part XXXI · Capstone Projects: Machine Learning
Dataset capstone-clustering-choosing-k.xlsx
Notebook View the analysis

Recommendation

Bottom line

Build the plan around three segments, and plan separately for the rest of the base. The three are real: they behave differently, and they responded to last quarter's price-off campaign at 48 percent, 10 percent and 4 percent against a base rate of 18. Together they are about 45 percent of your customers. The other 55 percent are not a fourth segment. They are a continuum, and a campaign aimed at 'them' is aimed at nobody in particular.

The three segments

Table 1. The three groups that behave distinctly, with their response to a campaign they were not selected for.
SegmentSizeLooks likeResponded to the price-off campaign
Bargain hunters87733 visits a year, 27 dollar baskets, 79 percent of purchases on promotion, mostly online48%
Occasional gift buyers6613 or 4 visits a year, 130 dollar baskets, a 24 percent return rate, almost entirely online10%
Loyal high spenders18138 visits a year, 149 dollar baskets, seven years' tenure, rarely uses a promotion4%

The gap between 48 percent and 4 percent is the practical point. A price-off campaign sent to the whole base costs the same per customer and does very different work depending on who receives it.

Bar chart of campaign response: bargain hunters 50 percent, the unstructured middle 14.5, occasional gift buyers 9.4, loyal high spenders 4.9, against a whole-base rate of 18.5 percent.
Figure 1. The three named groups and the unstructured middle, measured against a price-off campaign that played no part in building them.

Why not four or five

We can produce four, five or ten segments on request; the software never refuses. The question is whether the extra ones separate anything. We tested this by holding back last quarter's campaign result, building segments without it, and then asking whether the segments differed on it.

Table 2. Each extra split has to earn its place. The fourth one does; the fifth does not.
Number of segmentsGap between the best and worst responding segment
Two15 points
Three18 points
Four42 points
Five43 points
Eight44 points

The fourth split is where the bargain hunters separate out, and it is worth 24 points of response. Everything after it adds a fraction of a point. That is the whole basis for the recommendation, and it is a better basis than any statistical fit measure, all of which suggested two.

The group we would not name

One of the four groups the analysis produced looks superficially like a segment: 819 customers, about nine visits a year, 42 dollar baskets. It responded to the campaign at 12.6 percent, against a base rate of 18.5. In other words it does not behave differently from the average customer in any way that matters.

Why we are flagging this

This is the group that would have got a name, an owner and a budget. It is the densest patch of an otherwise featureless middle, and the only reason we can tell is that it failed the campaign test. Any segment that does not separate an outcome you care about is a label, not a segment.

Two curves against the number of segments. The gap in campaign response jumps at four and flattens; agreement with the true segments peaks at four and falls away.
Figure 2. Why we stopped at four. Each extra split has to separate something; the fourth one does and the fifth does not.

Two cautions

These segments are validated for price promotions. They separate response to a price-off campaign extremely well. They may separate response to a loyalty program, a service change or a new range badly. If next year's plan is not mainly about price, the segmentation should be re-validated against something closer to what it will be used for.

This is one year of behavior, not a permanent property of a customer. Nothing here says a bargain hunter stays a bargain hunter. Before anything is built on top of these groups it is worth spending a week on how many customers moved between them from the previous year.

From Statistics, Data Science and AI: A Visual Handbook by John Fisher. Every statistic, table, and figure in this report is reproduced by the companion notebook.