Академический Документы
Профессиональный Документы
Культура Документы
Dissatisfied Customers?
Editor’s note: Terry G. Vavrus book Improving Your Measurement of Customer Satisfaction: A Guide to Creating, Conducting,
Analyzing, and Reporting Customer Satisfaction Measurement Programs, published by ASQ Quality Press, provides rationale, iden-
tijies opportunities, and suggests programs for improving the measurement of customer satisfaction.
I
RONIC AS IT MAY SEEM, THE CUSTOMER
satisfaction measurement industry is
guilty of creating dissatisfaction among
the world’s customers. There are sever-
al reasons for this and they all have to
do with the process used to assess and remedy
Tips for customer satisfaction.
W. Edwards Deming’s mandate, “Find out
improving what customers want,” has sanctioned the
field of customer satisfaction measurement.
your survey For better or worse, customer satisfaction
measurement generally employs the survey
response rate techniques developed in marketing research.
while still Over the years, marketing research has estab-
lished reasonably strict survey guidelines bor-
pleasing your rowed from the disciplines of survey research
and public-opinion measurement. These pro-
customers tocols were not created from monitoring cus-
tomers’ opinions. A manufacturer’s customer
measurement (CSM) be executed with more
concern and follow-through than the typical
base as a survey population requires some dis- one-shot marketing research survey.
tinct considerations. While some may dis- Customer satisfaction work must draw on
agree, customer satisfaction research is much the strengths of marketing research practice
different from traditional marketing research while establishing its own set of practices.
or public-opinion measurement. Satisfaction measurement projects need to
by Perhaps the most critical difference add sensitivity to the management of cus-
Teny 6. Vavra between a survey research mentality and a tomer relationships, which may be missing in
customer satisfaction mentality is the research current marketing and survey research meth-
community’s insistence on respondent ods. Satisfaction survey respondents who
anonymity. Customers don’t necessarily want have taken the time to furnish information
to remain anonymous. are more than survey participants; they are
cherished customers of an organization.
The etiquette of caring for customers Their relationship with the organization
Regardless of the department or area should be strengthened as a result of the sur-
responsible for conducting a customer satis- vey, not taxed. Survey researchers routinely
faction survey, it must be understood that the deal with infinite populations. They exploit
survey is an important communication tool. It each member of the population who will talk
makes implied promises about the organiza- to them, hoping to collect the information
tion’s interest in and responsiveness to its cus- they’ve been hired to collect. While ethical
tomers. It is imperative that a customer service survey companies would never offend survey
a
Traditional marketing research would forbid follow-up to groups are to be included, the survey’s analytical plan will have
that individual, saying his or her anonymity was promised to address how the groups’ results are reported and possibly
and follow-up betrays this
promise. Yet what is the end
result when customer complaints
go unanswered? Customers may It is imperative to acknowledge the cooperation
become frustrated and assume the ofresponding customers. In the United States
organization doesn’t care.
Satisfaction measurement is not D today, people are bombarded with requests to
only a survey process, but an tell suppliers how satisfied they are.
invitation to correspond with
the sponsoring organization. 4
Correspondence establishes an
obligation of responding to participants. It may serve both combined.) Groups that could be surveyed are current, past,
camps to conclude all satisfaction surveys with either a per- potential, and competitors’ customers.
mission question or a negative option statement, such as: Current customers. Certainly the feelings of current cus-
“Your answers will be reviewed by our customer-care staff. tomers will be a prevailing informational need. But sometimes
This means you may be contacted about specific issues you (in a situation of shrinking business volume or brand share) it
raise. If you do not wish your name disclosed with your ratings, will be appropriate to include past customers and/or competi-
please check the box below.” tors’ customers. Current customers should not be thought of as
a homogeneous group. It is generally advisable to have classih-
The difference between a sample and a census catory information about customers available for the sampling
It is also necessary to decide on the degree of a CSM pro- and analytical stages. This is why it is so important to drive the
gram’s coverage. Here again, marketing research and customer survey with information from the customer base.
satisfaction perspectives differ. There are two roles a CSM can Because all customers are not created equal, you must decide
play: an informational role, collecting information to help an which current customers to interview and how many of them to
organization improve its products or services and processes, and include in the satisfaction measurement process. In fact, simply
a communicational role, demonstrating to customers the organi- identifying what is meant by a current customer may be more
zation’s desire to serve them better and learn more of their of a challenge than you might imagine. You’ll have to create a
expectations and needs. profile of the behaviors you associate with currency. Almost
If a program is to be instituted for the informational compo- always, you will want to identify your most important cus-
nent only, a sample is adequate. The company need only draw a tomers. To read the responses of important customers with sta-
52 O”illlly Pmpr(Mt/-r1997
tistical confidence, there must be an adequate number of them Measurement !wtuit%ments
in the total sample. Whether the satisfaction measurement program is to be field-
This discussion is not meant to imply that all customers are ed as a sample or census, a complete list of customers is neces-
external. Many customer satisfaction surveys are conducted
sary. Unfortunately, this seemingly simple requirement may
among internal customers. These surveys audit how well one prove to be one of the more difficult demands of the measure-
department or unit serves other departments or units within the
ment survey. If you encounter severe problems in identification,
same organization.
try to determine if any bias will be introduced into your survey
Past customers. Past customers represent a rich source of
by interviewing only those customers whose identities you cur-
information about product or transactional failures. When cus-
rently have. For example, are all missing customers:
tomers contact your organization to terminate their relationship,
l From one region
the organization should consider instituting an exit interview.
l Purchasers of one specific product
This interview, conducted when customers notify the organiza-
l Serviced by a particular distribution channel
tion that they will no longer be purchasing its products or ser-
vices, attempts to determine exactly why they are terminating If you were to find such a systematic explanation for absence
from your customer list, it is possible that proceeding without
their relationship. Obviously many manufacturers or service
providers, distanced from customers by a distribution network the unlisted customers would produce a biased picture of satis-
faction.
or channel, cannot determine when a particular customer stops
buying their services or products. Without this knowledge, it is Existing databases
impossible to conduct an exit interview. Without information
from exit interviews, past or lapsed customers become an When a customer database already exists it is wise to scruti-
important subsample in a customer satisfaction process. nize the list. You must satisfy yourself as to the completeness
Naturally, a somewhat different survey introduction will need to and accuracy of the list before instituting it as the backbone of
be used. But otherwise the questionnaire, in issues and ques- your satisfaction assessment process.
tions, should remain as similar to the current customer survey as In the purchase of all products and services, one or more
possible. individuals will have made the purchasing decision, and they
Potential customers. Considering potential customers brings deserve consideration for having their satisfaction measured.
with it the danger of catering to individuals who may never be The situation is most complex in the case of business-to-busi-
converted into actual customers. Beware of efforts to expand ness satisfaction measurement programs. Here, there may be an
categories. All too often these efforts are pipe dreams. Except in extensive cohort of individuals, from the purchasing agent to
new categories or industries or in the case of new, innovative the decision maker, users, and maintenance parties. Not only
products, those for whom the product is relevant usually already should these individuals be identified, but their relative impor-
have self-selected product or category usage. New-to-the-cate- tance in future acquisitions should also be ascertained. This
gory users are expensive to develop, and their needs may be dif- information may be used to combine ratings and possibly weigh
ferent from those of current customers and especially different the ratings by relative influence.
from those of high-value customers. Modifying the product With consumer products, the number of individuals involved
offering in the hope of attracting more users, tempting as it may in the purchase will be fewer, but mapping the relative influence
be, is generally impractical. will be no less difficult. The household bill payer will not neces-
Consider an example from the pet food industry. How feasi- sarily be the decision maker and primary user. Again, the billing
ble is it to attract new customers to the dog food category? You database is indifferent to these issues.
would first have to buy dogs for all of those consumers you
hoped to attract. While not as obvious in other product and ser- Creating a database
vice categories, usage is generally self-selective. Winning new It is recommended that once a customer base of adequate
customers is not that easy. The main lesson is to focus on cur- representation is identified, a separate satisfaction tracking data-
rent customers-they drive the category. base be established. This will be a copy of the customer base
Competitors’ customers. Why spend money and effort with special modifications. A separate database is desirable for
interviewing competitors’ customers? Because they represent several reasons:
one of the best sources of benchmarking data available, l It should be accessible to the satisfaction measurement team.
although finding them and interviewing them poses special, Piggy-backing the satisfaction database on an existing com-
sometimes ethical, considerations. If available, however, their panywide file may result in competition from other depan-
responses can prove to be an invaluable aid in interpreting the merits for access to the file.
ratings of current customers. Competitors’ customers may be l To properly sample and analyze the returned data, certain
dealt with as one group, disregarding their specific supplier, or customer information will be useful. This information may
you may sample customers of each of your major competitors. have to be appended to the file, extending the size of the cur-
Your interest in competitors’ customers is in how they rate rent file.
the competitor. These ratings provide a benchmark with which l The satisfaction tracking file will require linking to other
to interpret ratings that customers give to your product or ser- relational databases to enable storing satisfaction scores from
vice. There have been suggestions, however, that competitors’ years’ worth of surveys. This linking will generally not be
customers could be asked to rate the product and service quality welcomed to an existing file.
they expect they would receive from your company.’ This is Depending upon the size of the customer database, a micro-
more perception than actual experience; generally satisfaction or minicomputer should be appropriated on which to install the
surveys are oriented to measuring actual experience. database, and established software should be used. Rarely will a
OualiN P~IlVW/Decenber 1997 53
municatmg with customers, so customer response must
be rewarded to be encouraged. Additionally, satisfaction
projects must be funded with sufficient resources to be
conducted in a style and manner befitting their value to
the organization.
To increase survey response rate, it is a good idea to
prerecruit customers before contacting them with a ques-
tionnaire. This can do two things. First, it legitimizes the
survey. Customers will not be alarmed that someone
knows they own a product and are being asked about its
performance. Second, prerecruiting can reveal the most
convenient time for customers to be contacted. When the
survey is administered during a convenient time, cus-
tomers will more likely participate.
To prerecruit, the survey sample is contacted, generally
by telephone (letter is also acceptable), and told they have
been selected to participate in a customer satisfaction sur-
vey. They may be alerted to watch for a questionnaire in
the mail or on the Internet or a telephone call or visit
1984 1986 1988 1990 1992 1994 li96 from a personal interviewer. They are always given the
opportunity to state the most convenient time for them to
Year
Sources: be contacted, minimizing the intrusiveness of the survey
1985 and 1988: Your Opinion Counts research industry survey on their personal schedule.
1990 and 1992: Walker Research, Industry Image Survey
1995: Council for Marketing and Opinion Research The importance of incentives
Participating in a CSM (from the customer’s per-
spective) is time and labor intensive. It is appropriate
and reasonable to give respondents some incentive for
database warrant customized programming; in most applica- their efforts. Often in an industrial setting, the simple hope
tions, an off-the-shelf database program will suffice. of having the product better customized to one’s needs or
seeing an improvement in service or delivery will be a suffi-
Prerectulting tor participation cient incentive. Self-interest through high involvement is a
Generally, response rates to survey research are declining. strong motivator. Leverage the direct benefits to your cus-
The terrifyingly high refusal rates (58% in 1995) are shown in tomers through survey participation as much as possible.
Figure 1. While these data are not specific to satisfaction sur- This is the strongest motivation. In some industrial settings
veys, it is unlikely that satisfaction survey refusal rates will be any additional incentive, especially monetary, may be inap-
substantially lower. A number of factors are responsible for the propriate or even against the customer’s organizational poli-
rise in refusal rates: cy. (Government agencies will often forbid employees from
l Previous participation has not been acknowledged. Sadly, receiving monetary payment from a supplier’s organization.
most customer satisfaction surveys are undertaken on limited Even though well meant, an incentive offered in this situa-
budgets with a research mentality. The simple courtesy of tion could lose a contract.)
acknowledging a customer’s participation may not be under- When some additional incentive is either necessary (because
stood. Since many satisfaction studies are conducted among the product or category is not highly involving) or desirable (to
samples of the customer base, however, the likelihood of ensure a maximum response rate), there are two options: prein-
contacting the same customer again in the near future is centives or postincentives.
small. Hence, the importance of reinforcing the customer’s Preincentives. Preincentives are rewards delivered prior to
participation is downplayed. the potential respondent having completed the satisfaction inter-
l Limited budgets constrain the amount of communication view.
that may be undertaken in any one measurement wave. Preincentives play on both the attention value of the incen-
Hence, the costs of a follow-up acknowledgment discourage tive delivered with the request for survey participation and the
the activity. guilt created by the potential respondent having received some-
l The presentation and packaging of most customer satis- thing of value. Merchandise or money included with a mail
faction surveys is shoddy. There often is inadequate funding questionnaire heightens the attention the mailing receives. It
to execute the survey in a stylish manner. Appearance can also minimizes the likelihood of the mailing being immediately
influence response rates, and a cheap appearance can suggest discarded.
evidence of the organization’s low commitment to the CSM Having received something of value, it is hoped, creates guilt
process. stimulating the potential respondent to complete the interview.
These perspectives must be overcome. The research men- Unfortunately not all customers receiving preincentives will
tality must be replaced with a customer-relationship mentality. faithfully complete the interview, and a portion of preincentives
In such a perspective, reinforcing the customer’s participation are therefore wasted.
is essential. Relationship marketing stresses the value of com- Postincentives. Postincentives promise a reward to potential
from
ly do so out of a belief that their information needs are rele-
Informational. The most all-around effective and acceptable vant to these events and, therefore, the collection should be as
incentive is an informational incentive offering survey partici- contiguous to the event as possible. Sampling only certain
time periods is, of course, sub-
ject to bias from coincidental
contaminating events. For exam-
the customers perspective, participating ple, if the periodic measurement
in a CSM is time and labor intensive. It is of satisfaction happens to coin-
tide with a low-fares promotion,
appropriate and reasonable to give respondents how representative will the mea-
some incentive for their efforts. sured satisfaction be of nonpro-
motional fare performance?
Interval sampling also gives
the sales force or other service
pants a summary of the data collected. Not only does this providers a calendar with which to allocate special treatment to
intrigue potential respondents, but it is believed to add a level of customers. If the periods for customer satisfaction measurement
authentication to the survey. Of course, not all of the informa- are widely known, it can signal the time for enhanced service to
tion can (or should) be reported. But usually there are some customers. Some organizations will ask their sales or marketing
classificatory questions that may be interesting to potential personnel to distribute questionnaires to customers during these
respondents. In offering an informational incentive, you should periods. Such conduct is open to all sorts of bias, and this prac-
make it clear that only some of the results will be reported to tice should be discouraged and avoided.
prevent hard feelings when not all of the information is There is an efficiency to mass-distributing surveys at only
received. certain times of the year. The required infrastructure is much
Monetary. Having touted the benefits of information as an less, and distribution can be more easily subcontracted.
incentive, it must quickly be added that money speaks louder Unfortunately, periodic satisfaction measurement also can lead
than words. Money is certainly the most effective incentive to a periodic focus on satisfaction. Without an ongoing program
among consumers where there may be fewer prohibitions con- and regular reports on satisfaction trends, satisfaction becomes
straining your activities. One caveat: Don’t ever position or something that is only considered once a year-during the
imply that money is sufficient remuneration for the customer’s appointed interval.
time. Always offer money as a token of appreciation. Some cus- Interviewing continuously. Although a bigger undertak-
tomers get offended when small amounts of money are offered ing, more and more organizations are moving to a continuous
seemingly to offset the expense of their time or compensate audit of satisfaction with their products and services.
them for the value of their input or opinions. Continuous measurement recognizes the ongoing importance
Merchandise. Sometimes merchandise can be an effective of customer satisfaction. In addition, continuous measure-
incentive. This is especially true when the survey sponsor pro- ments will not be influenced by momentary events (the so-
vides an item that has a greater perceived value than its actual called contaminating events). With continuous measurement,
cost. Cameras might be such an example. One might acquire a the satisfaction professional has a better chance of developing
large number of inexpensive 3.5millimeter cameras for $5 to commitment to quality from the organization’s entire work
$15 that may have the perceived value of $25 to $50. force, since the measurement is contemporary and frequent.
Affinity merchandise featuring the survey sponsor’s logo Workers throughout the organization are likely to have their
should also be considered. Merchandise has the added advan- customers’ satisfaction reported to them monthly or quarterly.
tage of permanence, constantly reminding customers that their Continuous interviewing keeps an organization focused on
opinion was sought and rewarded. customer satisfaction, not allowing it to be forgotten between
Additional products or services. Occasionally survey spon- survey waves.
sors can offer additional units or amounts of the actual product Interviewing after moments of truth. “Moments of truth”