Академический Документы
Профессиональный Документы
Культура Документы
A practical guide
Roger Pierce
Apart from any fair dealing for the purposes of research or private study, or criticism or
review, as permitted under the Copyright, Designs and Patents Act, 1988, this publication
may be reproduced, stored or transmitted in any form, or by any means, only with the
prior permission in writing of the publishers, or in the case of reprographic reproduction,
in accordance with the terms of licences issued by the Copyright Licensing Agency.
Enquiries concerning reproduction outside those terms should be sent to the publishers.
A catalogue record for this book is available from the British Library
ISBN 978-1-4129-3550-0
ISBN 978-1-4129-3551-7 (pbk)
Preface x
PART I INTRODUCTION 1
1 Introduction 3
PART II METHODOLOGIES 39
11 Observation 161
20 Writing-up 309
Bibliography 330
Index 335
About This Book
This textbook has been written for students and researchers in Departments of
Politics at UK and other ‘western’ universities where English is the language of
instruction.3 It is designed to provide an introductory text for undergraduates, an
intermediate text for graduates following ‘taught’ Masters’ programmes and first-
year postgraduate researchers. It is also designed to provide an additional teaching
resource for busy teachers – especially those for whom teaching research methods is
a duty rather than matter of choice. It seeks to meet the wide variety of readers’ prior
training and training needs by adopting a multi-level approach. In this way, it seeks
to bridge the present gap in the literature between the good introductory texts and
the more advanced texts requiring substantial mathematical training, knowledge or
sociolinguistics.4,5 It also seeks to be inclusive by including and giving equal coverage
to quantitative (numeric) and qualitative ‘talk and text’ methods. It recognises the
criticism of research methods texts of ‘eurocentricity’ by acknowledging that, while
the underlying principles of research may be (almost) universal, the underlying
philosophic roots and techniques must vary between different contexts.
The book assumes a mixed readership of home English-speaking students and
overseas students for whom English is a second language. Similarly, it assumes that
some students – especially of ‘taught courses’ – may come from other disciplines
and be unused to terms more specific to Politics. To meet the special needs of some
students without patronising others, a system of comprehensive endnotes has been
used to explain terms and to cite references fully.6 (Regrettably, today’s printing
software precludes the use of footnotes.) Technical terms are written in italics. Where
key technical terms are introduced for the first time, they are displayed in bold text,
defined and discussed. Briefer definitions of terms are given in the glossary. Whilst
the Harvard system of referencing is used, this has been augmented by providing
the date of first publication so that the chronological significance is retained, e.g.:
Teaching and learning are often conceived as two sides of the same coin. Some
students still prefer to learn passively from teaching through formal lectures. Others
prefer to gain (arguably deeper) insights through a combination of individual study
vi About This Book
(including reading and writing), exploration and heuristic learning (including direct
practical experience). Most benefit from collective discussions at seminars or informal
discussions with colleagues.
The pedagogic 7 principle underlying this textbook is that we all learn best – in terms
of acquiring knowledge and skills – through a mix of formal teaching, independent
study, experience, and practice, in which the proportions will vary from student to
student. So a blended (or distributed) teaching and learning strategy has been adopted.
This offers readers a mix of:
To assist readers, supplementary case studies and packages of PowerPoint slides for
each of the chapters are available via the website www.sagepub.co.uk/pierce.
Readers are not expected or encouraged to read this book from cover-to-cover.
You are unlikely to really assimilate knowledge for its own sake. You are more
likely to assimilate best what and when you ‘need to know’. So a strategy of timely,
selective reading is recommended. And while this book seeks to be inclusive and
authoritative, it makes no claims to be a definitive text. Users are therefore expected
to follow the principles of best scholarship by considering and comparing other
narratives before firming up their views. The relevant additional literature includes:
• Burnham, P., Grillard, K., Grant, W. and Layton-Henry, Z. (2004) Research Methods in
Politics. Basingstoke: Palgrave Macmillan. This 308-page textbook has been written by
members of the Department of Politics at the University of Warwick. It draws on their
experience as teachers of research methods and their critique of the limitations of the
application to politics of the many research guides written by sociologists.
• Harrison, L. (2001) Political Research: An Introduction. London: Routledge.This 180-page
textbook has been written by Lisa Harrison, senior lecturer in Politics at the University of
the West of England. As its title states, it has been written primarily as an introductory
text for students.
• Marsh, D., and Stoker, G. (eds.) (2002) Theory and Methods in Political Science.
Basingstoke: Palgrave. This 368-page textbook contains separate chapters by leading
About This Book vii
academics in Politics at universities in UK, US and Australia. Its strength lies in the
coverage which it offers of the main approaches and issues and their implications for
research methods.
0 1 2 3 4 5
PART I INTRODUCTION
1 Introduction
Political science/ politics/political 0 1 2 3 4 5
studies
2 Power in Research, Ethics, Data Protection and Bias
Ethics in research 0 1 2 3 4 5
Data protection 0 1 2 3 4 5
The Research Effect (Hawthorne) 0 1 2 3 4 5
Bias 0 1 2 3 4 5
3 The Philosophy and Principles of Research
Positivism 0 1 2 3 4 5
Empiricism 0 1 2 3 4 5
Behaviouralism 0 1 2 3 4 5
Naturalism 0 1 2 3 4 5
Feminism 0 1 2 3 4 5
Marxism 0 1 2 3 4 5
Inductive research 0 1 2 3 4 5
(Continued)
viii About This Book
0 1 2 3 4 5
Deductive research 0 1 2 3 4 5
Grounded research 0 1 2 3 4 5
PART II METHODOLOGIES
4 Qualitative versus Quantitative Methods: A Relevant Argument?
Qualitative methods: claims and 0 1 2 3 4 5
criticisms
Quantitative methods: claims and 0 1 2 3 4 5
criticisms
Mixed methods 0 1 2 3 4 5
Research design(s) 0 1 2 3 4 5
5 Collecting Data Sets: Case Studies, Experimental, Comparative, Longitudinal
and Action Research Methods
Case studies 0 1 2 3 4 5
Comparative research 0 1 2 3 4 5
Longitudinal research 0 1 2 3 4 5
Action research 0 1 2 3 4 5
PART III COLLECTING INFORMATION
6 Critically Evaluating Published 0 1 2 3 4 5
Research
7 Evaluating Information: Validity, Reliability, Accuracy, Triangulation
Validity, reliability and accuracy 0 1 2 3 4 5
Primary and secondary sources 0 1 2 3 4 5
Triangulation 0 1 2 3 4 5
Sampling 0 1 2 3 4 5
8 Completing a Literature Review: Accessing Published (β) Information
Information search 0 1 2 3 4 5
Completing a critical literature 0 1 2 3 4 5
review
9 Asking Questions: Effective Elite Interviews, Other Interviews, Vignettes,
Projective Questions, and Focus Groups
Elite interviews 0 1 2 3 4 5
Group meetings 0 1 2 3 4 5
Vignettes 0 1 2 3 4 5
Focus groups 0 1 2 3 4 5
10 Questionnaire Surveys
Survey sampling 0 1 2 3 4 5
Designing and coding 0 1 2 3 4 5
questionnaires
Projective questions 0 1 2 3 4 5
Designing vignettes 0 1 2 3 4 5
11 Observation 0 1 2 3 4 5
About This Book ix
0 1 2 3 4 5
PART IV DATA ANALYSIS
12 Analysing Research Data: The 0 1 2 3 4 5
Process
IVA Quantitative Analysis
13 Calculating and Interpreting Descriptive Statistics
MS Excel 0 1 2 3 4 5
SPSS 0 1 2 3 4 5
Descriptive statistics
Mean, median, mode, outliers, 0 1 2 3 4 5
range, deviance
Grouped frequency distribution 0 1 2 3 4 5
Standard deviation 0 1 2 3 4 5
14 Using and Understanding Inferential Statistics
Standard error of the mean 0 1 2 3 4 5
Confidence limits 0 1 2 3 4 5
15 Testing for Association
Correlation 0 1 2 3 4 5
Significance 0 1 2 3 4 5
Linear regression analysis 0 1 2 3 4 5
16 Applying Factor Analysis and Other Advanced Techniques
Factor analysis 0 1 2 3 4 5
Bernouli distribution 0 1 2 3 4 5
Time series analysis 0 1 2 3 4 5
IVB Qualitative Analysis
17 Analysing Qualitative Information: Classifying, Coding and Interpreting
Information
Coding text 0 1 2 3 4 5
18 Using Content Analysis 0 1 2 3 4 5
19 Understanding and Adopting Discourse and Narrative Analysis
0 1 2 3 4 5
PART V COMMUNICATING RESEARCH
20 Writing-up 0 1 2 3 4 5
Preface
This book encourages researchers to begin their reports with a personal statement in
the form of a preface. This serves several purposes. First, it tells the readers why
the researcher has (really) chosen the research topic: what it means to the author
and their identity. Second, it discloses (the inevitable) starting biases, prejudices and
hunches – the intellectual and emotional baggage that the researcher carries. Third,
the preface acknowledges those other people who have influenced the work.
Writing the preface is a difficult task. It requires reflexivity (intellectual self-
awareness) and honesty. Overall, the personal statement should clarify matters at
the beginning for both the researcher and the reader. In particular, it underlines the
personal – the identity of the researcher that, in the discipline of Politics and other
social sciences, exerts a major influence on the choice of research, the findings and,
crucially, their interpretation. The researcher is therefore, in the language of research,
an independent variable (a causal factor or driver which affects the outcome).
In this case, the textbook has been written to ‘close the chapter’ on my ten-
year career as a mature graduate, doctoral student and, latterly, teacher of research
methods in the Department of Politics at the University of York. It seeks to bring
together in a single volume materials developed from many sources and academic
specialities over many years. In my previous work in urban regeneration, I helped
shape new environments and policies. They provide enduring evidence of effort and
success – or otherwise. Hopefully, this book serves a similar purpose. Si monumentum
requiris, etc.8
My baggage is essentially that of a practitioner as distinct from an academic.9 So
my approach seeks to be eminently practical: to show readers how to carry out
different types of research and techniques to high standards of scholarship. But it is
not a-theoretical: the various methodologies are grounded in theoretical principles
that must be properly understood if the tools are to be applied correctly. After all,
My particular research interests are: power, deference and complicity and the explanations
of Gramsci, Lukes, Bourdieu and Foucault.
This textbook has been shaped by many other people. Special thanks are due to:
my former mentor, Professor Mark Evans; to Dr Adrian Leftwich who provided the
original brief; to Dr Roger MacGinty and Dr Simon Parker who encouraged me to
develop this text from my module guides. To Liz Harrison who proof-read the drafts;
Preface xi
Dr Roger Pierce
York
Notes
‘He will have views and prospects to himself perpetually soliciting his eye, which he can
no more help standing still to look at than he can fly; he will moreover have various …
Accounts to reconcile;
Anecdotes to pick up;
Inscriptions to make out;
Stories to weave in; Traditions to sift
Personages to call upon;
Panegyrics1 to paste up at his door; Pasquinades2 at that…’
Rev. Laurence Sterne (1996/1760) Tristram Shandy. Ware: Herts.,
Wordsworth., p. 27.
Part I
Introduction
Chapter 1
Introduction
This chapter begins, like the others that follow, with a clear statement of the teaching
and learning objectives (or purpose). They are shown below:
What is research?
Additionally, we can claim that academic research can be distinguished from other
research by
• its central concern for theory involving either testing or extending existing theory
(deductive research), or developing new theory (inductive research).
than throwing out the dish, he first examined the contents and discovered that the
mould had prevented the formation of Staphylococcus bacilli. The discovery thereby
evidenced Pasteur’s earlier remark that ‘chance only favours the prepared mind’
(Greenfield et al, 2001: 302).1 Today, specialist ‘serendipity software’ is available
to search and compare data sets to identify potential associations for subsequent
investigation.
Similarly, research on research has shown that intellectual curiosity is the main
driver of effective research which, in turn, stimulates and sustains the essential
concentration and motivation (Mace, 1962: 29).2 In a post-modern world, it
may also be argued that scepticism (the doctrine of the Philosophic School of
Sceptics that real knowledge of the world is unattainable) is also an essential
component. There is therefore a new readiness to challenge accepted theories, ‘truth’
and ‘facts’.
At a time when so much is already ‘known’, the question has to be asked: why
undertake research? In particular, what real contributions can a single-semester,
undergraduate research project make to the knowledge and understanding of our
world? In reply, it can be argued that the real benefit of undergraduate, graduate
and doctoral research lies in the contribution the research activity makes to your
intellectual and personal development in terms of:
In other words, research provides an opportunity and arena for education for both
academic or non-academic careers.
But, what is Politics? Does the discipline require or pre-suppose a unique approach to
research training that favours specialist, in-house, faculty-wide, generic research training?
Politics is a relatively new academic discipline in the family of social sci-
ences. It has roots in philosophy, history, law, geography, economics, sociology,
psychology and, in the sub-field of voting behaviour, quantitative (statistical)
analysis and mathematical modelling. It has therefore been described as: ‘the
junction subject of the social sciences’ (Burnham et al, 2004: 8).3 Alternatively,
it can be seen as a ‘mongrel subject’ or ‘crossover discipline’ that draws on
others promiscuously. It can be both prescriptive (normative) and descriptive. Two
broad and six constituent approaches have been identified in the ‘diverse and …
cosmopolitan’ discipline: the formal operation of politics in government (and
other arenas) embracing: behaviouralism; rational (public) choice theory and
(new) institutional analysis; and, politics as a social process pervading all levels of
Introduction 5
This overarching view of Politics might, at first sight, be seen to imply that all
available research approaches and techniques can be adopted in Politics and that the
researcher’s tool bag is vast. But this is not the case. In particular, power (which
many commentators regard as central to the discipline) is not readily quantifiable or
measurable.6 It as another ‘essentially contested concept’ (Lukes, 1974: 9).7 Indeed,
power may not be observable (Bachrach & Baratz, 1962).8 Similarly, conflict need
not necessarily be overt. And historic events cannot be re-run. So, those laboratory-
based, scientific research approaches and techniques which rely on the repeated
observation of phenomena under controlled conditions are largely inappropriate to
Politics.
This textbook concentrates on those research methods which seek to discern and
interpret the underlying meanings, causes and consequences of conflict and power
at the level of supra-state, state, government, party, class and other identity groups,
and people in either the past or present-day. So a special characteristic of research
in Politics is that it collects information from both archives (historical records) and
fieldwork (field research).
The textbook is structured in five parts and their associated chapters which, generally
speaking, follow the research process and degrees of complexity.
Part I (Introduction) begins with this scoping chapter. It is followed, in Chapter 2,
by a review of power in research, ethics, data protection and the research
effect. It concludes, in Chapter 3, with a review of the underlying philosophy
and principles of research, including the concept of causality, provided by the
main schools of positivism, empiricism, behaviouralism, naturalism and feminism
newly mentioned and distinguishes between inductive, deductive and grounded
research.
Part II (Methodologies) identifies the underlying principles and theories from
which various methods have been developed. It begins, in Chapter 4, with a review
of the dualism of qualitative and quantitative research, the claims and counter-claims
of their disciples and the role of mixed methods. This concludes by identifying
the main approaches to research design. This is followed, in Chapter 5, by a
critical review of case studies, experimental, comparative, longitudinal and action
research.
Part III (Collecting information) begins, in Chapter 6, with advice on how to
critically evaluate published research. This is followed by guidance on how to test
the quality of information in terms of the gold standards of validity, reliability
and accuracy, the distinction between primary and secondary sources, and the use
of triangulation and sampling in Chapter 7. The next chapter (8) concentrates
on accessing secondary sources and completing an effective literature review.
This is followed, in Chapter 9, by guidance on how to organise and complete
interviews with political elites and other individuals, group meetings and focus
groups, projective questions and vignettes. Chapter 10 provides practical advice on
designing and conducting questionnaire surveys. Part III concludes with a critical
review of other observational methods including the role of the new popular science
of body language in Chapter 11.
Introduction 7
FURTHER READING
Notes
1 Greenfield, S., Singh, S., Tallack, P. et al (2001) The Science Book. London: Cassell & Co. p. 302.
2 Mace, C.A. (1962) The Psychology of Study. Harmondsworth: Penguin. p. 29.
3 Burnham, P., Grillard, K., Grant, W. and Layton-Henry, Z. (2004) Research Methods in Politics.
Basingstoke: Palgrave Macmillan. p. 8.
4 Marsh, D. and Stoker, G. (eds.) (2002) Theory and Methods in Political Science. Basingstoke:
Palgrave. pp. 3–11.
5 QAA (Quality Assurance Agency for UK Higher Education) (2000) Politics and International
Relations’ Benchmark Statement. QAA, Gloucester cited in Leftwich, A. (ed.) (2004) What is
Politics? Cambridge: Polity Press. p. 20. Note how this constipated ‘official view’ draws centrally on
Lasswell, H. (1958) Who Gets What, When, How. New York: Meridian.
6 For example, Robertson, D. (1993) Politics. London: Penguin.
7 Lukes, S. (1974) Power: A Radical View. London: Macmillan. p. 9.
8 See Bachrach, P., and Baratz, M. (1962) Two Faces of Power. In American Political Science
Review, 56: 947–52, and Lukes, S. (1974) Power: A Radical View. London: Macmillan.
Chapter 2
Power in Research, Ethics, Data
Protection and Bias
‘The researchers take, hit, and run. They intrude into their subjects’ privacy, disrupt
their perceptions, utilise false pretences, manipulate the relationships, and give little in
return.’
(Reinharrz, 1984: 95)1
The researcher (you) choose the topic, research question, design and means of data
collection and its interpretation. You will choose sources selectively for accessibility,
validity, reliability and accuracy. You will seek to exploit the resources and, for that
matter, the prestige and goodwill of the university. Some feminists likened traditional
research to a ‘rape model’. As you will see, the major resources in political research
are archives and people. The people may be agents, actors or bystanders. You seek
their collaboration on the basis of the benefit to society of the research and the
benefits of the interviewees (the subjects). But within the survey or interview
situation, power relations between the researcher and those researched are unequal.
Any process of question-and-answer favours the questioner. In particular, you are
likely to be more experienced and can leave the field at the end of the interview or
10 Research Methods in Politics
research project. So the potential for causing real harm, however unintentional or
as agent provocateur, is very great.
The trial of the Nazi war leaders at Nuremberg in 1947 was followed by the trial of
scientists, doctors and administrators who had carried out experiments on prisoners
in the concentration camps. They were charged with ‘crimes against humanity’.
Their defence was threefold: first, that they had not undertaken acts which were
contrary to German law at the time; second, that the practices were consistent with
the prevailing national ideology that Jews, Gypsies and Slavs were anti-state groups;
and, third, that the experiments were justified by their scientific value to mankind.
Power in Research, Ethics, Data Protection and Bias 11
One example cited in their defence was the immersion of prisoners in cold water to
determine the effect of lack of heat, body mass, age and gender on survival times.
The defences were dismissed. The argument of scientific value was thrown out on
the grounds that the prisoners were not representative of the population: they had
been systematically starved and beaten to the point that their very will to survive
had been extinguished. The defendants were executed or imprisoned.
During the trial, a group of US philosophers, doctors and lawyers was tasked to
provide a universal ethical code for medical experiments. The Nuremberg Code was
adopted by the Great Powers in 1947. It is reproduced in Box 2.1. The code has since
1. The voluntary consent of the human subject is absolutely essential . This means
that the person involved should have the legal capacity to give consent; should be
so situated as to be able to exercise free power of choice, without intervention of any
element of force, fraud, deceit, duress, overreaching, or other ulterior form of constraint
or coercion; and should have sufficient knowledge and comprehension of the elements
of the subject matter involved as to enable him to make an understanding and
enlightened decision. This latter element requires that before the acceptance of an
affirmative decision by the experimental subject there should be made known to him
the nature, duration, and purpose of the experiment; the method and means by which
it is to be conducted; all inconveniences and hazards reasonably to be expected; and
the effects upon his health or person which may possibly come from participation in
the experiment.
The duty and responsibility for obtaining the quality of consent rests upon each
individual who initiates, directs, or engages in the experiment. It is a personal duty and
responsibility which may not be delegated to others with impunity.
(Continued )
12 Research Methods in Politics
2. The experiment should be such as to yield fruitful results for the good of society ,
unprocurable by other methods or means of study, and not random and unnecessary
in nature.
3. The experiment should be so designed and based on the results of animal
experimentation and a knowledge of the natural history of disease or other problem
under study that the anticipated results justify the performance of the experiment.
4. The experiment should be so conducted as to avoid all unnecessary physical
and mental suffering and injury .
5. No experiment may be conducted where there is an a priori reason to believe that
death or disabling injury will occur; except perhaps in those experiments where the
experimental physicians also serve as subjects.
6. The degree of risk should never exceed that determined by the humanitarian
importance of the problem to be solved by the experiment
7. Proper preparations should be made and adequate facilities provided to protect the
experimental subject against even the remote possibility of injury, disability or death.
8. The experiment should be conducted only by scientifically qualified persons. The
highest degree of skill and care should be required through all stages of the experiment
of those who conduct or engage in the experiment.
9. During the course of the experiment the human subject should be at liberty
to bring the experiment to an end if he has reached the physical and
mental state where continuation of the experiment seems to him to be
impossible.
10. During the course of the experiment the scientist must be prepared to terminate
the experiment at any stage, if he has probable cause to believe, in the exercise of
good faith, superior skill and careful judgement required of him, that a continuation
of the experiment is likely to result in injury, disability, or death to the experimental
subject.
been strengthened by other codes, e.g., the Helsinki Code, to provide additional
guidance to scientists. It established four principles for research for whatever purpose:
voluntary informed consent; benefit to society; protection from unnecessary harm of subjects;
and, the right of subject to end experiments.
Today, UK’s ESRC2 and other research funders ask for research proposals to
include a statement identifying the specific ethical problems likely to be encountered
and how they will be resolved. Ideally, the applicant’s statement should cite the
university and department’s family of ethical research codes, and the value of frequent
supervision.
Power in Research, Ethics, Data Protection and Bias 13
The experiences of World War II and the post-war fears of totalitarianism (captured
in George Orwell’s Animal Farm and 1984) led to the United Nations Declaration of
Human Rights and the European Convention of Human Rights & Fundamental Freedoms
to protect the individual from government.3 However, fears were heightened again
by the increasing use of computers by government and business from the early 1960s
and their capacity to hold vast amounts of data on individuals. There was widespread
concern for the accuracy and security of that information (especially HIV and other
medical records) and its use for purposes for which it had never been intended.
Growing concerns for political freedom and privacy led to the convergence of human
rights and data protection protocols at supra-national level which were brought into
effect as national legislation.
The use of personal data for research was the subject of Article 108 of the Treaty
of Rome, 1957 and EEC Directive 95/46. Article 6 of the Directive provided
derogations for processing and long-term storage of data for ‘historical, statistical or
scientific purposes’ subject to ‘compatibility with the original purpose of collection’.
Specific issues that member states were asked to resolve were, on one hand, the right
of access by individuals to information held on them, and, on the other, restrictions
on their use of the data, considerations of national security, and the use of data
generated by medical research by private organisations. In Britain, the directive was
given effect by the Data Protection Act, 1998. This required ‘all persons who process
or use personal data’ in electronic, paper, tape or video formats to follow eight data
protection principles. The principles were that all data must be:
S.33 of the Act gives exemptions for personal data kept for ‘research purposes’.
S.33(5) allows ‘permitted disclosures’ to others for ‘research purposes’, to the subject
or their agents, or at the subject’s request. But data need not be disclosed where it
would require ‘disproportionate effort’ or ‘where the risk to the rights and freedoms
of subjects is low’. The implications for academic research were considered by the
14 Research Methods in Politics
Data collected for the purpose of one piece of research can be used for other
research without breaching the regulations on incompatible purposes and can be kept
indefinitely. This means that staff and students involved in research can keep records
of questionnaires and contacts so that the research can be revisited at a later date, or
so that a research project looking into an associated area, could reanalyse the data.
However, in order to avoid breaking subject access rules, researchers must ensure that
the final results of the research do not identify the individual.
British universities must register with the regulating authority: the Data Protection
Registrar. A senior university official must be designated as the Data Protection
Co-ordinator and submit annual returns to the Registrar. Generally speaking, the
head of department is designated as Data Protection Officer. They may delegate
administrative responsibility to a Data Protection Manager. Researchers should
notify the Data Protection Co-ordinator of:
• data must be held securely. This means that data on subjects and interview transcripts
must be stored separately in lockable cabinets or, if held on PCs or laptops etc. password-
protected
• personal data on subjects should only be held where essential
• individuals should be anonymous or not otherwise identifiable; strategies include:
– ‘anonymisation’, e.g., Mr. A said …
– positional descriptions, e.g., minister A said …
– deception, e.g. Ms A said … (where sex is not relevant)
– replacing place names by generic pseudonyms, e.g. Northtown
– changing descriptions slightly
• personal data should not be disclosed, transferred or copied (including by email),
especially outside the EEA, without prior agreement by the recipient to confidentiality
and authorisation
Power in Research, Ethics, Data Protection and Bias 15
• potentially reusable data should be archived centrally, e.g. at ESRC’s archive at The
University of Essex.
The penalties for negligence may include fines and the withdrawal of funding support
for the research. The greatest penalty will be the loss of the researcher’s, department’s
and university’s reputation and loss of future research opportunities as subjects refuse
to co-operate.
You will inevitably change your behaviour in the presence of power. You are
unlikely to maintain the same tone of voice and general manner in all situations,
for example, teachers do not speak to their head teacher in the same way that they
address schoolchildren. Your actual language and tone will vary according to whom,
when and where you are speaking. In the same way, researchers and their subjects
will also change their behaviour, especially in face-to-face situations. This change
of behaviour is termed the‘research effect’. The main types of research effect are
the Hawthorne effect, the Placebo effect, the John Henry effect, the Halo effect, Experimental
effects, the Pygmalion effect and the Peacock effect.
Hawthorne effect
The Hawthorne effect takes its name from the Hawthorne Plant of the Western
Electric Company in Cicero, Illinois. There, in the relay assembly room, engineers
experimented in 1927 with the effects on productivity on the introduction
of improved lighting, mechanical ventilation and humidity control. Separate
workspaces and groups were designated as experimental or control areas,where
the lighting conditions etc. were varied in the experimental areas and unchanged
in the control areas. The engineers were delighted when productivity in the
experimental areas increased as lighting and ventilation were improved. However,
when sceptical colleagues challenged the experimenters to reduce lighting and
ventilation, they found that productivity remained high. And it had also increased
in the control area. The help of the Harvard Business School was sought. The senior
investigator, Elton Mayo wrote that:
A highly competent group of Western Electric engineers refused to accept defeat when
experiments to demonstrate the effect of illumination on work seemed to lead nowhere.
The conditions of scientific experiment had apparently been fulfilled – experimental
room; control room; changes introduced one at a time; all other conditions held
steady. And the results were complexing: Roethlisberger5 gave two instances – lighting
improved in the experimental room, production went up; but it also rose in the control
room.
16 Research Methods in Politics
The explanation given by Mayo was that productivity had increased in both the
experimental and control workspaces because the workers there were the focus of
the researchers’ attention. The research was subsequently extended until 1932. Mayo
and his colleagues also argued that the research showed that aptitude is only weakly
related to performance, and that the workplace is a social system in which informal
organisation of work-groups and their attitudes are critical to production. In effect,
the work-group decided what was a ‘fair-day’s work’.
Mayo termed this behaviour change as the ‘research effect’. It has become better
known as the Hawthorne effect. However, his explanation has been challenged. Some
industrial psychologists argue that Mayo’s findings were wishful thinking: Mayo and
his colleagues were biased in their interpretation by the researchers’ promotion of
the (softer) human relations school of industrial relations (which favoured humane
treatment of worker and workplace democracy) in the face of the (harsher) scientific
management prevailing in the US.7 While the studies were extensive, the samples
were relatively small and not representative. The generalisability of their findings
could therefore be challenged. By re-analysing the data, critics argued that changes
in performance should better be attributed to the Depression, the substitution of
two particular workers and the threat of disciplinary action.8 Whether or not this
challenge to the Hawthorne folklore can be sustained, the episode does illustrate
the potential impact of the researcher’s own values on the research proposal, the
collection of data and its analysis (which is considered later in this chapter).
Placebo effect
The Placebo effect pre-dates Hawthorne. The term is derived from the Latin word
‘placebo’ meaning ‘I shall be pleasing’ which was used by physicians to describe inert
remedies to which some patients responded by meeting their psychological needs for
medical attention. The term has been extended to describe the practice in medical
drug trials, and other experiments, of giving placebos to the control group so that
the real efficacy of the trial drug can be calculated. In these cases, random, double-blind
trials are conducted in which the patients and medical observers are unaware who
is receiving the trial drug and who is receiving the placebo.
Halo effect
The Halo effect is the response of subjects to novelty where the press and other media
(including advertising) have created an expectation.
Experimental effect
The Experimental effect is similar. Here expectations are raised by the researcher.
Pygmalion effect
The Pygmalion effect is a sub-type of expectancy change. It can be a form of ‘self-
fulfilling prophecy’. It is most often cited in education where the teacher’s expressed
expectations of pupils, whether high or low, can greatly affect their performance.
It may also occur where, in an interview, the questioner implies that specific
responses are to be expected because they reflect prevailing norms, i.e. male, white,
middle-class values.
Peacock effect
The Peacock effect is the name given to the behaviour of some male birds among
females when they display their plumage or attributes. Some young men may behave
similarly in the presence of young women.
How can the impact of Hawthorne and other research effects on research be
reduced? Four strategies can be adopted:
Research effects will inevitably bias the research. Bias is essentially a predisposition
or prejudice for or against a theory, person, group or institution which may distort or
skew cognisance and interpretation of phenomena. However, your greatest source
of bias may be your very own researcher’s bias.
Researcher’s bias
You are unlikely to begin your with an open mind. Your choice of research
topic, question and starting hypothesis will reflect deep-seated values and prejudices.
18 Research Methods in Politics
Finally, [the researcher] must realise that he is biased, and somehow or other he must
manage to discover this bias …
‘Know thyself’ is the maxim uniquely imperative on the investigator of social institutions.
For the greatest obstacle to the advancement of knowledge – is an obstacle in the mind
of the student, the presence of biases.
(Webb, B., and Webb, S., 1975: 31 and 44)9
1. Identify the extent of your own prejudices using the Table 2.1 below. You can
copy the full table from the web-site www.sagepub.co.uk/pierce. Add your own
categories. Distinguish between your immediate (private) feelings and your (public)
thoughts. Try to identify their source. Are they derived from others (e.g. parents
or friends), intellectual inquiry or experience? How have they changed over the
years? Why?
2. You have been asked to undertake a survey of electors to find out whether non-
voters in general elections differ in their (other) characteristics from voters and
whether they are serial abstainers. What ethical difficulties do you anticipate? How
would you tackle them? What are your own starting prejudices?
3. In the course of your fieldwork, you discover a continuing case of child sexual
abuse. You have given an undertaking of confidentiality. What should you do?
4. Obtain a copy of your own department’s code of research ethics. What criticisms
would you make? How should it be improved? OR, if a code is ‘pending’, write a
draft.
Power in Research, Ethics, Data Protection and Bias 19
FURTHER READING
Berg, B. (2001) Chapter 3: Ethical Issues. In Qualitative Research for the Social
Sciences. London: Allyn & Bacon. pp. 39–65. Berg reviews the historical
development of ethical concerns in research from a US perspective with
particular emphasis on the role of Institutional Review Boards (IRBs). He
identifies how and why disadvantaged groups are more accessible to
researchers than privileged elites.
Burnham, P., Grillard, K., Grant, W. and Layton-Henry, Z. (2004) Chapter 11:
Ethics and Political Research. In Research Methods in Politics.
Power in Research, Ethics, Data Protection and Bias 21
Notes
1 Reinharrz (1984) p. 95 cited by Oakley, A. (2000) Experiments in Knowing: Gender and Methods in
the Social Sciences. Cambridge: Polity Press. pp. 37–8.
2 The Economic and Social Research Council (ESRC) funds research and training in social and
economic issues. It claims an international reputation both for providing high-quality research on
issues of importance to business, the public sector and government and for commitment to training
excellence, which produces world-class social scientists. ESRC is an independent organisation,
established by Royal Charter, but receives most funding through the Government’s Office of
Science and Innovation. Its budget of £181 million (2007/2008) funds over 2,500 researchers in
academic institutions and policy research institutes throughout the UK.
3 Significantly, whilst the British (Labour) government supported the application of The Convention to
recently-liberated, continental states, it resisted its application to the UK on the grounds that history
had shown that it was unnecessary and that it might impede the government’s programme of
post-war regeneration including large-scale nationalisation and economic planning. The
Convention was finally only adopted by the Human Rights Act, 1998. Jacobs, F.G. (1978) European
Convention on Human Rights. Oxford; Clarendon Press. p. 214.
4 EFTA: European Free Trade Area: formerly a seven-state free trade area now reduced to the
non-EU states of Iceland, Liechtenstein, Norway and Switzerland.
5 Roethlisberger, F.J. and Dickson, W.J. were Mayo’s principal associates.
6 Mayo, E. (1949) Hawthorne and the Western Electric Company. London: Routledge.:p. 60
7 Scientific management was originated in the 1890s by Taylor, W.F. who argued that productivity of
workers could be increased by the marriage of science, engineering and classical economics to
achieve greater organisation, specialisation, de-skilling of tasks and the use of bonuses. It is
associated with ‘time-and-motion’ regimes.
8 Franke, R.H. and Kaul, J.D. (1978) The Hawthorne experiments: first statistical interpretation,
American Sociological Review, 43: 623–43.
9 Webb, S. and B. (1932/1975) Methods of Social Study. LSE: Cambridge University Press. The
Webbs were founder members of the Fabian Society and the London School of Economics.
Chapter 3
The Philosophy and Principles
of Research
Introduction
Positivism
Empiricism
Empiricism is, simply stated (and at its most extreme), the doctrine that the only
source of real knowledge (‘the facts’) is experience gained by the senses through
observation and experiment. Only the observable can be observed and measured.
Emile Durkheim (1858–1917) is widely regarded as a foremost empiricist in his
advocacy of the scientific study of social facts (objects of analysis particular to a
social science discipline). The empirical research for which he is best known is his
comparative study of suicide to determine its causes (Suicide, 1897). He regarded
suicide as the ultimate outcome, an event unique to the individual. Using official
records and by analysing these for ‘empiric regularities’ (patterns and correlations),
The Philosophy and Principles of Research 25
Behaviourism
Behaviourism is a school of psychology associated with Harvard professor B.F.
Skinner (1904–90). He was the architect of the controllable ‘Skinner box’ and
‘programmed learning’. Its key tenet is that only observable behaviour may be
scientifically studied. So, while behaviour may include speech, intentions and
mental processes must be disregarded as ‘unobservable’. Behaviourism is associated
with animal experiments and the application of causal relations, e.g. Pavlov’s
dogs, to operant conditioning and behaviour modification. This emphasis on
experimentation and statistical analysis led some empiricists to subscribe to the ideas
of eugenics (the science of heredity associated with proposals for scientific breeding
to reproduce ‘higher’ intellectual characteristics and to exclude genetic weaknesses)
promoted by Darwin’s cousin, Galton (‘whenever you can, count’). Indeed, the
UCL professor, Professor Spearman, who devised the widely used Spearman’s
coefficient of correlation, r, was a leading eugenicist (and early socialist). Today,
Skinner’s contribution has become superseded by greater support for ‘cognitive
learning’.
Behaviouralism
Behaviouralism (note special spelling) was the term adopted by social and political
scientists for the application of positivism and empiricism to test and extend
explanatory theory at the level of state, party or other group, or individual.
In particular, the new approach offered a progressive approach to those academics
critical of the discipline’s obsession with the ‘old institutionalism’ of the study of the
structures of government. It became the dominant approach of politics – especially
in the US – in the post-war period. The approach is characterised by its greater
use of: theoretically derived hypotheses; sampling; early use of computers for data
collection and analysis; statistics; and belief in replication. Its principal exponent
remains Robert Dahl whose 1950s study of New Haven, Connecticut (described in
Who Governs?) remains the classic example of behaviouralist research. It demonstrates
the strengths and weaknesses of the approach.7
Dahl sought to explore two, rival hypotheses: the elite theory view (‘of European
origin’) that a unified oligarchy governed US cities (as argued by Hunter from his
study of Atlanta and C. Wright Mills’ Power Elite); and the (alternative) pluralist
26 Research Methods in Politics
theory that urban political systems were polyarchic. In his introduction, Dahl
noted the extreme variations of income and educational attainment, property
ownership and material environments in the US and asked: ‘Given the existence
of inequalities like these, who actually governs in a democracy?’. The research
problem which Dahl faced was how to observe and measure power and influence.
He chose what he called an ‘eclectic approach’ which spread the risk of unreli-
ability of data over six separate sources of information and methods of analysis,
namely:
the most supreme and insidious use of power which prevents grievances by shaping
people’s perceptions, cognitions and preferences in such a way that they accept their
role in the order of things.
(Lukes, 1974: 24).11
Furthermore, the ‘counterfactual’ (what you would have expected to happen but
didn’t) was - like Sherlock Holmes’ ‘dog that didn’t bark’ in Conan Doyle’s Silver
Blaze – evidence of the exercise unseen of third-dimensional power.12 But the
de-bunking of Dahl’s empiricist, behavioural model was not accomplished alone
by new, theoretical argument. As a noted pluralist and supporter of the ‘American
dream’, he has been criticised for wishful thinking and ‘seeing what he wanted to
see’. More recently, a systematic re-analysis of Dahl’s data has suggested serious
methodological and interpretative weaknesses. These were that: the survey samples
were not representative; Yale University was a much greater power-player than
(its professor) reported; he too readily accepted the ‘truth’ of interview statements
by the mayor and others which other documentary evidence contradicts; and he
was not sufficiently sceptical (Domhoff, 2005).13
Behaviouralism has become widely criticised in recent years. Three main criticisms
have been made. First, the emphasis on deduction meant that research became
‘boxed-in’ from developing new theory. Second, it tended to concentrate on
more readily measurable phenomena rather than other, more relevant topics
(Sanders, 2002: 52).14 And, third, important theoretical concerns and nuances were
unexplored or overlooked.
Naturalism
Feminism
Feminism offers another, additional critique of positivism: ‘that the concern with
measurement and control underlying quantitative, experimental ways of knowing
developed is part of the same social process which enables men to exercise power
over women’ (Oakley, 2000: 16).15 Feminists point to the historical association
between quantification and masculinity. Social science defined society in terms of
male values which reflected historic power relations in society where women were
simplistically categorised. Feminists argued that the relation between researchers
and researched reproduced the power relations between men over women. They
argued that relations between researchers and subjects should be consensual and that
greater weight should be given to ethical considerations. The subjects should be
empowered by the research process. Research should therefore be an emancipatory
project: ‘research for women not about them’. Feminist perspectives of research were
strengthened by increasing public opposition to experimental research, especially
involving animals, to which women were the main opponents. But the eminence
of qualitative methodology has been marked paradoxically by the divergence
between those traditional and new feminists. The traditionalists continue to promote
exclusively qualitative method. The new feminists (and others) argue that the real
conditions of women and other exploited, powerless groups can be more effectively
exposed by greater use of quantitative data, especially by harder, objective data on
the distribution of low pay, poverty and unwaged work (especially parenthood).
The Philosophy and Principles of Research 29
Prototypical examples of new feminist research in Politics are the published works
of Norris (1995, 1999) and Lovenduski (1995).16
Post-modernism
Causality
Post-modernism does not entirely dismiss the concept of causality (‘cause and
effect’ or causation) as a basis for explanatory theory: it argues that the world
is chaotic, rather than a closed system, in which causes and consequences cannot
be identified. Many post-modernists therefore adopt functional, structural, historical
or interpretative explanations where, for example, a functional explanation of poverty
might be because it ‘works’. But causality is central to all the main approaches used
30 Research Methods in Politics
in Politics research where causes are sought to explain effects. In emergent, everyday
English, causes are often referred to a ‘drivers’. But, in academic research, causes
and effects are generally called variables where:
Cause and effect appears straightforward. For example, from the report or observa-
tion: A knocks over B, then you can claim that A is the cause of B’s falling over. But
how do you know that A is not responding to B’s behaviour or seeking to protect
C? The social world and political world are incredibly complex. Unlike, say, nuclear
physics, the subjects of Politics research are sentient human beings exercising some
agency (personal autonomy) within a structure (rules of the game). The degree of
agency will vary with the individual context. Assume, for example, that a university
teacher, A, appears increasingly exasperated by student B. A raises a clenched fist
directly to B’s nose. What will happen? Well, you don’t know what will happen.
You can only speculate. A may or may not hit B. B may adopt a passive response
and accept ‘whatever happens next’. Or B may take pre-emptive action by either
moving or striking first. They may strike back if hit. But the choices of A and
B are both contingently structured by the teacher-student power relation, gender
relations, academic regulations and criminal law.19
There is therefore a substantial risk that the researcher may identify, incorrectly,
causes merely because they appear to immediately precede apparent effects. This
fallacy is termed post hoc, ergo propter hoc (‘after this, therefore because of this’). This
problem was considered by the Scottish Enlightenment philosopher, David Hume
(1711–76). He dismissed the claim that causes necessitate the events that are their
effects. He also refuted the argument that cause could be determined by reason alone.
The belief that flames are hot can only be based on sensory experience, custom and
practice. He developed eight ‘general rules’ which must be met before ‘probable
causation’ could be claimed.
8. An object which exists for any time in its full perfection without an effect, is not the
full cause of that effect …20
After Hume, five precise conditions have been specified for causation: covariation;
constancy of association; cause must take place before the effect; independent and dependent
variables must be discrete (rather than continuous); and non-spuriousness.21
Covariation describes the phenomenon where two variables appear to change
at the same time, for example, unemployment and poverty appear to increase or
decrease at the same time. The covariation can be plotted graphically and tested for
association (the degree of consistent relationship) by the statistical test of correlation.
However, ‘association does not necessarily equal causation’.22 And association does
not identify the independent and dependent variable. There are several ways that
variables may change at the same time. In social science, the cause is normally
indicated as x (from the Greek xenon meaning unknown) and the effect y. The causal
effect of independent variable x, on the dependent variable y, can be represented as
shown by the diagram:
x→y
However, another, independent variable, x2 may also be affecting y by the process
termed addivity:
x1 → y
↑
x2
Alternatively, x2 may be affecting x1 directly by the process of intervention:
x1 → y
↑
x2
Or x2 may act as a type of catalyst on x1 and y. This is termed interaction:
x1 → y
↑
x2
Finally, the association between x1 and y may be a spurious relation where they
are both being affected by x2 :
x1 y
x2
32 Research Methods in Politics
In practice, few causal relations in Politics research involve only one cause. Most
effects have many causes; and these causes will affect many effects. There is also the
argument that, even so, causes are only the tangible manifestation and agent of the
underlying distribution of power within society:
The flaw in the pluralist heaven is that the heavenly chorus sings with a strong upper-
class accent.
(Schattschneider, 1961: 35).23
Hume explained cause and effect in terms of billiard balls in which moving ball A
hits static ball B which is then propelled along the ‘green baize’. However, today
we would claim that, in Politics, the baize is not level and smooth but furrowed and
pitted, structured by institutions that affect the trajectory of the ball and frustrate the
trajectories of A and B.
However, in practice, the distinctions between deductive and inductive research are
blurred. In particular, the claim by inductive social researchers that their research
is a-theoretically grounded may be questioned. Can social scientists ever really ‘rid
their minds’ of the grand theories that they acquired in their earlier years? If they
really had no preconceptions or hunches, then how or why did they come to select
the phenomena for study? Can a young, white, male, middle-class, western social
researcher ever really ‘see the world through the eyes’ of an old, white, working-
class western woman let alone a Third World subject speaking an entirely different
language?
Grounded research was proposed by Barney Glaser and Anselm Strauss of
Columbia University in the 1960s as a new ‘third way’ derived from their critique
of the dominant tradition of deductive research in US sociology (Glaser and Strauss,
1995).21 In their judgement, US social researchers were pre-occupied with testing
hypotheses derived from the ‘grand masters’ of sociology: Marx, Weber, Tonnies
and Durkheim. Consequently, new researchers were not developing new theory to
explain the new social dynamics of a fast-changing, urban society. Most research
added only detail or embellishment. Social research had become insular and was
effectively overlooking new concerns. They were also critical of some of the claims
of a-theorocity of inductive researchers. At the same time, they were critical of
the cost and resource demands of large-sample quantitative data. They wanted to
34 Research Methods in Politics
develop a new approach which harnessed the skills and other resources of social
researchers to generate new, exciting, relevant and imaginative research.
The solution they devised was grounded research where the findings would
be entirely grounded in the data collected. The essence of grounded theory lay in
the selection by researchers of almost semi-randomised variables (for example, by
examining the contents of the ‘returned book trolley’ in the university library).
Rather than hypothesise specific causal relations, the researchers should first seek
out evidence of any relation. The initial sample and data would be limited. Their
findings would be grounded in that data, tested and re-formulated in further samples
until theoretical saturation were reached, when the additional data failed to reveal
any further significant findings. Importantly, ‘less was more’. It would no longer be
necessary to collect, at vast financial and opportunity costs, all the data before analysis
were attempted (with the temptation to overstate the findings to justify the costs).
One noted variant of grounded research is its application to deductive research by
adopting small, iterative samples to test hypotheses. However, despite the appealing
propositions put forward by Glaser and Strauss for ground-breaking ‘quick and dirty’
research, the criticism remains that, in practice, the selection of variables for scrutiny
invariably reflects the values and theoretical biases of the researchers. Additionally,
how can the researcher claim that the process is a-theoretical without reviewing
existing theory and the associated literature? How can they know that their research
is new and original?
The idealised grounded research model is:
Grounded research has great appeal to most British Politics researchers because it
avoids number-crunching and can be cited to justify a ‘thin’ theoretical review and
limited immersion in the field. Most researchers develop variants appropriate to their
research question.
FURTHER READING
Dahl, R. (1969) Who Governs? Democracy and Power in an American City. New
Haven: Yale University Press. pp. A new edition was published in 2005, ISBN
03001 03921. This is a well-written and detailed account of Dahl’s research
method and his interpretation of its findings. It remains a seminal work and
model for present-day researchers.
De Vaus, D.A. (2001) Chapter 2: Theory and Social Research. In Surveys in
Social Research. London: Routledge. pp. 11–26. This short account
summarises the interaction of theory and research, the process of theory
building and testing, and the sources of theory.
Glaser, B.G. and Strauss, A.L. (1967/1995) The Discovery of Grounded Theory:
Strategies for Qualitative Research. New York: Aldine de Gruyter. This very pacy
account provides the critique of contemporary research in the early 1960s from
which grounded theory was developed. As the American Sociological Review
claims: ‘The authors successfully transmit the sense of adventure, air of
excitement and of positive apprehension over what is discovered as one tracks
down clues and sorts [them] among attractive alternatives’.
Gubrium, J.F. and Holstein, J.A. (1997) The New Language of Qualitative Method.
Oxford: Oxford University Press. pp. 19–94. This 244-page textbook provides
incisive chapters on naturalism, ethnomethodology, emotionalism and
post-modernism including extracts from many case studies.
Marsh, D. and Furlong, D. (2002) Chapter 1: A Skin is Not a Sweater: Ontology
and Epistemology in Political Science. In Marsh, D. and Stoker, G. (eds.) Theory
and Methods in Political Science. Basingstoke: Palgrave Macmillan. pp. 17–41.
This chapter reviews the centrality of ontology and epistemology and the
divergent perspectives of positivism, interpretivism, and constructivism, and
demonstrates their application to case studies of globalisation and multi-level
governance.
36 Research Methods in Politics
Notes
1 Lacey, A. (1995) In Honderich,T. The Oxford Companion to Philosophy. Oxford: Oxford University
Press. pp. 145, 705–6.
2 Smith, M.J. (2003) Social Science in Question. London: Sage. p. 79.
3 The ‘natural sciences’ are generally considered to be astronomy, physics, maths, chemistry and
quantitative biology.
4 Smith, M.J. (2003) Social Science in Question. London: Sage. p. 81–2.
5 Williams, R. (1983) Keywords: A Vocabulary of Culture and Society. London: Fontana. pp. 238–9:
‘[positivism] becomes a swear word, by which nobody is swearing’.
6 The first ‘school of political science’ was established at Columbia in 1880: Burnham, P.,
Gilland, K., Grant, W. and Layton-Henry, Z. (2004) Research Methods in Politics. Basingstoke:
Palgrave Macmillan. p. 12.
7 Dahl, R. (1969) Who Governs? Democracy and Power in an American City. New Haven: Yale
University Press. A new edition was published in 2005, ISBN 03001 03921.
8 Dahl, R. (1969) Who Governs? Democracy and Power in an American City. New Haven: Yale
University Press. p. 331.
9 Bachrach, P. and Baratz, M. (1962) The two faces of power. In American Political Science Review,
56. ‘Dahl thereby excludes the possibility that in the community in question there is a group
capable of preventing contests from arising on issues of importance to it … [Dahl is] unable
adequately to differentiate between a ‘key’ and ‘routine’ political decision’.
10 This author’s own experience supports the claim that, in UK local government, the real decisions
on planning policy (but not planning applications) are made at the ‘pre-agenda’ meeting between
the (elected) executive members and the ‘officers’ (unelected officials).
11 Lukes, S. (1974) Power: A Radical View. London: Macmillan.
12 I experienced a counterfactual in my research on hegemony and social exclusion in rural England
where I note that the estate villages appeared to lack the war memorials that were characteristic
The Philosophy and Principles of Research 37
of the greens or crossroads of villages elsewhere. I found that the memorials had actually been
located inside the village churches – despite most of the casualties having been members of
Methodist chapels.
13 Domhoff, D.W. (2005) Power in America: Who really ruled in Dahl’s New Haven.
http:/sociology.ucsc.edu/whorulesamerica/power/new_haven.html (20.06.2006).
14 Sanders, D. (2002) Chapter 2: Behaviouralism. In Marsh, D. and Stoker, G. (eds.) Theory and
Methods in Political Science. Basingstoke: Palgrave Macmillan. p. 52.
15 Oakley, A. (2000) Experiments in Knowing: Gender and Methods in the Social Sciences.
Cambridge: Polity Press. p. 16.
16 Evans, G. and Norris, P. (1999) Critical Elections. London: Sage, and Norris, P. and, Lovenduski, J.
(1995) Political Recruitment: Gender, Race and Class in the British Parliament. Cambridge:
Cambridge University Press.
17 Neuman, W.L. (2003) Social Research Methods. Boston: Pearson Education. p. 89. Neumann
develops an alternative classification of social science into three paradigms: positivist, critical
social science and interpretative social science. He explains the latter as: ‘the systematic analysis
of socially meaningful action through the direct detailed observation of people in natural settings
in order to arrive at understandings and interpretations of how people create and maintain their
social worlds’ (p. 71).
18 Heywood, A. (2000) Key Concepts in Politics. Basingstoke: Palgrave Macmillan. pp. 101–3.
19 In UK criminal law, assault in ‘assault and battery’ refers to the perceived threat of battery by the
‘victim’.
20 Hume, D. (1739) A Treatise on Human Nature. 1: 467–8.
21 Glaser, B.G. and Strauss, A.L. (1967/1995) The Discovery of Grounded Theory: Strategies for
Qualitative Research. New York: Aldine de Gruyter.
22 Voight, P. (1999) Dictionary of Statistics and Methodology. London: Sage. p. 58
23 Schattschneider, E.E. (1961) The Semisovereign People: A Realists’s View of Democracy in
America. New York: Holt, Rinehart and Winston. p. 35.
24 Honderich, T. (ed.) (1995) The Oxford Companion to Philosophy. Oxford: Clarendon Press.
pp. 405–6.
Part II
Methodologies
Chapter 4
Qualitative Versus Quantitative
Methods: A Relevant Argument?
‘Quantitative research is hard and reliable … qualitative research is deep and rich’
(Bryman, 1996:94)1
‘Qualitative and quantitative methods are more than just differences between research
strategies and data collection procedures. These approaches represent fundamentally
different epistemological frameworks for conceptualising the nature of knowing, social
reality, and procedures for comprehending those phenomena’.
(Filstead, 1979:45)2
Introduction
The greatest strength of quantitative method lies in its general acceptance by others
as being rational, logical, planned and systematic. The findings are regarded as
credible. This method is therefore particularly favoured by public, research-funding
bodies keen to justify their investments to a sceptical public. It is also preferred
by news media whose audiences, they claim, regard percentages as ‘hard news’.
Therefore quantitative method, however complex the statistical methods employed,
is regarded as being straightforward and providing the facts. The researcher is seen
as dispassionate, objective and, therefore, trustworthy. It employs very large samples
designed to reflect and be representative of the population being studied. The use of
questionnaires ensures that every member of the sample is asked the same question in
the same manner. Supporters argue that attitudes can be measured by using scales, e.g.
the Likert scale of strongly agree, agree, etc. (see Chapter 9). Face-to-face contact
is not necessary and may contaminate the data. Research objects are best kept at
arm’s length. Geographically remote or immobile people can be surveyed by postal
survey, telephone or internet. Quantitative method makes best use of computers
and other new technology. So the time-scale for data analysis and the publication of
findings can be relatively short. Furthermore, the data can be re-examined, audited
Qualitative Versus Quantitative Methods: A Relevant Argument? 43
and re-analysed or used for other purposes. The process of analysis is overt in which
the scope for bias by the researcher is deliberately minimised. The method enables
research projects to be carried out by teams in which specialist talents can be properly
exploited and work sub-contracted to agencies. Quantitative research effectively
conforms to the modern-day business model.
In terms of academic research, quantitative method is particularly suited to
the development of grand, meta and micro theory by testing logical hypotheses.
Applying Popper’s tests of falsifiability ensures that the research hypothesis can only
be accepted after all alternative hypotheses have been disproved. It offers the best
means of identifying and comparing the distribution between people, places and
times of phenomena such as party membership, voting, income, poverty, housing
conditions, and changing attitudes. It can also be used to identify clusters of
relatively small-scale phenomena and to analyse these statistically to identify whether
44 Research Methods in Politics
can be devised and statistical analysis applied to produce findings within specified
confidence limits. Questionnaires can be designed with sufficient checks and controls
to identify bias by respondents and questioners. Most concepts are capable of being
represented by measurable indicators. Subconscious feelings and motivations can be
identified by using projective questioning (see Chapter 9). Quantitative method accepts
its own fallibility which its users consciously seek to minimise. Most variables are
capable of observation by trained researchers using modern technology. At the end
of the day, quantitative research is reliable and concrete and has ‘put the science’
into Politics to create political science.
This is the dominant approach adopted in UK Politics research. This choice reflects
in part the lack of confidence of many UK researchers in their quantitative skills.
In the main, qualitative method is preferred because it is considered best suited to
the study, understanding and explanation of the complexities of social and political
life. The strength of this method lies in its unique capacity, through in-depth
interviewing and observation, to learn and understand the underlying values of
individuals and groups. It better enables theory to be created by induction. By
learning the social meanings that the subjects apply to their world, researchers
are better able to ‘see the world through the subject’s eyes’. So researchers can
identify and understand the interpretative lens that subjects adopt, and, therefore,
the dominant powers and institutions that frame the view and tint the lenses.
Essentially, politics takes more than one person: it is an intra- and inter-group
activity. Qualitative method enables the focus to be shifted from the individual
to the group(s) and to learn (following the theories of Goffman and others) how
meanings are negotiated between members and the group dynamics involved.6
It allows comparisons and distinctions to be drawn between what the individual
says in the privacy of a personal interview and what they say, or don’t say, in
a group. Furthermore, the varied opportunities for participant observation, along a
continuum between thresholder and full member, allow degrees of access to the group.
The method also enables minorities to be researched who would otherwise be
missed by sample surveys because they are either small in number or might be
unwilling to identify themselves. Covert groups include homosexuals, drug-users,
gang-members, and terrorists and their supporters. The method avoids distance and
objectivity by seeking verstehen (empathetic understanding). Many of the researchers
are also (critical) activists. They seek to expose exploitation and to improve the lives
of their subjects through policy change. They want to assist their subjects to see
their circumstances through other perspectives and lenses, and to develop their own
interpretations. They seek to empower their subjects through the research process.
There is therefore a normative dimension to qualitative method that quantitative
46 Research Methods in Politics
method lacks and, for that matter, avoids. The method also offers a greater focus on
verbal and other communications and the application of linguistics to the analysis.
Sophisticated (digital) recording devices enable the data to be shared with other
researchers. New, miniaturised technology allows fieldwork to be carried out in the
homes and workplaces of their subjects in a more surreptitious way. So the subjects
are not inhibited by the equipment and contingent variables are less affected.
available full transcripts and other records of interviews and group meetings for
corroboration. There is a full paper trail available for audit purposes and external
examination. The research method provides the only means by which overlooked or
concealed minorities can be studied. In this way, their needs for special recognition
can be addressed by policy-makers before continued rejection leads to outright
dissent. The emphasis on studying subjects in their own habitat means that contingent
factors can be identified and the research effect (see Chapter 2) minimised. It recognises
that language is never neutral: ‘every word is a bias’ (Nietzsche). The normative
opportunities should be welcomed rather than criticised: research should improve
the circumstances of its subjects. The method acknowledges the central role of
the researcher in the research rather than pretending that this can be eliminated.
Quantitative method does not readily enable group behaviour to be studied. Overall,
qualitative research provides high quality data and findings, and deep, meaningful
insights into underlying values, fears and motivations of agents and actors in the
political world.
Mixed methods
Given the separate strengths and weaknesses of quantitative and qualitative methods,
then using them together – mixed methods – would appear to offer the best of
48 Research Methods in Politics
both worlds. But, given their opposing ontology and epistemology (see Chapter 3),
the criticism could be made of the lack of scholarship and the inevitable theoretical
weaknesses of seeking to mix oil and water. Alternatively, the criticism could be
rebutted as being too esoteric and academic and of overlooking the advantages,
especially of time and other costs, of bringing the two methods together when
the opportunities arise. The justifications cited for a mixed approach could include
synergy, corroboration of sources and data triangulation (see Chapter 7).
The received view among research practitioners tends to be that the differences
between the methods have been exaggerated. However, there remains strong
objection to a ‘mix and match’ approach. Instead, the use of combined methods
can be better accepted as appropriate where one method dominates and the other
is used in a secondary, supportive way.
Two examples of appropriate combined methods can be given. Both concern
research into voting behaviour.
UK election turnout has fallen since 1951.The research question is: why has turnout fallen? It
adopts a positivist, deductive approach in which Crouch’s theory of post-democracy is used
and tested. The research seeks to test Crouch’s argument that turnout has fallen because
globalisation and the decline of industrial production have loosened the previous sense
of antagonistic social identity and class. So the appeal of unions and political parties has
weakened and reduced support for active participation. Instead participation has once again
become an elite activity by ‘self-referential political class more concerned with forging links
with wealthy business interests’ (Crouch, 2004).7 In this case, the proxy-indicators of active
participation selected are: membership of parties and unions; attendance at political etc.
meetings; holding office; and, voting. The data will be collected from national published
records of voting and party, etc., membership since 1951. This population data will be
augmented by a national, postal questionnaire sample of a stratified sample of say 2,000
electors (following a pilot survey). It may offer hard, reliable evidence of changes in voting
behaviour, class consciousness and party identity and participation. Analysis is likely to
show a strong correlation between the decline in participation and loosening of political
identity. But it will lack compelling evidence of causal relations. In this case, the data could
be supported by interviews with a small sample of activists and non-activists to learn of their
personal experiences and to tease out their changing motivations. This qualitative data could
either be sought before the questionnaire survey to help frame the questions and alternative
answers, or afterwards to explore particular findings. In either event, ‘quotable quotes’ could
be incorporated into the research report to illustrate the findings and to create interest. The
report is likely to conclude with a discussion of the implications of the findings for ‘democracy’
and electoral reform.
Qualitative Versus Quantitative Methods: A Relevant Argument? 49
The second example also concerns the fall in UK turnout since 1951. The research question
remains the same although expressed in a slightly different way: why are more people
abstaining from voting? But this time, the research is inductive: there is no hypothesis to be
tested. The researcher is not seeking one explanation but a number of reasons applicable
only to the persons concerned. In this case, the researcher will interview a sample of people
in depth to learn what participation and voting means to them. The sample will not seek to
be representative of the population. Whilst the researcher will hope to build explanations
there is no expectation that a law of electoral behaviour will emerge. The researcher will also
interview and observe meetings of groups of people to learn how and if group norms are
negotiated and peer pressure exerted. In this case, these interviews could be supported by
evidence of the extent of abstention and classifications drawn from official records and the
British Election Survey. This quantitative data will quantify the incidence and extent of the
behaviour rather than to give explanations.This research is unlikely to stop at the explanations
gleaned. It will consider the implications for the individual and groups and to suggest how
the processes of participation and articulation should be improved to benefit abstainers.
FURTHER READING
Notes
Introduction
Choice of method
The single case study is the essential ‘building block’ of empiric research. It must
provide the basic minimum of information to enable the research question to be
answered and the research hypothesis to be tested. It is a sample of one. Historical
research may define the case study and its scope. For example, the research question
‘why did the TUC halt the British general strike of 1926’, will concentrate on the
specific events leading to the general strike and its conduct. The difficulty here
will be to decide when the ‘events leading to’ actually began and the main actors
involved over this timescale. The law of diminishing returns may be evidenced when
the marginal cost of further interviews becomes greater than their benefit to the
research, and where opportunity costs are high. On the other hand, research into, for
example the causes of strikes in the UK car industry post 1997 may focus, in the
first instance, on a single company or a plant within that company.
Self-containment and typicality are important requirements for an effective case
study. Self-containment means that the variables being researched should be clearly
distinguishable and be relatively unaffected by complex external factors. The case
study should also be typical of the range of other potential case studies. So conscious
choice – rather than blind or random selection – is required. It is therefore important
that the initial preferred case study should itself be carefully ‘researched’ before the
choice is confirmed. This initial examination should show that the case is not affected
by other, exceptional factors. It should also show whether the necessary access to key
individuals and other sources of data is likely to be achievable. You should also find
out whether the group or location has been researched before: frequent prior research
may have ‘poisoned the well’ of information and left people uncertain of their ‘social
reality’. Insertion and immersion (i.e. prolonged exposure) in the proposed case study
early in the research process is therefore essential if disappointment, or even failure,
is to be avoided.
However good the fieldwork, the quality of data and its analysis, the great
weakness of a single case study remains that its generalisability – and therefore its
54 Research Methods in Politics
Experimental research
hypothesis – that the change from traditional to all-postal balloting would increase
turnout – appeared confirmed. The outcome supported the rational choice
interpretation of voting behaviour (in which reducing barriers and costs of voting
would increase participation). However, other factors may have contributed to the
increase in turnout. In particular, the local authorities undertook substantial publicity
campaigns in the local press, radio, television, billboards and additional mail-outs to
electors. So significant Hawthorne and Pygmalion effects cannot be discounted. I also
suspect that pilot tests generally tend to realise higher improvements beyond those
likely to be attained when the initiatives are extended nationally. This pilot effect
may be attributed to the original selection of the pilots for their greater suitability
and the additional resources made available including the greater involvement of
leading officials. Subsequently, complaints were made to the police that applications
for postal voting in marginal wards had risen by 500%. The police investigations
led to trials and convictions in a small number of cases. Subsequently, in August
2004, the Commission recommended that the system of all-postal voting should be
discontinued because, in the absence of the reforms it had recommended for voter
registration, postal voting was vulnerable to abuse.5 Yet its earlier statutory reports
had stated that ‘it was unaware of any allegations of fraud and malpractice …’.
Comparative research
To sum up the facts thus cited. The great towns are chiefly inhabited by working people,
since in the best case there is one bourgeois for two workers, often for three …; these
workers have no property of their own, and live wholly for wages, which usually go from
56 Research Methods in Politics
hand to mouth … every working man is therefore constantly exposed to loss of work
and food … The dwellings of the workers are everywhere badly planned, badly built, and
kept in the worse condition, badly ventilated, damp, and unwholesome … The average
is nearer the worst case than the best.
(Engels, 1993/1845: 85–6)
His comparison of the ‘great towns’ enabled him to conclude that the conditions
were universal within British industrial towns and cities. The causes were therefore
not local, specific to different sectors of industry or otherwise contextual. He
concluded that the cause of these common conditions were state-wide: competition
between workers and Irish immigration. He then investigated these causes in turn,
extending his research to the ‘mining proletariat’ and the ‘agricultural proletariat’
and concluded that ‘The war of the poor against the rich … will become direct and
universal [i.e. not confined to Britain]’ (Engels, 1993: 302).
Engels’ research demonstrates many of the purposes (reasons) for undertaking
comparative politics research:
1. to provide rich, contextual descriptions which identify clearly the observed similarities
and differences between cases and places
2. to identify and develop systems of classification and typologies which generate data
sets appropriate to the research question
3. to distinguish independent variables (causes) from other variables
4. to test hypotheses and, thus, the validity of explanatory theories
5. to develop predictive capacity where, for example, there is evidence of stages of
development.
The selection of cases for comparative research depends on the number of variables
to be examined, the availability and access to related, comparable data, data format
(numeric or non-numeric) and the means of analysis to be adopted. Elementary
algebra has taught you that the value of two variables cannot be found from a single
equation: two, simultaneous equations are required. At least one case is required
per variable. Similarly, algebra and logic has taught you that you cannot compare
apples and pears: the data to be compared must be measures or descriptions of the
same variable. They must also be equivalent to the variables being examined. The
cases to be selected must offer the same data sets over the same periods. But data
need not be numeric or quantifiable. It can equally well be binary (e.g. yes/no,
democracy/non-democracy, etc.) or nominal (e.g. the name of the state).
The method of comparison to be adopted will determine the cases to be selected,
and the size of the sample relative to the size of the population. The three most
widely-used methods of comparison are Mills’ method of agreement, method of difference
and method of concomitant variations.
Collecting Data Sets 57
In this group of cases, only a is common to all cases where the outcome is y. So
a appears to be the cause/independent variable.
The method of difference is the converse of the method of agreement. It is
generally regarded as more practicable (easier). Here, similar cases are chosen for
their different outcomes, e.g. single-party or coalition governments. The potential
variables are sought and listed. Where the absence or presence of one variable is
associated with specific outcomes, then that variable may be concluded to be causal:
In this example, variables b, c and d can be seen not to effect the outcome whereas
variable a appears to be the cause of outcome y and variable p appears to cause
outcome z.
The method of concomitant variations is used where the magnitude of the
potential cause appears associated with the magnitude of the outcome. For example:
can be made between offices (e.g. foreign ministers), events (e.g. devaluations, civil
wars), policies (e.g. privatisation), organisations (e.g. NGOs) and ideologies.
The size of sample will also have a bearing on the degree of certainty to be attached
to the findings. Ideally, the entire population of, say, OECD states should be chosen.
Population-wide data is now more readily available especially via the internet. Where
a sample of the population is used, then there may be a suspicion that cases which
do not support the hypothesis have been deliberately excluded. For example, the
comparative research carried out by Przeworski et al (to answer the research question
‘what makes democracies endure?’) used a large sample of 135 states over the
period between 1950 and 1990 (Przeworski et al, 1996).8 But a comparatively small
number of UN member states were omitted. They included the oil-producing Gulf
states, where, with western support, feudalism continued to prevail. The necessary,
compelling defence against criticisms of selection bias was not made.
The potential samples can be categorised as small-n or large-n, i.e. a small or
large sample of the population, N. As previously noted, the size of sample must be
no less than the number of potential independent variables to be investigated. A
small-n sample is more appropriate for qualitative research where a more intensive
level of investigation is proposed, generating rich, thick descriptions, and where the
focus of analysis is differences or similarities of outcomes. The small sample enables
Mills’ method of similarity or difference to be used. These methods are termed
most similar systems design (MSSD) or most different systems design
(MDSD). Comparative research using small samples is called case-orientated
analysis. Generally speaking, the optimum size for small-n samples is 15.
In contrast, a large-n sample is used to enable a limited number of potential
independent variables to be identified by statistical methods (including regression
analysis and discriminant analysis) from a very large number of cases. It is termed
variable-orientated analysis.
The decision whether to adopt small or large samples for comparative politics
research will, as ever, depend upon time and other resources and access to reliable
data. Each has its strengths and weaknesses. Large samples enable computer-driven
statistical techniques to be adopted and levels of confidence to be determined.
A higher level of abstraction is permitted. Unusual cases are more likely to be readily
identified for further examination. However, the level of abstraction may be too
high and superficial and the available data may not properly represent the variables
under consideration. Data collection standards may also vary between cases. A more
profound understanding of advanced statistical analysis may be required. At the end of
the day, the acceptance of the research findings will depend on the reader’s readiness
to accept statistical methods. By comparison, small samples offer thick description, a
lower level of abstraction, intensity and analysis of differences and similarities which
the reader is more likely to follow and accept. But the suspicion of selection bias
may be difficult to refute. One solution may be to combine both methods in which,
say, a large sample is first used to identify apparently key variables, which are then
Collecting Data Sets 59
Table 5.1 Selected average annual rates of growth of GNP per capita,
1965–90
tested against a smaller sample from which the influence of the variables may be
more properly understood.
One topic of intensive comparative politics research is the relationship between
democracy and development. This is illustrated in Table 5.1.9
The democracy-development link is the holy grail of western, comparative
politics and development research. The findings thus far vary. For example, Moore’s
comparative qualitative study (1966) of the paths to modernisation of Britain, USA,
France, India, Japan and China concluded that, where the new bourgeoisie and
progressive landowners combined, then democracy was more likely (Britain and
USA).10 But where the traditional elites were unable to meet the peasants’ demands,
then communism would prevail (China). Finally, where traditional elites were
able to frustrate democratic institutions, then fascism was possible (Japan). In the
post-war period, the prevailing view, especially among colonial powers, was that
democracy would hinder development. Democracy (decolonisation) would best
be the child of development only when higher levels of literacy, civil society and
class formations had been achieved. Indeed as Table 5.1 shows, states achieving
higher levels of economic growth 1965–90 included China, Taiwan and South
Korea. A critical, comprehensive review of the published comparative research is
provided by Landman (2003).11 He distinguishes between large-n and small-n samples
and qualitative and quantitative inquiry. He shows that the large-n studies carried
out by such luminaries as Lipset, Dahl and Przeworski support both ‘weak’ and
‘strong’ conclusions where, respectively, democracy is associated with development
and development causes democracy. Wealthy democracies are more likely to endure.
Small-n, quantitative research either supports the ‘weak version’ (i.e. association) or
60 Research Methods in Politics
Longitudinal research
date of birth, or membership of a particular school class. In this type of survey, each
of the subjects is interviewed separately for every year or period of years. Those
who leave (by death or migration) are not replaced. You will find it very difficult
to complete successfully in urban areas where the residents frequently move homes
and jobs, or change family names on marriage or divorce.
The most widely-used longitudinal research data is collected by panel surveys.
A panel is a set of subjects chosen to be representative of the population under
study. For example, the government-sponsored British Household Panel Survey
(BHPS) – begun in 1991 – involves an annual survey of all the adults within 5,000
randomly selected British households.12 However, the term panel can be misleading:
unlike common usage, the members of the panel do not meet together. Each
is interviewed separately using a highly-structured questionnaire. When children
in the selected households reach 16 they are added to the panel to replace those
who are lost through death, illness or disappearance (which may include either
withdrawing consent or moving contact address without telling the researchers).
BHPS is carried out by the Institute for Social and Economic Research incorporating
the ESRC Research Centre on Micro-Social Change at Essex University. Each
cross-sectional survey is termed a wave. The BHP survey for 2006 was called
‘Wave 14’. Ideally, a panel survey should seek to ask the panel members the same
core questions at every wave to enable comparison to be made of changes of
attitude or behaviour over time. However, new questions can be added. The panel
may also be increased to ensure better representation of minorities. For example,
in Wave 9, the membership was increased in Wales to enable attitudes towards
the Welsh language and national identity to be monitored. The data gathered
by BHPS is available for inspection and use at the ESRC Data Archive at Essex
University.13
Another authoritative source of longitudinal research data is the British Election
Survey (BES) funded by ESRC and the Electoral Commission, and carried out at
each British general election. A new panel is recruited by random sampling at every
general election. Members of the panel are interviewed before and after the election.
BES 2005 interviewed 4,700 British electors. It gave special attention to the issue of
(falling) turnout and (increasing) abstention.14 Panel survey data is also collected – on
a near-monthly basis - by the EU commission and published in the Eurobarometer.
New panels are recruited by stratified, simple, random sampling (see Chapter 7).
Eurobarometer 65.2, published in Spring 2006, included data from a British panel of
1,312 electors.15 A particular concern for the EU is tracking the movement of pro-
and anti-EU sentiment among nationalities in the 25 member states. Elsewhere, the
Panel Study of Income Dynamics (PSID) provides a comparable example of US
longitudinal research.
Longitudinal Politics research can be time-consuming and costly. Sponsorship
by some government research agency is therefore likely to prove essential in order
to provide a panel large enough to produce good, representative data. The great
62 Research Methods in Politics
advantage is that this data is available for re-analysis and use by the Politics researcher.
Why collect new information when good data is already available?
Action research
Action research is derived from critical social theory whose central aim is
the emancipation of society (rather than mere description or explanation). The
researcher focuses on the myths and contradictions, e.g. ‘women’s work’. A common
maxim is: ‘reports don’t change policies … it is people who will change them’.
Action researchers therefore tend to seek out underprivileged groups and work
with and among them to enable them to recognise and overcome the institutional
barriers which prevent them from self-actualising (achieving self-fulfilment). The
groups may be Travellers, migrant families, illegal immigrants, gays and lesbians,
former prisoners, and other, pariah groups. The researcher is a passionate, committed
activist. Researching the group means sharing their lives, experiences and indignities.
It can be a high-risk undertaking for you and for your co-participants. The risk is
particularly great for the participants when they challenge the institutions which
have served dominant groups. The danger is that you may lead the group into
harm’s way or raise expectations which cannot be achieved. The involvement of an
experienced supervisor is therefore essential if some form of emancipation, rather
than repression, is really to be achieved.
The task facing the action researcher is difficult. You will face problems obtaining
access to the subject group and establishing mutual trust. Funding is problematic.
The UK Community Development Programmes lost funding when they criticised
the government’s funding ministry and its local allies. Your task is to enable the
subject group to ‘think (and discuss) the unthinkable’, to identify potential actions
and to implement change.The arena of action research is the group meeting. Your
role here is to facilitate (enable) group identity to form and a new consciousness
of their social reality to emerge. In particular, you should gently prod the group
to re-examine institutions which have become regarded as ‘natural’ or ‘for the
best’. Examples may include the disproportionate burden of childcare borne by
women, restricted opportunities to education, or the classification and exclusion of
groups from mainstream programmes. Another role for you will be to carry out
those tasks which the group is unable, as yet, to accomplish. They may include
researching similar groups and activities, arranging meetings, taking notes, printing
and distributing leaflets, lobbying elites and representing the group at meetings with
dominant others. You should also train the group to carry on these activities for
themselves as part of the essential capacity-building exercise. This should form
part of your exit strategy which should also include a celebration of the group’s
activities. This event, like other social ritual, marks and announces to all the transfer
of responsibility to the group.
Collecting Data Sets 63
Because action research focuses on outcomes rather than process, there are
relatively few research reports. Publication is an anathema to many social action
researchers who would regard their own preferment as further exploitation of those
they seek to assist. However, writing-up and publishing action research projects is
justifiable for the insights they provide into the why’s and how’s of domination and
the success (or otherwise) of action to dismantle barriers. The increasing emphasis
in western polities on participation has led to a widening of research interest in
and funding for quasi-action research. A recent publication, Effective participation in
anti-poverty and regeneration work and research (Beresford and Hoban, 2005), assesses
the lessons drawn from UK initiatives to involve people with direct experience of
poverty in anti-poverty programmes.16 The study concluded that:
But there remains a strong suspicion that increasing western government interest in
public involvement seeks to smooth the process of policy change by co-opting and
thus neutralising potential losers.
1. You are researching the causes of local government corruption in England. Your
case study has identified new causes which are not included in the current
literature. What steps should you take to establish whether these causes were
unique to your case study or more widespread?
2. Can experimental research be wholly discounted in Politics? How might the impact
of various electoral innovations on turnout be evaluated?
3. You wish to carry out comparative research on the relationship between democratic
reform, economic policy change and changes in GNP per capita in the former
Warsaw Pact states in Eastern Europe after 1991. What sample and method of
analysis would you use? Why?
4. Gypsies in your locality are widely criticised for their exploitation of welfare services.
You regard the basis for this criticism and related hostility as a myth. A national
charity offers funding for social action research to improve the conditions of
Gypsies and other Travellers. Draft a research proposal setting out how you
propose to access this group, what roles you expect to pay, indicators of success
and your exit strategy.
64 Research Methods in Politics
FURTHER READING
Comparative research
Hopkin, J. (2002) Chapter 12: Comparative Methods. In Marsh, D. and Stoker, J.
(eds.) Theory and Methods in Political Science. Basingstoke: Palgrave
Macmillan. pp. 249–67. This chapter provides a good introduction to the
development of comparative politics, the comparative advantages of small-n
and large-n samples and the competing claims of quantitative and qualitative
comparative research.
Landman, T. (2003) Issues and Methods in Comparative Politics: An Introduction.
London: Routledge. This 292-page textbook is devoted to comparative research
in Politics. It begins by identifying and examining the reasons for using
comparisons, theory and method, units of analysis, and levels of analysis. This
is followed by comparing comparisons where the comparative research on a
range of significant topics is compared and evaluated. The topics are: economic
development and democracy, violent political dissent and social revolution,
non-violent political dissent and social movements, transitions from democracy,
institutional design and democratic performance, and human rights. It ends by
identifying the new challenges facing the sub-discipline.
Leftwich, A. (2000) States of Development: On the Primacy of Politics in
Development. Cambridge: Polity. pp. 127–51. This excellent, rich chapter uses
comparative data and published comparative research to abstract and examine
five main conditions for democratic consolidation: legitimacy; adherence to
rules-of-the-game; policy restraint by winning parties; poverty as an obstacle;
and ethnic, cultural or religious cleavages as constraints. He concludes
controversially by arguing that: ‘democratic politics is seldom the politics of
radical economic change’ (p. 150).
Mayer, L.C. (1989) Redefining Comparative Politics: Promise versus Performance.
London: Sage. pp. 1–46. The author identifies the epistemology of social
science and its implications for comparative research. The role of comparative
research is to suggest explanation of differences and similarities at state level.
He argues that the unique role of comparative research lies in its capacity to
‘identify two distinct objects for analysis: the attributes of individuals and the
attributes of whole systems’ (p. 42).
Pennings, P., Keman, H. and Kleinnijenhuis, J. (2006) Doing Research in Political
Science: An Introduction to Comparative Methods and Statistics. London: Sage.
pp. 1–51. Pennings et al is a challenging text. However, it uniquely provides
hard, technical explanation of the concepts behind comparative methods within
the discipline of Politics.
Collecting Data Sets 65
Przeworski, A., Alvarez, M., Cheibub, J.A. and Limongi, F. (1996) What makes
democracies endure? In Journal of Democracy, 7(1): 35–55. This is a very good
example of the application of comparative methods to international data sets.
However, as previously noted, the exclusion of Gulf-states from the large-n
sample compromises the generalisability of the conclusions.
Longitudinal research
Gilbert, N. (2003) Researching Social Life. London: Sage. pp. 275–9. This short
extract provides an authoritative explanation of panel, longitudinal and cohort
studies and an introduction to the main data sets available from US, UK and EU
sources.
Pennings, P., Keman, H. and Kleinnijhuis, J. (2006) Doing Research in Political
Science: An Introduction to Comparative Methods and Statistics. London: Sage.
pp. 166–79. This extract provides a higher-level introduction to the mathematics
of time series analysis and ways of diagnosing and reducing the potential
problems of autocorrelation and heteroscedasticity.
Robson, C. (1993) Real World Research. Oxford: Blackwell. pp. 50–1. This very
brief extract outlines the design of effective longitudinal research.
Action research
Harvey, L. (1990) Critical Social Research. London: Unwin Hyman. pp. 19–32.
Lee, R.L. (1995) Dangerous Fieldwork. London: Sage. pp. 1–13. In this
introduction, Lee scopes the types of danger that researchers face when
working with ‘outlaw bikers’, youth gangs, people infected with HIV, and
informants in inherently dangerous occupations. He argues that proper risk
analysis can effectively minimise the dangers facing researchers and prevent
them from being inhibited – or even paralysed – by their fears in the research
setting.
Stringer, E. (1996) Action Research: A Handbook for Practitioners. London: Sage.
pp. 142–60. Stringer has become a foremost authority on participatory or
community-based action research especially in the discipline of education. In
this extract, he sets out strategies for effective action research to practitioners.
Notes
1 The ‘Law of Large Numbers’ states that the probability that a sample shares the characteristics of
the population increases as the size of sample (i.e. number of cases) increases.
2 The Thatcher government introduced ‘large-scale voluntary transfer of housing stock’ in 1989 as
an extension of its ‘right-to-buy’ policy of assisting tenants of council houses (municipal social
66 Research Methods in Politics
housing) to buy their own homes (at a discount). This policy was retained by the New Labour
government.
3 www.electoralcommission.org.uk/about-us/statutoryreports.cfm 25/07/06
4 Elections staff at the city council reported that, at the all-seats all-postal voting local council and
EU elections in May 2004, turnout was 46.8%. The results ended the Labour party’s hegemony
over the city council when the Liberal-Democrats took control.
5 ‘Delivery democracy? Postal voting. Executive summary.
www.electoralcommission.org.uk/files/dms/Deliveringdemocracy 4473-10934 E S W.pdf
6 Mill, J.S. (1843) A System of Logic. London: Longman.
7 Engels, F. (1845/1993) The Condition of the Working Class in England. Oxford: Oxford University
Press.
8 Przeworski, A., Alvarez, M., Cheibub, J.A. and Limongi, F. (1996) What makes democracies
endure? In Journal of Democracy, 7 (1) pp. 35–55. The research concluded that democratic
government is more likely to endure where per capita income is high, income inequalities
moderate or falling, economies maintained or increased levels of growth, and there is no recent
history of democratic government being overthrown. Furthermore, parliamentary democratic
governments are more likely to endure than presidential systems (where deadlock between
president and parliament can lead to paralysis and a coup d’etat by the defence forces).
9 Leftwich, A. (2000) States of Development; On the Primacy of Politics in Development.
Cambridge: Polity.
10 Moore, B. (1966) Social Origins of Dictatorship and Democracy. Boston: Beacon Press.
11 Landman, T. (2003) Issues and Methods in Comparative Politics: An Introduction. London:
Routledge.
12 For more information on the British Household Panel Survey, see www.esds.ac.uk
13 www.data-archive.ac.uk
14 The survey questions and data can be inspected at www.essex.ac.uk
15 Eurobarometer data can be accessed at http://ec.eurpoa.eu
16 Beresford, P. and Hoban, M. (2005) Effective participation in anti-poverty and regeneration work
and research. York: Joseph Rowntree Foundation. The full report can be accessed at
www.jrf.org.uk/knowledge/findings/social policy/0395.asp
Part III
Collecting Information
Chapter 6
Critically Evaluating Published
Research
Introduction
As a child and student, you are likely to have developed and improved your own
writing skills – consciously or otherwise – by reading books and other publications
recommended to you. Similarly, reading others’ research reports will help you
to develop your own research report-writing skills. However, going further, by
consciously, critically evaluating others’ research reports, you can draw valuable
lessons into effective research design, data collection, analysis and interpretation,
and how best to communicate your findings. Critical capacity is an essential part of
academic scholarship (which owes its origin to its original function of training priests
to identify heresies). In this way, you can therefore appreciate better the successes or
otherwise of other researchers before you begin your own research. In any event,
the literature review of texts and research reports is an essential first step in research
(which is considered later in Chapter 8).
Some overseas students are inhibited from criticising published works – especially
by great authors – because they have been taught to respect authority and the
expert opinion contained within university libraries. However, in the UK and
other western universities, you must offer justified criticism of the literature relevant
to your topic. But, as an overseas student, you may also be concerned that your
criticisms of your own government’s policy or accepted textbooks may lead to you
or your family being punished. In this special case, you can ask for those criticisms
to be excluded from public copies of your dissertation.
This chapter introduces two ways of evaluating published research: research
component analysis (RCA); and, Rose’s ABCDE validity analysis.
70 Research Methods in Politics
1. when
2. where
3. who
4. abstract
5. research question and rationale
6. theory and literature review
7. hypothesis
8. methodology
9. data collection: what, when, how
10. data presentation
11. data analysis, interpretation and discussion
12. conclusions
13. implications
14. style
15. referencing and bibliography.
↓ ↑
↓ ↑
↓ ↑
to C, B, and A
Despite its longevity (1982), Rose’s deciphering model has not been bettered.
It is premised on a Weber-type ideal model of empiric research. This model has five
stages and elements named – somewhat prosaically in an era before memorable
acronyms became widely adopted – A, B, C, D, E. The model for theory-testing
research is:
A is the theory which is being tested. The propositions in B are the hypotheses
in the form of testable statements about the causal relationships between the
independent variables and the outcome. Rose classifies stage C as the ‘pivotal stage in
the research process’. Here, the theoretical concepts are transformed into measurable
74 Research Methods in Politics
every citizen rationally attempts to maximise his utility income, including that portion of
it derived from government activity.
(Downs, 1957: 297).
the percentage of low-income citizens who abstain in elections is higher than the
percentage of high-income citizens who abstain (ceteris paribus).
(1957: 299).
This proposition can be tested at micro- and meta-levels. A large sample of voters
could be randomly selected and asked details of their income and voting. But,
income data can be a very sensitive area. The prospect of a high level of response
is poor. A more acceptable means of asking people’s income might be to adopt
thresholds of, say, less than £12,000 for low income and more than £35,000 for
high incomes. In those cases, the thresholds have become indicators of income. The
meta-level of analysis would compare the (readily available) data on ward turnout
with socio-economic data from the census. In this case, turnout (or its absence)
could be used as an indicator of abstention whilst census data on house tenure, social
class, education and occupation, etc. would be used as indicators of income. Using
multiple regression analysis, the relationship between turnout and socio-economic
variables, and the power of the equation can be calculated.
Rose uses his model of the research process to provide a three-stage framework
for critically evaluating research:
Central to this method of evaluation is the concept of validity. Derived from
the Latin, validus meaning ‘strong’, validity in the context of research means:
the extent to which a measure, indicator or method of data collection possesses the
quality of being sound or true as far as can be judged. … in the social sciences generally,
the relationship between indicators and measures and the underlying concepts they are
taken to measure is often contested.
(Jary & Jary, 1995: 714)6
Critically Evaluating Published Research 75
External validity
A Theory: ←
B Theoretical Proposition ←
↓ ↑
C Operationalisation ←
D Fieldwork ↑
↓ ↑
E Results ↑
Rose suggests that the first stage involves evaluating the internal empirical
validity by assessing the extent to which the conclusions are fairly drawn from
the data collected. The second stage involves assessing the internal theoretical
validity. This examines whether the theoretical propositions have been fairly drawn
from the chosen theory and whether the stated concepts are fairly represented
by the indicators chosen. The final stage examines the external validity – the
strength of the relationship between the research, the wider literature and the ‘real
world’.
A criticism of this method of evaluation is that, by working backwards through
the research process, it ‘puts the cart before the horse’, i.e. if the research does not
relate well to the literature (or the indicators to the concepts, etc.) then the internal
empirical validity doesn’t really matter.
Rose develops separate ‘strategies’ for evaluating research reports based on
quantitative and qualitative data. The strategy for evaluating theory-testing,
quantitative research has six steps:
3. adding further descriptive details of: the researcher’s theoretical exposition and theory-
evidence linkages; and tables of data presented, reliability and accuracy, and interpre-
tation
4. assessing the internal empirical validity by examining the ‘fit’ between the data and its
interpretation
5. assessing the internal theoretical validity, i.e. the relationship between A (theory ) and
B (hypothesis)
6. concluding with a general assessment which consolidates the separate assessments
made and makes an assessment of the overall contribution of the research to the
discipline. (Rose, 1982: 104–5)
1. summarising the research report into its ABCDE stages stating: its natural history
(origins and development); the data and methods of collection; sampling; method of
analysis; and presentation of results
2. evaluating in turn the validity of: the concept-indicator links; theory; and sampling and
generalisation
3. concluding by reviewing the consistency (or otherwise) of the various validities and other
factors and assessing of the overall contribution of the new theory to the discipline.
(Rose, 1982: 130–2)
Rose can be criticised for the assumptions made about the neat dichotomy of theory-
testing/quantitative and theory-building/qualitative research and for unnecessarily
complicating the evaluation strategy.
Both research component analysis and Rose’s ABCDE provide good, highly-
structured methods for analysing research which are particularly useful for first-time
or inexperienced researchers. With practice, you will learn how to home directly
on the strengths and weaknesses of published research and to answer the question:
does it do what it says on the tin?
1. Consider the concepts of: conflict; freedom; liberty; hegemony; and consciousness
of identity. What concept-indicators would you suggest for these? Why? What data
would you collect?
Critically Evaluating Published Research 77
BOX 6.1
UWUK
Department of Politics
University of Watersea
Dr Adrian Helvetica
Editor
New Politics Digest
[date]
Dear Arial
Overall, my view is that, whilst this excellent paper breaks new ground, there is a number
of areas where minor revisions and additions would be helpful.
Let me begin by summarising what I believe are the research question, theoretical
framework, the hypothesis and the key concepts involved. The research question etc., is ….
[200–300 words].
I would also like to comment on the style of the paper … [200–300 words].
The paper is, of course, suitable for publication in your journal in its present form. However,
I would suggest that a number of small changes are made. They are … [200–300 words].
Best wishes,
2. [For undergraduates] You are a distinguished academic. You have been asked by
the editor of a refereed journal to act as a referee for a draft research report. Select
one of the two published reports:
Bevir, M. and Rhodes, R.A.W. (2006) Prime Ministers, Presidentialism and
Westminster Smokescreens, Political Studies, 54 (4): 671–90
Chaney, P. (2006) Critical Mass, Deliberation and the Substantive Representation
of Women: Evidence from the UK’s Devolution Programme, Political Studies, 54 (4):
691–714.
Write your assessment using the letter (above):
3. [For graduates] Select a research report on a subject that interests you from
a refereed journal in your university library. Evaluate it critically using research
component analysis or Rose’s strategies. Attach a copy of the research paper
to your assignment showing what you concluded were the various analytical
components. How could the research and the report be improved?
FURTHER READING
Notes
Introduction
In Chapter 6, you read how published research reports can be assessed. The
research component analysis and Rose’s ABCDE model examined the completeness
and coherence of the research process adopted. They also considered the validity
or otherwise of the relationships between theory and hypothesis, concepts and
indicators, empiric data and analysis, and conclusions. Research essentially involves
the gathering or collection of data that addresses the research question and enables
theory to be tested or developed. So the data from which answers to the research
question are to be drawn must be appropriate in terms of its relevance and efficacy –
‘fitness for purpose’. Much of this information will be drawn from published sources
80 Research Methods in Politics
that will be supplemented as necessary by new information specially collected for the
research project. So this chapter therefore suggests how best you can assess existing
data and seek additional material.
Many textbooks use information and data interchangeably. Some complicate
matters by treating ‘data’ as a plural noun and therefore writing ‘the data are …’.
While this is grammatically correct (for data is indeed the plural of the datum), it can
sound odd to students untrained in Latin conjugation. The author, Kingsley Amis
notably described such Latin correctness as the practice of ‘wankers’ as opposed to
‘berks’ who used slipshod English (1977).2 So this book follows everyday practice of
treating data as singular. Politicians also tend to use the word ‘evidence’ to describe
what they would wish us to regard as ‘conclusive, compelling information’ which
either proves or, in its absence, disproves allegation.
But is there a real difference between data, information and evidence? Certainly, the
dictionary meanings are similar. But some distinction is useful. Researchers tend to
speak of data as the mass of disordered, raw material from which information
(knowledge) is abstracted to provide evidence to support argument and conclusions.
(Information technologists adopt a similar distinction by defining information as
processed data sets attaining meaning.) Information informs. Evidence supports
conclusions.
So it is helpful to conceive of research as involving three stages. First, the raw
data is gathered. Second, the data is organised and distilled into information. Third,
evidence is abstracted from the information through processes of analysis and testing.
But neither information nor evidence is self-evident: the material seldom ‘speaks
for itself’. Some interpretation is required. However, when interpretation is re-
interpreted, some distortion of the original is inevitable. So some distinctions, criteria
and tests are useful to weed out distortions and ‘untruths’. The distinctions adopted
are between primary and secondary sources of information. The criteria used are validity,
reliability and accuracy. The main test adopted is triangulation.
and β data.3 Wherever possible, Politics researchers prefer to use primary, eye-
witness data recorded at the time by participants or privileged observers. The main
sources of primary data used by Politics researchers are fourfold:
Other sources are popular songs, poems, paintings and cartoons, photographs,
graffiti, murals (e.g. N. Ireland), T-shirts and videos. But beware, all records,
however ‘primary’ incorporate some degree of bias, perception, interpretation, and
editing, whether contextual, cultural, curatorial or deliberate.
Written primary records include accounts of meetings, minutes, diaries, letters,
reports, telephone transcripts, telegrams, emails, and newspaper reports, etc. But
how reliable, accurate and truthful are they? Who actually prepared them and why?
Arguably, all accounts are partial because they are functional, i.e. designed to fulfil
a purpose. But whose purpose? Most public records reflect the interpretation of
those holding power. Foucault argued that the victors write history. Alternatively,
how reliable are the diaries of (former British Labour Cabinet ministers) Richard
Crossman, Barbara Castle or Tony Benn? Did their cabinet colleagues know that
they were keeping diaries and change their behaviour accordingly?
Crossman offers telling insights into official records:
But the BBC’s former Political Editor, John Cole wrote of Crossman that:
… [Crossman] had a brilliant mind, was a great polemicist, and a subtle – though
sometimes self-defeating – operator. But if you were Constable Plod seeking a reliable
82 Research Methods in Politics
witness, he would not be your first choice. I sometimes wondered if he knew how
to distinguish what he said to the Prime Minister from what the Prime Minister said
to him.
(Cole, 1996: 64)5
Inspector Thompson in his two volumes of reminiscences is good at capturing the heart
of the matter but less reliable on exact dates, times and places than might have been
hoped for a meticulous detective.
(Jenkins, 2001: 562)
As a general principle, all primary information in the form of records – other than
those that you make through your own observations – should be treated with
caution. A ‘health warning’ is necessary. You should always ask yourself:
gathered from a number of separate, primary sources and may contain authoritative
commentary and analysis. The source’s interpretations and bias are important –
especially of evidence of how events were interpreted at the time and later, and the
moral relativism of value-judgements.
the extent to which a measure, indicator or method of data collection possesses the
quality of being sound or true as far as can be judged. … in the social sciences generally,
the relationship between indicators and measures and the underlying concepts they are
taken to measure is often contested.
(Jary & Jary, 1995: 714)7
cabinet government. But Dennis Healey claimed (playfully) that Tony Benn ‘always
seemed to be on the toilet every time a difficult decision had to be made’ (BBC2
interview). Accounts may have been ‘sexed up’ to promote sales. Biographies
may be hagiographic. For example, Michael Foot’s biography of Aneurin Bevan
uncritically portrays the Welshman as a wholly heroic figure, whereas my father –
a fellow native of Blaenau-Gwent – told me how, after 1948, some local trade
unionists called the Ebbw Vale MP ‘Urinal Bevan’. This epithet followed Bevan’s
assertion that:
it is for the [Party] Conference to lay down the policies of the Parliamentary Party, and
for the Parliamentary Party to interpret those policies in the light of the parliamentary
system.
(Foot, 1973: 236)9
hundreds of dodgy academic departments put out … to impress busy newspaper people
and to win themselves cheap publicity which can in turn be used in their next funding
applications.
(2004: 254)
biased towards exciting or unusual pictures; news that is refreshing or odd; and news
that bears some relation to viewers’ lives.
(2004: 291)
So anything that looks dull, ‘stories about northern European countries, about
buses, about old people, about infrastructure, banking, manufacturing, Whitehall
and regeneration,’ is unlikely to be televised. Marr argues that a task of TV news is
to increase viewing figures – which means also retaining the viewers of the preceding
programme – usually popular light entertainment of the ‘soap’ or ‘chat show’ genre.
Once again, you will find that adopting a critical distinction between facts and
truth is useful. Facts are the available data. They present incomplete snapshots of
events. Truth is the reality behind the facts. Sometimes the facts may obscure
the truth – perhaps deliberately so. A good example was provided to me by a
leading academic. He privately described how he had critically reviewed a best-
selling account of British rural life where the author had misrepresented the facts by
combining material from a number of interviews to represent a composite figure.
The author had replied to the effect that his critic was unable to distinguish between
the facts and truth.
Interviews
Case Study
Harold Nicholson provides a detailed narrative of the fall of the second Labour government in
1931 and its replacement by a National Government which was to last effectively until 1945
(Nicholson, 1953: 453–469).11 The Labour Prime Minister, Ramsay MacDonald, became the
leader of the National Government in what became named by Labour Party members as the
‘great betrayal’.
Nicholson describes the relevant background as the rapidly deteriorating public finances
caused during the worst years of the Depression when the demand for public expenditure
on unemployment benefit etc. grew whilst income from taxation fell. In response to demands
by the Conservative and Liberal parties (amplified by the Tory press), the Government formed
an independent committee under Lord May. On 31 July 1931, May recommended substantial
cuts of up to 20% in public sector salaries, 20% cut in unemployment benefit and reduction
in the pay of the armed services to 1925 levels. But two of the six May members issued a
minority report dissenting from May’s recommendations on the basis that the costs of the
cuts would fall mainly on the working classes. Nicholson wrote that ‘The rank and file of the
Labour party agreed whole heartedly with [the Minority Report]; MacDonald and Snowden
[Chancellor of the Exchequer] did not’ (1953: 455). Nicholson reports how, later that day,
MacDonald formed a five-man, special, Cabinet Economy Committee to consider how May
could be implemented. The ‘Big Five’ consisted of MacDonald, Snowden (Chancellor), J. H.
Thomas, Arthur Henderson and William Graham.The likely continuing withdrawal of deposits
held in London meant that the government would be unable to fund the public sector deficit
without support from bankers in Paris and New York. The bankers were unwilling to lend the
Evaluating Information: Validity, Reliability, Accuracy, Triangulation 87
money unless and until firm proposals were made to balance the UK budget. On 19 August,
the Cabinet’s Economy Committee proposed cuts similar to the May report. Half the deficit
would be met by reductions in unemployment benefit and public sector pay and the other by
increasing taxation etc. According to Nicholson, the proposals were reluctantly approved by a
majority of the Cabinet with the exception of transitional unemployment pay (1953: 457).They
suggested an additional revenue tariff which MacDonald told them would not be accepted by
the Liberals.The TUC – which had created and funded the Labour party – met MacDonald on
20 August. The Council refused to accept cuts in unemployment benefit or public sector pay.
On 22 August, MacDonald proposed a modified version of the programme – including a 10%
reduction in unemployment pay – to the Cabinet. He obtained Cabinet support to ‘enquire’
of the Opposition leaders whether the revised proposals were acceptable. The Opposition
leaders responded that the overseas bankers’ support was critical to wider support for the
package.
The King (George V) had been kept informed by MacDonald of the increasing crisis. He
returned from Balmoral to London on 23 August when he was told by MacDonald that leading
members of the Cabinet would not support the latest proposals (being considered by the
bankers). The King decided that the ‘correct constitutional course’ would be to meet the
leaders of the three main parties: MacDonald (Labour), Baldwin (Conservative) and Samuel
(Liberal, as Lloyd George was in hospital). Nicholson describes how the King stated his
preference for MacDonald and the Labour government to stay in office and to implement
the cuts. If that were not practicable, then the best alternative would involve the formation
of a National Government – headed by MacDonald – with a Cabinet drawn from three
parties and commanding a sufficient majority in the House of Commons to approve the
necessary legislation. The King met the three leaders separately who agreed to join a
National Government if necessary. Once the crisis had been resolved, then new elections
should be held.
Later that day, the Labour Cabinet met. After a long adjournment, they were advised by
telegram from the Government’s agents (the bankers, J. P. Morgan) that the necessary US
public support for a public loan would be problematic until Parliament had approved the
proposals. They suggested a short-term treasury loan. Finally, they enquired whether they
were correct in assuming that the package proposed by the Cabinet had the support of
The Treasury and City. But the Cabinet had not and would not approve the programme.
MacDonald told them that he would report the divisions (eleven in favour: eight opposed) to
the King whom he would ask to convene a meeting of the three party leaders. He would tell
the King that the Cabinet had placed their resignations in his hands. He immediately reported
to the King. Acting unilaterally, MacDonald began that night to plan the new Government
Continued
88 Research Methods in Politics
with what Snowden described ‘an enthusiasm which showed that the adventure was highly
agreeable to him’ (1953: 465). On 24 August, the King met the three party leaders who agreed
to form a National Government. MacDonald tendered his resignation. He was then invited
to lead the National Government. He asked them to prepare a communiqué saying that
the formation of the new Government was being considered. The party leaders agreed that
the new Government would not be a coalition but a ‘co-operation of individuals’. MacDonald
described the proposals to his Cabinet and invited them to join a new ‘Cabinet of Individuals’.
With the exception of J. H. Thomas, Lord Sankey and Philip Snowden, they declined.
Following the resignation of the Labour Cabinet, the new Cabinet was formed on 26 August
with Baldwin as Vice-Premier.
There are a number of other accounts of this episode. One central dispute
among them is whether the King or MacDonald first raised the proposal for a
National Government, i.e. whether MacDonald accepted the King’s proposal to lead
a national government out of patriotism and loyalty, or, proposed the arrangement as
a means of continuing in office and increasing his power whilst appearing to follow
the constitutional requirements of the King. For example, the celebrated Labour
historian, G. D. H. Cole wrote that:
The exact method of the split is vehemently disputed. The Labour Cabinet was still
discussing the outrush of gold and the ‘threat to the pound’ under the influence of the
deliberately exaggerated menaces of Philip Snowden, when it came. They had agreed
to enormous concessions but jibbed (it is stated) at penalising the unemployed. Then it
was put to them that arrangements had already been made, with the King’s consent but
clearly on MacDonald’s initiative for the formation of a ‘National Government’ of Labour,
Conservatives and Liberals.
(Cole, 1938/66: 593)12
Triangulation
Triangulation is a method developed over the centuries for navigation and surveying.
It provides the basis for satellite navigation. Its origins lie in geometry. A point
can be precisely defined in space by the angle it subtends to a line joining two
other points by the application of the Law of Sines. Any geographical area could be
mapped by first selecting two ‘trig points’ (triangulation points) that are a measured
distance apart and then recording the position of any other point in terms of
the angle subtended. In this way, a third trig point could be established and the
exercise extended. In navigation, triangulation is used to establish a ship’s precise
position by taking bearings on three or more known landmarks. The position is
90 Research Methods in Politics
most accurately determined when the three points are equally located around the
ship, namely
Lighthouse A Lighthouse B
Ship ⇑
Lighthouse C
Sampling
You will quickly find that, even when you adopt triangulation, the volume and
potential sources of data in terms of people and records can still remain vast. So
a selective approach is essential. You simply cannot interview every member of
a union or examine every council minute. The age-old solution to this particular
problem is to concentrate your activity on a sample of the population. These everyday
words have special meanings in academic research which warrant explanation. The
population is the universe of all the subjects or cases under study. You must define
your population. It may be all the members of a union, the residents of a city or
town, states of Africa, a particular ethnic or age group and so on. The population
is a set of individuals, cases, states, etc., which share a common characteristic. The
sample is a selection of individuals, cases, states, etc., made from the population.
The sample is, therefore, a subset of the population.
You must define your research population in a sample frame. Your sample frame
is a list or schedule of the population from which the sample will be drawn. It may
be a membership list or a directory of engineering firms.
You can use either probability or non-probability samples.
Non-probability samples
Non-probability samples are samples where members of the population do not
have an equal chance of being selected. They are not statistically reliable. They
cannot generate generalisable data. You select the members of the sample. Non-
probability samples include nomination, snowballs, volunteers, case studies and theoretical
samples (used in grounded research). Non-probability samples will not generate
generalisable information. You have already been introduced to case studies and
theoretical samples in Chapter 5. Non-probability samples are very small. They are
used for qualitative research.
Nomination is the most widely-used form of recruiting a non-probability
sample. Essentially, you ask a local social gatekeeper or intermediary to nominate
(name) a group of people who meet your requirements for a research sample.
A social gatekeeper exercises control over who enters a community. They may
be head teachers, village headmen, employers or heads of family (if you want to
interview children). Essentially, you search them out, write to them explaining who
you are and the nature of your research, and ask them to nominate a cross-section of
local people to interview. Often, they will offer to arrange the meetings. But this offer
of assistance is incompatible with the ethical ideal of voluntary consent. The people
nominated may feel as if they have been commanded to attend. This will inhibit
your meeting: they will feel obliged to say what the gatekeeper would like them to
say. It is better if you contact the named people individually (preferably in writing).
Again you should introduce yourself, explain the nature of your research and its
92 Research Methods in Politics
benefits to them. You should say why you want to speak to them individually or at
a (focus) group meeting, and add that X (the local social gatekeeper) has suggested
that they might be able to help. Intermediaries are not social gatekeepers but
trusted outsiders or thresholders who are respected by the community. Typically,
they are ministers of religion, teachers, nurses or local leaders of voluntary agencies
or NGOs (Non-Governmental Organisations) like Oxfam.
Snowballs grow larger as they are rolled across snowfields. The term snowball
sample is therefore used to describe samples which become larger as each contact
suggests more people to contact. They are particularly useful for researching groups
whose identity is concealed. For example, say you wish to research the likely impact
on crime of a greater liberalisation of laws against illicit ‘hard’ drug use (crack, meth,
etc.). You would be unlikely to make contact with drug-using criminals through
a probability sample of, say, 1000 from the UK population. First, the incidence
of drug-using criminals is relatively small. And, second, they would be unlikely to
reveal themselves to you. The two problems you face here are access and trust. These
can be overcome by using a snowball sample. In the example above, you could
begin by contacting a person who is publicly known to have had some contact
with these criminals. They might be a specialist doctor, a prison visitor, shelter
manager or journalist. Your first task would be to meet them to establish your
bona fides (Latin, meaning ‘good faith’) as an academic researcher and, therefore,
trustworthy. Several meetings might be required. You would ask them to refer
you to other people who might be able to assist you. They might refer you on
to recovering addicts, their relatives, or organisers of self-aid groups. In turn, you
would hope that they would find you sufficiently genuine and trustworthy to provide
further contacts. You would hope that your research trail would end in clandestine
meetings with practising addicts who funded their drug purchases through petty
crime or wider involvement in criminal networks. At the end of your research,
you will not be able to claim that your findings applied to addicts beyond those
you had met: however, you can claim that they apply to all the subjects in your
sample.
A volunteer sample is one where members of the research population volunteer
to take part in your research. You are most likely to seek volunteers where your
sample is likely to undergo a period of discomfort, pain or financial cost. You will
have received emails from university departments – especially Psychology – asking
for volunteers for lab-tests. They may offer a small cash payment to volunteers. For
example, you might seek volunteers from colleagues if you wished to pre-test and
compare the possible impact of positive and negative political advertising in the
UK. But appeals for volunteers need not necessarily be made only to people. You
can also ask for volunteers from organisations. For example, to pursue research on
political networks, you could write directly to each unitary authority asking them
to take part in your research. The great advantage of seeking volunteer samples is
that they can be relied upon to co-operate fully. Conversely, because the volunteers
Evaluating Information: Validity, Reliability, Accuracy, Triangulation 93
are self-selecting, then they are more likely to be especially interested in the topic
and therefore may be less likely to be representative of the population as a whole.
Probability Samples
Probability samples are samples in which every member of the defined population
has an equal likelihood of being selected for inclusion. So, in a population of 1,000,
each person has a 1/1000 probability (also expressed as 0.1% or p = 0.001) of
being selected. Probability samples are statistically reliable. This means that they
are capable of generating data which is representative of the population. In other
words, if the average age of members of a probability sample is 30, then you can be
confident that the average age of the population as a whole is also 30. This capacity to
generate accurate representation is called generalisability. Probability samples are
large. They are used in all quantitative research where the population is very large.
The reliability of the data obtained from a sample will increase as the sample
increases in size towards that of the whole population. But it is the size of the
sample which determines its accuracy: the size of the population is less relevant. But
doubling the size of the sample will not double the reliability of the information.
Accuracy is proportional to the square root of the sample size. So, to double the accuracy,
the sample size must be increased fourfold – which will greatly increase the cost of
the sample survey.
There is, therefore, a trade-off between cost and reliability – and time. This is
an example of the so-called law of diminishing returns (or diminishing marginal utility).
It explains why most samples are relatively small, e.g. national opinion polls rarely
use more than 1,500 people, whilst even national, life-or-death medical surveys
rarely exceed 60,000, i.e. a 0.1% sample.
There are many types of probability samples: simple random samples (entirely
random); systematic samples (every nth person); stratified samples (e.g.
50:50, men: women, etc.); multi-stage cluster samples, and, probability
proportionate to size (PPS) samples. Essentially, stratified, multi-stage cluster
and PPS involve pre-designing the sample to reflect the known characteristics of the
population under study, e.g. by gender, age group, ethnicity, social group, residence.
They are also used to make the sample more readily contactable and thereby reduce
costs. For example, if you were proposing to carry out a face-to-face survey of
10,000 people in England, then you could choose 1,000 electoral wards randomly
and then 10 addresses within each (or 200 wards and 50 addresses in each). A further
refinement would be to select randomly 125 wards within each of the 8 standard
regions and 10 residents in each ward. But some regions have larger populations than
others. So you could vary the number of wards pro rata so the likelihood of any ward
being chosen was more equal. But wards also vary significantly in size (depending
on whether they elect one, two, or three members). So the list of wards from which
the sample is to be chosen should reproduce multi-member wards twice or three
94 Research Methods in Politics
times, and so on. In this way, you are constructing a sample with a probability
proportionate to size. In this case, you would have constructed your sample frame
in three layers: region, ward, population. These layers are termed strata.
The more strata employed, the smaller the size of each group and the lower
the reliability of the data. One statistical survey rule – rarely followed – is that the
smallest group should not be lower than 1,000. In practice, a ‘rule-of-thumb’ is
adopted in which the group should be at least 50–100 (Hoinville et al, 1977: 61).13
There is a particular problem with very small minorities, e.g. non-whites in UK rural
county towns. A group of, say, 100 educated males 26–35 may well include less than
five members of minority ethnic communities. But five people are unlikely to be
representative of the many minority ethnic communities. In this case, you should
seek a higher number of participants from these communities and scale down the
data accordingly. Alternatively, if ethnicity is a critical variable, then a very much
higher stratified sample should be sought.
Tables have been developed which relate sample size to the degrees of acceptable
sampling error and levels of confidence (CL). Most Politics research adopts levels of
confidence of 95%. This means that you are confident that, in 95 out of every 100
cases, the characteristic (e.g. party preference) shown by the sample will be shared
by the research population. The sampling error is the inaccuracy arising from the
use of a sample. So, as Table 7.1 shows, if you are willing to accept a sampling error
of 5% either way, you can use a sample of 400. But, if you insist on a sample error
as low as 1% either way, then you must use a sample of 10,000.
For example, say you have adopted a random sample of 2,500 people whether
they support or oppose NATO forces, involvement in Afghanistan. Of these, 36%
say they are supportive. What the table above tells you is that, in this case, you can
be confident that, in 95 out of every 100 members of the population, 36% will be
supportive ± 2%. So, at 95 confidence levels, support will lie between 34% and 38%.
Therefore, if you want to reduce the sampling error by half (to ± 1%), then you
will have to increase your sample to 10,000.
The greatest difficulty in using probability samples is designing the sample frame.
The sample frame is the list of the population from which the sample will be
drawn. Say, for example, you want to carry out questionnaire research of residents
of a city. Twenty years ago, you could have used the electoral roll or telephone
directory. However, to protect the privacy of the public and to encourage more
people to register and therefore to vote, the full electoral roll is no longer publicly
available. The telephone directory is now much less representative than previously
now that a third of ‘subscribers’ choose to go ‘ex-directory’. In any event, the
telephone directory lists heads of household and not their partners. Additionally,
young people are more likely to use only mobile telephones which are unlisted.
Large-scale probability sampling is very expensive. One practicable means
available to (fully-funded) researchers to obtain very large samples is to buy into
one of the very large (100,000) sample omnibus questionnaire surveys undertaken
by market researchers acting on behalf of commercial clients – notably superstore
grocers and financial services. They use random samples obtained from a sample
frame of a national gazetteer of postal addresses. The disadvantage is the relatively
low completion rates and the bias arising from the use of prize incentives.
For these and other reasons (especially costs and the lack of life-or-death
consequences for the population), Politics researchers rarely use probability samples.
Instead, like most private firms, you are most likely to use quota samples.
Quota sampling
Despite being the most widely-used, quantitative sampling technique, quota sampling
is non-probabilistic. However, for calculation purposes, custom allows you to analyse
the data using the same statistical techniques as if it had been obtained using simple
random sampling. A quota sample is a sample of the population which is pre-
designed to be representative. So, for example, if you know that 69% of your
population of UK electors voted in the last general election, then you will design your
sample to have a quota of 69% voters. How do you know whether a person voted?
You ask them. Quota samples are usually recruited in town centres by researchers
who select passers-by to complete their quota of interviews. It is non-probabilistic
because the interviewers select individuals to meet their quota. So each passer-by
does not have the same probability of being selected. Furthermore, because the
weekday city centre contains higher proportions of some groups of the population
and less of others, then the probability of each member of the research population
being selected is unequal. This also explains why you may not have been interviewed
by the ever-present pollsters in your city centre. Their quota of people like you had
already been filled. Or, alternatively, your type of person did not form part of the
sample frame of, say, pensioners. Or, importantly, they may have felt uncomfortable
96 Research Methods in Politics
by your appearance. You will find out when you carry out your own quota sampling
that you are likely to select people with whom you believe that you are likely to
develop rapport. You will find more detailed guidance on administering (carrying
out) an on-street survey in Chapter 8.
Then you can sub-divide the 100-cell matrix into columns for sex and socio-
economic group (assuming the owner/tenant distribution is uniform between
genders and ages) and into rows for age bands, namely:
In this matrix, the highest, right-hand cell (marked ‘X’) will be a woman, aged
18–34 and living in rented accommodation whereas ‘P’ will be a man, aged 35–49
who is an owner-occupier.
You can then ‘scale-up’ the matrix to provide the optimum sample size on the basis
of weighing the advantages of accuracy, reliability and representativeness, against
the resource costs. You can, of course, add further sub-divisions, for example, of
ethnic origin. But remember that, each time you subdivide the sample further, the
sub-groups become smaller and potentially less representative.
So armed with your quota matrix and questionnaire, you can begin your quota
sampling. As you recruit each member of the quota sub-group, you ‘tick them off’
from the matrix. Beginning is easy. However, the technique becomes more difficult
as the number of vacant cells in the matrix reduces.
1. What do you understand by the essential difference between validity, reliability and
accuracy, in terms of data? Why are the distinctions useful?
Evaluating Information: Validity, Reliability, Accuracy, Triangulation 97
18–34 X
35–59
60+
2. Discuss the case study of the formation of the National Government in 1931,
drawing on other accounts which, together with Nicholson’s biography of George
V, enable an appropriate triangulation to be achieved.
3. Consider your university’s prospectus. Identify examples where numeric or other
authoritative data may have been used selectively to create a best-case presen-
tation to potential students.
4. Arthur Scargill attracted both strong supporters and critics for his role as leader
of the NUM (National Union of Mineworkers) during the miners’ strike of 1983–4.
You have obtained documentary sources from the NUM and the autobiographies
of government ministers and advisers of the day. What other sources would you
seek out to achieve triangulation?
5. Design a quota sample of 400 adults to represent your research population of
adult residents of your university city, or town.You wish to test the potential causal
98 Research Methods in Politics
relationship between ‘green practices’ and age, class and sex. You have learned
that 60% of households separate and sort recyclables from their household refuse.
Find the data on age, class and sex from the census data for your city or town.
What are the advantages and disadvantages of this method?
FURTHER READING
Notes
Introduction
The literature review is a major part of any research. But many literature reviews
are done badly. Poor reviews often consist of one description of a text after another.
They lack any original criticism or evidence that the student has actually pondered
what they have read. There remains a suspicion that some students haven’t actually
read the texts they cite, but merely summarised the abstracts or dust-covers. They
are also very boring – especially to the external examiners who will have been
chosen because they are authorities on the research topic. Perhaps the fault lies in
the expectation by higher education that students will have been taught how to do
a literature review at secondary school and vice versa. There is also the view that
doing a literature review is ‘common sense’ which requires no preliminary guidance.
I strongly disagree with these views.
The review is not undertaken for its own sake, or as a kind of academic penance
(although it may feel that way at times). The primary purpose of the literature review
is to establish the state of current ‘knowledge’ – or argument – about your research topic.
Knowledge includes views, concepts, theories, understanding, evidence, schisms
Completing a Literature Review: Accessing Published (β) Information 101
and schools, and the main authors. In the first place, it involves you finding out
what has already been written (or said). It also involves finding out what you don’t
know and possible unknowns. As Donald Rumsfeld famously said:
Reports that say that something hasn’t happened are always interesting to me because,
as we know, there are known knowns; there are things that we know we know. We also
know that there are known unknowns; that is to say we know that there are some things
that we do not know. But there are also unknown unknowns – the one’s we don’t know
that we don’t know.
(Donald Rumsfeld, US Secretary of State for Defense, 2003)
Reaction against Rumsfeld’s part in the Iraq war has meant that his statement was
widely ridiculed, whereas, in hindsight, it is worthy of Foucault.
Reviewing the literature prevents you from ‘reinventing the wheel’ and enables
you to contribute to new knowledge or understanding. However, in Politics,
there are few uncontested, ‘knowledge claims’. Instead, there are a number of –
often competing – explanations of phenomena which reflect opposing paradigms,
information and periods of time. But those explanations are not beyond criticism.
Your task as a Politics researcher is, therefore, to identify: who are the main
theorists, commentators and texts; how the arguments have developed over time; the
areas of agreement and disagreement; the overlaps and the ‘gaps in the literature’. The
literature review should also summarise and evaluate published criticism and, most
importantly, offer fresh, original criticism. Your criticism should identify loopholes,
illogical deductions and conclusions, which are not supported by the information
from which they are allegedly derived. A literature review is not merely a chronicle
of who wrote what and when, but a forensic examination of texts to identify one
or more critical elements where current understanding is unclear or contested and
which the new research can address. After all, it is this lack of clarity or information
that is the justification for you undertaking the research and for the reader spending
their time.
The explosion of text, in the form of books, journals and the Internet, makes
literature reviews more difficult than before. Conversely, the Internet has made
searching for publications very much easier. But you will be unable to read every
available text. A selective approach is essential in terms of what texts – and which
parts of those texts – you should read and what records you should make. The ‘law
of diminishing returns’ applies to literature. And, conversely, reading ever more
texts can become a displacement activity to justify putting off the start of fieldwork.
A good supervisor can spot when you are blaming the literature review for general
lack of progress (or effort). As a rule-of-thumb, the literature review is likely to
occupy between a quarter and a third of the time available for the research project.
A quarter of the research report is likely to be set aside for the theory and literature
102 Research Methods in Politics
review. Traditionally, the first year of a three-year PhD research project was devoted
to ‘reading the literature’. Whilst the proportion of time remains the same, current
practice is to integrate the literature review with the search for empiric data in a
type of grounded research with a near-continual process of writing-up-as-you-go that
begins with the original research proposal. The objective of the review is to identify,
criticise and synthesise the most recent, relevant, authoritative texts. Authority is critical.
It generally means those texts that are widely accepted by the academic community
as works of considerable scholarship. Finding and accessing these texts requires a
systematic search of literary sources.
The literature search necessarily precedes the literature review. So, where should you
begin to search for authoritative texts? A starting point is your course modules, your
core texts and the bibliographies provided by their authors. Then you must (not
‘should’) move on to the bibliographic databases of journals (and their predecessors the
printed bibliographies) provided by the university library. As already noted, journals
are much shorter and more concise than books, and will have generally been vetted
before publication by referees selected from the leading academic specialists in the
topic field. Bibliographic databases allow you to search for articles which include
specific words in the title or abstract or, alternatively, written by a particular author.
You can limit your search to a specific range of years, a particular set of journals, and
so on. The database is likely to have been designed to enable you to follow a link
directly from the database entry to the article itself, where the journal is available in
electronic format. Useful databases for UK-based Politics researchers include (listed
alphabetically):
Each journal article will also contain its own bibliography. The Social Sciences Cita-
tion Index allows you to move from the details of one article to all the other articles
that have been cited and also to identify which articles are cited most often. You must
log in to use these databases. Many have been acquired by the US information firm,
CSA based in Maryland, or other commercial providers. But researchers based in UK
Completing a Literature Review: Accessing Published (β) Information 103
You must make the request in writing (which may include email) to the organisation
which you believe holds the information. The organisation is required to answer in
20 working days (i.e. four weeks). A small charge may be made for photocopying.
However, where the cost of providing the information is more than £600 to
central government or £450 for other bodies, then the request can be refused.
Some records will be protected from scrutiny on grounds of necessary secrecy,
or the Data Protection Act. Where a request is refused, then you can appeal
to the independent Information Commissioner. The onus remains on the body
holding the information to justify not making it available. For further details, see:
www.dca.gov.uk/index.htm.
Local councils, NHS trusts and Police authorities are required to open their
meetings to members of the public. So you can attend and note what happens.
However, cameras and tape-recorders, etc. are not allowed. But you should be
issued with a copy of the agenda papers (if not, ask the committee clerk/democracy
officer). Reports will identify the relevant ‘background papers’ which you can ask
to inspect. But you will be excluded from hearing those ‘exempt items’ concerning
commercially sensitive or personal information.
The UK’s national archives are held at the National Archives for England, Wales
and the United Kingdom (formerly the Public Records Office) at Kew, London,
where they are available for public inspection. The records held cover the British
Isles, former British Empire colonies and Commonwealth states. The National
Archives includes the Family Records Centre (at Islington). A new search engine
at www.nationalarchives.gov.uk/search enables you to search all official and private
archives in the UK. Researchers do not have to register or obtain permits before
they visit Kew or Islington.
All other states maintain comparable systems. The US national archives are held by
the National Archives and Records Administration in Washington (www.archives/gov)
which also maintains regional archives. US states and city authorities have archives.
Alliances and supra-state groups also maintain records. For example, EU archives
can be accessed via ec.europa.eu/historical_archives/
UK county councils (and some unitary authorities) keep extensive local archives.
These are a valuable source of information. The professional archivists know their
records and are generally very helpful. It may be worth making an appointment
before a visit to arrange for the specialist member of staff and relevant records to be
made available. Trade unions, large companies, the churches, etc. all maintain large
archives. The county councils and unitary authorities also have specialist ‘research
and information units’ who may be able to run cross-tabulations of census data etc.
using SASPAC and other software.
The Land Registry is also available for public inspection. This holds records of
the titles, extent and ownership of all properties that have been sold. A small charge
(currently £3.00) is made for each title search. The Land Registry remains the only
current authoritative record of land ownership in the UK. However, information on
Completing a Literature Review: Accessing Published (β) Information 105
land that has never been sold – for example, the core estates of the great aristocratic
landowners – is not available.
Companies House in Cardiff holds information on all current and some past public
companies, including their annual reports and accounts. Records can be obtained
on-line at www.dupont.co.uk/companies-house.htm. A small charge (currently
£1.99) is made for each search.
Whether your search has revealed a very large number of texts or otherwise, you
will have to be selective in your reading and note taking. Consider the advice given
to historian William Woodruff in his first tutorial in Oxford. He was asked to write
an essay on Inclosure. He asked his tutor which books he should read. Eight volumes
were recommended. When he asked whether it was really necessary to read all of
them, his tutor replied:
Gracious me no, Woodruff. You’d be mad to. You don’t read books; you gut them; it’s the
gist you’re after. If you feel that an author has nothing important to say, drop him. You’ll
get the nub of things pretty quickly. Anyway, you won’t find half the books I’ve given you.
There are other students preparing essays, you know … Even looking for a book you
can’t find will teach you something … what you are after is the gist, remember.
(Woodruff, 2003: 130–1, my emphasis)1
You ‘gut’ the literature by reading the abstract first. If this is relevant, then read the
introduction and conclusion and – only if necessary – individual chapters. Learn to
skim the text to identify relevant passages for slow, careful reading.
You will need to make a rolling bibliography of texts that you have read and those
that you intend to read. You will also need to make a record of those texts to be cited
in your theory and literature review. A traditional method is to record the relevant
information for each publication – author, year of publication, title, publisher’s
address and name and a summary of the main arguments and page references – on a
standard 150 × 100 mm (6’ × 4’) record card. The cards can be kept in an alphabetical
index where they can be abstracted and grouped into themes, topics or approaches.
But there is a limit to the information that can be held on a single record card.
An alternative approach is to keep an electronic record of each text in a separate
file within a bibliography folder and a hard copy. These records are, therefore, not
limited by space to bibliographic citation and key arguments. They can include key
passages identified by their page numbers. In this way, a key text can be reduced to
four pages (or less) of quotations (which, incidentally, can be traded with colleagues
106 Research Methods in Politics
for similar records of their summaries). The passages can then be copied and pasted
directly into the research report or discussion paper.
Having reduced the literature to a series of records, abstracts and summaries, you
can now begin the literature review. The trend among inexperienced students is
to write-up the literature as a series of descriptions of what each author wrote
in chronological order. Such approaches are over-long; at best overly descriptive
and, at worst, obvious plagiarism, confusing and boring. In particular, they lose the
interest of the writer and reader, and tend to give least attention to the most recent
texts. Instead, a critical synthesis is required which focuses on the ideas and arguments
rather than the authors. Indeed, I would argue that, with the exception of the ‘grand
theorists’ – Marx, Weber, etc. – the names of the (lesser) authors should generally
be omitted from the text, and given in Harvard references or footnotes. You must
give references to acknowledge the sources of information and to show where readers
can find them. They should be clear, consistent and follow an ordered structure.
A guide is given in Box 8.1.
A reference consists of two parts: a notation or insertion in the text; and a full description of
the source.
There are two systems for notations and insertions: the footnote system and author-date
(Harvard ).
The footnote system uses a supertext notation in conjunction with footnote or endnote,
e.g.1 (In MS Word you would use the Insert/Reference/Footnote routine.) You can either
insert the footnote number immediately after the source or quotation to be referenced or
at the end of the sentence (after the full stop). The full description of the source should be
given in the footnote or endnote. When you use the number system of referencing, the full
description of the text in the footnote or endnote should follow the convention of:
Author, Initials (Year of Publication used) Title of Book. Place of Publication: Publisher.
Pages.
The Harvard system is more widely used than the numbering system. It consists of:
(Name of Author, Year of Publication used: page number) e.g. (Smith, 2007: 57). Harvard
is particularly useful where you want to acknowledge several texts and authors, e.g. (Smith,
2007: 57; Waterman, 2007: 132–5).
Completing a Literature Review: Accessing Published (β) Information 107
In all systems of referencing, you must provide a full description of the text or other source in
the Bibliography (list of sources) at the end of your research report.The convention is Author
name, Initials. (Date of Publication) Title and sub-title. Place of Publication: Publisher, e.g.
Burnham, P., Gilland, K., Grant, W. and Layton-Henry, Z. (2004) Research Methods in
Politics. Basingstoke: Palgrave Macmillan.
Where you draw your reference from an edited textbook, then the full description given
should be:
Budge, I. (1997) Chapter 1: Party Policy and Ideology: reversing the 1950s? In Evans, G.,
and Norris, P. (eds.) Critical Elections: British Parties and Voters in Long-Term Perspective.
London: Sage.
Where you cite an Internet source then the reference given should be:
Retrieval Method, e.g. http://, host and domain name, Path and File Name (Date of Visit).
Example
In 2003, I completed a short literature review on power. The first pages are
reproduced at the end of the chapter.
Ideally, the literature should be brought together in distinct groups or typologies.
One very effective way of communicating these is to tabulate the arguments by
schools or sub-topics. In this way, you can clearly distinguish the major differences
between groups of texts. The review can therefore concentrate on the main
arguments between the schools on key topics that you can then make the subject
of detailed scrutiny. In this way, you can achieve real depth – especially in terms of
original criticism – and show your mastery of the material. But remember that you
must justify your criticism: to argue that a text is ‘fundamentally flawed’, you must
demonstrate how. Where the synthesis reveals that the arguments have developed
over the years between and within schools of thought, then this relationship can be
mapped diagrammatically. Table 8.2 in the Questions for discussion or Assignments
shows how I was able to map the development of western philosophies on property.
Remember that tables and diagrams (and photographs) drastically reduce the word
count and add interest.
108 Research Methods in Politics
The literature review can be the most difficult part of the research project and the
most likely to be re-written as you seek to reduce its length. Three drafts are likely.
At the end of the first draft, ask yourself:
• Has the literature search revealed all the main sources? How do you know?
• Has the search identified those texts that are the most relevant, authoritative and
recent? How?
• Have you ‘gutted’ the most important texts and uncovered their ‘gists’?
• In writing the literature review, have you been able to organise the texts into distinct
schools or approaches?
• Have you clearly identified the agreements between different schools, their disagree-
ments, overlaps and, crucially, gaps in the literature?
• Have you identified and evaluated the key criticism already made by commentators?
• Have you provided original, penetrating and pungent criticism?
• In your criticism, have you clearly identified what is ‘known’, contested and ‘unknown’?
• Have you clearly identified the theoretical perspective to be adopted, the contested area
or gap in the literature to be addressed in the fieldwork, and a refined hypothesis to test?
If the answer to any of these questions is no, then you must revise – or wholly
rewrite – your literature review. Where the research is taking place over several
years, then you will have to revisit your literature review to identify any new
texts and amend your review accordingly. Your bibliography will also need
revising.
Plagiarism
Aristotle (348–322BC)
Cicero (106–43BC)
Seneca (48)
Calvin (1559)
Ponet (1556)
Grotius (1625)
Levellers (1646)
Filmer (1680) Hobbes (1651)
Locke (1690)
George (1880)
Spencer (1884)
Communism Libertarianism
Fascism Capitalism
‘Free Markets’
‘Property-Owning Democracy’
110 Research Methods in Politics
1. You have been asked to undertake a literature review on ‘social exclusion in the
UK’ (or another topic set by your teacher). Describe how you would undertake the
literature search and the priority to be given to particular sources. How would you
‘read’ the relevant texts? What records would you make of the key texts and how?
Describe the structure of your literature review.
2. Select a literature review from a journal article. Review it critically. How would you
improve how it was written and presented?
FURTHER READING
Power
Introduction
and Gramsci. More recent theorists include Bourdieu, De Jouvenel, Foucault, Clegg, Mann,
Wrong and the authors of what have been called the three dimensions of power : Dahl;
Schattschneider; Bachrach and Baratz; and Lukes. But whilst there are many theories,
most are either partial or offer views from different perspectives which reflect the normative
values or disciplines of the authors. Given the proliferation of theories and perspectives,
then exceptionally in this dissertation, their authors are identified in the text. Arguably, the
perspectives are also culturally and historically eurocentric (Foucault, 1973). But many of
the conceptualisations are supportive or compatible. For example, most support the view
that power is relational and relative. There is no absolute power. There is usually some
resistance – conscious or unconscious, overt or covert – to the exercise of power. There is
also complicity. Power is contingent. It is contextual. It is also fluid. It is generally a means to
objectives rather than an end in itself (which raises the question whether all means of attaining
objectives are forms of power). Power is a generalising medium, a characteristic akin to –
but different from – a resource and money (Parsons, 1963: 232–62). But the argument that
power, like money, is a ‘circulating medium’ (Pareto, 1935; Parsons, 1963; Habermas, 1987)
is not widely supported.
Power can be held and exercised by and between individuals, groups of individuals,
by organisations (‘embodied institutions’), and states (geopolitics). Power can be either
extensive, comprehensive or intensive (De Jouvenel, 1958: 159–69) where, as extensiveness
increases, comprehensiveness and intensity fall (Arendt, 1951). Power is exercised within
realms or scopes (Wrong, 1997: 10). Society is stratified by power where the strata reflect
the distribution of power.
Power may be distributive (conflictual – involving zero-sum outcomes), or collective
(co-operative, non-zero-sum outcomes), (Parsons, 1963). Distributive and collective powers
are dialectical : organisation is the manifestation of collective power which is inherently
oligarchic, where leaders exercise distributive power over members (Michels, 1949; Lowi,
1971; Mann, 1998). One consequence of collective power is that, paradoxically, individuals
become subordinated by the delegation they extend to officials (Bourdieu, 1999: 107–16).
However, the individual rarely belongs to only one organisation (Truman, 1951: 508).
Similarly, organisations rarely act alone: organisations are ‘functionally promiscuous’:
‘organisational outflanking’ is a common strategy contributing to the turbulence of power
relations (Mann, 1998: 7).
Collective power is the product of size (membership), solidarity and organisation (Wrong,
1998: 237). Solidarity derives from mutual identity, consciousness of kind and rituals of
belonging. But, as membership increases, intensity of common identity may diminish and
‘organisational diseconomies of co-ordination’ may multiply. The organisations created are
‘living machines’, sui generis characterised by their own objectives and internal conflicts
among members and officials (Weber, 1947: 140). Political mobilisation is the ultimate form
of collective power – where the organisation seeks control of the state (Wrong, 1998: 144).
Alternatively, parties or unions are seen as ‘class persuaders’ providing the structural cement
Continued
112 Research Methods in Politics
of ‘class reality’ rather than as an organisational expression, class or other groupings (Sartori,
1969 in Wrong, 1998: 167).
By most accounts, power over is a special (distributive) type of power to (of which
power against is a defensive type of power to). There is also general agreement on
the bases and forms of power. The bases – sources or domains (Dahl, 1961), power
resources (Wrong, 1997) – include ‘collectivity’ (the greatest), wealth, reputation, fear,
respect, success, nobility and excellence (according to Hobbes, 1651/1996: 58–59). Others
have added legitimate position derived from office, personal appeal, skill or specialised
knowledge (Dahl, 1961). Additional power (re)sources include property, class, credentials,
capacity for reasoning, information and knowledge, control of discourses, historiography
and discursive media (Foucault, 1978), ‘systematic luck’ (Dowding, 1996: 170), speech,
bearing, accent, clothes, how the mouth is pursed (Bourdieu, 1999: 17) and legitimacy –
moral, traditional or rational-legal (Weber, 1986). Thus power can be ‘original ’ (intrinsic)
or ‘instrumental ’ (acquired) (Hobbes, 1651/1996: 58). However, postmodernists argue that
knowledge, rather than being a source of power, is its product (Foucault, 1978).The argument
appears compromised by the secrecy of the modern state. Alternatively, the counter-
argument can be made that the state gathers, screens and guards the data from which
knowledge is fabricated to reinforce its dominant discourse; the ‘stem’ of the word statistics is
state.
Authority is problematic. The essential characteristic of authority is the general approval
and acceptance of those over whom it is exercised (Weldon, 1953 in Friedrich, 1958: 31).
But some argue that authority can only be derived from credentials or received wisdom
which confer ‘evidence of a capacity to reason, weigh alternatives and exercise delegation’:
authority is a source of power (Friedrich, 1958: 31; De Jouvenel, 1958: 159–69).
They believe that the quality of communication is the ‘essence of authority’ (Friedrich,
1958: 34–7). Thus authority can be exercised without power, e.g. Roman Senate, or
vice versa, e.g. Nero (Friedrich, 1958). Context may be instrumental (Bourdieu, 1999).
Most regard authority as a special form of power (Wrong, 1997) inseparable from
legitimacy (Weber, 1986). Others regard legitimacy as consent to authority in which
authority is a legitimate use of power and therefore different from power (Giddens,
1998: 339).
Power is a universal experience. Most people exercise power over others at some time –
especially as parents – and are also the subject of others’ power (although they may not
recognise its source or influence). Perhaps this universality explains the broad compatibility
of distinguished definitions: ‘an intuitive idea of power, is … A has power over B to the
extent that he can get B to do something that he would otherwise not do’ (Dahl, 1957:
201–05); ‘the probability that an actor within a social relationship will be in a position to
carry out his own will despite resistance, regardless of the basis on which this probability
rests’ (Weber, in Lukes, 1986: 28–36); ‘the capacity of persons or collectivities to “get
things done”’ (Parsons, 1963: 232); ‘the production of intended effects’ (Russell, in Lukes,
1986: 19–21 ); ‘the capacity to achieve outcomes … to make a difference’ (Giddens, 1984
Completing a Literature Review: Accessing Published (β) Information 113
in Clegg, 1984: 138 ); ‘the capacity to produce intended and foreseen effects in others’
(Wrong, 1997: 2);‘the ability to pursue and attain goals through mastery of one’s environment’
(Mann, 1998).
Power is, therefore, widely held to be primarily a capacity. Power can thus be
dispositional (capacity) or episodic (exercise of power) (Ryle, 1949, In Clegg, 1998: 73).
Intentionality is considered by many commentators to be a requisite of the exercise of
power (Russell, 1986: 19–21; Wrong, 1997, In Clegg, 1998: 73). Others argue that a ‘law
of anticipated reactions’ is evident where subjects anticipate and comply-in-advance which
makes redundant the exercise of power (Friedrich, 1937). This phenomenon challenges
the classical notion of power as necessarily observable in the sequence of stimulus-
delay response – ‘push-and-shove’ (Hobbes, 1691; Dahl, 1957). Intentionality is therefore
contested.
Power can be negative (prohibitory) or positive (especially Foucault) or both. But the
issue of overt and covert power is contested. Behaviouralists argue that only the observable
exercise of power is verifiable and substantive (Dahl, 1957). Others criticise this view as
‘one-dimensional’. They argue that power has ‘two faces’ and can also be exercised unseen
by non-decisions and by preventing issues from reaching agenda (Bachrach and Baratz,
1962: 947–52 after Schattschneider, 1961). Those with power determine both the rules-
of-the-game and which game is played (Schattschneider, 1961). Some argue that power
can be exercised unseen and unknown through hegemony - the cultural domination of civil
society by discourses which lead subjects unquestioningly to carry out activities which are
contrary to their interests (Gramsci, 1935 In Forgacs, 1988: 192; Lukes, 1974; Foucault,
1978). Lukes termed this: ‘three-dimensional power . . . the most insidious use of power . . .
by influencing, shaping and determining the very wants’ of those over which it was exercised
(Lukes, 1974: 23).
But others argue that three-dimensional power is unachievable (‘How is it done? With
mirrors?’ Clegg, 1998: 165). This challenges a major tenet of psychology that the major
determinants of personality, identity, attitudes and behaviour are the family, the state and
the economy. The (arrested) development and resource-dependence of children on the
institutions of parents and school makes them subject to exceptionally long periods of
control. However, ‘brain-washing’ has no enduring efficacy and may be a ‘coping strategy’
(Brown, 1983: 24). Foucault alternatively argues that control of thought and attitudes
is first achieved through control of physical behaviour, e.g. children being seated at
desks, soldiers marching, etc. (So, forms of dress which surround the body – ties and
rings – are, after Saussure, signs of others’ control.) Supporters of three-dimensional
power argue that this can be evidenced – paradoxically – through counter-factuals (Lukes,
1974) or counter-actuals (Dowding, 1996), e.g. Conan Doyle’s ‘dog that didn’t bark’ in
Silver Blaze. In any event, the consequences of the intended exercise of power will
generally have unforeseen or counter-intended consequences (Friedrich, 1937; Foucault,
1978).
Continued
114 Research Methods in Politics
of the inducement. Indeed, the practice may provoke resistance if the value of the
inducement is not raised and especially when inducements are withdrawn. Hence the
combination of coercive and inducive authority used in the form of ‘throffers’ (Dowding,
1996: 56–8).
Legitimate authority requires a bilateral acceptance by power-holder and subject of the
right-to-command and duty-to-obey, whereas competent authority (by this account) arises
from the subject’s belief in the superior knowledge or decision-making of the power-holder,
e.g. Socrates’ patient-doctor relationship. Personal power is unique to the power-holder and
subject; its bases are love and admiration or predispositions to dominate or submit. A special
type of extensive personal power is charismatic authority (Weber, 1986). Arguably, all forms
of authority are overlain by personal authority which power-holders craft to bolster their
power.
Each form of authority is unstable and subject to decay or de-mystification. Power-
holders must develop strategies of metamorphosis and diversification.The conqueror’s initial
coercive authority metamorphoses into legitimate authority as the conquered adjust to the
new power-holder. Arguably, the adage that ‘political power grows out of the barrel of a gun’
(Mao, 1938/72: 61) refers principally to the long-term consequences of coercion. However,
acceptance by subjects of the power-holder’s legitimate use of force is greatest when they
are likely to be unaffected by its use and where its use will be directed against ‘others’. The
professor who gives an incomprehensible lecture increases his academic authority (Foucault,
1999).
Power can be considered as a type of influence or, alternatively, all influences can be
considered as power. Understanding is obscured by the ‘polyvalence’ of words (De Jouvenel,
1958). Power has no transitive verb. Whilst its ultimate causality – agency or structure – may
be contested, its ultimate purpose must be the achievement of the power-seeker’s mastery
of the present and future environment – in its widest sense – social, economic, political,
technical, physical. Arguably, the ultimate power is social power – ‘mastery over other
people’ and, thus, their resources (Mann, 1998: 6). The ultimate means is through control
of the state which territorialises, institutionalises and regulates its population (Mann, 1998)
(although others have seen the state as the instrument of international capitalism (Marx)
and globalisation (Cerny, 1999). Power, unlike money, is hierarchical (Parsons, 1963). The
state stands at the intersections of ideological, economic and political systems and has
sole control of coercive military power (which has internal and external application). Until the
late eighteenth century, ideological (especially religious) and military power were dominant in
Europe (Mann, 1998). Now economic and political systems of power prevail. States have both
despotic power and, increasingly, infrastructural power – especially through state education
(Mann, 1998).
Who exercises the power of the state is contested. Pluralists argue that power is either
widely diffused within the systems or, where elites develop, no single elite dominates
(e.g. Dahl. 1961/89:). Elitists now emphasise the distributive power of a centralised elite
Continued
116 Research Methods in Politics
and the geopolitics between states. Institutional statists argue that states – not elites –
institutionalise social conflict in organisations which develop autonomous interests which
structure future conflicts (e.g. Skocpol, 1979 in Clegg, 1998: 259). The institutions provide
‘regulatory passage points’ (e.g. Parliament) in ‘fields of force’ (Lockwood, 1964: 244–57).
Alternatively, these views are rejected because they fail to recognise the disunity of
state institutions, confederalism, the ‘empty centre’, globalisation and ‘polymorphism’ (the
way states crystallise at different centres in power networks). Instead a cock-up/ foul-up,
‘organisational materialist’ model of the state is argued (Mann, 1998: 41). However, these
views embrace a variety of normative and descriptive viewpoints of a range of divergent
states.
These views also incorporate polarised perspectives of where, ‘in the final analysis’,
power lies and who initiates power. Modernists, after Hume and Hobbes and extending
to Dahl and Lukes, have developed primarily mechanistic concepts of power and causality.
They emphasise individual agency and autocracy and accept the centralising power of the
state through the social contract to achieve protective social order. Power is ‘zero-sum’; ‘the
negation of power of others’ (Clegg, 1998).
The alternative view is that structure prevails. The baize over which Hume’s billiard balls
move is already marked by folds which channel them along pre-determined pathways. The
modern individual is ‘institution-ridden’ and ‘institution-supported ’ (De Jouvenel, 1958: 164).
There was no original social contract. Marxists argue that the interests of the dominant
mode of production will prevail. The lives of people are ‘written’ by those who frame the
dominant discourses and exploit the social sciences to create ‘bio-power’ and systems of
surveillance (Foucault, 1978, 1995). Self-surveillance is the most effective. ‘They’ construct
nodal points which fix meanings essential for political articulation (Laclau and Mouffé, 1985).
Individuals are also caged by the past: ‘Men make their only history … under circumstances
directly encountered, given and transmitted by the past’ (Marx, 1851/1977: 300). They are
also caged by whoever constructs that history: ‘Who controls the past controls the future;
who controls the present controls the past’ (Orwell, 1949/1989: 37).
Alternatively, agency and structure ‘interpenetrate’ to form a ‘duality of structure’ in which
power can be analysed as ‘relations of autonomy and dependence between actors in
which they draw upon and reproduce structural powers of domination’ (Giddens, 1981: 29).
Within organisations, power relations reflect (mutual) resource-dependency, e.g. work-pay
(Mintzberg, 1983: 172). Whilst these and other power relations are asymmetric, subordinates
can extract benefits by emphasising the reciprocal obligations of power relations, e.g. the
‘deferential (farm) worker’ (Newby, 1977: 381–432).
Note
Questions
Elite interviews
Interviews are generally defined as: ‘conversations with a purpose’ (anon). Interviewing
members of the political elite – often shortened to ‘political elites’ – as a routine
activity is unique to Politics research. But it can prove difficult, especially for
first-time or young researchers to gain access to the most appropriate elite or
useful information from the encounter. Whilst gaining access to the most senior
elites may better serve your research interests, you may well be overawed and
inhibited by the combination of their personal presence, the presence of their
‘minders’ and the surroundings (which are often designed to create a sense of
power and prestige). Effective interviewing requires sound preparation, planning
and confidence. So class-based simulation and individual practice can be very valuable
to prepare you for the interview. Remember that the best way to learn is often from
other people’s mistakes in class exercises.
The whole process of arranging and conducting the interview is bound by
institutions (traditions, customs and rules) that vary significantly between states and
cultures. For example, officials in the People’s Republic of China will rarely agree
to be interviewed unless their superior has given formal approval. Even so, they
are obliged to re-state official policy. So, before you seek to interview elites from
a different state or culture to your own, find out – from a fellow student from that
country or from your diplomatic service – what the institutions are, how they have
developed and what purposes they perform. The advice given below is written for
students seeking to interview UK political elites. However, much of the advice will
apply to students seeking to interview elites in other western states.
The rules of the game for interviews cover whether the interview will be on a one-
to-one basis, whether the replies will be treated in confidence, attribution, circulation
of drafts, publication and recording. Subjects may ask for advance (written) notice
of questions to be asked. Paradoxically, there is some confusion as to what the
various terms ‘in confidence’ etc. actually mean. You are recommended to adopt a
conservative interpretation unless the subject agrees otherwise. Here, in confidence
means what it says: that whatever is said remains a secret between the interviewer
and subject. Off-the-record similarly means that no recording or note is kept
of the interview and that the information is provided to enable the researcher to
understand the context and background better. On-the-record means that the
comments can be recorded, used and attributed to the speaker. Subjects may switch
between ‘off the record’ and ‘on the record’ comments. Attribution means to
whom the comments are attributed. Unattributable means that the source is not
identified. However, agreement may be sought to attribute comments to a ‘former
minister’ to underline the authority of the source. Alternatively, sources may be
Asking Questions 121
anonymised, e.g. ‘a northern Labour MP, A argued that Minister B’s comments had
been reported out of context’.
1. Select the ‘target’ political elites on the basis of their recorded involvement in your
research topic. Do not rely on any one elite providing you with an interview or all the
information: adopt a ‘multi-track strategy’. Aim high rather than low by approaching the
‘A-list’ elites rather than lesser elites whom you may consider to be more approachable.
2. Access personal details from the Internet or parliamentary etc., directory. Telephone
their PA (personal assistant or secretary) to confirm their full title and preferred form
of address (e.g. Dr, Mr, Mrs, Ms, Minister, etc.). Then write a personal letter on your
Departmental University letterhead. Ask for their ‘help’: ‘help’ is a so-called ‘hook word’ to
which people have become conditioned to respond positively. Describe the importance
of your research and their potential contribution. Ask for an interview. Emphasise that the
research is for academic purposes. Reassure them that their comments can be treated
entirely in confidence, off-the-record or, alternatively, not individually attributed if they
wish. Ask them for an interview preferably before … Add how grateful you will be and end
by saying how much you look forward to meeting them. Offer a contact and reference
(your research supervisor) so that their staff can authenticate your identity and status.
Say that you will telephone their PA on a specific date to agree a time and date for an
interview. Describing your intention to call on a specified date means that the PA – who
will normally screen and ‘triage’ their mailbox into ‘immediate’, acknowledge/pending or
‘acknowledge/bin’ – will have to classify your letter as ‘immediate’ to seek instructions
(or give advice) whether the interview is to be granted or not. Retain the initiative: don’t
expect them to contact you first. When you telephone, you may be told that the elite is
unable to see you. In this case, ask why in a casual way: the PA may let slip information
that may be useful, e.g. ‘Oh, he wants to forget about that: it wasn’t his finest hour’.
Paradoxically, a non-interview can be a good source of useful material. An example of
an initial letter is shown in Box 9.1.
3. When you speak to the PA, try to obtain a late-morning appointment. This will allow your
elite interviewee to extend a ‘good’ interview by inviting you to lunch where you are likely
to be introduced to other contacts. Confirm the appointment in writing (email will suffice).
4. If you are unable to speak to the elite or their PA after several attempts, write again.
Attach a copy of your earlier letter. Be gently persistent. Exploit contacts and leverage.
For example, if the subject is an MP, attend their constituency surgery. Or ask your own
122 Research Methods in Politics
UWUK
Department of Politics
University of Watersea
Watersea
WA3 7HU
Dear Ms Atkins
I’m a local government practitioner studying for an MA in Urban Policy at the University
of Watersea. The subject of my dissertation is policy change theory. I’ve chosen ‘public
participation in the National Health Service’ for my case study. My special interest is the
apparent contradiction between the public’s readiness to comment as patients on their own
experiences of NHS services, and unwillingness to become involved as members of the
public in broader consultation exercises. I know that, when you were Minister of State at the
Department of Health (2005–6), this was a specific area of your responsibility. I understand
that, despite the successful introduction of YCTP, your wider ambitions were frustrated by
(what the Guardian described, 22 August) as ‘the opposition to reform from the medical
profession and leading foundation hospital trusts’.
I would therefore welcome an opportunity to meet you in London to learn at first hand
of your experiences and insights of promoting policy change. Your contribution will be very
significant. I can assure you that information gained will be used for academic purposes
only – although I hope that my research can be published in Policy Research Quarterly.Your
contribution can – if you wish – be entirely ‘off the record’ or ‘unattributable’.
I will phone your PA on Wednesday to – hopefully – arrange a date, time and place
where we can meet. Ideally, I would like to see you in June–July and, in any event, before
12 August. I look forward to meeting you.
Yours sincerely
Ted Smith
MP to arrange an interview. Ask your MP or local councillor to help set up meetings with
reluctant civil servants or local government officers. Remember that serving Ministers,
civil servants and local government officers are likely to be less willing to be interviewed
than others because of the heavy demands on their time and the risk of loss-of-office
from unanticipated disclosure. They will want to ensure deniability of any material that
inadvertently reaches the public domain. So only one researcher will be allowed to attend
the interview. Retired ministers, MPs and officials are likely to have more time on their
hands and may welcome the renewed attention and the opportunity to set the record
straight. But, whilst they may be less discreet – especially about former colleagues –
they will not necessarily be more truthful.
of greeting to which the expected reply is ‘fine, thank you’ (rather than a recital of your
current medical conditions).
• Follow Elton Mayo’s advice:
1. Give your whole attention to the person interviewed, and make it evident that
you are doing so.
2. Listen – don’t talk.
3. Never argue; never give advice.
4. Listen to:
(a) What he wants to say.
(b) What he does not want to say.
(c) What he cannot say without help.
5. As you listen, plot out tentatively and for subsequent correction the pattern
(personal) that is being set out before you. To test this, from time to time
summarise what has been said and present for comment (e.g. Is this what
you are telling me?) Always do this with the greatest caution, that is, clarify but
do not add or distort.
(Mayo, 1949: 64)5
And don’t agree with (and thereby reinforce or lend credence to) irrational prejudices,
fantasies or self-beliefs.
• Try to maintain eye-contact. Minimise note-taking. If you take verbatim notes then you will
be unable to study the subject. They are also likely to slow down their speech so that it
becomes too well-considered.
• Don’t be intimidated. Be gently assertive.
• Watch the subject’s body and look out for differences between what the subject is saying
and what is being communicated in body language. Touching the face around the mouth
or averting gaze can indicate a less-than-truthful response. Conversely, much waving
of open palms – a sign of openness and honesty – may be more evident of a learned
attempt to simulate sincerity (see Chapter 11).
• Retain control (which is difficult with authority figures).You must terminate the interview –
generally ten minutes before the hour likely to have been set aside. This early end is
likely to lead to apparently unimportant comments by the interviewee which may be very
significant. (GP’s [UK family doctors] are told that the most important remarks by patients
are made when they are opening the door to leave the consulting room.) Conclude by
asking if there is anything that you should have asked but missed out and what would
have been the subject’s reply.
• Write up your field-notes as soon as possible after the interview. Accurate recall fades
quickly (which is why wartime bomber crews were ‘de-briefed’ immediately after they
landed, even after very long flights).
that question first, she’s likely to repeat government policy about greater public
involvement in shaping government policy. So a possible sequence of questions and
supplementaries might be:
1. Minister, your (Labour) party founded the NHS 60 years ago. It has been described
as the ‘jewel in the crown’ of your party’s record in government. More recently, your
government has substantially increased the funds provided for health services. What do
you consider has been the NHS’s greatest success?
This is a non-adversarial question which is designed to flatter, to place the government
minister at ease and to give her the opportunity to be enthusiastic and, thus, open.
Her answer may well cite the success of NHS services for children where mortality
rates have been drastically reduced. Your supplementary question may therefore be:
Why do you think that the NHS has been so successful with children’s services?
2. Many GPs and hospital consultants objected to the founding of the NHS. The minister,
Aneurin Bevan famously said that he had obtained the consultants’ agreement by
‘stuffing their mouths with gold’. Despite very generous new contracts, many doctors
remain critical of the NHS. How best can the government win their support? Or – as
Denis Healey said – is acquiescence sufficient?
(Possible supplementary) What lessons have you learned from the ‘new contracts’?
3. Demand by patients for emergency and other health services continues to grow as do
the costs of new drugs and equipment. Commentators have referred to a ‘crunch time’
when either services will have to be rationed, or taxes or charges increased. What’s your
view of the future?
(Possible supplementary) How can your own MPs’ historic opposition to increased
charges be overcome?
4. The government favours greater delegation of decision-making to local NHS trusts and
greater public participation in the process. But this can lead to different practices being
adopted in different areas which the news media describe as a ‘postcode lottery’. The
government also sets national policies in the form of ‘national frameworks’ specifying
standards of care. Given this complexity, what therefore is the real scope for public
participation?
(Possible supplementary) I think I understand. But then why did the government scrap
the Community Health Councils and the replacement Forums for Patient Involvement?
5. A final question: some critics claim that the government’s new support for greater
participation by the public, is merely a cynical ploy to disguise its necessary strategy
of wholesale reform of the NHS. They say that you enlist the support of the public only
when it suits you, and then as a counter-balance in a ‘force-field’ to the opposition by the
medical professions, hospital managers and unions. I understand that you had some
Asking Questions 127
reservations to the high priority given by your colleagues to ‘Patient Choice’. What do
you think?
(Possible supplementary) Your constituency has two district hospitals providing the
full range of services. The government now favours a mix of larger, ‘locality hospitals’
offering full services, and more localised walk-in and GP surgeries. How will you ‘square
the circle’ of defending both government policy and your constituents?
6. Minister, thank you for your time. Are there any questions which you believe that I should
have asked but didn’t. Can you recommend other people I should speak to?
Post-interview
• transcribe the recording and apply the format of commentary-transcript-analysis
• separate out ‘quotable quotes’
• summarise the answers to your original questions
• triangulate with other sources
• follow-up leads
• write thanking the subject and forward a copy of your abstract at a later date. You may
want to interview your source again for other research. Use this opportunity to seek
confirmation of unexpected replies to important questions.
You are also likely to want to interview other people – ‘non-elites’ – to provide
perspectives from users or practitioners. For example, if you are researching
social exclusion, then you will need to interview a cross-section of socially-
excluded people and those responsible for implementing government policy. They
may include homeless people, unemployed people, single-parents, older people,
JobCentrePlus staff, social workers, voluntary agencies and council officers. Unlike
128 Research Methods in Politics
A B
So, to really see the world through the subject’s eyes, you must, first, identify
your cultural and communications overlap and, second, expand your own field of
experience. Living in the locality and carrying out pilot interviews can be very useful
to develop the local vocabulary and to understand local discourses.
You should be able to access the research subjects using either the snowball or
nomination methods described in Chapter 8.
The interview should follow the same semi-structured interview schedule of
open-ended questions and supplementary questions used for elite interviews.
However, the general style will be gentler and softer. You are more likely to engage at
a closer, personal level and gain enduring friendships. Indeed, interviewing members
of the general public can be the most enjoyable and rewarding part of the research
process. Members of the public are more likely to make admissions and confessions
to complete outsiders than to members of their own family. The interview may
prove a liberating experience for them.
Asking Questions 129
Payment
In the UK, payment is not expected for interviews. Indeed, its offer may offend.
But, in other countries, some ‘reciprocity’ is expected. You will therefore need to
find out local custom and practice. In the UK and elsewhere, the offer of a gift of
a small memento in the form of a university key-ring or letter-opener at the end of
the interview is likely to be appreciated. Where a subject has been especially helpful,
then sending a relevant paperback book may be appropriate.
Recording interviews
A. [coughs]
003 I rushed to the House
4 sec pause, rubs 004 immediately to . . wary of expressing real intention?
chin support ? Was he really a strong
supporter of Ken or did he regard him
as most likely winner and wish to see
what advantage he could gain? Or did
he lie low until the outcome became
clearer?
7 sec pause 005 offer my support to . .
looks up to see 006 … Ken
reaction
telephone rings in
outer office
transcribed into text using the three-column format shown in Table 9.1. Note how
you should give each subject and interview a unique reference and add line numbers
to enable accurate references to be given, e.g. (A01: 003).
A 50-minute interview generally takes a whole day to transcribe. Audio-tapes can
be transcribed using a pedal-operated player. Digital recordings can be transcribed
direct to your PC. Voice transcription software is now available (Dragon Naturally
Speaking Professional 9 from Nuance Communications) which claims to be able to
transcribe one voice without extensive calibration. This may be very useful for
transcribing narratives. However, voice-transcription software is not yet able to
automatically transcribe several voices at the same time (although this appears likely
in the future). Full transcription is therefore generally confined to selected parts of
elite interviews where a detailed textual analysis is proposed. A supplementary or
alternative approach (which I prefer) is to write-up an ethnographic account which
combines observations, events and quotable quotes. An example is given in the
box (9.3) overleaf.
Every community has its own pariah or difficult topics where special care is required
in introducing, framing and expressing questions. British people have many. One
explanation of why British people discuss the weather at their first meeting is that
it is the only common, safe topic in a repressed society where religion, politics, sex
Asking Questions 131
and even sport are regarded as essentially difficult and therefore private matters. The
pariah topics in western society have been categorised as:
• illness and disability – especially sexually transmitted diseases and mental illness
• illegal and contra-normative behaviour including crime, tax evasion, drinking and sexual
practices
• financial status including income and savings.
(Foddy, 1993: 115)10
There will also be some people who are unwilling or unable – consciously or
subconsciously – to answer your questions.
In all these circumstances, projective techniques or vignettes may be appropriate.
Projective techniques are designed to prompt answers. The main types are:
You will appreciate that not all types of projective techniques are appropriate to all
subjects and circumstances. Tact is essential. But you will find that many subjects
find some of these types of question to be enjoyable and act as ‘ice-breakers’ in
otherwise tense situations.
A vignette is a more subtle form of question. Vignettes are:
Vignettes are premised on empiric evidence that what people identify as their
beliefs are often compromised by their actions. For example, when people are asked
whether they are honest, they will generally apply affirmatively. Similarly, they are
likely to denounce racial prejudice. But actions – what people actually do – provide
better evidence of underlying belief systems. Indeed, small changes of behaviour
can prompt fundamental changes of belief. Good vignettes pose some form of moral
dilemma. They may also ask what the subject should do and what they would be most
likely to do. For example, most people, if asked, will say that they strongly oppose
cruelty to children or racial segregation. They will also say that they are honest.
In these circumstances, vignettes may be helpful. Consider the three examples:
1. A family has moved into the terraced house next door to you. After a few months of
heated arguments, the husband quits the house leaving the mother alone to care for
two children under six years old. The boy is a ‘bit of a handful’. But you hear him being
slapped and being told that he’s ‘stupid’ and ‘just like his dad’.
What should you do:
A Speak to the mother?
B Speak to the authorities?
C Do nothing: mind your own business?
What would you actually do? Why?
2. You join the queue at the bus stop. When your bus arrives, it’s nearly full. You’re last on
board. There are only two seats vacant. They’re next to people of your same age and
sex. One is the same race as you. The other is a different race. They both remove their
bags. You have three options:
A Accept the place next to the person of your same race?
B Accept the place next to the person of a different race?
C Stand?
134 Research Methods in Politics
3. You approach the vending machine in the refectory to buy a coffee. You are about to
insert a 50p coin when you notice that there is already one lying in the change slot.
What should you do?
A Hand the 50p coin into the porter’s lodge as ‘lost property’?
B Use the coin to get your drink?
C Put the coin in the charity box in the bar?
What would you actually do? Why ?
Good vignettes are difficult to write and should be pre-tested before finalising. One
useful adjunct to vignettes is to ask respondents – at the end of the interview –
what they actually did in memorable circumstances to calibrate their general responses.
Examples might include whether they’ve always voted for the same political party.
One set of questions that I’ve found useful is to ask older subjects their support (on
a scale of one-to-ten) for the mineworkers in the ‘three-day-week’ (national strike
which led to the fall of the Conservative government) of 1974 and, after they have
answered, their support for the mineworkers in 1982–3.
In many circumstances, partners may ask if they can stay during the interview.
You must always give parents or carers of children this option. This can inhibit the
subject. But it can also provide or deny corroboration. I well remember that, when
a husband replied that he was ‘fully behind the miners in 1983’, his wife added: ‘Oh,
no you weren’t. You said that Arthur Scargill should be strung up!’12
Focus groups
The optimum number of participants is usually between five and eight. This
will ensure a variety of views and an opportunity for each person to speak. The
participants should, in the first place, provide a cross-section of people sharing a
particular identity and location. They can be recruited by word-of-mouth, public
notice or via a social gatekeeper intermediary. Where a social gatekeeper is available
then they should be used, first, because they are likely to be able to recruit a willing
cross-section more easily and, second, because if their help is not sought, then they
may be offended and oppose the research. They may be clergy, teachers, councillors
or the secretaries of local groups. They will advise you whether and what kind
of ‘incentives’ (i.e. a small gift) should be offered to the members of the group.
However, you should personally write to or contact the people suggested to you to
invite them to the meeting and to outline your research, the benefits to them, and
the rules-of-the-game.
The venue should ideally be a neutral, central location in which the group can sit
comfortably for as long as two hours. ‘Hospitality’ should be offered in accordance
with local conventions. So, in the UK, tea or coffee and biscuits should be provided.
Occasionally, wine may be offered. The seating should be set out in a circle. But
many researchers find that people feel more confident when they are sitting in a
circle of easy chairs or, if these are not available, around a defensive perimeter of
tables. You should sit down first and allow the members of the group to sit where
they wish. The seating pattern is likely to reflect their assessment of their relative
social position. So, the members considering themselves most important and capable
of speaking out are likely to sit facing you. Conversely, the least confident members
are likely to sit at each side of you.
You should start the session by explaining the nature of the meeting and re-
stating the rules-of-the-game. Where you have a central topic, then you should
specifically invite the views of the group. Alternatively (and often better), you should
ask the group which issues are most important to them. Ideally, the session should
then proceed entirely driven by its members. But, in practice, some intervention –
moderation – by the researcher may be necessary. This may include (tactfully)
silencing dominant members (by a finger to the lips), inviting those who have
remained silent to state their views, stopping rows emerging and moving on when
136 Research Methods in Politics
1. Draft letters to each of the following seeking an interview to learn their views on
the use of military options to counter terrorism:
George W. Bush
Tony Blair
President Chirac
Martin MacGuiness
Asking Questions 137
2. The (Labour) Leader of the city council in the north of England has agreed to
be interviewed on the subject of corruption in local government. Your research
hypothesis is that ‘standards of public office’ are locally contingent and emergent
rather than absolute. A recent press report alleged that the leader had favoured
a cousin in a construction contract. Draft a semi-structured interview schedule.
Complete and video record an in-class simulation in which two students separately
interview the Leader of the council (who is best played by the course teacher or a
mature postgraduate). Contrast and compare the interviews.
3. A bacon factory in a nearby market town slaughters and packs pork in a continuous,
industrialised process. It employs over 2000 workers. The majority are young
women who are bussed in from villages in the upland areas. Union membership
is low and staff turnover high. The management recognises USDAW for pay (etc.)
negotiations.Your hypothesis is that membership is low because of a combination
of a rural culture of deference, the portrayal by managers of the union as a ‘big
city thing’ and the domination of union offices by men. The HR staff and union
have nominated a cross-section of female workers for you to interview in paid time
as a group and singly. Draft a semi-structured interview schedule to be used in
individual meetings with the workers. How would you organise and structure a
focus group of the workers? Simulate, contrast and compare the interview and
meeting.
4. You have arranged to meet a newly-retired infantry major who took part in the
invasion of Iraq. He strenuously denies that torture is used by British soldiers.
Design a series of vignettes to test your hypothesis that undue pressure was
exerted by some soldiers on prisoners to obtain information with the knowledge
of their officers who turned a ‘blind eye’ to these practices.
FURTHER READING
Arksey, H. and Knight, G. (1999) Interviewing for Social Scientists. London: Sage.
This textbook provides a rich variety of theoretically-based, practical techniques
for all social science researchers.
Berg, B.L. (2001) Quantitative Research Methods for the Social Sciences. Boston:
Allyn & Bacon. pp. 66--99. Chapter 4 adopts a ‘dramaturgical look’ at interviewing
as variously an art, skill, science, game and face-to-face interaction. It examines
the separate roles of the interviewer as an actor, director and choreographer.
This text provides very good advice for the inexperienced interviewer.
Burnham, P., Killand, K., Grant, W., and Layton-Henry, Z. (2004) Research
Methods in Politics. Basingstoke: Macmillan. pp. 205–20. Chapter 9 of this
textbook is devoted to interviewing political elites.
138 Research Methods in Politics
Notes
1 Note that, in the UK and many other countries, it is illegal to record telephone conversations
without the consent of the respondent.
2 bona fides, Latin, ‘in good faith’.
3 Friedrich, C.J. (1937) Constitutional Government and Politics. New York: Harper & Brothers.
4 An elite’s ‘opposite number’ will normally be the member of the opposition party or group
nominated to lead the opposition to a particular policy area for which a minister holds
responsibility. They may be called the ‘shadow spokesperson’. A ‘parliamentary pair’ is the term
used to describe a grouping of a government and opposition MPs in which, when one is unable to
vote in Parliament for unavoidable personal or parliamentary reasons, the other will abstain.
5 Mayo, E. (1949) Hawthorne and the Western Electric Company. London: Routledge.
6 Wilbur Schramm, How Communication Works. The Process and Effects of Mass Communication
ed. Wilbur Schramm (Urbana, Ill.: The University of Illinois Press, 1961) pp. 5–6.
7 Berg, b.l.(2001) In Quantitative Research Methods for the Social Sciences. Boston: Allyn & Bacon.
p. 99–100.
8 Smith, M. (1993) Personal Interviewing: A Mini-Training Workshop In Breakwell, G.M.; Foot, H.
and Gilmour, R. (eds.) Doing Social Psychology: Laboratory Exercises. Leicester: BPS. pp. 23–31,
40–1.
9 Dr Max Bergman, lecture to Essex Summer School as part of the course ‘Qualitative Data
Analysis: Interpenetrative Methodologies for Analysing Text and Talk’.
Asking Questions 139
Questionnaires
• use very large samples (e.g., opinion polls use samples of 1,500 people, medical research
can use samples of 60,000 or more)
• use only closed questions
Questionnaire Surveys 141
• use pre-determined answers – including Don’t Know (DK) and No Response (NR)
• take less time for the subject to complete
• seek to use representative samples
• can be administered (carried out) by intermediaries
• similarly, the tasks of questionnaire design, administration, coding and analysis can be
carried out by separate individuals or teams
• can be administered either:
• face-to-face with the subject
• remotely by telephone
• self-administered by the subject in their own home (or workplace, etc) using self-
completion questionnaires delivered and returned by mail
• email.
• are a common tool of quantitative method
• are designed and coded to be readily analysed by computers
• necessarily involve a trade-off between cost, reliability and time.
Access
Access concerns the means by which the subject is contacted. It requires a sample
frame (a list of the research population from which the sample can be drawn),
a means by which a representative sample can be selected and some form of address
or arena where the questionnaire can be administered to them. In the UK, the two
most common forms of lists were the electoral register and the telephone directory.
So, if you wanted to research the general adult population of a city or part of a
city using a 10% sample, then you would use the electoral register to select every
tenth person. The register would also give their address where the researcher could
call on them, post the questionnaire to or, after looking up their number in the
telephone directory, phone them. However, the introduction of the ‘community
142 Research Methods in Politics
Pilots
Having designed the quota sample, then the next stage is to pilot your questionnaire
survey, i.e. test it on a small sample. This is most readily done by trialling the draft
on non-teaching staff at your university. They will tell you if they find the questions
difficult to understand or answer. They may suggest more appropriate (to the local
population) ways to ask your questions. The pilot should also help you identify or
amend your list of potential answers.
Hello, what a lovely/cold/awful day.You look as if your enjoying the rest … Can you help?
I’m a student at the university. We’re trying to find out what local people think about the
EU and why …. May I sit down? It won’t take long … Do you live in Watersea?
Motivation
Response rates and co-operation are likely to be much higher when the potential
subjects feel motivated to assist. Motivation means providing the necessary
incentives for respondents to give their time, views and personal details. This involves
appeals to altruism (concern for others’ welfare), public or personal benefits, or
small measures of ‘reciprocity’, e.g. a pen, token, lottery ticket or donation to
charity. Motivation also involves dispelling doubts about your identity, real purpose
144 Research Methods in Politics
The main problem for students is framing questions in plain conversational language.
There is a tendency to use academic or technical language and to be precise
Questionnaire Surveys 145
• proxy-indicators
• show-cards
• post-codes.
Proxy-indicators
One way of asking sensitive questions is to use proxy-indicators where precision is
unimportant. A proxy-indicator is an alternative means of measuring or describing
a variable, e.g. using housing tenure (whether subjects own or rent their homes
and the number of bedrooms) as a proxy measure for income. The indicator is
effectively an approximation. Alternatively, you can use established classification
schemes. The social classification scheme most widely adopted by government and
146 Research Methods in Politics
private organisations is the A, B, C1, C2, D, E. The broad definitions and percentages
of the population of England given in the 2001 census are shown in Box 10.1:
A Higher managerial/administrative/professional
22%
B Intermediate managerial/ administrative/professional
C1 Supervisory, clerical, junior managerial/administrative/professional 30%
C2 Skilled manual workers 15%
D Semi-skilled and unskilled manual workers 17%
E On state benefit, unemployed, lowest grade workers 16%
• ‘What do you do for a living?’ (If they reply that they are retired or not working, then ask:
‘What did you do last’?)
• ‘Which daily newspaper do you normally read’?
• ‘When did you leave school: at 16 or 18?’ (if they reply ‘18’, you can then ask: ‘Did you go
on to university?’)
• ‘Do you rent or own your home?’
Note how the questions are phrased using conversational English. Note also how
they avoid the prestige bias of implying that the respondents should go to university
and should own their own home.
The issue of newspaper readership is interesting. Currently, UK newspapers rely
on commercial advertising for over three-quarters of their income. To survive,
they must therefore sell their readerships to advertisers. The National Readership
Survey audits sales and readership using the ABC classification. Newspaper groups
seek to ensure maximum market penetration by publishing a range of ‘titles’
Questionnaire Surveys 147
(newspapers) which are designed to appeal to all the major market segments.
Examples are:
So, asking people which newspaper they read can be an easy, inoffensive way of
gaining information into their lifestyle group and social class. In the UK, there is also
a relationship between newspaper readership and political affiliation. The Telegraph,
Times, Mail and Express are traditionally associated with the Conservative Party and
The Mirror with Labour. The Guardian and Independent are more sympathetic to
Labour and the Lib-Dems whilst the (best-selling) Sun is regarded as supporting
whichever party is most likely to win the next election. Therefore, if a subject
tells you that they read The Telegraph, then, rather than asking which party they
support, you can ask (with a slight smile) whether they support the Conservative
Party.
Show-cards
Another ways of seeking information on class, socio-economic group or other
sensitive issues is to use show-cards. Here you ask the subject to look at a card and
to say ‘which letter corresponds to your income’. The card might read:
Postcodes
A third method is to ask subjects for their (home) postcode (similar to the US
zipcode). The housing market in the UK tends to bring together people of similar
age, income and socio-economic class. Groups of around 50 homes are classified as
enumeration districts (EDs) which form the basic building block of population census
data. The firm CACI has matched small area census data and postcodes to create
ACORN : a classification of residential neighbourhoods.
ACORN categorises all 1.9 million UK postcodes, which have been described using
over 125 demographic statistics within England, Scotland, Wales and Northern Ireland,
and 287 lifestyle variables, making it the most powerful discriminator, giving a clearer
understanding of clients and prospects.
(www.caci.co.uk)
So, a simple way of finding out social class, etc. is to ask people their postcode.
The weakness of this approach is twofold: first, its assumption that all people sharing
the same postcode are very similar; and, second, the cost of subscribing to CACI.
However, you can avoid the subscription fee by using a map of post-codes (likely
to be held in your university library) to cross-refer to a map of enumeration areas
and the census data.
Scaling attitudes
Semantic differential
The semantic differential was developed by Good in 1957. It uses a five- or
seven-point scale to assess respondents’ assessment of conditions or abilities, etc.
between pairs of words with diametrically opposite meanings.
For example:
Alternatively, you can give the respondent a list of semantic differentials for
comment, e.g. trustworthy/untrustworthy, sincere/insincere. The difficulty is to
find generally-acceptable differentials for some words like ‘aloof’ etc.
Questionnaire Surveys 149
Likert scale
The Likert scale (Likert, 1932) puts the question in the form of a statement with
which the respondent is asked to scale their agreement or otherwise.
For example:
‘How strongly do you agree or disagree with the following statements: the Prime Minister is
essentially honest’, etc.
Strongly agree agree neither agree nor disagree disagree strongly disagree
2 2 2 2 2
☺ ☺ ☺
Guttman scale
A weakness of both the semantic differential and Likert scale is the marked tendency
for many respondents to select the central, neither/nor answer. The Guttman
scale seeks to overcome this problem by asking a series of related questions
which will determine the intensity of the respondent’s attitudes to a specific issue.
It can therefore be likened to limbo-dancing or high-jumping. It seeks to build a
continuum in which the respondent’s answer to one question is likely to be repeated.
The process begins with you drafting a series of statements referring to the chosen
topic. Ideally, you should draft as many as 100. You should ask your research
colleagues to separately consider the drafts and to say whether or not each statement
directly relates to the topic or not. The ten statements receiving the highest ‘yes’
vote are selected. A pilot study of the sample population is carried out in which
the respondents are asked whether they agree or not with the statements. The
answers are then tabulated into a scalogram in which the questions are ranked by
the highest number of positive responses received. The ranking constitutes the scale.
An example of the Guttman scale is the Bogardus Social Distance Scale which seeks
to measure respondents’ attitudes towards social groups in terms of the degrees of
social acceptance. For example, a Guttman scale question might ask each subject:
• neighbours (5.00)
• work-colleagues (4.00)
• UK citizens (3.00)
• visitors (2.00)
• would exclude from my country (1.00).
Note that agreement with the first statement indicates likely agreement with the
following statements until the last. So respondents most favouring immigrants would
achieve the highest score, 28 (i.e. 7 + 6 + 5 + 4 + 3 + 2) whereas those most hostile
would score only 1.
Another example would be attitudes to capital punishment, e.g.
• There can never be any justification for the death penalty (score 0.00)
• The death penalty can only be justified in exceptional circumstances following a trial
where evidence had shown beyond a shadow of doubt that the accused are guilty of:
• crimes against humanity including genocide (1.00)
• a murder following a previous conviction for murder (2.00)
• the murder of two or more children (3.00)
• murder and rape (4.00)
• murder in the course of other criminal activity (5.00)
• any murder (6.00)
• lethal injection is not painful enough (7.00)
• executions should be carried out in public (8.00)
In this case, abolitionists would achieve a score of 0.00 whilst ‘hangers and floggers’
would score 36.00. Note that, except for the first statement, agreement with other
statements implies agreement with all preceding statements. The responses can then
be displayed in a frequency table and chart which show the distribution and intensity
of opposition and support for the capital punishment (see Fig 10.1).
Ideally, the statements should be scrambled before they are presented to the
respondent. But, in practice, it is much easier for the researcher and subject if the
questions are asked in accordance with the scale.
Scale-rating
Scale-rating is a new scale developed largely by the entertainment media and widely
used by younger people. It asks people to ‘rate’ a particular individual or other entity
on a scale of 1–10 (where 10 is ‘well cool’).
Questionnaire Surveys 151
40
Intensity of support for
35
30
death penalty
25 Support for
20 death penalty
15 (max 36)
10
5
0
0 10 20 30 40
Respondents (%)
But whilst a question might be simple and straightforward for ‘media-savvy youngsters’,
it might not be readily understandable to older people.
Ranking
Subjects can also be asked to rank the importance or significance they give to
particular characteristics, e.g.
152 Research Methods in Politics
A honesty
B intelligence
C local knowledge
D party loyalty
E shrewdness
F business experience
G personal wealth
H involvement in the voluntary sector
Whilst this technique has certain advantages, it can irritate subjects when they are asked to
rank a complete list of criteria. It is therefore best used sparingly and with a show-card and
pencil to hand where conditions or the short-term memories of respondents prove difficult.
Personal safety
Face-to-face interviewing poses potential risks to you. These can be reduced by
observing the following do’s and don’t’s:
DO
• carry ID and a letter of authorisation from your course leader or tutor written on
departmental letterhead and providing a series of contact telephone numbers
• carry a mobile phone
• always carry out your questionnaire surveys within sight and earshot of another
student
• carry out your surveys in daylight in a public place
• consider borrowing or buying a personal alarm
• comply with any instructions from a police officer to ‘move on’
Questionnaire Surveys 153
• where the survey is being carried out as part of an assignment, ask the course
leader to write to the local police commander and local authority notifying them
that you will be carrying out the survey, when and where.
DON’T
Overseas students often worry that they will have greater difficulty in recruiting
members of the public to help with their surveys. However, experience in York has
been that overseas students have rather less difficulty than ‘home’ students because
the public are curious and want to find out what they think of the UK.
Coding
An important feature of questionnaire design is the coding of questions and
alternative responses to enable manipulation of data and analysis by computers.
A code is the representation of any group of words (or numbers) by a unique
set of numbers or letters. The initial pilot questionnaire should establish the range of
most frequent responses (scoping). Advances in software have enabled the coding
to be simplified. A simple generic form of coding can be used which combines the
number of the question and a number allocated to each potential response.
For example, if Question 7 asks whether the respondent left school at 16 or 18
then the coding (see brackets) might be:
Left at 16 (07.1) :
Left at 18 (07.2) :
Don’t know (07.3) :
No reply (07.4) :
coded 1, ‘neither agree nor disagree’ 0, ‘disagree’ −1, and ‘strongly disagree’ −2.
So, if the average is 0.25 then the average view of the public is only marginally
in agreement with the statement. But there is a flaw: the assumption that levels of
agreement etc, are linear and equal, so that one person’s ‘strongly agree’ is equal to
two people’s ‘agree’. This assumption is highly questionable.
The coding will enable the answers received to be recorded directly into a table
or spreadsheet: you do not need a separate questionnaire for each face-to-face interview. It
is usual to list the respondents in the left-hand column and the questions in the
top row. Each cell in the table will contain the sub-code for the answer given (see
Table 10.2). Each respondent should be given a unique reference which, where
a team of researchers is used, should identify who administered the questionnaire.
This can be extended to denote where and when the survey was carried out.
The best way to learn how to design a questionnaire is to complete one. An
example of a questionnaire is therefore given below as a demonstration.
Questionnaire
You have been set the assignment of answering the research question:
Examination of the Eurobarometer site has shown that support by the UK public
for the EU has fluctuated. But support is greater in Scotland and Wales. Overall
UK support reached its lowest following French and German refusal to join the
invasion of Iraq and widespread opposition to the proposed new constitution.
The UK government has deferred any decision on ‘joining the Euro’ (European
Monetary System) and any new constitution which would involve majority voting.
Questionnaire Surveys 155
Hello, can you help me? I’m a student at the university. We’ve been asked to find out why
British people are so anti-EU. I’d like to ask you ten questions. It will take five minutes.
I will not ask you your name or address, so whatever you tell me can’t be traced back
to you.
Q2. How would you describe your overall attitude to the EU?
Q5. On the other hand, critics of the EU say that the costs are
considerable. They argue that the disadvantages are:
• Freedom for Poles and other EU people to enter UK to seek work 5.5
• The ‘Brussels bureaucracy’ 5.6
[Pass show-card]
Which do you think are the two biggest disadvantages on this list?
• Don’t know 5.7
• No response 5.8
Q6. I’d like to ask you how patriotic you feel. How proud are you to
be a resident of
Some people claim that age, sex and background affect people’s attitude to the EU.
Q7. When were you born? Or, how old are you?
Q9. What do/did you do for a living? [ask them for their occupation
which you allocate to the most appropriate group below]
Thank you for your help. Have you any questions for me or additional comments about
the EU that you’d like to make?
Note how the temptation has been avoided of asking the respondents’ knowledge
of the research office by, for example, asking: ‘who is Head of the European
Commission?’ A questionnaire should avoid being a quiz or asking questions which
seek to verify answers: don’t be too clever.
Questionnaire Surveys 159
1. Pilot the questionnaire on at least two members of the public (not students). What
improvements would you suggest and why?
2. You are asked to test the hypothesis that age and education strongly influence
the likelihood of electors voting in general elections. You must use a ques-
tionnaire. Identify the sample frame. Devise a quota sample for an on-street
survey. Design, test and revise a questionnaire of no more than 12 questions.
Administer the questionnaire to ten members of the public in the main shopping
street. Comment critically on your experiences as a questionnaire writer and
questioner.
3. Discuss critically the claim that questionnaires can measure people’s attitudes
and beliefs.
4. Most of the national opinion polls published in the lead-up to the 1992 UK general
election wrongly forecast the outcome. Critically assess the various explanations
given by analysts.
FURTHER READING
polls leading up to 1992 when most of the pollsters’ forecasts (that the
Conservatives would lose) proved wide of the mark.
Yates, S.J. (2004) Doing Social Research. London: Sage. pp. 31–64. Whilst
coverage of the topic may seem slight, this book excels in the rich case studies
(including the 1992 UK polls) and the discussion of model answers to the
questions asked of readers.
Chapter 11
Observation
‘A politician can never [lie] flawlessly because their body language will always give
them away, psychologists say’.
(BBC News 5 September 2006)1
Introduction
A senior nurse pursuing doctoral research in Politics at York argued that too
much attention is paid by Politics researchers to what people say and write and
too little to how they behave and what they do. She described the importance
given in medicine to the systematic observation of patients as part of the initial
process of analysis and diagnosis and, subsequently, in assessing the efficacy of
any ‘intervention’ (treatment) and ‘management’ of illnesses (which are no longer
regarded as ‘cured’). Particular attention is paid to how the patients initially ‘present’
themselves: degrees of consciousness; whether they exhibit cheerfulness, sadness,
pain or anxiety; whether their faces are pale, perspiring or ‘florid’; whether they
walk with or without difficulty; whether they are obese, well-nourished or thin; the
attention they pay to their surroundings; hearing or other sensory difficulties; how
they treated their carers and medical staff, and so on. These initial observations
are noted and followed by measuring the ‘vital signs’ of blood pressure, pulse,
temperature, breathing and heart rate. This researcher argues that Politics researchers
should similarly observe, record and analyse how subjects present themselves as an
integral part of the data collection and analysis process.
162 Research Methods in Politics
But what are the claims of body language? How can they be assessed? What is its
value to Politics research?
Tony Blair unconsciously fiddles with his little finger whenever an opponent makes him
anxious … George Bush bites the inside of his cheek at anxious moments … Bill Clinton
Observation 163
tended to bite his lip when he wanted to appear emotional … George Bush walks like
a bodybuilder, hanging his palms to the rear as though laden by huge muscle, to imply
that the is larger than he is’ … [However] no amount of coaching or media training can
co-ordinate the hand gestures and facial expressions to fully cover up what a person
knows not to be true.2
Expert opinion
Mixed actions have, as the term implies, a combination of origins. For example,
innate actions like crying are modified by social pressure to an occasional tear or
sniff in western society and wailing in other cultures. Another mixed action is the
realisation of the comfort derived from sitting cross-legged. But US culture regards
cross-leggedness as effeminate: hence, perhaps, the US practice of men sitting behind
the backs of the chairs to achieve manly postures. Social etiquette also affects the
precise form of actions.
Gestures are a sub-group of actions: they are adopted to visually transmit a signal
to the observer. Morris introduces a convenient classification of gestures as either
incidental or primary. Primary gestures are those which you perform alone. They
are non-social and convey no meaning. You rub an itch because it relieves the
discomfort. Winking, on the other hand, is an incidental gesture which provides mood
signals (in this case, collusion). Sometimes you deliberately use primary gestures as
stylised incidental gestures to convey mood, e.g. when you deliberately slump or yawn
to communicate your boredom and disrespect for the teacher.
There are six primary gestures of which five are unique to Homo erectus (‘Man’).
The exception is the expressive gesture. This is made by the face or hands. But, as we
mature, they can become modulated by cultural and gender influences.
Incidental – purposeful, communicating – gestures include mimic gestures. They
can be social mimicry (putting on a good face), theatrical mimicry (which imitates specific
actions or seeks to emulate the imagined mood of the part), partial mimicry (where we
imitate an entirely different species like a bird or cat) and what Morris terms vacuum
mimicry – which today you would call air mimicry like air-guitar-playing – where,
for example, you emulate drinking to indicate your wish to drink. Other types of
signal gestures include schematic, symbolic, technical and coded gestures. Schematic gestures
are abbreviated (e.g. using two fingers to emulate cigarette smoking). Symbolic signals
are essentially local social conventions: for example, tapping the head and pointing
in western society can mean mad, whereas in Saudi Arabia this signal is given by
lowering the eyelid. Technical gestures are made by specialist minorities where voice
communication is not reliable in potentially dangerous situations. They include,
for example, the hand-signals given by construction workers to crane operators,
media directors to presenters, and those given by bat-men to pilots of aircraft on
the taxiway. Although specialised, these gestures are intuitive. Coded gestures are
the formal language of sign language (of which there are several types), semaphore
and the bookmaker’s assistant (tick-tack man) at race courses. Some gestures may
be relics where they imitate an action outdated by technical change (e.g. indicating
a bad smell by holding the nose and imitating the action of pulling-the-chain to
the historic overhead cistern). Morris argues that the near-universal head-shake –
meaning ‘no’ – is derived from babies’ actions when they have had enough milk and
push the breast way. Similarly, the cigarette is an adult baby-comforter (dummy).
Baton signals have been called: ‘beating time to the rhythm of words’ (1977:56).
They are widely used by political elites. They include the open palm, the air grasp,
Observation 165
the hand-chop, the air punch, the raised fist and the palm back. The raised fist is widely
used to add vehemence (Martin Luther King) or aggressive intent (Mohammed Ali),
whereas the lowered, tight fist transmits unshakeable determination (Nixon). Guide
signs are used to indicate direction. They can indicate ‘go there’ (extended hand) or
‘come here’ (beckoning, hinged hand).
Gaze behaviour (eyeballing) is complex:
when two people meet and make eye contact, they find themselves in an immediate
state of conflict. They want to look at each other and at the same time they want to look
away. The result is a complicated series of eye movements … (1977: 71).
and nose touches. Instead, he argues that these are physiological auto-responses to
pressure. These include the increase in the sensitivity of the nasal lining which nose-
touching reduces. So, these tells should never be regarded as conclusive. Similarly,
barrier signals – for example, touching shirt-cuffs or crossing limbs across the body –
are also more likely to be responses to a sense of nervousness. Examples of activities
stimulated by nervousness – displacement activities – include: jingling coins, clicking
biros and re-checking boarding passes (reportedly ten times more common among
air than rail passengers).
The most reliable indicator of mood appears to be eye-pupils. These react
spontaneously to changes of light and emotion. They cannot be controlled. Your
pupils will automatically narrow in brighter light or when you see an unpleasant
object. They will widen when you see something you like, for example, a baby or
a kitten. Pupil signals are both unconsciously given and received. (Hence, perhaps,
the appeal of dark glasses to some insecure political elites and poker players.) But
the difficulty remains actually being able to detect the width of pupils beyond very
close range and without appearing over-curious (which presumably would affect the
pupils under our observation). In any event, medical sources point out that pupil
dilation can also be a symptom of illicit drugs or amphetamines, drug overdose,
certain medications, eye drops, brain injury, stroke, brain tumour or, in extreme
cases, death.5
Morris concludes by discussing threat signals, dress, body adornments, infantile signals,
sexual signals and play patterns, etc. He also discusses (and appears to support) the
claim that, as human beings are the only female primates to have both hemispherical
breasts and buttocks, the female breast shape has evolved as a mimic of the other
primates’ buttocks which are the principal body parts used for sexual display In two
later books, Morris explores the distribution of signs and gestures in a large sample
of European and North Africa states (Morris et al, 1979).6 They show that, whilst
the same signs are common throughout Europe, they may have entirely different
and opposed meanings. For example, the ring sign means OK in the UK, Ireland,
Spain, Germany and southern Italy. But in France and Tunisia, the ring sign means
zero. Yet in Greece, Malta and Sardinia, it means orifice. In Tunisia, it means threat
(1979: 99–103). The influence of trade and cultural trade links is obvious from the
mapping.
Morris extends his study of body language worldwide by trying to identify signs
and gestures which are universal and thus more probably innate (Morris, 1994).7
Nearly 600 informal gestures are studied. Only 50 are worldwide. The gestures (G)
(and their meanings) are:
Note that, in this book, Morris contradicts his earlier argument that nose-touching
could better be explained as a response to changes in the nasal lining caused by
nervousness. Conversely, some gestures that are acceptable in some cultures may
be unacceptable and insulting in others. For example, in western society, the
knees-cross is an indication of relaxation and confidence. But the extended knees-
cross will inevitably show the sole of the raised foot to onlookers (observers).
In Saudi Arabia, Egypt, Singapore and Thailand, this gesture is interpreted by
onlookers as showing that that they are considered to be the lowest of the low and
dirt-ridden. It is therefore especially offensive and can provoke extreme violence
(Morris, 1994: 77).
You will find many public meetings of many councils and health trusts, etc. and
court proceedings very dull. A useful way of spending your time is to record the body
language, and frequency and tenor of speeches. You can do this by drawing either
‘matchstick figures’ or, if you are more ambitious, sketching profiles. (You are not
allowed to photograph or record meetings of UK public bodies.) But drawing in this
way enables you to analyse what you would otherwise overlook in a photograph.
So it uses your time productively. Pay particular attention to posture and the attitude
of heads and hands. My experience is that people who sit close to the table and
remain still are primarily lending support rather than taking part in the deliberations.
They are usually backbenchers or officials. Most of the main protagonists will
adopt – literally – a laid-back approach resting back in their seats. They may appear
bored. Those leaning forward are likely to be aspiring councillors or others keen to
demonstrate their attack and defence skills to their leaders. Note how – in a new
tradition derived from the US – the most senior party member present will often
take off their jackets and sit in shirt-sleeves. Note the exaggerated, theatrical gestures
and how they appear to lose their tempers. Watch the young male councillor who
leans back with his hands behind his head indicating his self-satisfaction. Note how,
when party leaders say something even slightly funny, the others laugh loudly. This
courtier-like behaviour is a classic sign of dominant power. Compare this to when
a junior councillor says something really amusing and no one laughs until the leader
Observation 169
leads or halts the laughter. Look at the mutual dependency between the senior
councillors and the senior officers. Record who speaks to whom and the tenor
(volume, pitch, rhetorical style, etc.) of their voices. Show these as thick or thin
arrows in your record. Note that, despite the apparent intense arguments between
the parties, they readily enjoy one another’s company after the meeting. What you
have seen is the elaborate role play of the ritual of democracy: the real decisions are
often taken privately elsewhere.
Examples of matchstick figures and more representative drawings and annotation
are in Figure 11.1(a)-(d). These drawings and analysis were made from sketches made
at a meeting of a local council meeting. The same techniques can also be applied to
170 Research Methods in Politics
focus groups although the initial sketches should best be made from memory after
the meeting.
Conclusions
FURTHER READING
Notes
‘One swallow doth not a summer make. But two swallows might attract a research
grant, and three are enough to work up a paper in a marginal journal of climatology …’
(James Meek, The Guardian, 9 November, 2000)
‘Politics researchers tend to draw summers of conclusions from single swallows of data.’
(Anon)
Introduction
• analysis and discussion are given without cross-reference to the information on which
they rely
• evidence is not compelling: acceptance is based almost entirely on trust: no opportunity
or means are given to corroborate the findings
• much statistical analysis assumes an in-depth knowledge of the mathematical routines,
formulae and symbols used, and may be impenetrable to most UK students; the rationale
and meanings of the techniques adopted go without comment, explanation or indication
of confidence limits
• quantitative and qualitative methods of analysis have been seen as entirely different and
lacking any common process
• research findings are rarely persuasive to those readers not otherwise subscribing to the
implicit assumptions adopted
• consequently, much Politics research tends to confirm or qualify existing explanatory
theory in an ever-decreasing circle
You will be familiar with the axiom: ‘rubbish in: rubbish out’.
Five guidelines for effective analysis are suggested:
1. The data never speaks for itself: ‘all knowledge is theoretically impregnated’ (Silverman,
2001: 23)1 : your analysis and interpretation are always required.
2. Similarly, you must make the process of analysis transparent if the critical reader is to
share your findings: trust and belief in your scholarship and honesty are not enough.
3. Ensure that the analysis and interpretation are proportionate in depth and extent to the
information to which they are applied.
4. The means of analysis you use must be relevant and appropriate to the research
question and to the information collected; you must justify using them.
5. You must identify, consider and justifiably discount (discard) other explanations before
you claim firm conclusions.
You may have gathered the data in quantitative (numeric) or qualitative (non-
numeric) form. However, the former distinction between quantitative and quali-
tative analysis has been overtaken by technological development. Whilst numeric
data can only be analysed by quantitative means, you can now analyse qualitative
data by qualitative or quantitative methods.
What do we mean by analysis? What does it involve? Oddly enough, the authorities
are largely silent – presumably, on the assumption that, after all, we all know what
Analysing Research Data: The Process 177
The greatly increased interest in analysis has spawned a very good literature,
including Miles and Huberman (1994), and Ritchie and Lewis (2003).2,3 However,
this emerging literature tends to concentrate exclusively on either qualitative
or quantitative data analysis and implies that they adopt divergent approaches.
Exceptionally, Neuman (2003) provides a valuable review of similarities and
differences which have been tabulated in Table 12.1.
A hierarchy of analysis
Despite the differences, it is possible and useful to suggest a general, generic model
of analysis (which draws in part from Ritchie and Lewis Analytical Hierarchy, 2003:
212, Box 8.1). The model has five, iterative, component phases: raw data assembly,
validation and reduction; classification, coding and sorting; testing; inference-drawing; and
theory development. The process can be illustrated as a pyramid (after Maslow)4 which
reflects the successive reduction and refinement of the volume of raw data into
information and evidence.
178 Research Methods in Politics
Δ Theory development
Testing
This first phase involves you bringing all the raw data together at the same place and
time. The objective here is to reduce the mass and mess of data in sheets of text,
photocopies, emails, scoping documents, transcripts, letters, memos, questionnaires,
etc., audio and video-records and photographs. You should selectively discard all
the non-relevant and duplicate data to a ‘recycle bin’, transposing the relevant
data into a common format (e.g. Microsoft Office) and organising it into folders
and files. The files are then validated. This involves checking the data for errors
Analysing Research Data: The Process 179
or omissions. It may also involve you anonomysing people and places (hiding their
real identities). You should also identify and flag (mark) outlier data. Outliers are
extreme and exceptional data which lie outside the expected range. For example,
where a new leader has shown an increase in support of, say, 5–15% in most opinion
polls, then you might classify an increase in one poll of, say, 25% as an outlier.
But, you should check first whether it is exceptional because of some recording
or transposition error, or may represent a significant finding. Where outliers are
considered dubious, then you can discard them. By the end of this initial process,
you will have reduced and organised the mass of raw data into useful information
ready for coding.
When this first stage is complete, you will be able to begin the processes of
classification, coding, testing and inference drawing. These processes are very different for
quantitative and qualitative information and are therefore described separately in the
following chapters.
FURTHER READING
Notes
1 Silverman, D. (2001) Interpreting Qualitative Data: Methods of Analysing Talk, Text and Interaction.
London: Sage.
2 Miles, M.B. and Huberman, A.M. (1994) Qualitative Analysis: An Expanded Sourcebook. London:
Sage.
3 Ritchie, J. and Lewis, J. (2003) Qualitative Research Practice: A Guide for Social Science Students
and Researchers. London: Sage.
4 Abraham Maslow’s Hierarchy of Needs (1943), see Maslow, A.H. (1970) Motivation and
Personality. New York: Harper and Row.
Part IV
A: Quantitative Analysis
Chapter 13
Calculating and Interpreting
Descriptive Statistics
‘Lies, damned lies and statistics’, attributed to Benjamin Disraeli by Mark Twain.
Introduction
18,18,18,18,19,19,19,19,19,19,19,19,19,19,19,19,20,20,20,36,45,48.
There are actually 22 students. To calculate the average, you must, of course,
add all the ages together and divide the sum by the number of students. In this
184 Research Methods in Politics
case, the total ages are 489. There are 22 students. So the average is 489/22 =
22.23 years.
So what? Well, in this example, none of the students is aged 22. So the average
is misleading. The reason for this apparent discrepancy is because the class contains
much older students. This is more obvious when the students and their ages are
individually plotted on a type of graph or chart termed a scattergram:
In this simple example, the average has been distorted by the inclusion of three
much older students. But, suppose that one of the 18-year-old students were to
‘drop out’ and an 85 year-old admitted. In this case, then the average mean would
increase to 25.3 and the graph to:
60
50
40
Ages
30
20
10
0
0 10 20 30
Individual students
90
80
70
60
Ages
50
40
30
20
10
0
0 10 20 30
Individual students
In this second case, the calculation of the average has been grossly distorted by the
replacement of a more typical student by a very much older one. This is called the
outlier effect – the effect of those highest or lowest terms to skew – distort – your
everyday, ‘average’ mathematical description of complex information. (Incidentally,
some quantitative researchers argue that qualitative researchers rely on outliers; the
exceptional case is more attention-grabbing than more typical information.)
To overcome this weakness, statisticians use a set of simple statistical measures to
better describe, say, a student class. These are the arithmetic mean, median, mode, range,
variance and the standard deviation. These are termed measures of central tendency
(or measures of dispersion). As the terms imply, they describe numerically the extent
to which the individual terms cluster around the ‘centre’. The class is termed the
population: the total group of people or events being described or under study. The
population is represented by the Roman capital, N. The individual measurements
of data from the population are called terms. A group of terms which measure the
same characteristic at the same moment in time is called a series.
The arithmetic mean is what is generally called the average, i.e. the sum of the
terms divided by the number of terms. In statistics, the terms are called X and the
number of terms N . ‘Sum of’ is represented by the Greek symbol (pronounced
sigma). The arithmetic mean is called X bar and represented nowadays by the symbol
X . So X = X N
The median is the middle term when the series is ranked (normally in ascending
order), e.g. 4,10,2,8,6 becomes ranked into 2,4,6,8,10. The median is the (N+1)th
term/2. So, the series 2,4,6,8,10 has five terms. Therefore the median is the
(5+1)/2th term = 3rd term. The third term in the series is 6. If the series were reduced
to four terms – 2,4,6,8 – then the median would be the (4+1)/2th term = 2.5. In this
case, the median is calculated as lying midway between the second term (4) and the
third term (6). So the median is 5.
The mode is the most frequent term in the series, e.g. in the series 1,3,6,5,1,2 then
the mode is 1. This is rarely used.
Returning to the example of the initial class of 22 students, then, whilst the
arithmetic mean may be 22.3, the median is the (22+1)/2th term, i.e. the 11.5th
term or half-way between the 11th and 12th term. In this case, the 11th and 12th
terms are both 19 so the median is 19. The mode (the most common term) is also 19.
So, in this example, the median and the mode provide better descriptions than the
mean (of 22.23). In the revised class, the median and mode remain 19 and the effect
of the (85 year old) outlier is effectively discounted. In cases like these where most
terms lie below the mean, then the data – or distribution – is termed positively
skewed. In many universities, the final degree classification uses the median exam
mark rather than average mark. In this way, exceptionally good or bad exam marks
are discounted.
Another statistical measure of the data is the range – the difference between the
highest and lowest term. However, as noted earlier, the range can be distorted by
186 Research Methods in Politics
exceptionally high or low outliers, e.g. the very mature student. In the revised class,
the range would be 67 (i.e. 85–18). So statisticians developed the interquartile
range. This is the difference between the first and third quartiles when the terms of
the series are placed in ranked order. So in a series of 99 terms, the interquartile
range is the difference between the 25th and 75th term. The first and third quartiles
are identified in a similar way to the median by calculating
(N + 1) 3(N + 1)
and
4 4
For example, in our initial class of 22 students ranked by age, then the interquartile
range is the difference between the ages of the 5.75th and 17.25th students, i.e. 19
and 20 = 1.
The greatest use of median measurements probably lies in representing unequal
distributions especially in terms of resources. Income is a prime example where a
small number of people may have vast wealth and, at the other end of the scale, a
large number virtually nothing. In these cases, the inequality is shown by calculating
and comparing the income of the 10th and 90th ‘percentiles’. So, in a fair society
where incomes are equal, then the 10th and 90th percentiles will be the same
whereas, in less equal countries, the ratio of 10th to 90th percentiles may be as high
as 100. A more sophisticated descriptive statistic for measuring unequal distribution
of income and wealth is provided by the Gini coefficient. This is the ratio between
the areas above and below the Lorenz curve (of cumulative incomes) and the area
of equal distribution. The coefficient varies between less than 0.25 (Greenland)
and 0.6 (Namibia). No coefficients are calculable for Sub-Saharan Africa. The Gini
coefficient for the UK is 0.35–0.39.
In the UK, the official (upper) level of poverty is calculated as 60% of median
household income. ‘Deep poverty’ is calculated as 40% of the median household
income. The definitions reflect a rejection of the historic concept of poverty being
calculable as an absolute level in favour of relative measures.
0 0
0 100 0 100
A Population share (%) B Population share (%)
However, the median itself can be misleading. Take for example, data obtained
from applying the Likert scale to the question:
Q. To what extent do you agree with the following statement:
The Anglo-American invasion of Iraq has actually increased the threat of terrorism
in both countries. Do you strongly agree, agree, neither agree nor disagree, disagree,
or strongly disagree? You code the possible answers 1–5 (where 1 is strongly
agree, etc.). Let us say that you ask three samples of ten people of three different
age groups (in practice, you would use much greater samples). The results (ranked
in descending order) are:
Young people 5 5 5 4 3 2 1 1 1
Middle-aged people 4 4 3 3 3 2 2 1 1
Older people 4 3 3 3 3 3 3 3 2
In each of these three groups, the median is 3 (neither agree nor disagree) although
the intensity of agreement or disagreement is significantly higher among the sample
of younger people. To overcome this problem, mathematicians developed the
variance.
The variance
(X − Xj )2
where j is the number of terms in the series
N
This sounds more complicated than it is. Consider the example above of the Likert
scores for the sample of ten, younger people:
Young people, X 5 5 5 4 3 2 1 1 1
Arithmetic mean, X = 3 3 3 3 3 3 3 3 3
Difference between term (5−3) (5−3) (5−3) (4−3) (3−3) (2−3) (1−3) (1−3) (1−3)
and mean (X −X ) = +2 +2 +2 +1 0 −1 −2 −2 −2
Difference 2 (X −X )2 = 4 4 4 1 0 1 4 4 4
188 Research Methods in Politics
(X − Xj )2 26
Variance = = 2.6
N 10
Standard deviation
N and n
You will note that, in most scientific research publications, it is the number of terms
and standard deviation which is normally given to describe experimental data, e.g.
n = 1600, σ n−1 = ±12.1.
However, the symbol n rather than N is given. Why? The answer is that the
symbol N is used to denote the number of terms – people or events, etc – in the
population: n is used to denote the number of terms in the sample. Similarly individual
terms in the sample are denoted by x rather than X .
The symbol for the standard deviation of the sample is also written in lower case
as σ n−1 . But why is the n − 1 notation added? The reason is that, where the series
is a sample of the population, then the number of terms may be comparatively
small. To compensate for the small number of terms and the potential experimental
error, the number of terms is notionally reduced by subtracting 1 to give a larger
standard deviation. To distinguish a sample from a population, the symbols x, n
and σ n−1 are used. So the formula for the standard deviation of a sample of n
terms is:
(x − xj )2
(n − 1)
families may show the following numbers of children in each: 2,1,2,3,2,1,0,4, i.e. a
total of 15 children. These can then be tabulated in a grouped distribution as:
The measure in which data is grouped is called an interval. In the example above,
the interval used is the number of children. The most commonly used age intervals
in Politics research are years, i.e. 1998, 1999, etc., age groups, e.g. 0–17, 18–28,
29–38, 39–48, 49–58, 59 +. , and incomes, e.g. $0– $999, $1000 – $1999, etc.
Grouping data by frequency distribution also enables the data to be displayed as
a graph, e.g.
3.5
3
Number of families
2.5
(Frequency)
2
1.5
1
0.5
0
0 1 2 3 4 5
Number of children
100
Frequency (memberships)
80
60
40
20
0
0 10 20 30
Number of clubs joined
Most descriptive statistics can now be calculated using a good calculator, for example,
the Casio fx-83 series (which can be bought for as little as £6.99). However, most
students are more likely to have a PC or laptop readily available than a calculator.
Unlike a calculator, a computer can save the data and calculations as a file and enable
them to be pasted (copied) into a report. Whilst a wide variety of statistical software
is available, most students use the MS Office software package which includes the
spreadsheet Excel. Most students are also familiar with using Excel which is quite
adequate to perform descriptive statistics.
Before using Excel to perform statistical calculations, it is necessary to add the
Analysis ToolPak – which contains a large number of specialist statistical formulae –
bundled into the software. This is relatively straightforward. Open an Excel spread-
sheet. On the menu bar, click on Tools. Then click on Add-Ins. Click on Analysis
ToolPak and Analysis ToolPak VBA at the head of the dialogue box and click OK.
You can now enter your data. Insert the term Income in cell A1. Then insert the
following data in cells A2:A11 in Column A. This is a small sample from a northern
benefits office of the annual household income of current single-parent claimants
having three children for income support. In practice, of course, we would seek to
use a much larger sample of 35 terms or more for greater accuracy.
Claimants’ household income:
Save the data as a file titled Claimants’ Household Income. We want to calculate
the mean, median, tenth and ninetieth percentile, range, variance and standard deviation.
The first step is to copy the data onto a nearby column, E using the Copy/Paste
routine. This safeguards your original data. Your next step is to critically examine
the data. This is best done by sorting the data into ascending order and by drawing
a chart (graph).
To do this, first highlight the data (including the title ‘income’), then click on
Data and Sort. In the sort dialogue box, click OK. The data will now appear in
ascending order. Leave it highlighted. Then click on Insert and Chart. Click on X–Y
(Scattergram). Click on Next until the graph appears.
30,000
25,000
20,000
Income
15,000
10,000
5,000
0
0 2 4 6 8 10 12
Benefit claimants
This graph shows that the distribution of incomes is relatively straightforward and
that there are no ‘outliers’ or other unexceptional terms.
To calculate the descriptive statistics, click on Tools, then Data Analysis, then
click on Descriptive Statistics in the dialogue box and OK. The Descriptive Statistics
menu will appear. In the box marked Input Range, insert E2 : E11. (Whilst there
is a short-cut alternative to inserting the cell numbers, it can complicate routines at
this initial stage.) Click on Grouped by columns. The Output Range is the cell where
you want the statistics to appear: insert G1. Then place a tick in the box marked
Summary Statistics. Finally, click OK. The table of statistics below will appear:
By reading this table and rounding up to one place of decimals, we can report that:
Income £ Column1
8,003
11,370 Mean 15146.2
12,317 Standard error 1543.355
12,561 Median 14375
13,889 Mode #N/A
14,861 Standard deviation 4880.518
15,270 Sample variance 23819453
18,241 Kurtosis 1.035046
19,671 Skewness 0.839166
25,279 Range 17276
Minimum 8003
Maximum 25279
Sum 151462
Count 10
In this case, the summary statistic for the standard deviation calculated is the standard
deviation of the sample. If the data were a population, then you would have to use
a different formula =STDEVP( ). Click on the cell where you want the standard
deviation of the population to appear. Insert =STDEVP(A2:A11) on the task bar
next to the fx notation. Press the Enter key. The answer 4630.066 will appear.
To record the meaning of this data you will have to enter standard deviation of the
population in the cell above or to the right. (If you use a cell to the left then the title
will be partially obscured unless you increase the column width.) Note that the
standard deviation of the population is smaller than the standard deviation of the
sample.
To calculate, the 10th and 90th percentile, click on Insert and then Function. The
Insert Function box will appear. In the first box headed Search for a function, insert
percentile and then click on Go. PERCENTILE will appear highlighted blue on
the larger box below. Click on OK. A box marked Function Arguments will appear.
In Array, insert E2 : E11. In k, insert 0.1 (meaning 10%). As soon as you insert this
data, the answer will appear to the right of Formula result = 11,033. Change the k
value to 0.9 (i.e. 90%) and the formula result will be 20,232. So we can report that:
You will appreciate that it makes no difference to the practical ease of completing
the calculation whether the spreadsheet contains – as in our example – 10, or 10,000
terms.
Types of numbers
In the example above, numbers have been used to represent incomes. However,
there are two different groups and four different types of number that you can use.
The two groups of numbers are categorical and cardinal.
Categorical numbers
Categorical numbers involve nominal numbers and ordinal numbers (rankings).
Your university number is an example of a nominal number. Your university number
gives you a unique identity and enables your name to be replaced by a number. If
your university number is lower than a friend’s then it does not mean that you
are better or worse in any respect. Nominal numbers have no mathematical
significance: they are entirely nominal. In contrast, ordinal numbers are used to
indicate rankings. But their significance is confined to some ranking relative to a list
of criteria, e.g. 1 may indicate the person with the highest mark.
Cardinal numbers
Cardinal numbers involve interval and ratio scales. Ratio scales have an absolute
zero, e.g. income, time, degrees Kelvin (degrees centigrade of Fahrenheit are
interval scales). Interval scales measure the variance above or below a particular
benchmark. Ratio and interval scales can be negative. For example, an annual
income of −£500 means that you owe someone else £500. Accountants express
this as (£500).
Wherever possible, quantitative researchers seek ratio scales.
Where variables are expressed as categorical or cardinal numbers they can be termed
categorical variables or cardinal variables. Variables may also be discrete or continuous.
Discrete variables are those where there is only a limited number of intervals in
the range. For example, the numbers of children in a household are discrete because
you can only have zero, one, two, etc children: you cannot have 1.4 children
(although that may be the arithmetic mean of children in all households). In contrast,
continuous variables are those where there are an infinite number of intervals in
the range. So, for example, the ages of the children in a household are continuous:
even twins will have different ages when measured in terms of minutes or seconds.
Generally speaking, categorical variables are discrete whilst continuous variables are
cardinal.
194 Research Methods in Politics
Whilst the distinctions between categorical and cardinal numbers and discrete
and continuous variables may appear academic, they are important. For example,
the descriptive statistics in the example above can only be calculated using cardinal
numbers. As you will see in Chapter 15, the type of number will dictate which
advanced statistical formulae can be used.
1. Access a UN, World Bank or EU data bank on the Internet, e.g. http://unstats.un.
org/unsd/cdb/cdb or http://mdgs.un.org/unsd/unsd/ Choose a table of interest to
you. Copy it to Excel. Calculate the summary descriptive statistics, 10th and 90th
percentile. Compare the mean and median and explain the difference.
2. Create your own file of 1,000 random numbers.To do this click in turn on Tools in the
menu bar then Random Number Generation. In the Random Number Generation
Dialogue box, enter:
Save as (file) Normal distribution random numbers. Then calculate the summary
statistics for the entire data set. Retain the file for future use as your own bank of
random numbers.
3. Now analyse the random numbers above into a grouped frequency distribution.
First, decide what class interval you wish to adopt. Your data extends from 0 to
100.You may decide to use a class interval of 5.Then enter 5 in cell K1 and continue
to enter 10, 15, 20 etc until you reach 100 in cell K20. (You can, of course, use
the Autofil routine.) Then click on Tools and Data Analysis. In the Data Analysis
dialogue box, click on Histogram and OK. In the Histogram dialogue box, insert
5 Bin Frequency
10 5 12
15 10 12
20 15 20
25 20 32
30 25 42
35 30 48
40 35 76
45 40 78
50 45 79
55 50 101
60 55 92
65 60 89
70 65 83
75 70 77
80 75 53
85 80 41
90 85 32
95 90 12
100 95 9
100 7
120
100
80
Frequency
60
40
20
0
5
20
35
50
65
80
95
Bin
You will note that the histogram apparently takes the shape of a uniform
distribution. However, as we constructed our 1,000 cell bank of random numbers
from a normal distribution then the chart is reassuring rather than surprising.
But note how, despite having been calculated from 1,000 random numbers, the
histogram does not follow a perfect uniform distribution: there will always be some
variations from the perfect normal distribution when bins are used.
FURTHER READING
Clegg, F. (2005) Simple Statistics: A Course Book for the Social Sciences.
Cambridge: Cambridge University Press, pp. 1–28. This is an excellent, readily
readable, authoritative account for students new to or lacking confidence in
statistics.
Burnham, P., Gilland, K., Grant, W., and Layton-Henry, Z. (2004) Chapter 5:
Descriptive Statistics. In Research Methods in Politics. Basingstoke: Macmillan.
pp. 114–42. This account provides good advice on the ‘charting’ of descriptive
statistics using examples from Politics.
Pennings, P., Keman, H., and Kelinnijhuis, J. (2006) Chapter 5: Explorative and
descriptive statistics. In Research Methods in Politics. London: Sage.
pp. 88–131. This is an advanced text better suited to experienced researchers
wishing to develop their mathematical skills.
Chapter 14
Using and Understanding
Inferential Statistics
Introduction
Consider the example of a survey of a random sample of 100 Labour party members
which reveals an average weekly net disposable income of £84.12 with a standard
deviation of £21.07. Twenty-six of the sample (i.e. 26%) regularly read The Guardian
newspaper. In terms of other (non-print) news media, 72% rely mainly on BBC TV
and radio services for national and international news.
Given this information from a small sample of people, then how can you calculate
the extent to which it is shared by the general population? Furthermore, how can
you tell whether or not your sample is representative in the first place?
The answer is that you can use inferential statistics. These are:
The solution to drawing inferences from sample data lies in the attributes of the
normal distribution and the central limit theorem.
In the previous chapter, you learned how to describe a series of data by the number
of terms, N , the arithmetic mean, X and the standard deviation, σ . The standard
deviation probably appeared contrived and of no real practical use. However,
consider the normal distribution in Figure 14.1
An important characteristic of the normal distribution is that 95% of the terms
will lie within two standard deviations (actually 1.96 SD) either side of the mean;
conversely, only 5% will lie outside two standard deviations. Of the terms, 99%
will lie within 2.97 SD. These characteristics can be expressed as probabilities.
A probability is the likelihood that an event will occur. For example, if an event
is certain – like death albeit in the distant future – then the probability is 100% or
1.00. Alternatively, a remote possibility – like winning the UK national lottery next
week – may be 0.001% or 0.00001. A one-in-four likelihood would be expressed
as a probability of 25% or 0.25. A bookmaker would give odds of 4–1 on an
event having a 25% probability. So, returning to the normal distribution, there is
100
80
Number of men
60
40
20
0
0 50 55 60 65 70 75 80 85 90 95 100 105 110 115
x ± 1 SD
x ± 2 SD
x ± 3 SD
Diastolic blood pressure (mmHg)
a probability that of 95% or 0.95 any individual term will lie within 1.96 standard
deviations of the mean. This means that it is likely that 95 out of every 100 terms
will lie within 1.96 standard deviations of the mean. We can increase the likelihood
of any term lying in the distribution to 99% by increasing the span to 2.97 standard
deviations. There is therefore a trade-off between probability and accuracy.
The means of samples randomly taken from a population will always differ. This
difference is termed the sampling error. The central limit theorem (where a
theorem is a mathematical deduction accepted as a truth) effectively proposes that the
arithmetic means of large samples (greater than 30 terms) will approach a normal
distribution – even where the population is not normally distributed. Therefore, by
referring to the distribution of terms in the normal distribution curve above, we
can say that 95% of all the sample means lies within 1.96 standard deviations of the
‘mean of the means’.
(For samples of less than thirty terms, the sample means will follow the Student’s
T distribution. This is symmetrical and looks very similar to the normal distribution.
However, the spread of the distribution reflects both the standard deviation and the
sample size. The accuracy of inferences from the T distribution is therefore lower
than from a normal distribution and decreases as the sample size falls.)
The standard error of the sample mean, SE, provides the statistical method of
generalising from samples to populations. It estimates the likely variance and therefore
accuracy between the sample mean and population mean. Its formula is:
sd
SE = √
n
where sd is the standard deviation of the sample and n the number of terms in the
sample (sample size)
The formula which brings together the characteristics of the normal distribution,
central limit theory and standard error of the sample mean is that, at 95% probability,
the population mean X , lies within 1.96 standard errors SE, of the sample
mean x, i.e:
X = x ± 1.96SE
200 Research Methods in Politics
Consider again the initial example of a random sample of 100 Labour party
members that reveals an average weekly net disposable income of £84.12 with
a standard deviation of £21.07. So we can say that:
X = 84.12
Sd = 21.0
n = 100
√ √
The standard error, SE = sd/ n = 21.07/ 100 = 21.07/± 10 = ± 2.107
You can calculate the income of the population of all Labour party members at
a probability of 95% by substituting in the formula:
= x̄ ± 1.96SEP
X
X = 84.12 ± (1.96)(2.107) = 84.12 ± 4.12972 = 79.9902 to 88.24972
Alternatively, you can complete the calculation using Microsoft Excel. Open an Excel
spreadsheet. Then click on Insert and fx function. In the Insert Function dialogue
box, select the category statistical and scroll down the functions until you reach
CONFIDENCE. Click on OK. The Functions Argument dialogue box will appear
asking you to insert values for Alpha, Standard deviation and Size. Alpha is the
significance level for which 95% is the default for Politics. For a significance level of
95%, the Alpha is 0.05. The standard deviation is £21.07. The (sample) size is 100.
Insert these figures. The answer (formula result) of 4.129 will appear automatically at
the foot of the dialogue box. Click on OK and the answer will be entered in cell A1
(or any other cell that you’ve highlighted in advance).
What the manual or Excel calculations mean is that you can infer that 95 of
every 100 members of the Labour party overall will have a net weekly disposable
income of between £79.99 and £88.25. These two figures are termed the upper and
lower confidence limits. The variance – difference – between these two figures is
termed the confidence interval or margin of error. The margin of error can either
be expressed as the difference between the confidence limits or their variance from
the sample mean. So, in the example above, we could report that the margin of error
was either 8.26 or ± 4.13. Note how the numbers calculated have been ‘rounded
up’ to two places of decimals only in the final answer: this avoids accumulated errors
which can occur where initial calculations are rounded up. If you wanted to learn the
likely spread of income of 99% of all party members, then we would use the figure
of 2.97SEs or an Alpha of 0.01. The result will be a confidence interval of ±5.42
This initial example of sample data also showed that, of our random sample of
100 Labour Party members, twenty-six of the sample (i.e. 26%) regularly read The
Guardian newspaper. In terms of other (non-print) news media, 72% rely mainly on
BBC TV and radio services for national international news. How can you calculate
the confidence limits of likely Guardian readership and BBC news of other party
members from the sample?
Using and Understanding Inferential Statistics 201
In this case, you can use the standard error of the proportion, SEp where
√
SEp = {p(1 − p)/n}
Where p is the standardised proportion of the sample sharing the characteristic. So the value
p for 26% is 0.26; 100% would be 1.0.
To calculate the population proportion P, you can use a formula similar to that
using the standard error. In this case, at the 95% confidence level:
P = p ± 1.96SEp
P = p ± 1.96SEp
P = 0.26 ± (1.96)(0.043863244) = 0.26 ± 0.0859723118
P = 0.2161365756 to 0.348597231182
Now, you can round up to say that P = 0.216 to 0.349 or, in percentage terms,
you can say that, at 95% confidence limits, between 21.6 and 34.9% of all Labour
party members will read The Guardian.
Similarly, you can calculate that, if 72% of the sample relied on BBC news
services, then the percentage of the national members who also rely on the BBC
at 95% confidence limits would lie between 63.2% and 80.8%. In this case, the
confidence interval is 17.6%. This confidence limit is obviously too large – because
of the small sample size – for useful inferences to be drawn. Greater predictive
accuracy requires much larger samples.
Opinion pollsters – NOP, Gallup, etc – generally use a random sample of 1600.
Consider, therefore, the example of opinion polls which show that, by February,
202 Research Methods in Politics
support for the government is slowly rising, whilst support for the main opposition
party is falling. The very latest poll (of 1600 electors) shows that 39% of the electorate
say that they will vote for the government ‘if an election were held tomorrow’ and
33% for the main opposition. This is the highest level of support given for the
government for two years. Should the prime minister risk an election in May, or
wait another year? What is the margin of error?
In this case, the standard error of the proportion, SE p is 0.01219. There would
be a 95% probability that support for the government could lie between 36.6 and
41.4%. Conversely, opposition support could lie between 30.7% and 35.3%. At the
99% probability level, support for the opposition could conceivably be as great as
36.6% and therefore greater than the lowest level of support for the government at
35.5%. So, despite a 6% lead over the opposition and a national random sample of
1600, the government could lose the election.
The margins of error are therefore much larger than newspapers – who commission
polls as a low-cost source of ‘news’ – admit. This is important because of the potential
effect of opinion polls in manipulating attitudes and discouraging people from voting
where they believe that the outcome is a ‘foregone conclusion’, e.g. UK general
elections in 2001 and 2005 (Heath and Taylor, 1999: 180).1 However, where the
proportion of the sample sharing the same characteristic rises to nearly 100% then
the margin of error falls considerably. So, if 90% of the sample of 1600 support the
government’s policy on, say, ‘tougher sentences’, then, at the 95% confidence level,
the margin of error falls to 1.5% ‘either way’, i.e. between 88.5 and 91.5%.
The null hypothesis is effectively the practical application of the test of falsifiability
or fallibalism added by Popper (see Chapter 3). It is the assumption – similar to the
assumption of innocence in UK and US law – that the data is untrustworthy until
shown conclusively otherwise. It is generally explained as the concept of ‘no differ-
ence.’ Its general application is to the control and experimental samples. Any difference
in the experimental group must first be attributed entirely to chance. It can only
attributed to the effect of some stimulus (cause) when chance has been eliminated.
The null hypothesis is termed H0 and the alternative hypothesis – our hunch – is
termed H1 . H0 must be disproved – shown to be false – before H1 can be accepted.
In the case of samples and populations where only one variable is being studied –
so-called univariate statistics – the null hypothesis is that the sample has not been
drawn randomly from the population and is therefore not representative.
and statistically representative of the population? And, second, could the findings
from the sample be entirely by chance?
To answer the first question, you must verify that the sample is really drawn
from the population. In your initial example, the population was the national
membership of the Labour party. To be statistically reliable, the sample must be
randomly drawn from that population. So, if the sample were gained from only
one region or constituency of the UK, it would not be statistically representative.
A very small sample would be unlikely to be representative. You can also check
the sample against known characteristics of the population – e.g. age or sex. So, if
the male/female ratio of the population is, say, 60:40 then you would expect that
of the sample to be similar. You can test this mathematically. The average age of
all party members is 59 (source: Labour party, London, January 2007) whereas the
average age of the sample is 57 with a standard deviation of, say, 3. You can use the
formula:
X = x ± 1.96SEp
As you know that X is 59 and therefore between the upper and lower levels predicted
above, you can say that you are 95% confident that the sample could indeed have been drawn
from the population.
You can also investigate the significance (the likelihood that any similarity between
sample and population means occurred entirely by chance) of the difference between
a population mean X , and the sample mean x, by using the t-test for a population
mean. Where the variance of the population is unknown, then the formula to
calculate the test statistic, t is
√
t = (x − X)/(sd/ n)
In the case of the ages of the sample and population of the Labour party
X = 59
X = 57
sd = 3
n = 100
You will calculate that t = −6.67. By referring to the t-distribution tables published in
most statistical tables, you can see that, for degrees of freedom, df of 99 (i.e. n − 1) and
204 Research Methods in Politics
a probability level of 0.05 (i.e. 95% confidence levels), the critical value of t is ±1.65.
As your calculated t statistic is greater than the critical value, then you can conclude
with 95% confidence that the data from the sample has not arisen by chance. The
null hypothesis can therefore be rejected and your alternative hypothesis – that the
sample is statistically representative of the population – accepted.
1. Work your way through each of the worked examples shown above at your own
pace to test and improve your understanding of the procedures.
2. Discuss what is meant by confidence level, confidence interval and confidence
limits. Where and why should they be used?
3. Develop your own table for calculating the confidence limits of opinion polls. In
column A enter sizes of sample from 10, 20, 30, …100, 200, 300, … 3,000, 4,000,
5,000, 6,000, … 10,000, 15,000, 20,000 … 100,000.You can use the Autofil routine
to simplify this process. In row 1, enter the percentages of the sample sharing the
same characteristic or attitude from 01, 02, 03 ,04, 05,… 99%. Write your own
formula for calculating the confidence limits at 95% confidence levels, i.e. values
√
of 1.96( p(p − 1)/n. Copy your formula across the spreadsheet and save.
FURTHER READING
Clegg, F. (2005) Simple Statistics: A Course Book for the Social Sciences.
Cambridge: Cambridge University Press. pp. 31–124. This is an excellent text
for researchers who lack confidence or experience of statistical methods. The
text is supported by operation schedules which demonstrate the use of the
statistical techniques. A major strength is that the demonstration calculations
are undertaken manually rather than computed elsewhere.
Levine, D. and Stephan, D. (2005) Statistics: Even You Can Learn. London:
Pearson Prentice Hall. pp. 103–23. This is a very readable account which
includes step-by-step instructions for using Microsoft Excel to complete
calculations and downloadable practice files.
De Vaus, D. (2002) Analysing Social Science Data: 50 Key Problems in Data
Analysis. London: Sage. pp. 147–234. This is an advanced text which uses
SPSS for calculations. Its discussion of the principles involved in sample sizes,
significance and confidence intervals is good.
Using and Understanding Inferential Statistics 205
Kanji, G. K. (1999) 100 Statistical Tests. London: Sage. p. 27 t -test for a population
mean (variance unknown). This is another advanced text. It shows clearly which
tests should be carried out and includes simple worked examples and statistics
table.
Note
1 Heath, A., and Taylor, B. (1999) Chapter 9: New Sources of Abstention. In Evans, G. and Norris, P.
(eds.) Critical Elections. London: Sage. pp. 164–80.
Chapter 15
Testing for Association
Introduction
In the previous chapter (Chapter 14), you considered how individual measures of
characteristics of a sample could be generalised into statements about the population
from which they were drawn. However, only one characteristic was measured for
each member of the sample: whether they voted or belonged to a union, income and
strengths of attitude, etc. These are called univariate statistics, i.e. one number. But
a greater ambition of Politics research is to identify causes and effects – the independent
variables and dependent variables. Because they involve two (paired) variables, they
are referred to as bivariate statistics. Where two or more independent variables
cause a particular outcome or effect they are termed multivariate statistics. By
convention, the independent variable (cause) is termed x, and the dependent variable
(effect or outcome), y. This relationship is expressed mathematically as:
costs – expressed as the inverse of travel time to the power 1.8. This is known
as the transport equation which can be expressed as:
Di = µ{i (u/C 1.8 ) i−n (u/C 1.8 )}
because of their power to inflate wages under threat of industrial action (strikes) and
their influence on Labour governments. On the other hand, the trade unions argued
that they had been responsible for securing real improvements to living conditions
for workers and their families through ‘free collective bargaining’ and responsible
partnership with Labour governments. (Few argued that increases in pay caused
union membership to rise.)
You can chart the data in Excel as an X–Y scatter graph:
Pay as % of all other industries
180
160
140
and services
120
100
80
60
40
20
0
0 50 100 150
Union density %
Figure 15.1 X–Y graph of Table 15.1, Union density and pay, 1981
You will see that, as union density rises, pay also appears to rise. The graph would
appear to support the belief – shared by Left and Right – that higher union density
can be associated (related to or connected with) with higher pay. However, note
that there are some sectors where high union density is not associated with high
pay – especially in textiles and education services. But generally the relationship
could be represented as a straight line and, therefore, described as linear. This linear
relationship might be expressed as an equation:
Where po is (basic) pay levels where unionisation is nil (zero) and g is the gradient
(steepness, slope) of the straight line.
Measuring association
12 12 9
10 8
10
7
8 8 6
5
6 Series1 6 Series1 Series1
4
4 4 3
2
2 2
1
0 0 0
0 5 10 15 0 5 10 15 0 5 10 15
A B C
Multiple R 0.688452
Intercept 71.48414
X Variable 1 0.564809
What do they mean? They mean that the coefficient of correlation (termed
‘Multiple R’ in Excel) is +0.69, that the point where the straight line crosses the
Pay axis is £71.50 and the gradient of the straight line is 0.56 (which means that,
for every change in union density of 1%, pay will increase by 0.56%). The linear
equation between pay as an outcome of union density is therefore:
Summary Output
Regression Statistics
Multiple R 0.688452
R square 0.473966
Adjusted R square 0.444742
Standard error 20.01117
Observations 20
ANOVA
df SS MS F Significance F
Regression 1 6494.574 6494.574 16.21831 0.00079
Residual 18 7208.046 400.447
Total 19 13702.62
Other results are also useful. As previously explained, R Square (written R 2 ) is the
proportion of Y (outcome) that can be attributed to X (cause). In this case, it is 0.47.
So 47% of pay can be attributed to union density. So there must be other drivers.
What might they be? The Adjusted R Square is a more sophisticated and reliable
estimate than R Square. In this case, Adjusted R Square is 0.45.
However, before you can accept relatively high coefficient of correlation of +0.69
as evidence of association, you must be able to refute the null hypothesis. If your
starting hypothesis, H1 was that union density affects pay, then the alternative
hypothesis, H0 must be that there is no causal relation and that the association
between data has arisen entirely by chance. In other words, you must be able to
show that the data and results are statistically significant
There are various statistical tests of significance for paired data. They include the
Pearson product-moment correlation, Z-test and t-test. Perhaps the simplest way, is to
use the confidence interval estimate of the slope. This is calculated by multiplying the
t-statistic by the standard error of the slope and then adding and subtracting this product
to the gradient. This sounds complicated. But, fortunately, Excel has already done
this. The results are at the foot of the summary output of Table 15.2:
This shows that, at 95% confidence levels, the upper and lower levels of the
gradient are 0.270 and 0.859. Because these figures are greater than 0, then you
can be satisfied that a significant relationship exists between the union density and
pay data. The null hypothesis can therefore be refuted. Alternatively, you can refer
in statistical tables to the Critical Values of Pearson’s r. These will tell you critical
212 Research Methods in Politics
values of r for a given sample size and levels of significance. You will note that, for a
level of significance of 0.05 (95%) for a one-tailed test for a sample size of 20, the
critical value of r is 0.378. Because your calculated r (of 0.69) is greater than the
critical value, you can conclude that the association between union density and pay
is statistically significant at 95% confidence limits.
Another simple alternative is to use the P-value automatically calculated by Excel
and included in Table 15.3. The P-value is the observed level of significance. Basically,
you can reject the null hypothesis Ho if the P-value is less than the level of significance
you have chosen (typically 0.05 in Politics research) and vice versa: ‘if the P-value is
low, then Ho can go’. In the example, the P-values are well below 0.05 and the null
hypothesis can be rejected.
You will note that statistics tables distinguish between one-tailed and two-tailed tests.
The default position in politics research is the one-tailed hypothesis: that, as one
variable increases (say, union density), the other (pay) will also increase. However,
there may be circumstances where, although you hypothesise that, as one variable
changes, the other will also change but you can’t predict whether it will go up or
down. In that case, your hypothesis will be two-tailed. What this means is that,
for the same confidence limits, the critical value of r will have to be much higher if
significance is to be attributed.
Regression analysis also enables predictions to be made of variables for which data
is not available. You will recall that the linear regression example for pay/union
density was:
So you can calculate that, for a union density of, say, 50%, pay will be:
The predicted value of a term is denoted by a ‘hat’ sign. So, a predicted value of y
is denoted by ŷ and called ‘y hat’. In the example above, the predicted value of pay
is called ‘pay hat’. However, if we substitute data in the formula from our original
paired data, there is a difference between predicted pay (pay hat) and recorded pay.
Testing for Association 213
For example, in Table 15.1, the pay and union density for distribution are 85.5 and
60%. But if we substitute a union density of 60 in the formula:
This difference between predicted value (105.1) and actual data (85.5) is called the
residual error. It is represented by the Greek letter (pronounced ‘epsilon’).
The general equation for linear regression is therefore:
y = a + bx +
where:
The use of regression analysis to calculate y can only be used between the range of
values for x for which data is available.
y = A + B1 x1 + B2 x2 + B3 x3 + . . . + Bn xn
Your first step is, once again, to produce an X–Y graph of the data:
You will note in the chart that there is prime facie evidence of association
between pay and the proportion of male workers and proportion of the domestic
market. However, there is little evidence of a strong relationship between pay
and the proportion of workers employed in plants of more than five hundred
workers.
You can complete the multiple linear regression analysis in entirely the same
way as the linear regression analysis. The summary output is shown in
Table 15.5.
Testing for Association 215
Pay/other variables
and UK market share
200
worplace size, men
Pay, union density,
Pay
150
Union density
100
% of workers in
50 plants of 500+
% Men
0
0 5 10 15 20 25 % UK market share
Industrial and service sectors
Regression Statistics
Multiple R 0.813484
R Square 0.661756
Adjusted R square 0.571558
Standard error 17.57806
Observations 20
ANOVA
df SS MS F Significance F
Regression 4 9067.796 2266.949 7.336683 0.001757
Residual 15 4634.824 308.9883
Total 19 13702.62
That is:
Relative Pay % = 35.2 + 0.46 [Union Density %] + 0.14 [%Workers in plants
of 500+] + 0.31 [% male workers] + 0.18 [% UK market
share] + residual error
However, when you examine the values for the Lower and Upper 95%
confidence limits, you will note that these extend across zero (e.g. Variable 2
from −0.32 to + 0.49). The null hypothesis cannot therefore be rejected. Similarly,
the P-values for X2, X3 and X4 are higher than 0.05 which also means that the null
hypothesis cannot be rejected.
The regression summary does not include the coefficients of correlation between
pay and each of the four individual variables. To calculate these, click once again
on Tools and Data Analysis. In the Data Analysis dialogue box, scroll upwards to
correlation and click. In the Correlation dialogue box, insert the first and last cells of the
five columns of data (B3:F22) in the Input Range box and click OK. The output
appears in Table 15.6.
in the process and interpretation of the summary output. The greatest errors arise
from the pitfalls of:
1. applying the formulae before first considering the likelihood of relationship – if any – in
theoretical terms and without creating X–Y graphs of variables
2. failing to identify collinear variables
3. failing to interpret the summary output correctly
4. misapplying or misinterpreting the tests of significance
5. consequently, wrongly rejecting or accepting the null hypothesis
6. predicting values of ŷ outside the range of known x data.
1. ‘Correlation does not necessarily mean causation’. Discuss. Explain how you would
investigate a high correlation for causation.
2. The table shows paired data for the total number of UK workers registered as
unemployed and membership of the British Communist party, 1929–39.
FURTHER READING
Introduction
You may have noticed that UK research methods textbooks rarely go beyond linear
regression analysis because of space and complexity. This is unfortunate for two
reasons. First, the data and software now available to researchers make more advanced
statistics much easier to apply. And, second, the more advanced techniques are,
paradoxically, more useful they are than the basic descriptive or inferential statistics
with which you are more likely to be familiar.
The underlying purpose of this chapter is, therefore, to widen your appreciation
of the new possibilities in quantitative data analysis readily available to you to achieve
more practical and adventurous research.
Consider, for example, the physical and social character of many of the inner
city areas of western cities located between the city centre (US ‘central business
district’, CBD) and the outer rings of ‘better suburban housing’ (first identified
by Park, 1925 and Wirth, 1928 of the ‘Chicago School’).1 Physically, the inner
city remains characterised by decaying, predominantly older, high-density, terraced
housing. Most is privately rented. The larger houses have been sub-divided into
‘houses in multiple occupation’ (HIMOs). The schools, parks and shopping areas
are dilapidated. The roads are congested with traffic moving between the suburbs
and the city centre. Most of the mills, factories and other industrial buildings have
closed. Air quality is poor. Socially, the area has become the entry point for successive
‘waves of immigrants’. Other temporary migrants include students and other single
people or single parents seeking lowest-cost housing. Turnover is high. There is
also a large number of single, older pensioners living on low-incomes. Many suffer
chronic illnesses. There is a relatively high level of drug and alcohol abuse, and
street crime. Economically, job opportunities and wages are very low. Most of the
residents rely on some form of income support from the state. In other words, these
physical, social and economic characteristics come together – cluster – in the inner
cities of the western world. The geographical clusters are termed areas of multiple
deprivation.
Governments and local authorities have developed statistical indices of deprivation.
They combine census data on: population age, household size, employment, health,
and housing conditions, with other data on: incomes, benefits and health treatments.
The UK government uses the indices as part of the funding formulae (developed by
multiple linear regression) to distribute central government grants in an objective
(but contested) framework to local authorities, police and health trusts. Local
authorities also use the indices to identify the localities in greatest need and to
lobby government for additional resources. Both use indices to measure changes
over time and the success or otherwise of intervention.
Why these characteristics co-locate is disputed. That dispute is fundamental to
political divisions in society. The Right explains the inner city as the manifestation
of conditions which are created where individuals choose a lifestyle of welfare
dependency: they get what they deserve. The policy solution therefore lies in welfare
cuts to force them to work and become self-reliant. (My grandfather, a self-made
businessman, alderman and church warden subscribed to this view despite both his
grandmothers having died in workhouses.) On the Left, inner city residents are seen
as the victims of a capitalist economy in which those unable to work or find work and
therefore with the least economic power are consigned to the worst areas by market
forces. They are prescribed meagre handouts and a large police presence to prevent
them from challenging the system. The solutions advocated include redistribution of
income, greater income support and empowerment of local institutions. The Centre
takes a slightly ambivalent view in which the inner city is seen as a cost to the national
economy, in which the residents are underused resources. The solutions therefore
222 Research Methods in Politics
Factor analysis
1. First, an R-matrix is produced. This enables the variables with the highest coefficients
of correlation to be identified. It also enables the clusters of variables to be detected by
visual analysis. Consider for example, the (simplified) R-matrix in Table 16.1. Note that
the R-matrix is called a ‘square matrix’ because there are as many rows as there are
columns:
2. Second, the underlying factors are extracted from the R-matrix. The simplest method
is called principal factor extraction. When you shade or colour the cells containing
coefficients of correlation with a value of 0.3 or more, then two clusters become apparent:
You will note from Table 16.1a that variables 1, 2 and 3, and variables 4 and 5 show
high degrees of association. The two separate clusters they form are termed the two
Applying Factor Analysis and other Advanced Techniques 223
principal factors. These factors can be named A and B. In this stage, the eigenvalues
are calculated. The eigenvalue is the measure of the variance in the original variables
that can be attributed to a particular factor.
3. Thirdly, the principal factors are rotated using the varimax procedure (which maintains
the independence of the factors) in which the factor axes remain at right angles to one
another. What this means is that the variables are plotted along the axes of the factors.
This is shown diagrammatically below:
0.8
0.7
0.6
0.5
Factor B
0.4 Factor B
0.3
0.2
0.1
0
0 0.1 0.2 0.3 0.4 0.5 0.6
Factor A
4. Lastly, the factor scores are calculated. These are estimates of the people’s individual
standing with regard to the factors identified.
on its network. Alternatively, you may find that you can buy your own copy from
your computer services under special annual licences for the cost of the CD-ROM,
i.e. £5. But you will only be able to renew the licence as long as you are a student or
employee of the university. After that you will have to pay to purchase the software
(£1200 for SPSS) and pay the annual licence renewal (around) £200. But you can
download a copy for a 30-day trial period.
SPSS
SPSS will be used for factor analysis. SPSS was originally the acronym for Statistical
Package for the Social Sciences. More recently, the acronym has changed to Statistical
Product and Service Solutions as the company has extended its range of products
and customers beyond its original academic base. The web-site is www.spss.com.
Remember that learning to use a different type of software is like learning a new
language: it is useful and develops your intellect.
The software can appear initially perplexing but it is very easy and has become
more intuitive to use. SPSS uses a full Windows environment. Like Excel, all the
data is held on a single spreadsheet called the Data Editor. This has two alternative
screens: a Variable View and a Data View.
The Variable View is the spreadsheet where you enter the variables as separate
rows and nominate the name, type, width, decimals label, values etc. For example, these
might be: name (age of respondent), type (numeric), width (4), decimals (2), label (age), etc.
The Data View is the spreadsheet where you enter your data. In this spreadsheet,
the variables occupy the columns whilst each case is entered as a new row.
Consider the example where you want to find out what the public thinks should be
the most important characteristics and qualities of candidates for the post of prime
minister.
Following a pilot study, you reduce the characteristics to twenty-one attributes:
(their) age (youthfulness); sex (male or female); appearance; religion; origins
(class); peccadilloes (known or alleged personal misbehaviour); family (partner
and children); wealth; identity (notably English, Scots, etc); speech (speaking and
debating abilities); modernity (not old-fashioned); honesty; sincerity; integrity; guile
(cunning); principle; loyalty; courage; patriotism; and, Euroscepticism (anti-EU).
You enter these variables in the opening Variable View shown in Table 16.2.
Note how an additional variable, ‘cases’ has been added to the Variable View. The
‘cases’ are the individual members of the public whom you have asked to rate the
importance they attach to each of these short-listed characteristics on a scale of 0 to
10 (where 0 is least importance and 10 is highest importance). The members of the
Table 16.2 Variable view
Name Type Width Decimals Label Values Missing Columns Align Measure
1 Age Numeric 3 0 Age None None 4 Right Scale
2 Sex Numeric 3 0 Gender None None 3 Right Scale
3 Appearance Numeric 3 0 Looks None None 4 Right Scale
4 Religion Numeric 3 0 Religion None None 4 Right Scale
5 Origins Numeric 3 0 Background None None 3 Right Scale
6 Peccadillos Numeric 3 0 Peccadillos None None 3 Right Scale
7 Family Numeric 3 0 Private/family life None None 4 Right Scale
8 Wealth Numeric 3 0 Wealth None None 4 Right Scale
9 Identity Numeric 3 0 Regional identity None None 3 Right Scale
10 Speech Numeric 3 0 Speaking skills None None 4 Right Scale
11 Modernity Numeric 3 0 Modernity None None 4 Right Scale
12 Honesty Numeric 3 0 Truthfulness None None 4 Right Scale
13 Sincerity Numeric 3 0 Sincerity None None 4 Right Scale
14 Integrity Numeric 3 0 Integrity None None 4 Right Scale
15 Guile Numeric 3 0 Guile None None 4 Right Scale
16 Intellect Numeric 3 0 Intellect None None 4 Right Scale
17 Principles Numeric 3 0 Principles None None 4 Right Scale
18 Loyalty Numeric 3 0 Loyalty None None 4 Right Scale
19 Courage Numeric 3 0 Courage None None 4 Right Scale
20 Patriotism Numeric 3 0 Patriotism None None 4 Right Scale
21 Eurosceptic Numeric 3 0 Euroscepticism None None 4 Right Scale
22 Cases Numeric 8 0 Case number {1, case number} None 8 Right Scale
226 Research Methods in Politics
general public will have been randomly selected. The sample size will be 630, i.e.
calculated at 30 people per variable.
You will enter the data collected in the Data View. The Data View for the first
ten cases is shown in Table 16.3.
Starting the factor analysis procedure is relatively simple. On the Data View, click
in turn on:
Analyze
Data Reduction
Factor Analysis
On the Factor Analysis dialogue box, highlight all the variables listed in the left-hand
pane except ‘cases’. Then, click in turn on:
The higher ‘radio button’ this will transfer the list of variables to the pane marked
‘Variables’
Descriptives
Univariate descriptives
Initial solution
Coefficients (Correlation Matrix)
Reproduced
Continue
You will return to the Factor Analysis dialogue box. Now click in turn on Extraction.
In the Factor Analysis: Extraction dialogue box, click in turn on:
You will return once again to the Factor Analysis dialogue box. Click on Rotation.
In theFactor Analysis: Rotation dialogue box, click in turn on:
Varimax
Rotated solution
Continue
Table 16.3 SPSS Data View (cases 1–10 only of 630 cases)
Age Sex Appear- Religion Origins Peccadi- Family Wealth Identity Speech Modernity Honesty Sincerity Integrity Guile Intellect Principles Loyalty Cour- Patriot- Euroscepti- Cases
ances llos age ism cism
1 7 6 8 0 5 3 5 2 4 7 6 6 7 7 7 8 9 7 7 8 5 1
2 4 8 8 4 8 8 8 8 9 8 2 7 8 6 8 5 7 8 8 9 9 2
3 9 1 8 2 1 2 4 2 5 8 9 7 7 7 8 6 7 7 8 7 3 3
4 1 1 4 1 1 1 3 1 2 6 4 9 9 9 5 7 8 7 6 7 2 4
5 2 2 8 0 0 0 1 0 5 9 7 7 7 6 8 8 6 7 6 4 0 5
6 0 9 9 1 7 1 3 5 5 7 2 6 7 8 9 4 6 7 8 8 9 6
7 3 9 8 0 0 0 1 0 9 8 8 4 4 4 8 7 5 8 9 9 9 7
8 0 0 2 0 0 0 0 0 0 9 9 5 5 5 8 9 8 8 8 5 5 8
9 7 9 8 5 6 7 8 5 8 9 2 6 6 6 8 5 7 7 8 9 9 9
10 2 9 8 7 5 8 7 8 9 8 2 5 5 5 8 7 7 7 9 9 9 10
228 Research Methods in Politics
You will finally return to the Factor Analysis dialogue box where you will
click on OK.
The output will appear immediately on a new screen. This will consist of nine
tables and one chart. The most important for your purposes are the Total Variance
Explained, the Scree Plot and the Rotated Component Matrix
Part of the Total Variance Explained is shown below in Table 16.4. You will note
that Component 1 (i.e. Factor 1) has an eigenvalue of 8.7 and explains 41.6% of the
variance. Component 2 explains 24.6% of the variance. Five components (factors) have
eigenvalues greater than 1.0 and explain 88.9% of the variances overall.
The table is illustrated in the Scree Plot which shows the components having the
highest eigenvalues.
8
Eigenvalue
0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21
Component number
Component
1 2 3 4 5
Wealth .961 .168
Peccadillos .948 −.114 .245
Private/family life .917 .376
Religion .883 .115 −.205 .151
Modernity −.867 .235 −.195 −.194 .237
Background (class) .862 .228 .196
Patriotism .664 .335 .200 .566 .266
Euroscepticism .641 .606 .294 .301 −.105
Gender .620 .395 .522 .313
Regional identity .560 .354 .539 .312
Truthfulness −.922 −.205
Sincerity .136 −.911 −.126 .180
Integrity −.883 .387
Courage .350 .819 .235
Loyalty −.104 .664 −.151 −.320
Principles .143 −.291 −.835 .106 .168
Looks .324 .784 .445
Guile .149 .444 .641 −.408
Intellect −.570 .211 −.619 −.247
Speaking skills .442 .108 −.846
Age .125 .948
Notes:
Extraction method: principal component analysis.
Rotation method: varimax with Kaiser normalization.
A rotation converged in seven iterations.
The rotated component matrix is shown in Table 16.5. This matrix identifies the
relationship between the original 21 variables and the five principal components
into which the data can be reduced. Components 1 and 2 are clearly the most
important. Component 1 shows very high values for wealth, peccadilloes, private/family
life, religion, background (class), patriotism, euroscepticism and gender. You must now
interpret this result to identify what is the family of characteristics incorporated
in Component 1 interpretation as ‘traditional values’. Indeed, these are the
characteristics associated with the Conservative party. The strongest characteristics
of Component 2 are courage, loyalty and guile. (Sincerity and truthfulness are negative
aspects here.) One interpretation of these characteristics might be ‘street fighting
qualities’.
The analysis shows that two factors dominate the characteristics that the British
public wish to see in candidates for prime minister. These can be labelled
‘traditional values’ and ‘street fighting qualities’. Age and intellect are not important.
230 Research Methods in Politics
Consider the data in Table 16.6 of civilian casualties in Iraq from March 2003 and
October 2006.
You will be aware that coalition spokespersons (especially for US forces) continued
to claim for some time that, despite occasional ‘blips’, the level of violence was
actually declining. Using Excel, you can chart the table:
In Figure 16.3, you can see that the general movement for monthly casualties is
to increase over time. You can identify the underlying trend by using the Moving
Average function in Excel (click in turn Tools, Data Analysis, Moving Average).
Essentially, this calculates the average of the months March–May, then April–June,
May–July and so on. The calculated moving averages for the first year are shown in
bold in Table 16.7
The moving averages can be charted to show the trend (forecast):
You will note that there is a variance between the actual data (Y) for casualties
and the trend.
4000
3500
Civilian casualties
3000
2500
Month no.
2000
Casualties
1500
1000
500
0
0 10 20 30 40 50
Time (months)
Moving average
4000
3500
3000
2500
Actual
Value
2000 Forecast
1500
1000
500
0
1 6 11 16 21 26 31 36 41
Data point
Year/Quarter Q1 Q2 Q3 Q4
2003 78 62 56 71
2004 84 64 61 82
2005 92 70 63 85
2006 100 81 72 96
Trend Component, T
Cyclical Component, C
Seasonal Component, S
Residual Component, R
Where: Y = T + C + S + R
Time series analysis is a very underused but useful research method in Politics.
Try to use it. It will pay dividends by identifying those irregular movements which
may be the outcome of policy change. Time series analysis is therefore a very
powerful tool for monitoring public policy and assessing the effectiveness of policy
change.
Take the example of two food parcels, A and B, being prepared by an aid agency
for use overseas to sustain IDPs 2 in a specific war-torn state. Both parcels contain
different food of equal nutritional value. The parcels have transparent packaging
so that the people can choose A or B. A two-parcel strategy has been adopted to
optimise cost, local production capacity and variety. The theoretical probability of
a person choosing parcel type A is therefore 0.5. An initial trial of a random sample
of 100 of the target population shows that 61 preferred parcel type A. The research
problem is therefore: does this higher preference represent the choice likely to be made by the
population as a whole or has it occurred entirely by chance?
The problem can be solved using SPSS. In the Variable View, enter ‘parcel’ in
the first row and ‘frequency’ in the second row. In the Data View, enter ‘1’ (for A)
and ‘2’ (for B) in the column marked ‘parcel’ and ‘61’ and ‘39’ in the column marked
‘frequency’. Now click in turn on Data View and Weight Cases. In the Weight Cases
dialogue box, click on Weight Cases and, using the radio button, transfer ‘frequency’
to the Frequency Variable. Then click on OK. You will return to the Data View.
Click in turn on Analyze, Nonparametric Tests and Binomial. In the Binomial Test
dialogue box, use the radio button to transfer‘parcel’ to the Test Variable List. Note
theTest Proportion box. This is where the theoretical probability is inserted. The
default proportion is 0.5 so no new entry is required. Finally, click on OK. The
Output is:
The key calculation is the Asymp. Sig. (2-tailed) of 0.35. This is less then the test
proportion (theoretical probability) of 0.5. This means that the null hypothesis can
be rejected. So the preference of parcel A cannot be attributed to chance. The
implications are that the aid agency should either change the ratio of production
from 50:50 to nearer 61:39 or improve the appeal of parcel B and re-test using a
new sample.
A special type of Binomial distribution occurs where the population is very large
and the incidence of events is very small. This special type is termed the Poisson
distribution (named after Siméon Denis Poisson, 1781–1840 who developed the
distribution to forecast the likelihood of any of his fellow cavalrymen being kicked
236 Research Methods in Politics
In this example, x = 5 and the mean = 3. The Help? Button will tell you that:
‘cumulative is a logical function that determines the form of distribution returned’.
You can enter either TRUE or FALSE. When you enter TRUE, Excel will calculate
the ‘cumulative Poisson probability that the number of events occurring will be
between zero and x’. If you enter FALSE, then Excel will calculate the ‘Poisson
mass probability function that the number of events will be x exactly’. First, complete
the formula as:
Press the Enter key. The answer will appear immediately in the highlighted cell:
0.916.
Repeat the process, inserting FALSE. The answer is 0.1008. This answer tells
you that there is 10.1% probability (0.1008 − 0.916 ×100) of the number of illnesses
being 5 where the mean is 3. So the illnesses in city C could have arisen entirely by
chance and are therefore not exceptional. However, if the incidence was ten children
a year, then you will calculate that the probability is 0.0008. In other words, the
incidence could not have arisen by chance. So emergency intervention is required
to identify and tackle a local cause or source.
Applying Factor Analysis and other Advanced Techniques 237
1. Work through each of the examples given in this chapter. Seek help when you
encounter difficulties.
2. Collect new data from the class population of their assessment of candidates
for UK prime ministers using the criteria listed in the chapter. Add four additional
criteria of your own choice. Carry out a factor analysis and comment on the results.
3. Obtain unadjusted data for registered unemployment in the UK since May 1979.
Apply time series analysis. Identify the size of irregular movements and offer
cogent, potential explanations.
4. Two Departments of Politics, having equal and good RAE and TQA ratings in ‘new
universities’ A and B both have 30 places available for similar Politics degrees.
A attracts 56 applicants whilst B attracts 73. Could the variation have arisen entirely
by chance or does it indicate that B’s department or university are significantly more
attractive than A? If so, what should A do?
5. The Conservative party has a working majority of 11 over all other parties
combined in the House of Commons following the general election. On aver-
age, five MPs die each year causing by-elections to be held. The new prime
minister believes that harsh economic policies are essential for the first three
years. He assumes that half the Tory-held seats will be lost in by-elections.
Calculate the probability that the party can survive in office for three years.
(Remember that each time a government loses one seat, their majority reduces
by two.)
FURTHER READING
A notable feature of SPSS is the number of very good textbooks that are available
which combine excellent explanations of the statistical concepts and
instructions how to carry them out using SPSS software. Two titles can be
recommended:
Kinnear, P. R. and Gray, C.D. (2004) SPSS for Windows Made Simple. Hove:
Psychology Press Ltd. This offers a very good introductory and intermediate
text. Earlier editions are also available.
Field, A. (2005) Discovering Statistics Using SPSS (and Sex, Drugs and Rock ‘n’
roll). 2nd edn. London: Sage. This more extensive and expensive book is very
readable and provides a comprehensive range of material for new and more
experienced researchers.
238 Research Methods in Politics
Notes
1 Chicago University’s School of Sociology was the first established at a US university. As the
‘Chicago School’ it developed a reputation for ‘urban ecology’ which identified the concept of the
‘zone of transition’ and, later ‘inner city’ that provided the initial theoretical underpinning for US and
UK urban programmes and urban regeneration. See Park, R.E. and Burgess, E.W. (1925) The City
and Wirth, L. (1928) The Ghetto.
2 IDPs: acronym used by UN to distinguish ‘internally displaced persons’ from other refugees.
Part IV
B: Qualitative Analysis
Chapter 17
Analysing Qualitative
Information: Classifying, Coding
and Interpreting Information
Introduction
In Chapter 12, you were introduced to the hierarchy of analysis which begins by
assembling all the raw data, validating it and reducing it to ordered information.
At the end of this essential first stage, you will have uncluttered the chaos of your
desk and reduced the paperwork etc. to the ‘nuggets of gold’ on which you can
begin your analysis.
There are three principal methods for analysing qualitative information. Most
qualitative information takes the form of talk-and-text - spoken or written words.
The methods are:
• coding
• content analysis
• discourse analysis.
Coding
This has become the most widely used method of qualitative analysis. Coding
is essentially the process of replacing or substituting groups of words, phrases or
sentences by letters or numbers (or a combination). Unlike a cipher, a code is not
designed to hide the original meaning of the word or phrase. Indeed, an essential
property of an effective code is that it should be readily understandable to users and
readers. A word or phrase can be given several different codes.
Codes can be theoretical, descriptive or inferential.
Theoretical codes are derived from the independent and dependent variables
identified in your theoretical framework. A descriptive code merely describes what
it seeks to represent. An inferential code is used when you draw an inference usually
from repeated patterns or clusters of juxtapositions of different codes. One special
type of inferential code is a factor code. A factor is a latent, underlying variable
like ‘power’. Chapter 16 showed you how to identify underlying factors from
quantitative data. There will be occasions when you identify important variables
which fall outside your initial range. In this case, you can develop new codes as you
continue. These are called in vivo codes (‘code-as-you-go’).
Codes are usually designed generically and given alphabetical references to help
identify and distinguish them intuitively. For example, where ‘education’ is the
theoretical variable, then a family of codes could be, say:
Education E
Pre-school Ep
Early Years Epe
Nursery Epn
Infants Ei
Junior Ej
Secondary Es
Sixth-Form E6
Teacher Et
Further Education Ef
Higher Education Eh
University Ehu
Uni-Tutor Ehut
Uni-Friend Ehuf
Analysing Qualitative Information 243
The process of designing and applying theoretical, descriptive or in vivo codes to text is
termed first-level coding. They are applied by underlining or making bold all the
key passages and recording the codes in the right-hand margin. Alternatively, you
can use Nud*st, ATLAS.ti or other (‘CAQDAS’) software to code the information
electronically. In this way, passages can be multi-coded. Authorities suggest that you
will be able to remember and use as many as 60 generic codes without difficulty
(Miles and Huberman, 1994: 58).1
You must have already reduced your raw data to organised information before
you begin tagging and coding. This will have involved transcribing your interviews
into a three column format and having omitted all extraneous clutter and ‘noise’.
However, you don’t need to have collected all your data before you begin the
process of reducing available data and coding. Indeed, there are great advantages in
designing your codes and applying them at an early stage of your fieldwork to test
their appropriateness and the value of your initial data and information.
The initial part of the process – identifying key, codable words or phrases before
they are coded – is termed tagging. You are likely to be already familiar with
the most basic tagging and coding of text. This involves highlighting or underlining
words, phrases or sentences with coloured pens. Each different type of text is
marked with a different colour. So the text becomes colour-coded. However, you
will encounter two or more problems. First, you are likely to run out of colours.
And, second, many words or phrases may be coloured two or more times so
the coding becomes unreadable. Yet, words or phrases which attract many codes
are particularly important because they demonstrate the links between different
characteristics and concepts.
The case study below has been developed to demonstrate how to design and
apply simple codes and to analyse the coded information.
Case study
The research question is: why are UK leading political elites first drawn into politics and
particular parties?
You have chosen a comparative approach which relies, in the first instance on
primary, published sources. Your starting, theoretical hypothesis is that choices of
party and political careers are caused by a combination of environmental factors.
You believe that they will include: family, education, religion, class, occupation and
circumstances. You have chosen a modified form of grounded research in which you
start with a small sample of two cases. You will analyse these before seeking further
cases until you achieve theoretical saturation.
244 Research Methods in Politics
(Transcript of interview first published in The Observer from Harris, K. (1967) Conversations.
Hodder and Stoughton. pp. 266–86.)
Wilson: I suppose the short answer is because politics are in me, as far as I can
remember. Farther than that: they were in my family for generations before me, as they
were in the families of dozens of members of the Labour party. The first time that I
can remember thinking systematically about politics was when I was seven. I was in
hospital with appendicitis. My parents came in to see me the night after my operation
and I told them not to stay too long or they’d be late to vote – for Philip Snowden.
Then when I was 10 I went to West Australia where my uncle was an Australian
MP and later President of the Upper House. That was my first visit to a politician.
Wilson: They were non-conformist by religion and radical by temperament. The Lib-Lab
tradition. The day after the 1906 election results came out in Manchester, my grandfather –
he was a Sunday school superintendent – chose the hymn: ‘Sound the loud tumbrel
Analysing Qualitative Information 245
o’er Egypt’s dark sea! Jehovah hath triumphed, his people are free’. It’s the old story of the
pursuit of religious freedom and indignation with social injustice combining to conflict with the
established social order. My other grandfather, too, was a deeply religious man who believed
that politics represented the nation’s application of religious principles.
In my childhood, it was chapel and the scout movement, that kind of pattern. My wife’s the
daughter of a Congregationalist minister – I met her at a sports club. So I was impregnated
with nonconformity. It was the soil out of which the Labour party grew. Incidentally, there are
plenty of second-generation nonconformist radicals in the Labour party, men and women
whose approach to politics stems from the religious values their parents planted in them.
There are a lot of first generations, too. I don’t think that you can understand the Labour party
if you don’t bear that in mind. Or the trade union movement. Or the Co-op[erative Movement].
Wilson: I have religious beliefs, yes, and they have much affected my political views. But I’m
no theologian…
Wilson: Not at all. I’ve studied the subject as history: you can’t understand the Russians
without it. But, quite honestly, I’ve never read Das Kapital. I only got as far as page 2 – that’s
where the footnote is nearly a page long. I felt that two sentences of main text and a page
of footnote were too much.
Wilson: Well, as I have said, my parents and the Scout movement … but there was another
indirect influence. The two men who influenced me most directly were schoolmasters.
One of them is still alive … a lifelong socialist. Not by argument, but by example. He was
246 Research Methods in Politics
a great teacher – unselfish and unstinting. When I was fourteen I caught typhoid, and missed
two terms at school.When I got back to school, I was miles behind – miles. It looked hopeless.
I reckoned I could catch up in things like history. But not in mathematics. The second day of
term he called me up to his desk. He said: ‘if you put in an extra hour in the afternoon after
school closes, you should be able to make it all up this term. If you’re willing, I am’. I did.
Wilson: Coming from my kind of background, the teachers were the most important adults in
your life. And my mother and my sister were teachers, and two uncles. Politics is education.
Harris: I’ve taken you off the point. I was asking who
influenced you?
Wilson: At Oxford, my tutors: for example, my tutor in politics, R B McCallum, who is Master of
Pembroke now. A Liberal politically. He taught me so much about the mechanisms of politics,
such as parliamentary standing orders, the works of the public accounts committee and so
on. When I became a don at University College, there was G D H Cole, a socialist. Both had
a lot of influence on my ideas, and on the training of my mind.
Wilson: Beveridge. I was his assistant – his research assistant – for a couple of years before
the [1939–45] war … Then there was Attlee. A great prime minister. The story of Attlee
has yet to be told, though I think that the public has been getting a fuller notion of his real
contribution to history in the last four or five years.
Analysing Qualitative Information 247
Wilson: I would like to think that I was. I learnt a great deal from him. I think that I’m
driving the party at a faster rate than Clem [Attlee] did – at the moment. His method
was to sit and listen and then say: ‘We all seem to want it this way’. I talk more, far too
much in fact, put more cases, am more positive. But the circumstances are different …
Wilson: Nye [Aneurin Bevan]. It’s very difficult to abstract from Nye’s influence on me. It was
the whole man, you see. He taught me the power of the public platform. I wish I had a tenth
of his power on the public platform. And he corrected my interest in detail. Nye always took
the broad view. In many ways he was lazy, and avoided detail, if he could, anyway, but he
had the gift of instinctively seeing the horizon. He never failed to see the wood for the trees.
I regard him as the best-educated man I have ever met, particularly in philosophy. He could
see everyday political issues in the deep human perspective and he could communicate
them simply and instantly to anybody.
(Transcript of interview first published in The Observer from Harris, K. (1967) Conversations.
Hodder and Stoughton. pp. 255–65.)
Harris: What made you a Conservative in the first place? Are you
a Conservative because your father was a Conservative?
Heath: No, in more ways than one. The other day my father said that he had been a Liberal.
No, I certainly didn’t become a Conservative because my family were Conservative. I’m not
248 Research Methods in Politics
sure what they were. We hardly ever talked about politics in the family because as a family
we weren’t particularly interested in politics.
Heath: My father was a very likeable and good man, and a good craftsman – a carpenter. I
was born in Broadstairs [Kent] but during the First World War he went to work at Vickers –
woodwork for aircraft – and he came back to Broadstairs when I was seven or so, and the
family with him. I still have a sense of everything beginning when I came back to Broadstairs
at the age of seven.
My mother was a fine character with a strong personality, a high sense of morality and public
responsibility, but none of which she projected on anybody, including the family. She had the
spiritual sense of her Christian faith, not that she was all ethereal about it – she kept her
feet on the ground. I think that she was rather a remarkable woman, because she had high
standards and strong views and yet she was a wonderfully forbearing mother towards her
children. For instance, when I was thirteen I went to Europe on my own, or with one or two
other boys, and I only discovered later how much she worried about me without letting me
ever know.
to do with freedom too. She left us boys free – to go one’s own way, and because she did
that, I had the sense of moving forward, growing up, without the feeling that I was doing it
against my parents. On the contrary, I was doing it with them, because of them, and that
one’s parents were behind one – which makes such a difference.
As I got to 17, 18 years old, the country as a whole was moving out of the period in
which it was preoccupied with the suffering of the unemployed – things were looking up –
and moving into the threat of dictators. This was the moral dimension – of my youthful
associations with the attractions of freedom. By the time I went up to Oxford, if there was
one political idea in the broadest sense of the term which governed me it was a deep
feeling about and for the idea of freedom. I was very conscious of this. I joined all the
three parties on my first term at Oxford, to see what they were up to, but by then I had
accepted that I was a Conservative as part of accepting, so to speak, the facts of life.
Heath: Just after I got to Balliol – I was an organ scholar there – they were putting a new organ
into the chapel, and, partly because of this, and partly because I later became President
of the Junior Common Room, I saw a great deal of the Master of College, A D Lindsay.
(Harris: A socialist).
Heath: Yes, formative, inspirational. But, as I say, it shaped and gave a clearer meaning to
what … But it also started processes for me. It wasn’t merely that I went up to Oxford but
250 Research Methods in Politics
that I went to Balliol. Balliol is a college of high academic standards and strong democratic
traditions where old Etonian sons of dukes or millionaires are expected – and expect – to
meet on equal terms, well, the son of a carpenter. Balliol opened all the doors to me …
Heath: Good lord, yes. It’s been the same all along. I was brought up in a Christian home,
as they say in the obituaries, and at Oxford – well, I just went on as I do today … I believe in
God, very much the kind of God, I would say, that ministers of the Church of England would
believe in. I believe in Christ and in the divinity of Christ. I believe in an after-life …
Harris: How far does your religion come into your politics?
I don’t think that there should be too much talk about religion and politics. And I think that
Temple [war-time Archbishop of Canterbury, 1942–44] was right: the Christian should not aim
at programmes of action. It’s the declaration of values and principles and inward personal
attitudes that come from faith …
Harris: Apart from your religion, has any system of ideas, or any
particular person’s ideals, had much influence on your views?
Heath: Yes, a great many. I don’t get much time to read now outside of what I have to read,
but I’m a reader by temperament and when I’m free I read a lot. But it isn’t the people I’ve
read most of that come to mind. It’s more what I’ve read about them. Disraeli, for instance.
His one-nation approach, his refusal to be distracted from the search for the national interest
by the existence of class and sectional interests. I found that profoundly sympathetic. And
I admired him because he didn’t come from the top men of politics of its day, and he was
opposed by them in his early political life and had to struggle to preserve his confidence in
himself, let alone succeed in getting the confidence in others.
Analysing Qualitative Information 251
Locke also comes to mind too. Locke’s ideas I found gave me a base on which to think about
my own – his emphasis on liberty enshrined in political institutions based upon experience
and judgement, not on doctrinaire theories and utopias.‘No man’s knowledge can go beyond
his experience.’ And his view of the state. It exists for men, not men for the state. Indeed,
it’s only a convenience, the state, to deal with the problems you’d have if each man tried to
be a judge in his own case. And I admire the cast of his mind, Christian, calm, temperate,
good-humoured.
Codes
You have chosen and designed the following generic, theoretical codes:
Variable Education E
Sunday school Ess
prep school Ep
secondary school Es
sixth-Form Es6
university Eu
teachers and tutors Et
variable Family F
Father Ff
Mother Fm
Sibling Fs
Grandparents Fg
Uncles and Aunts Fua
Wife Fw
Children Fc
Others Fo
variable Religion R
Non-conformism Rn
Methodism Rnm
Church of England Rcoe
Ministers Rp
Lay preachers Rlp
variable Politics P
Labour Pl
Conservative Pc
Leading Members Pm
MP Pmp
252 Research Methods in Politics
The codes can now be applied to the text. This is shown in Table 17.1. Note how
landscape format has been used to transcribe the text. This effectively condenses the
text and provides greater continuity from page to page in both its printed form and
on-screen display. Note how line numbers have been added to your transcript to
enable you to cross-reference quotations later to their original source.
You will quickly find out that this first-time (first-pass) coding is time-
consuming – especially if you code to screen. But it will save you time later.
When you apply the codes, you will learn whether they capture all the independent
variables that you identify in the text. You may decide that additional, in vivo codes
would be useful. Two variables for additional coding might be ‘significant others’
and ‘music’.
Examine your coded sheet. You will see that substantial parts of the transcript
have been coded. This shows that the material is an information-rich source.
Note also how many passages have been coded many times. For example, the
part of the sentence lines 012 and 013 attracts three codes (Fg, Ess, Rlxp). These
codes show the concurrence of family (grandfather), education (Sunday school) and
religion (superintendent). This appears to confirm your original hypothesis of family,
religion and education as causal variables of political consciousness. However, what
is missing from this and other parts of the Wilson interview is any mention of
contemporary events, despite his childhood in the late 1920s in a northern UK
mill town. He makes no reference to the Depression, the rise of Fascism and the
appeal of Communism. His politics appear to reflect an entirely historical rather than
experiential basis. Compare this with Heath’s account. Heath describes the influence
of experiencing his own family’s hardship, reading of unemployment in the depressed
areas, the growth of Fascism and joining all the political parties at university to
experience their appeal. Perhaps this comparison may explain the greater sense of
Table 17.1 Coding of Wilson interview (paras 1 and 2 only)
His political 003 Wilson: I suppose the short answer is because politics are in me, as far as I can remember. Farther than that: P
career seems 004 they were in my family; for generations before me, as they were in the families of dozens of members of F
‘written for 005 the Labour party. The first time that I can remember thinking systematically about politics was when I P , Lc
him’. Didn’t 006 was seven. I was in hospital with appendicitis. My parents came in to see me the night after my operation Ef , Fm
he ever rebel 007 and I told them not to stay too long or they’d be late to vote – for Philip Snowden. Then when I was ten I Pm, Lc
against the 008 went to West Australia where my uncle was an Australian MP and later President of the Upper House. EXo, Fa, Pmp
orthodoxy or 009 That was my first visit to a politician.
look at
alternatives? 010 Harris: Why was your family so politically minded?
No mention of
Damascene 011 Wilson: They were non-conformist by religion and radical by temperament. The Lib-Lab tradition. The Rn
events 012 day after the 1906 election results came out in Manchester, my grandfather – he was a Sunday school Fg, Ess, Rlp
013 superintendent chose the hymn; ‘Sound the loud tumbrel o’er Egypt’s dark sea! Jehovah hath triumphed,
014 his people are free’. It’s the old story of the pursuit of religious freedom and indignation with social injustice
Social and 015 combining to conflict with the established social order. My other grandfather, too, was a deeply religious
political 016 man who believed that politics represented the nation’s application of religious principles. // In my Fg, R
engineering? 017 childhood, it was chapel and the scout movement, that kind of pattern. My wife’s the daughter of a Lc, Rn, Vsc
018 Congregationalist minister – I met her at a sports club. So I was impregnated with nonconformity. It Fw , Rlp, Vsp
019 was the soil out of which the Labour party grew. Incidentally, there are plenty of second-generation Rn, Pl
Is Wilson 020 nonconformist radicals in the Labour party, men and women whose approach to politics stems from Pl , F , Lc
being entirely 021 their religious values their parents planted in them. There are a lot of first generations, too. I don’t think
truthful or is 022 that you can understand the Labour party if you don’t bear that in mind. Or the trade union P , Vtu, Vcoop
this post-facto 023 movement. Or the Co-op.
justification to
appeal to
readers?
254 Research Methods in Politics
political conviction and obduracy displayed by Heath when he was prime minister
in 1970–74. However, you must beware that these observations are being made
from only two, relatively short interviews and with the benefit of hindsight.
The next stage is to abstract the coded passages into a table whose columns are
formed of the primary codes used. In your research, the outcome is membership
of a particular political party. So place this dependent variable – politics - in the
first (left-hand) column. The process of abstracting highlighted passages is relatively
easily done by copying and pasting the highlighted passages and their codes. The line
numbers are added in brackets to enable cross-referencing to their source. Where
passages are multiply-coded, then they should be copied in each of the relevant
columns and the relevant sub-sections highlighted. This is shown in Table 17.2.
The next task is to look for patterns and clusters. In this context, a pattern is a
repeated set of relationships. One of the simplest methods of identifying these is to
compress the analysis table and to colour-code or grey-scale the contents. This is
shown in Table 17.3.
This tabulation enables patterns and clusters to be seen to emerge. For example,
religion and family can be seen to be more strongly associated with politics.
However, that represents only the first two paragraphs of the interview. Suppose
that the tabulated coding of the full interview produced Table 17.4.
You can see how education, events and significant others become associated with
politics. If you wish, you can calculate the number of passages.
The next task is to apply this potential explanation to the Heath interview. Heath
attributes the appeal of Conservative politics to a ‘combination of home background
and the times’. He extends the influences to ideas of freedom. But perhaps the
most telling passage is his description of his father: ‘. . . working hard, showing
enterprise, taking risks, and gradually developing his capacity in spite of very difficult
circumstances’. His father was a self-employed carpenter working in a predominantly
rural county. In short, the Heaths were petty-bourgeoisie and church – rather than
chapel – goers. However, the evidence is not wholly conclusive. But both appear
to have conformed to the political norms of their social class.
Another step would be to prepare a comparative table drawing together material
from the texts.
End stage
Footnote
However, there are no easy fixes in coding and its analysis. You will have to explore
and prepare different ways of ‘differentiating and integrating’ your information until
258 Research Methods in Politics
Politics Family Religion Education Life Stages Events Vol. Orgs. Sig. Others Music
Analysing Qualitative Information 259
Politics Family Religion Education Life Stages Events Vol. Orgs. Sig. Others Music
29 16 15 21 3 8 2 14 0
Family
Religion
Voluntary
Education organisations
Significant
others
some signs of clarity appear. Be prepared to invest considerable time in the process:
as much as (if not more than) you spent collecting and transcribing the data.
These include memoing, case analysis meetings, interim case studies and pre-structured cases
(Miles and Huberman, 1994: 73–85).1
Memoing
Writing a memo generally means writing an informal note to yourself or colleagues
of new information. In the context of research, memoing has a more specific
meaning:
the theorising write-up of ideas about codes and their relationships as they strike the
analyst while coding … it can be a sentence, a paragraph or a few pages … it exhausts
the analyst’s momentary ideation based on data with perhaps a little conceptual
elaboration.
(Glaser, 1978: 83)2
260 Research Methods in Politics
In other words, when you have a Eureka moment, insight or brainwave during your
coding and analysing of text, write it down and continue with your activity. Copy
the memo to your colleagues or supervisor for their views. Return to your memos
when you have finished your coding. Many of your bright ideas will prove false
dawns. But you will not have forgotten them and have evidence of all the leads
that you explored and discounted.
Conforming Non-conforming
Conforming working class (Wilson) Nonconforming working-class (D. Davis)
Class Conforming middle class (Heath) Nonconforming middle class (Attlee)
Conforming upper class (Macmillan) Nonconforming upper class (Mosley)
Analysing Qualitative Information 261
1. Consider and discuss the transcripts of the interviews with Harold Wilson and
Edward Heath. On the basis of your theoretical understanding gained from other
courses, what causal influences on their political choices would you suggest? Copy
them from www.sage.co.uk/pierce. Develop your own generic codes and apply
these. What additional, in vivo codes would you suggest? Tabulate the codes and
extracts for Wilson and Heath. Tabulate a comparison of the transcripts. Develop
a typology of your own. What inferences would you suggest?
2. Visit www.bbc.co.uk On the home page, enter ‘Paxman Interviews’. Select an
interview with a UK political elite. If in doubt, use interview with Tony Blair on
27 April 2005. Click on ‘printable version’. Download, transcribe and code. Note
that you can also watch video recordings of many BBC interviews.
FURTHER READING
Notes
1 Miles, M. B., and Huberman, A. M. (1994) Qualitative Data Analysis. London: Sage.
2 Glaser, B. G. (1978) Theoretical Sensitivity: Advances in the Methodology of Grounded Theory. Mill
Valley: Sociology Press.
Chapter 18
Using Content Analysis
Introduction
On the other hand, the criticisms that can be made of content analysis include:
Content analysis may be qualitative or quantitative. Both can use the same body
of textual and other data. Qualitative content analysis is highly interpretive.
It essentially involves the reading of texts, etc. to determine the extent of bias in
terms of supportive, critical or (more or less) neutral accounts of organisations,
institutions, concepts or figures. In York, it was used by students over many years
to analyse the bias of British print media towards the Loyalists and Nationalists in
Northern Ireland. The approach here, as elsewhere, is to select a sample of texts
over a long period of time for independent reading and analysis by a number of
researchers whose own biases are recorded at the beginning of the exercise. The
assessments are then compared.
Alternatively, qualitative content analysis can be used to compare different
perspectives on the same topic by different speakers. In 2004, as an exercise
at the Essex Summer School, I compared the interpretations of ‘democracy’ of
world leaders in their speeches to the UN following 9/11. My analysis is shown
below. You will note the differences in the meanings of democracy adopted and
promoted by the US President and European leaders. Note also how Putin adopts
an instrumental view of democracy.
BLAIR
CHIRAC
cooperation
liberty
human rights
responsibility
peace and prosperity
BUSH fear freedom and dignity
peace and
tyranny multilateralism
development
censorship state sovereignty
peace and prosperity
from taxes rule of law under UN
freedom hope rule of law
equal dignity of all cultures
to choose respect for others
respect for diversity
raise families liberty rather than
dialogue
vote freedom
assemble stability partnership SCHROEDER
worship uniting disparate institutions to guarantee human
groups tolerance rights
God + Democracy + Liberty justice popular participation
hard work shared trade
opposite of responsibility to defend
offering asylum to sustainable development
communism greater vigilance,
security refugees disarmament and non-proliferation
military action merit full state sovereignty
sacrifice worth social and material security
intervention minority rights
response BURLESCONI
pre-emption freedom and democracy PUTIN
can't be neutral defence of human rights market economies
peace and development decent standard of living
freedom from totalitarianism choice
route from poverty European humanism
anti-totalitarianism
myth of partnership (NATO)
caliphate
Figure 18.1 Interpretation of world leaders of ‘democracy’ in speeches to the UN following 9/11
266 Research Methods in Politics
This rough and ready approach has been replaced by the development of discourse
and narrative analysis as the principal method for the qualitative analysis of text.
Quantitative analysis
Most content analysis is now entirely quantitative. It counts the incidence and
frequency of words. Its theoretical underpinning is provided by Zipf’s Law –
an experimental law developed by George Zipf (1902–50), Harvard professor of
linguistics. Zipf’s Law is, technically, a power-law distribution. The law states that
the frequency of occurrence of some event (P), as a function of the rank (i) when the
rank is determined by the above frequency of occurrence, is a power-law function
Pi ∼ 1/i a with the exponent a close to unity. What this means is that, in any body of
text, the frequency of any word is inversely proportional to its rank in the frequency
table (of most commonly-used words). In English texts, the word ‘the’ is the highest
ranking word. So, in any text, it is likely to be the most frequently used word and,
indeed, is used twice as often as the next, highest-ranking word.
What Zipf means in plain English is that, where uncommon words (or phrases)
are used often in a text, then they express and reflect the greatest concerns of the
communicator. These are termed key words. For example, a Zipfian analysis of
G. W. Bush’s presidential inaugural address of 20 January 2005 shows that, in a
speech of only 2,083 words, the key words used were:
However, the word ‘Iraq’ was not mentioned at all. This example readily
demonstrates the great weakness of content analysis as a tool of Politics research: that
the key words used by political elites (and their speech-writers) do not necessarily
express what may be their greatest concerns. Hence the criticism made of Margaret
Thatcher by a cabinet colleague that: ‘The trouble with Margaret is that, when she
speaks without thinking, she says what she thinks’.2 Indeed, the key words may be
used deliberately to conceal or divert attention from real policy concerns. Political
speeches have become carefully-planned, ‘communications events’ whose contents
will have been analysed to ensure that the ‘right words’ are used the ‘right’ number
of times and ‘resonate’ (appeal) to the target audiences. However, paradoxically,
content analysis by others can enable omissions to be identified.
Using Content Analysis 267
You can carry out your own simple content analysis by copying texts of speeches
from the Internet and then using the Edit/Replace function in Microsoft Word.
First, identify your key words. Then ask Word to replace all your first key word by,
say, xyz. Word will tell you how many occurrences have been replaced.
Quantitative content analysis can be either structural or substantive. Whichever you
adopt, you must firstly clearly identify the population of texts and sample frame and
justify fully the (random or non-random) sampling method you adopt.
Structural content analysis is primarily concerned with how the text is presented
and reported rather than the frequency of key words used. It seeks to measure:
The Independent 238 Shoot the messenger: Blair blames press for anti-war mood
Daily Express 773 Big new tax on house owners
Daily Mail 2,311 Now a school bans crucifix
The Mirror 1,540 Big brother shot my dad dead
The Sun 3,026 Shoot him, mother’s anger at beast who raped girl, 3
The Star 750 Big Bro on skids
TV news (audience for post-watershed news)
BBC News 5,000 Reid moves to quell offender row
ITN news 3,000 Boys killed by Tube train
Sky News 2,000 Men killed in Tube tragedy
Source: Audit Bureau of Circulation www.abc.org.uk, BBC, ITN and Sky News web-sites
not widely read by the British public.Their importance is that they are read by the political
and media elite and reported intensively in newspapers, TV and radio. Thus their textual
emphases set the tone and themes of campaign discussion (1999: 2).
He explains that the task of analysing the data is simplified by the coding of all
Western European manifestos since 1945 by the Manifesto Research Group of the
European Consortium for Political Research (ECPR). The Group uses a base of 46,
major, policy areas which are coded generically. They include: 101 Foreign special
relationships: positive; 102 Foreign special relationships: negative; 103 Decolonisation; …
706 Non-economic demographic groups. Each sentence is coded and counted under
one policy area. The percentage of sentences devoted to each policy area is then
calculated. In this way, the coverage given to any policy area can be plotted over
time by extending the analysis over all of the parties’ manifestos in chronological
order.
Budge extended the research by analysing the movement of manifestos across the
political spectrum to establish how far (and often) the parties have changed their
Using Content Analysis 269
ideological positions and appeals to the electorate. He adopted the left-right coding
scale developed by Klingermann et al (1994).4 This is shown in Table 18.1.
Budge applied this scale by adding all the sentences in Klingermann’s ‘left list’ and
subtracting them from all the sentences in the ‘right list’ to provide a scale between
+100% (manifesto wholly ‘right wing’) to –100% (all ‘left wing’). The scores are
charted in Figure 18.2.
40
Left wing (−) / Right wing (+) scores
30
20
10
for each party
0 Conservative
−10 0 20 40 60 Liberal
−20 Labour
−30
−40
−50
−60
General Election years (where 1945 is 0)
Labour moves sharply rightwards from 1992 and for the first time in post-war history
shows a preponderance of right wing positions over left ones positions (+5%) … Labour
moved rightwards and ‘leapfrogged’ over the [Liberal–Democrats] … in relative terms,
Labour became the most centrist party.
(Budge, 1999: 6)
You may criticise Budge’s method for its reliance on assumptions that you regard
as very problematic (e.g. the categorisation of ‘human rights’ as a right-wing
phenomenon). However, you must accept that his analysis does appear to chart
accurately the ideological emergence and drift of New Labour to the (more electable)
centre-ground. However, this very good example of effective content analysis also
demonstrates that the method is not a quick fix. In this research project, it has
involved reading and coding 42 election manifestos. So structural content analysis
can be very laborious. And users can also be criticised for substituting hard labour
for the less-laborious but more intellectually demanding methods such as discourse
and narrative analysis (see Chapter 19).
New software removes the hard labour of traditional content analysis but compounds
criticisms of its use as a principal research method. There are now a large number of
English language software programs for quantitative content analysis. They include:
AutoMap; CatPac; General Inquirer (Harvard); Hamlet II; Leximancer; TACT; Textpack
(Cologne); Texstat (Berlin); VBPro; Wordsmith; WinMax. You can find reviews of
and information on many of these programs at: http://lboro.ac.uk/research/methods/
research/software/stats.html
Each of these types of content analysis software perform a wide range of functions.5
The core functions include:
combination of, say, ‘bomb’ and ‘Islam’ are likely to automatically attract the attention of
the security services.
Hamlet II
To provide an example, Hamlet II has been used to complete a content analysis of the
full text of President Bush’s State of the Union Address 2005. This was downloaded
from the White House’s Internet site at www.whitehouse.gov/news/release/
20050202 as a plain text file. A list of key words was selected from a quick skim of
the speech. They were (in alphabetical order) better world, budget, democracy, economy,
free*, freedom, God, history, hope, justice, liberty, sacrifice, tax, terror* and tyranny. (The
wild card * is used to enable all words beginning with the chosen stem, e.g. free*,
to be counted together.) No synonyms were used. However, the word ‘Applause’
272 Research Methods in Politics
(included in the transcript as ‘(Applause)’) was added to find out which key words
generated the greatest support from Members of Congress. A demonstration copy
of Hamlet II was installed and the instructions followed. The analysis was saved and
copied and is shown in Boxes 18.2a, b, and c:
CATEGORY/WORD COUNTS
You will note that the most frequently used key words were free* (27), terror* (27),
democracy (8), liberty (7), ‘better world’ (6), tax (6) and history (5). ‘Applause’ was recorded
in the transcript on 67 occasions
BOX 18.2b
1 2 3 4 5 6 7 8
9 10 11 12 13 14 15 16
+-----------------------------------------------------
Applause 1 |
better world 2 | 4
budget 3 | 7 0
democracy 4 | 9 0 0
economy 5 | 20 3 2 0
free* 6 | 25 0 0 4 2
God 8 | 1 0 0 0 0 1
History 9 | 6 0 0 1 2 6
Hope 10 | 4 1 0 1 0 3
| 0
justice 11 | 7 0 0 1 2 1
| 0 0
liberty 12 | 6 0 0 3 1 9
| 1 1 0
sacrifice 13 | 1 0 0 0 0 0
| 0 0 0 0
society 14 | 4 0 0 0 0 1
| 0 0 0 0 0
tax 15 | 11 1 2 0 6 0
| 1 0 0 0 0 0
terror* 16 | 26 0 0 6 0 23
| 0 6 0 3 0 0
tyranny 17 | 2 0 0 2 0 3
| 0 1 0 0 0 0 4
274 Research Methods in Politics
The joint frequency table clearly shows that ‘Applause’ was most strongly associated with
terror* (26 times), free* (25 times) and economy (20 times). Other frequent associations
are; free* with terror* (23 times); liberty with free* (9 times); history and free* (6 times);
and, hope and free* (3 times).
The probability of a specific pair of words being present in any pair of words is measured
by the Jaccard coefficient. This is shown calculated in Box 18.3c:
HAMLET II analysis: Jaccard coefficients
1 2 3 4 5 6 7 8
9 10 11 12 13 14 15 16
+---------------------------------------------------
-----
Applause 1|
better world 2| 0.06
budget 3| 0.11 0
democracy 4| 0.14 0 0
economy 5| 0.34 0.21 0.17 0
free* 6| 0.36 0 0 0.13 0.06
God 8| 0.01 0 0 0 0 0.04 0
History 9| 0.09 0 0 0.08 0.14 0.23 0 0.20
Hope 10| 0.06 0.13 0 0.10 0 0.11 0 0
| 0
justice 11| 0.11 0 0 0.09 0.15 0.03 0 0
| 0 0
liberty 12| 0.09 0 0 0.25 0.06 0.36 0 0
| 0.09 0.11 0
sacrifice 13| 0.01 0 0 0 0 0 0 0
| 0 0 0 0
society 14| 0.06 0 0 0 0 0.03 0 0
| 0 0 0 0 0
tax 15| 0.18 0.09 0.29 0 0.55 0 0 0
| 0.10 0 0 0 0 0
terror* 16| 0.38 0 0 0.21 0 0.74 0 0
| 0 0.25 0 0.10 0 0 0
tyranny 17| 0.03 0 0 0.25 0 0.12 0 0
| 0 0.25 0 0 0 0 0 0.16
Using Content Analysis 275
The dendogram and minissa display are shown in Figures 18.3 and 18.4. They
demonstrate the functional relationship between the key words used and their
relative proximity.
The example demonstrates the main strengths and weaknesses of using content
analysis software. The main strengths are:
• the meanings of key words change over time and can be deliberately changed by political
parties who exploit ‘feel good’ or ‘feel bad’ words to make their policies more attractive
(e.g. ‘community’, ‘homeland’)
• overall, the analysis is not really conclusive enough to provide sufficiently reliable
evidence to confirm your research hypothesis.
Are these differences significant? What alternative explanations can you give?
FURTHER READING
Most textbooks of research methods in Politics mention content analysis but few
give more than a few pages’ coverage.
Krippendorff, K. (1980) Content Analysis: An Introduction to its Methodology.
London: Sage. Despite its age, this remains an essential text for students
contemplating the use of content analysis. Its early publication (1980) means
that it pre-dates PCs and the availability of software. Hence, Krippendorff
provides a very good, detailed account of the assumptions and processes
adopted, and shows how these can be applied manually.
Harrison, L. (2001) Political Research: An Introduction. London: Routledge.
pp. 113–20, provides an authoritative account of the scope and application of
content analysis. She provides a case study of the portrayal by UK news media
of political leadership qualities.
278 Research Methods in Politics
Notes
1 O’Sullivan, T., Hartley, J., Saunders, D., Montgomery, M. and Fiske, J. (1997) Key Concepts in
Communication and Cultural Studies. London: Routledge.
2 Matthew Parris, The Times, 13 January 2007.
3 Budge, I. (1999) Chapter 1: Party policy and ideology: reversing the 1950s? In Evans, G. and Norris,
P. (eds.) Critical Elections: British Parties and Voters in Long-Term Perspective. London: Sage.
4 Klingermann, H-D., Hofferbert, R. and Budge, I. (1994) Parties, Policies and Democracy. Boulder:
Westview Press.
5 Brier, A.P. and Hopp, B. HAMLET a Multidimensional scaling approach to text-oriented policy
analysis. In Journal of Diplomatic Language 2(1) (2005) (online at http://www.jdlonline.org//
IIbrier.html), illustrates the comparison of a number of sources.
Chapter 19
Understanding and Adopting
Discourse and Narrative Analysis
‘We cannot get iffy over other people’s power-games with language, and then pretend
we are not players in the game too’
(Curt, 1994:19)1
Introduction
Discourse analysis is characterised, at one hand, by growing enthusiasm for its use by
ambitious students and researchers and, at the other, by a variety of interpretations
and advice from leading authorities. The paradox is that discourse analysis has many
interpretations: there is a discourse on discourse. Some regard it as a method.
Others profoundly disagree: they conceptualise discourse analysis as a discipline.
It is, therefore, another ‘essentially contested concept’ (Gallie, 1956).2 Indeed, there
are times when, faced with the wide range of differing authorities, you may be
forgiven to likening discourse analysis to Churchill’s description of Russia as:
• a description for studies focusing only on linguistic units above the level of the sentence
(Stubbs, 1983)8
• analysing the way systems of meaning or ‘discourses’ shape the way that people
understand their roles in society and influence their political activity (Howarth, 1995)9
• an examination of the relationships between units of talk, writing, or other representational
forms, and of the significance of these relationships for our subjective experience (Squire,
1995)10
• discourse analysis does not look for truth – but rather at who claims to have truth (Carver,
2002: 53).11
Essentially, discourse involves language (rather than individual words). But the
modes of discourse also include other sounds (a referee’s whistle), non-verbal
communication (gestures, holding a child’s hand) and signs (for example, traffic
lights). The primary uses of language are:
• emotional expression
• social interaction
• an instrument of thought
Understanding and Adopting Discourse and Narrative Analysis 281
• expression of identity
• co-ordination and control of others.
Examples of the use of language for co-ordination and control include parade-
ground commands, children’s nursery rhymes and the litany of religious rituals. But
the meaning of the language will be determined by the context and societal norms.
Consider the example of a brick. A brick on a building site is a component of
construction. A brick as part of a wall is a means of enclosure. A brick to an artist
is a highly textured and variegated surface within a regular and repeated shape. But
if you carry a brick through a crowded shopping street, then – especially if you are
wearing a ‘hoodie’ – it may well be regarded as a potential weapon and you, the
bearer, as a would-be criminal.12
Linguistics
Linguistics is ‘the science of language’ (Crystal, 1995: 425).13 Its original focus
was grammar and the rules of language. In the Enlightenment period, the rationalist
scholars investigated what appeared to be universal features of language as evidence
of universal rationality. Their nineteenth-century successors studied the evolution
of language and grammar. In the twentieth-century, the focus moved to psychology
and social theory. A paradigmatic shift was provided by the Course in General
Linguistics (1916) by Ferdinand de Saussure (1857–1913). He distinguished between
language (facility of speech), langue (language system) and parole (speech act). Langue
is essentially a system of signs which has two parts: the signifier (what signifies) and
the signified (what is signified or meant). He also distinguished between diachrony
(study of the historical development of language) and synchrony (study of the ‘lived’
language of the present).
The synchronic approach of concentrating study on the structural forms of
language – rather than diachronic study – became termed structuralism. Its name
derived from the belief that that individual agency (personal autonomy) is superficial:
behaviour is determined by underlying structures of society. Individuals are not the
architect of their universes but their products. This approach was extended by the
French scholars: Claude Levi-Strauss (1908–),who was particularly concerned with
the role of myths in society); cultural seminologist, Roland Barthes (1915–80),
and psychoanalyst; Jacques Lacan (1901–81) and others (Jary, 1995: 660–2).14
282 Research Methods in Politics
How [is] it that human beings, whose contacts with the world are brief and personal and
limited, are nevertheless able to know as much as they do?
(Chomsky, 1986: xxvi)15
Semiotics
Semiotics is the:
study of the properties of signs and signalling systems especially as found in all forms
of human communication.
(Crystal, 1995: 430)16
More recently, the signifiers have been extended to include consumer durables,
gadgets, gifts, music and architecture. For example, archaeological research has
shown that the great fortified gatehouses built by the Romans had little military
value: their role was to express to the native population the overarching power
of Rome.
Philosophy
The philosophers principally associated with the development of discourse theory are
the Austrian-born philosopher, Ludwig Wittgenstein (1889–1951) and the French
philosopher, Michel Foucault (1926–84).
Wittgenstein argued that language pictured the world. Furthermore, there could
never be a ‘private language’. Language was bounded by language games where each
game had its own rules and was grounded in its own ‘form of life’.
Foucault was, in part, a poststructuralist and iconoclast (a person who challenges
accepted beliefs). He re-examined topics and prevailing beliefs ‘through the
other end of the telescope’. He argued that there was no absolute truth or
Understanding and Adopting Discourse and Narrative Analysis 283
objective knowledge. The maxim that knowledge is power was a myth. In practice,
power is knowledge. Elites use language to promote their interpretations of knowledge
through fabricated truth regimes. Discourse was a system of representation in the form
of epistemes and discursive formations. In particular, language is a vehicle for the
production of new knowledge and systems of classification of society. Knowledge
did not liberate individuals. Instead, it has become part of the apparatus of control by
the state. He was particularly concerned (and personally affected) by the emergent
discourse of scientific and medical knowledge by which individuals became labelled
as mad or homosexual, and panoptically complicit in their own exclusion and
confinement. Madness and sexuality were entirely social constructs. In this way,
individuals were objectified and structured by discourse. His approach has been widely
adopted by Foucauldian critical discourse analysts.
Other significant contributions were made by Canadian-born sociologist Erving
Goffman (1922–82), US sociologist, Harold Garfinkel (1917–) and Canadian media
guru, Marshall McLuhan (1911–80). Goffman studied face-to-face interaction
through the lens of social interactionism where the meanings of language were never
static or fixed but negotiated by the participants. Garfinkel was the founder of
ethnomethology which studied the everyday methods used by members of different
societies (ethnomethods) in their conduct and interaction. McLuhan contributed the
maxim that: ‘the medium is the message’ (1962).17 So ‘television is more significant
than the content of its programmes’ (O’Sullivan, 1997: 176–7).18
Members of this school see the task of discourse analysis as, therefore, to identify
these frames, their effectiveness and the consequences of their use.
Realists argue that objects have an existence independent of society’s conception or
perception. The objects have their own properties and causal capacity. So discourses
284 Research Methods in Politics
are objects in their own right which contribute to events and social development.
The task of discourse analysis is to identify the discourses, show how they contribute
to processes of development and to expose the ‘underlying material resources which
make discourses possible’ (Parker, 1992: 1).21
Marxists see discourses as ‘ideological systems of meaning’ which legitimate the
unequal distribution of resources and power. The discourses are economic. They
are promoted by capitalists via their political parties, state education system and news
media. The task of discourse analysis is: first, to expose the false consciousness sustained
by discourse; second, to identify the mechanisms and means adopted: and third, to
liberate those people whom it imprisons.
Critical discourse analysis is essentially similar to the Marxist conception of discourse.
However, it privileges social over economic influences. This is described in greater
detail later in the chapter where it is adopted to analyse a case study.
Post-structuralists (and Post-Marxists) regard:
The proponents of this view include Derrida, Foucault, and, more recently,
Howarth’s colleagues, Laclau and Mouffé.22 Laclau and Mouffé set out ten
propositions. These include the argument that a political discourse can never
dominate a discursive field to the exclusion of other discourse: it is defined by
a subordinate one. Their propositions are very sophisticated and probably too
advanced for first-time discourse analysts.
Confused by discourse theory? This brief review demonstrates one essential element of
discourse analysis: don’t think about using discourse analysis unless you are willing to
confront a very challenging literature. If your research project is merely a means to an
end outside academia, then choose another method of analysis. Go for an easy option.
But if you regard your research as a unique opportunity to develop your intellect by
tackling new concepts ranging beyond the conventional boundaries of political science, then
consider using discourse as both the theoretical framework and method of analysis. On the
practical side, an understanding of discourse can help you to compete better in the growing
communications and media sectors of the economy.
You may well feel intimidated by Laclau and Mouffé’s post-structuralist approach.
In that case, you are likely to find that critical discourse analysis provides a
Understanding and Adopting Discourse and Narrative Analysis 285
better starting point for your journey into discourse analysis. It offers three great
advantages to the political scientist. First, critical discourse analysis sees its primary
role as ‘emancipatory’:
to expose the way in which language and meaning are used by the powerful to deceive
and oppress the dominated.
(Howarth, 2000: 4).
Second, critical discourse theory draws on wide-ranging authorities with whom you
are likely to be already familiar: Gramsci, Althusser, Foucault, Giddens, Habermas
and Bakhtin (1895–1975). And third, a leading school is led by Norman Fairclough,
formerly Professor of Language in Social Life at the University of Lancaster, whose
very readable, authoritative texts draw examples from Politics – especially the
discourses of Thatcherism and New Labour.
In the introduction to his major text, Language and Power (2000), Fairclough
explains that his language study is critical (CLS) because it seeks to expose
otherwise hidden connections between language, power and ideology (2000: 4).23
He differentiates this approach from others by concentrating on how the audience
interprets the text (rather than the intentions of the ‘text-producer’) drawing on their
members’ resources (MR, i.e. accumulated experience). He also includes within
the scope of discourse analysis the turn-taking of everyday conversations (which
others tend to treat as a specialist sub-field).
Critical language study adopts a concept of discourse which Fairclough defines
succinctly as: ‘language as social practice determined by social structure’ (2000: 14).
So language is integral (rather than external) to society and a socially-conditioned
process. The relevant conditions are the social conditions of production and the social
conditions of interpretation. These social conditions have three levels of organisation: the
immediate social situation; the social institution; and the level of society. Fairclough
develops three arguments about the relationships between language, discourse and
social practice. First, the discourse used is socially determined by orders of discourse -
conventions set out in social institutions. Second, orders of discourse are ideologically
shaped by power relations of class and power in capitalist society. Third, (following
Giddens’ structuration theory) discourse shapes social structures and vice versa.
So this dialectic of structures and practices achieves both social continuity and
change.
Fairclough’s critical language study develops Gramsci’s concept of hegemonic
power. Discourse is used by the state to win consent and acquiescence. However,
286 Research Methods in Politics
Social conditions of
interpretation Process of production
Context
Process of interpretation
Interaction
Text
Vocabulary
Grammar
Textual structures
These terms need explanation. Experiential value refers to traces of how the
text producers’ own experiences of the world – social or otherwise – are represented.
By way of example, Fairclough cites the difference between the use of the terms
‘solitary confinement’ and ‘seclusion’ by different groups of psychiatrists. The two
terms reflect two opposing ideologies. The replacement of ‘solitary confinement’
by ‘seclusion’ is an example of rewording. Relational value refers to traces of
the social relationship in the discourse. In other words, how the words used create
social relations between the participants (for example, addressing each other by title,
family name, first name or nickname). Expressive value refers to the text producer’s
view of reality (for example, ‘globalisation’ and ‘internationalisation’). Euphemisms
provide traces of expressive values, for example, ‘defence forces’.
In terms of grammatical description, Fairclough analyses the grammar of sentences
into subject (S), verb (V), object (O), complement (C) and adjunct (A). Their
combination and order express three types of process: actions (SVO, e.g. Thatcher
attacked the welfare state), events (SV, e.g. Thatcher was speaking), or attributions
(SVC, e.g. the welfare state was attacked by Thatcher). Attributions identify causes
(or allocate credit or blame to agents). In contrast, where agency is unclear,
then causes are concealed – perhaps for legal reasons. Nominalisation is used
to convert a process into a noun. In this way, meaning and attribution become
(conveniently) ambiguous. A verb requires a subject and may cite an object. For
example, using the word ‘development’ rather than the verb ‘to develop’ enables
Understanding and Adopting Discourse and Narrative Analysis 289
the speaker to be much less specific about who is going to develop what, how
and when. ‘Community development’ is a wonderful example of nominalisation in
practice.
Fairclough distinguishes between modes of sentence, modality and pronouns. Modes
can be declarative ( SV), grammatical question (no O) or imperative (no S). Each treats the
subject in a different way. Using grammatical questions or imperatives underlines
the power of the subject. Modality refers to the authority of the speaker. Relational
modality is the social authority of the speaker, whereas expressive modality is concerned
with the speaker’s authority of truth or reality, and can be recognised by their
use of ‘is’, ‘may’ or ‘can’. Similarly, using ‘we’ or ‘you’ can evidence power
relations.
Aspects of Fairclough’s textual analysis are sophisticated and, at first sight,
complicated, He can perhaps be criticised for appearing to omit other key
contributions to the discourse of particular importance to the Politics researcher.
These are primarily contextual. They include the when, where, to whom (the audience)
and how (the medium), the role of the speaker or writer (the ‘text-producers’) and
the position of the discourse in preceding or contemporary events. For example,
you may consider that contextual factors like a formal speech by the British prime
minister to the UN in the wake of 9/11 may be more significant in the first instance
than whether individual sentences have objects or not.
Interpretation
Explanation
1. We. Mrs Thatcher uses the pronoun we mainly in lines (11–9) and (79–81), both
inclusively and exclusively … The inclusive use (e.g., ‘ now we do enjoy a standard
of living which was undreamed of then’) is rationally significant in that it represents
her, her audience and every one else in the same boat. It assimilates the leader
‘to the people’ … (Fairclough, 2000: 148)
… (a) that politics and government are social practices in which language is salient –
this is a durable feature of these social practices in comparison with others [he cites
agriculture as a case where language is less salient], (b) language is becoming more
salient within these practices.
(Fairclough, 2000a: 156).
Case Study: President George W Bush’s State of the Union Address, 2007
4 January as the first woman speaker and the most senior elected politician in the country.
She is ‘two heartbeats away from the Presidency’
• The President is effectively reading a prepared speech written by speech-writers and
honed to perfection by rehearsals
• the speech is being made to the Members of Congress face-to-face and, via the news
media, to the citizens of the US
• the speech will also be considered carefully by the US allies, supporters, critics and
enemies
• by tradition, the speech is made unchallenged by opposition; it is punctuated only by
applause which is triggered by pauses in the President’s delivery
• President Bush is ‘beleaguered’: the Iraq project has become the dominant political issue
in the US and, in consequence, the President’s Republican Party has lost control of the
Senate and House of Representatives
• The President’s approval ratings are at an all-time low
• the ‘separation of powers’ set out in the US constitution means that, if bills are not to
be vetoed by the President or Congress, then a new ‘bi-partisan’ approach will have to
be negotiated by the two institutions if progress is to be made on new policy on social
security, Medicare, taxation, home security and defence
• big business, the Pentagon, the ‘neocons’, and potential candidates for the presidential
election will be watching for signals of support for their own constituencies
• The President has just rejected the recommendations of the bi-partisan Iraq Study Group
to involve Syria and Iran in the resolution of Iraq
• a predecessor, President Reagan was called the ‘Great Communicator’; George W. Bush
is no great communicator
• US commentators tell us that, whatever the public’s view of any individual President, they
retain great respect for the Presidency.
A comparative content analysis of key words used in all President Bush’s State of the Union
Addresses shows the changing emphasis given to key issues over the years:
The table is illustrated in Figure 19.2
The analysis will adopt Fairclough’s three-stage system of description, interpretation and
explanation.
Understanding and Adopting Discourse and Narrative Analysis 293
40
Number of mentions of
35
Iraq
30
keywords
25 Afghanistan
20 Economy
15 Iran
10
Oil
5
0
0 2 4 6 8
Years (2000 onwards)
Figure 19.2 President Bush’s State of The Union Addresses 2001–07: frequency of
key words
Source: Table 19.1 from New York Times: 21/01/07
Explanation
You will recall that the questions to be asked of the text are: what are the experiential,
relational and expressive values and metaphors used?
Experiential values refer to the traces of ‘text-producer’s’ experience of the natural and social
world included in the text. Aspects include the classification schemes used, whether words
are ideologically contested and over-wording used. In this case, the classificatory schema
adopted by the President is primarily to reduce the world to the US, ‘Americans’ and US
interests. Ideologically contested words are minimised in favour of the language of consensus
and learning-through-experience. This is also achieved by portraying the enemy in over-
worded, graphic terms:
… possessed by hatred and commanded by a harsh and narrow ideology. They preach
with threats, instruct with bullets and bombs, and promise paradise for the murder of
the innocent.
Continued
294 Research Methods in Politics
Note also the use of alliteration (the rhetorical style which uses the repetition of opening
consonants to achieve emphasis): ‘hatred … harsh, bullets and bombs …, promise
paradise…’. Notice how ‘our American values’ are contrasted with their ‘extremism, ideology,
and totalitarianism’. By contrast, ‘our government’ is using ‘lawful and proper use of
intelligence, etc.,’ in a list in which ‘military action’ is mentioned last, implying a ‘last resort’.
What they (the terrorists) ‘fear most is human freedom’. There is a superabundance of purple
prose:
free societies where men and women make their own choices, answer to their own
consciences and live by their hopes rather than resentments.
Relational values refer to traces of social relationships enacted via the discourse. In this
case, the social relationship sought with his immediate audience of Congressmen is that of
friendship in adversity: e.g. ‘Like many before us, we can work through our differences, and
achieve big things for the American people’ and: ‘our success in the war’. You will note
that, in the video recording, emphasis is given by the President to we. In terms of the
wider audience of the American people, President Bush is seeking to project himself as
their resolute protector. But the social imagery induced is more like the ‘strong father’ than
‘benevolent mother’ or ‘kindly grandfather’ (which President Reagan was able to evoke). But
this President is no wise old man sitting out on the porch: he is a military scout and fire-fighter.
Are there any euphemistic expressions? Well, the whole speech seems to avoid saying either
‘my disastrous invasion of Iraq, my failure to secure peace there, the worsening situation,
and 3,000 US dead’. Instead, he asserts that ‘our success in this war is often measured
by the things that do not happen’. Are there any markedly formal or informal words? The
speech is ‘US formal’ which seeks to underline the dignity and authority of the Presidency
and the seriousness and fitness-for-office of the current President.
Expressive values refer to traces of the speaker’s evaluation of reality and their ideological
significance. In this case, the President ‘congratulate[s] the Democrat majority’. He appears to
avoid terms ideologically confined to the Republican Party and uses instead terms common
to the Republicans and Democrats: ‘extending the nation’s prosperity, to spend the people’s
money wisely … to guard America against evil’. The ideological struggle is between America
and its enemies. There is no accommodation possible which does not compromise US
freedom: ‘the security of our nation is in the balance’.
What metaphors are used? There appears to be very few metaphors used. The President
avoids using the popular metaphors of baseball or American football or the ‘tough talk’ (e.g.
‘I say, bring it on’ for which he apologised later). He’s ‘talking Presidential’, using measured
words.
Understanding and Adopting Discourse and Narrative Analysis 295
What experiential value do grammatical features have? The main grammatical features are
short, grammatically correct sentences. Most sentences are given in the active (rather than
passive) tense in which the subject–verb–object predominates. So does the present tense.
The subject is ‘we’ rather than ‘I’ or ‘you’. Agency is clear: terrorists. The sentences are mainly
positive and confident. There are few nominalisations.
The grammatical mode is almost wholly declarative (rather than grammatical questioning
or imperative). The relational modality is President to Congress and ‘our citizens’. The
expressive modality is characterised by the use of ‘can’, ‘will’ and ‘know’ rather than ‘may’
or ‘might’. The President is confident and certain. The main logical connectors employed
are hyphens. There are no lists. Applause is cultivated to maintain control and to enable
topics to be changed. Indeed, applause is the main interactional element between speaker
and audience. The President speaks direct to his audience rather than to the ceiling and
notes. There are no asides or quips. He is reading from the transparent video-screens at
each side.
Interpretation
There will be many interpretations of a Presidential address. The interpreters will
include: Congressmen, the television audience, the newspaper readers and the ‘expert
commentators’ who mediate between the text and the wider audience. Each group is
diverse. They will all draw upon very different members’ resources (MR). Then there will
be your own member’s resources as the Politics researcher. Knowing how the State of the
Union Address will ‘play in Peoria’ will be difficult for a British or Australian researcher, and
doubly-difficult for a researcher who is not wholly fluent in American-English. So, ideally
you should be able to identify which interpretations are likely to be given by the main
constituents to whom the President is seeking to appeal and influence. There are many.
You must identify the principal constituencies and suggest how they might interpret the
speech.
Take, for example, the US military who, despite forces of over a million men and women and
a budget of $600 billion, appear unable to stem the rising violence in Iraq. What’s in it for
them? Well, their Commander-in-Chief declares that:
on this day, at this hour, it is still within our power to shape the outcome of this battle. Let
us find the resolve, and turn events towards victory’. Victory will be achieved by sending
‘more than 20,000 additional soldiers and Marines to Iraq.
Continued
296 Research Methods in Politics
An additional 92,000 troops will be recruited, and civilians hired for rear echelon duties.
Our country is pursuing a new strategy in Iraq, and I ask you to give it a chance to work.
And I ask you to support our troops in the field, and those on their way.
This last statement evokes memories of Vietnam when President Nixon argued that it was
primarily the lack of support for US forces at home that undermined the war effort over there.
You may conclude that US soldiers based in Baghdad would interpret the speech to mean
‘more of the same’ with the options of withdrawal or ‘taking the fight to the real enemy in
Iran and Syria’ ignored. They may be disappointed or even angry that the death of so many
soldiers goes unstated.
Explanation
Fairclough’s critical discourse analysis concludes by identifying the power relations,
ideologies and effects. He is particularly concerned to identify how the audience’s members’
resources are reproduced unconsciously through their interpretation of the text. In this case,
the President achieves – or seeks to achieve – reproduction of his discourse by minimising
the differences between Republicans and Democrats, by wrapping himself in the flag of
consensual American values and by painting his enemies as wholly evil and hell-bent on
destroying our America. His discourse is therefore of integration and differentiation. American
values are being defined by the enemy. It is their ideology which is defined. He continues to
link the war in Iraq with 9/11 and seek popular support for a war of righteous retribution against
evil which threatens ‘the security of [our] nation’. So the war is essential to defend American
values and way of life. He raises the sword of ‘human freedom’ which ‘every terrorist fears
most’. The appeal is to emotions rather than intellect. But – despite the stentorian rhetoric –
the speech is comparatively uninspiring and lacks the power of John Kennedy or Churchill
to reinforce the determination of the people.
Postscript
In his State of the Union Address, the President spoke of the budget that would ‘shortly
be sent to Congress’. His budget was announced on 15 February. Despite his pledges to
balance the budget and to protect Medicare provision, the budget proposed to increase
military spending by nearly 12%. This would be achieved by reducing federal spending
on Medicare by $66 billion over five years and cutting back $12 billion from the Medicare
Understanding and Adopting Discourse and Narrative Analysis 297
healthcare scheme for lowest-income citizens. However, he argued that these reductions
could be achieved by attacking costs rather than by reducing the level and volume of
services.
Conclusion:
How useful is critical discourse analysis?
The case study demonstrates the strengths and weaknesses of applying Fairclough’s
approach to critical discourse analysis. The highly-structured framework of analysis enables
you to offer a wealth of critical assessments. The framework provides a good starting
point for the ambitious researcher keen to adopt discourse analysis. However, there
are a number of weaknesses which arise in part from its roots in linguistics. Too
little emphasis is given to the context in which the discourse is produced. It is better
suited to the analysis of interactive discourse than the speeches and monologues which
characterise politics. It emphasises the interpretations given by the audience rather than
the intention of the ‘text-producer’. Identifying the interpretations given by the audience is
highly speculative. This requires understanding of their members’ resources. Furthermore,
the audience is likely to consist of a number of constituencies with very different
resources
You may therefore wish to modify the approach by including other methods, such as:
Narrative analysis
Origins
The origins of narrative analysis include linguistics, social and literary theory, history
and discourse theory. The classical theory underpinning narrative analysis is the
Morphology of Fairy Tales (Propp, 1927). Vladimir Propp (1985–1970) examined
the main Russian fairy tales. He found that the underlying narrative structure was
remarkably common. Each fairy tale could be deconstructed into 5 categories of
elements and 31 narratemes. The five categories were: the dramatis personae (‘cast’);
the conjunctive elements of misfortune and good fortune; motivations; forms of
appearance of the cast (e.g. the flying fairy godmother); and, lastly, attributive
elements (e.g. Jack’s beanstalk, the old lady’s shoe). The narratemes began with
α, the initial situation when the hero and members of family are introduced,
followed by when one of the members of the family goes missing. The
stories all end with the last narrateme, , when the hero marries and ascends the
throne. Western fairy tales also followed this pattern. Propp therefore argued that
fairy tales constituted pre-knowledge – comparable to Fairclough’s earliest members’
resource – by which people became conditioned to believe that their own lives
would follow a similar fairy tale course. These expectations enabled them to
accept that early misfortune was inevitable and part of the essential tapestry of
life that – ultimately – would end in happiness. Parents and grandparents become
reconditioned and reproduced by their role as household narrators. The concept of
pre-knowledge can explain how readily the British public came to see Princess
Diana as the ‘fairy princess’ and Camilla Parker-Bowles as the ‘wicked witch’
Understanding and Adopting Discourse and Narrative Analysis 299
and ‘step-mother’ to the young princes. Indeed, the western antipathy to step-
mothers and mothers-in-law can be attributed to the bad press they receive in fairy
tales.
Whilst Propp’s work has been hugely influential, he has been criticised for
overlooking the nuances of context and mood. He can also be criticised for
overlooking the competing pre-conditioning role of religion and Biblical narrative
on western society. The narrative of Christ is the antithesis of the fairy tale. Through
this combination of fairy tales, religious tracts and local folk stories (King Arthur,
etc.), the structures of stories become both historically embedded and conservative
(retrospective). The participant or observer is conditioned to believe that there is
little opportunity for – or point in – agency. This historicist model can be likened
to Heidigger’s ‘horizons of meaning’.
History – especially national history – is grand narrative. History shapes national
identity. Identity shapes and reinforces the boundaries of the state. History is shaped
by dominant power: ‘it is the victors who write history’ (Carr, 1990).33 So whose
history prevails is critical. Hence the continuing argument in the UK about the
contents of the unified, national curriculum for history in which – as one insider
told me – the central question was: ‘how much can we afford to tell the working
class about their past?’ Some concentration camp survivors argue that narratives of
the Holocaust were suppressed in Western Europe during the Cold War to facilitate
reconciliation and military coalitions against the ‘Soviet threat’. In the same way, the
historical narrative of Japan was re-written by the British government in the 1980s
to air-brush out Japanese wartime atrocities and therefore to reduce opposition to
Japanese inward investment.
Narrative analysis
Definitions of narrative analysis include:
• the analysis of act, scene, agent, agency and purpose (Burke, 1966)34
• how respondents in interviews impose order on the flow of experience to make sense of
events and actions in their lives (Kohler Reissman, 1993)35
• the analysis of how stories mark out identities, mark out differences, differences define
‘the other’, and the other helps structure the moral life of culture, group and individual
(Plummer, 1995)36
• the analysis of the production of narratives: the process of association, building and ‘the
and, and and’ connections between actions and events and negotiating them with readers
(Czarniawska, 1998)37
• the study of lives from the narrator’s experience as a shared production with social
scientists (Social Anthropology, Feminist Research, McRobbie, 1982).38
300 Research Methods in Politics
• identifying the formal structures (properties) of stories in terms of the plot, setting,
characterisation, and temporal ordering
• identifying the social roles of stories in terms of:
• the ways they are reported
• the ways they are read
• how they change
• their role in the political process
• stories as speech acts.
Speech Act Theory is central to narrative analysis in explaining how words ‘work’. The
underlying concept is that words ‘do action’. The speech acts can be distinguished
and classified as (Austin, 1962):39
• locutionary speech acts: constative, descriptive statements, e.g. ‘it’s hot today’
• illocutionary speech acts that achieve action ‘in’ saying (directly): e.g. ‘in saying it I was
warning him’
• perlocutionary speech acts that ‘do something’ indirectly. They use the language of a
constative statement: e.g. ‘students who do not attend classes are more likely to fail’.
Often these categories of speech act are linked. Not all speech acts are felicitous (suc-
cessful): some are infelicitous. Narratives can also compete for support. For example,
consider the famous case of the Congressional hearings in 1991 when President
Bush’s nominee for the US Supreme Court was contested. The nominee was Judge
Clarence Thomas, a 43-year old, conservative, African-American from Georgia.
Critics argued that, whilst Thomas would maintain the racial composition of the
Supreme Court, he would replace a black liberal judge by a conservative who would
oppose reform in decisions involving Affirmative Action and abortion. The hearing
considered the objection by Anita Hill (a former colleague) of sexual harassment.
Both were high-achieving, black Republicans from poor backgrounds whose
successful careers were assisted by early ‘affirmative action’ programmes. The hearing
was held in the context of the imminent presidential elections in which Republicans
Understanding and Adopting Discourse and Narrative Analysis 301
were arguing that affirmative action was discriminatory. The full transcript of
the hearing is available on http://chnm.gmu.edu/courses/122/hill/hillframe.htm.
When you read them, you will note how both Thomas and Hill adopted
‘narrative strategies’. She sought to argue on the basis of the ‘facts’ (detailed
descriptions of diarised events). He presented himself as a ‘victim’ citing his deprived
background and the ‘high-tech lynching for uppity Blacks’ by the liberal news media.
Furthermore, he criticised his sister, Mae as a ‘welfare queen’ and portrayed Hill as
a ‘black lady’. Thomas’ narrative prevailed by appealing to embedded US narratives
of the self-made man and ‘victimhood’.40 You may note how the contemporary
narrative metaphor of ‘black’ - which had recently replaced the more pejorative
‘negro’ - has now been superseded by ‘African-American’ in the same period in
which ‘Red Indian’ has been superseded by ‘Native American’ (cf., Canadian ‘First
Nations’).
Narrative constituents
Narrative analysts adopt a scheme of terms to classify the components of narrative
discourse. They are:
all the world’s a stage in which you act the part dictated by the combination of the set
and your interests at the time.
(This view contradicts the argument of Sartre and others that, despite peripheral
flux, people have solid, stable, cores of authentic self.)
Case Study
Consider the example of the famous interview of Princess Diana by Martin Bashir
broadcast on BBC Panorama programme in 1995. You can watch the video-recording
and inspect the transcript by inserting ‘Diana, Bashir’ in the search box on the web-site
www.bbc.co.uk
You can identify the narrative of the self employed by the Princess:
Her victim strategy was successful in her narrative struggle with Prince Charles for the ‘heart
of the nation’. Her narrative was defined and reinforced by Prince Charles’ own TV interview
later (with Jonathan Dimbleby) in which he admitted his adultery.
FURTHER READING
Howarth, D. (2000) Discourse. Buckingham: Open University Press. pp. 166. This
excellent textbook is ‘essential reading’ for students contemplating the adoption
of discourse analysis in their research. The author critically examines and
compares the various concepts of discourse.
Fairclough, N. (2000) Language and Power. 2nd edn. Harlow: Longman. pp. 224.
This text is also ‘essential reading’ for students contemplating discourse
analysis and wishing to learn how critical discourse analysis can be applied.
Fairclough, N. (2000a) New Labour: New Language? London: Routledge. pp. 178.
This is a very readable and wry demonstration of the application of critical
discourse analysis. It is less technical than his previous text (Fairclough, 2000).
It might have been strengthened by a comparison with the discourse of the
earlier, new Labour (of the ‘white heat of technology’ and economic
restructuring) successfully forged by Harold Wilson in the 1960s (which proved
equally disappointing in the long term).
Austin, J. L. (1962) How to Do Things with Words. Oxford: Oxford University Press.
Williams, R. (1988/ 1976) Keywords. London: Fontana. Raymond Williams
(1921–90) describes and analyses how the meanings of ‘keywords’ like culture,
class, community and democracy have evolved through adaptation and
struggle. He defines keywords as: ‘significant, binding words in certain activities
and their interpretation; they are significant, indicative words in certain forms of
thought. Certain uses [bind] together certain ways of seeing culture and
society …’ (1988: 15).
Notes
1 Curt, Beryl C. (1994) Textuality and Tectonics; Troubling Social and Psychological Science.
Buckingham: Open University Press, cited by Bergman, M. at Essex Summer School, 2003.
2 Gallie, W.B. (1956a), Essentially Contested Concepts. In Proceedings of the Aristotelian Society,
56: 67–198.
3 Churchill’s quote is widely attributed to his (post-war) assessment of China. However, he first
coined it in 1939 about the Soviet Union in the wake of the Germany-Soviet Union
Non-Aggression Pact.
4 Fairclough, N. (1989) Language and Power. London: Longman.
5 Howarth, D. (1995) Discourse Theory. In Marsh, D. and Stoker, G. (eds.) (1995) Theory and
Methods in Political Science. Basingstoke: Macmillan.
6 Carver, T. (2002) Discourse analysis and the ‘linguistic turn’. In European Political Science,
Autumn 2002, cited by Bergman, M. at Essex Summer School, 2003.
7 Hajer, M. (1995) The Politics of Environmental Discourse. Oxford: Oxford University Press, cited
by Bergman, M. at Essex Summer School, 2003.
8 Stubbs, M. (1983) Discourse Analysis. Oxford: Blackwell, cited by Bergman, M. at Essex Summer
School, 2003.
Understanding and Adopting Discourse and Narrative Analysis 305
9 Howarth, D. (1995) Discourse Theory. In Marsh, D. and Stoker, G. (eds.) (1995) Theory and
Methods in Political Science. Basingstoke: Macmillan, cited by Bergman, M. at Essex Summer
School, 2003.
10 Squire, C. (1995) Discourse Analytical Psychology. In Wilkinson, S. and Kitzinger, C. (eds.) (1995).
Feminism and Discourse: Psychological Perspectives. London: Sage, cited by Bergman, M. at
Essex Summer School, 2003.
11 Carver, T. (2002) Discourse analysis and the ‘linguistic turn’. In European Political Science,
Autumn 2002, cited by Bergman, M. at Essex Summer School, 2003.
12 A ‘hoodie’ is the slang term popularly given in the UK to the hoods of jackets worn over the head
by young men. It is interpreted both as a means of concealing their identity from CCTV cameras
and as a self-proclaimed sign of the wearer’s separate and alienated identity.
13 Crystal, D. (1995) The Cambridge Encyclopaedia of Language. Cambridge: Cambridge University
Press.
14 Jary, D. and Jary, J. (1995) Sociology. London: HarperCollins.
15 Chomsky, N. (1986) Knowledge of Language. New York: Praeger, cited by Crystal, D. (1995) The
Cambridge Encyclopaedia of Language. Cambridge: Cambridge University Press. p. 409.
16 Crystal, D. (1995) The Cambridge Encyclopaedia of Language, Cambridge, Cambridge University
Press.
17 McLuhan, M. (1962) The Gutenberg Galaxy. London: Routledge and Kegan Paul.
18 O’Sullivan, T., Hartley, J., Saunders, D., Montgomery, M. and Fiske, J. (1997) Key Concepts in
Communications and Cultural Studies. London: Routledge. pp. 176–7.
19 Howarth, D. (2000) Discourse. Buckingham: Open University Press. pp. 2–5.
20 Burnham, P., Gilland, K., Grant, W. and Layton-Henry, Z. (2004) Research Methods in Politics.
Basingstoke: Palgrave Macmillan.
21 Parker, I. (1992) Discourse Dynamics. London: Routledge, cited by Howarth, D. (2000) Discourse,
Buckingham, Open University Press.
22 Laclau, E. and Mouffé, C. (1985) Hegemony and Socialist Strategy. London: Verso. Laclau, E. and
Mouffé, C. (1987) Post-Marxism without Apologies, New Left Review, 166: 79–106.
23 Fairclough, N. (2000) Language and Power. 2nd edn Harlow: Longman.
24 Williams, R. (1976) Keywords. London: Fontana.
25 Fairclough, N. (2000a) New Labour: New language? London: Routledge.
26 The ‘3Rs’ is popular shorthand for ‘reading, rewriting and arithmetic’ widely regarded by older
people as the core curriculum of education which had been marginalised by trendy, socialist,
schools reform which had allegedly ‘left our children ill-qualified for the world of work’.
27 A ‘glottal stop’ occurs when air from the larynx suppresses the ‘t’ in words. In its extreme form,
‘bottle’ becomes ‘bo’ol’. A milder form is very popular with young middle-class people who are
trying to play down their accents. Blair suppresses his consonants in interviews.
28 Barthes, R. (1966) Introduction to the Structural Analysis of the Narrative. Birmingham: University
of Birmingham, cited by Bergman, M. at Essex Summer School, 2003.
29 Bruner, J.S. (1986) Actual Minds, Possible Words. Harvard, Mass.: Harvard University Press, cited
by Bergman, M. at Essex Summer School, 2003.
30 Mumby, D.K. (1993) Narrative and Social Control. Newbury Park, Calif.: Sage, cited by Bergman,
M. at Essex Summer School, 2003.
31 Berger, A.A. (1997) Narratives in Popular Culture, Media and Everyday Life. Thousand Oaks:
Sage, cited by Bergman, M. at Essex Summer School, 2003.
32 Manning, P. K., and Cullum-Swan, B. (1998). Narrative, content, and semiotic analysis. In Denzin,
N.K. and Lincoln, Y.S. (eds.), Collecting and Interpreting Qualitative Materials. pp. 246–73,
Thousand Oaks, CA: Sage Publications, cited by Bergman, M. at Essex Summer School, 2003.
33 Carr, E.H. (1990/1961) What is History? London: Penguin.
306 Research Methods in Politics
34 Burke, K. (1966) Language as Symbolic Action. Berkeley: University of California Press, cited by
Bergman, M. at Essex Summer School, 2003.
35 Kohler Reissman, C. (1993) Narrative Analysis. London: Sage, cited by Bergman, M. at Essex
Summer School, 2003.
36 Plummer, K. (1995) Telling Sexual Stories: Power, Change and Social Worlds. London: Routledge,
cited by Bergman, M. at Essex Summer School, 2003.
37 Czarniawska, B. (1998) A Narrative Approach to Organization Studies. London: Sage
Publications, cited by Bergman, M. at Essex Summer School, 2003.
38 McRobbie, A. (1982) The Politics of Feminist Research: Between Talk, Text and Action. In Feminist
Review, 12, pp. 46–58, cited by Bergman, M. at Essex Summer School, 2003.
39 Austin, J. L. (1962) How to Do Things with Words. Oxford: Oxford University Press.
40 Lubiano, W. (1992) Black Ladies, Welfare Queens and State Minstrels. In Morrison, T. (ed.)
Race-ing Justice, En-Gendering Power: Essays on Anita Hill, Clarence Thomas and Social
Reality. New York: Pantheon. Compare with Carver, T.(1997) Identity and Narrative in Prime-Time
Politics: The Hill-Thomas Hearings. In Carver, T. and Hyvarinen, M. (eds.) Interpreting the Political:
New Methodologies. London: Routledge.
Part V
Communicating Research
Chapter 20
Writing-up
Introduction
Report-writing is not, or should not be, a frantic activity carried out at the end of the
project. It is a process of varied stages all of which need to be recorded at the time
they are completed. Your first drafts will certainly need to be revised and in some cases
completely re-written but the foundations of the report should have been established at
the planning stage.
(Bell, 1997:152)1
310 Research Methods in Politics
Writing-up research
Why?
How?
What?
So what?
Readership
The readership is all important. This will determine the language used. The reader’s
prior knowledge or experience will – or should – also determine how concise or
expansive the theoretical and conceptual exposition will need to be and, critically,
how the conclusions are expressed. Conclusions must be relevant to the reader.
Remember that your initial readers are likely to be your external examiners or
the referees for journal articles. They have been selected because they are leading
authorities in your research field.
Readership will also affect the style of writing-up. The discipline of Poli-
tics contests objectivity. There are few facts but many interpretations. Political
researchers are interpreters. So the clinical style of the natural scientist is rarely
adopted. Instead, Politics researchers admit their own subjectivity, communi-
cate their interest in the research topics and conclude with almost jaw-jutting
assertions. Most researchers seek, especially in case study research, to tell a
good story. However, the danger in this enthusiastic, assertive style of writing-
up is that the empiric experience – the facts such as they are – can become
so inseparable from the interpretation as to appear highly selective or fabri-
cated. Similarly, the great emphasis given to theoretical exposition can lead to
springs of conclusions being drawn from a few swallows of evidence. A good
research report should lead your readers stage-by-stage and paragraph-by-paragraph
through the research process and enable them to fully share (or reject) your
conclusions.
Writing-up 311
Publication rules
The readership – or their publisher – will also have their own rules to maintain
comparability and scholarship. They may seem anachronistic or petty, e.g. margin
size and line spacing. But they cannot be ignored – especially with regard to
word length – if your dissertation is to be approved or your research published.
Remember, words count: illustrations, tables and graphs rarely do so. When
you are preparing an MA or PhD dissertation, check the format required by
the university regulations. These will include printing margins. In many cases,
the double-spaced, single-sided pages of ink-and-parchment days have been
superseded by more recent formats which include 1.5 line spacing and verso
(printing on both sides). These new formats reduce the volume and weight of
your research report and, arguably, make your dissertation easier to read. But
note that regulations allowing double-sided submissions set specific additional
requirements for gutter widths. You may be tempted to exceed the maximum
word limit on the grounds that your department or university won’t count them.
That’s correct. However, departments receiving a large number of dissertations
of 20,000 words length know that these should be about 95 double-spaced
pages. So they will recognise when the word limit is likely to have been
exceeded. New regulations also require that an electronic copy is also submitted
for interrogation by plagiarism software. The software will automatically calculate
the word length.
Structure
When to write-up
As already noted, writing-up has traditionally been regarded as the last stage of the
research process. However, the practice of leaving it all until the end is neither
encouraged nor accepted. Instead, you will be expected to ‘write-up-as-you-
proceed’ in parallel with the research process. This is particularly important in the
initial phases of contextualisation, theoretical and literature review, and hypothesis
setting. Indeed, you will begin the research process by writing your outline and
detailed dissertation proposals which will provide the foundation for your first
chapter of the research report.
Writing is an exploratory and creative process. Ideas can emerge in this process
which might have eluded mere abstract contemplation. Writing-up-as-you-go provides
a substantive record of progress for circulation to, and discussion with, supervisors
and colleagues and as back-up in the event of some disaster befalling you. Most
sponsors demand this parallel writing-up as a basis for monitoring – and controlling –
the research process and budget. Most supervisors require their supervisees to submit
draft chapters before any meeting as part of the teacher-student ‘supervision contract’
so that there is a substantive document to discuss.
You will have already received expert advice on essay-writing in your earlier
module guides. Most of that advice applies to research reports and need not be
re-stated. Whilst there is no right way to write-up research in politics, the following
conventions are recommended:
• write generally in the third person; e.g. ‘it was considered that …’
• however, you can use the pronoun ‘I’ to emphasise your own position – especially
where you disagree with accepted theory: but use this sparingly so that it retains its
impact
• avoid writing ‘one’: use ‘you’ to share the text with the reader, e.g. ‘as you have seen’, etc.
• avoid gender problems of ‘his/her’ by referring to subjects as ‘they’ if possible
• using the present tense to describe historical events may be a good literary device to
create excitement: however, it can become very confusing in academic reports. Instead,
use the past tense to describe the methodology and field-work; reserve the present tense
for your analysis and conclusions
• qualify your assertions – but not excessively
• always state your assumptions clearly
• strike an appropriate balance between the coverage and erudition given to theoretical
discussion, methodology, data, interpretations and conclusions
• don’t write the data speaks for itself : you must interpret the data
• try to avoid excessive and spurious accuracy in the text, e.g. don’t say ‘48.73%’,
write ‘nearly half’: where you think that precise figures are helpful, give them in
footnotes
Writing-up 313
Title:
Note that capital letters are now much less used in titles than previously
Abstract:
This is a synopsis of the research of 200–300 words. The abstract is a statement of what
you have done – not of your starting intentions.
Dedications:
Preface
A personal statement explaining why you, as the researcher, chose the topic, your
starting biases and prejudices, and what the research means to you, i.e. the reflexive
relations between you and your social world. Often students speak of carrying out research
which enables them to shed fresh light on specific experiences and to make sense of
their past.
Acknowledgements
Declaration
A statement to the effect that: ‘The dissertation is entirely my own, original work with the
exception of those academic and other sources which are separately identified in the text,
fully attributed in the footnotes and listed in the bibliography’.
In many scientific research papers, a statement of conflicts of interest is normally given
here – especially in medical research. Such admissions or declarations would be a useful
addition to Politics research papers.
Contents
List of Figures
List of Tables
Acronyms and Abbreviations
II
Chapter One
Introduction
The context, the aims of the research, research question and hypothesis, overview and
(chapter by chapter) contents.
Chapter Two
Theory and literature review
Critical review of theory, contemporary research and literature review leading to the
identification of the gap in the literature.
Writing-up 315
Chapter Three
Method of data collection
• concept/indicator link
• what methods were used
• why
• when did the research take place
• where
• how was access to the data and subjects obtained
• who was involved (population, sample, case studies)
• how many were involved
• how were they selected
• why the procedures were chosen
• limitations of methods employed
Chapter Four
Data: e.g. the case study
Chapter Five
Analysis and Discussion
Chapter Six
Conclusions
Has the hypothesis been confirmed or not? What contributions to theory has the research
made? What are the implications and recommendations for follow-on research (and
grants)? Provide a retrospective, critical evaluation of your research and proposals for its
improvement. This shows that you are fully aware of the limitations and know how these
might be overcome.
III
Appendices
Bell provides a very good check-list for reviewing the final draft report
(1997: 162):4
Re-writing
You are likely to find that your chapters are too long. Trimming or editing is unlikely
to be sufficient. You must expect to completely rewrite every chapter at least once
and plan your work programme accordingly.
Word distribution
There are no rules for the breakdown of words to individual chapters. However,
following the advisory model distribution given below should ensure that proper
Writing-up 317
coverage is given to the theory and literature review and to your analysis and
discussion of your data.
Chapter 1 Introduction 5%
Chapter 2 Theory and Literature Review 30%
Chapter 3 Method of Data Collection 5%
Chapter 4 The Data, e.g., Case Study 30%
Chapter 5 Analysis and Discussion 20%
Chapter 6 Conclusions and Implications 10%
Avoid the temptation to reduce the analysis and discussion. Adequate coverage
is essential if your conclusions are to be shared.
1. Select three research reports from approved journals on the same topics, e.g.
election turnout. Contrast and compare these. Which do you regard as being
most successful in attracting your interest? Why? What improvements would
you suggest to the other two?
2. Select a dissertation previously approved by your department for BA, MA or
PhD purposes appropriate to your own degree. Critically evaluate the writing-up.
What improvements would you make? Give specific examples.
3. Prepare a programme for your research project on a week-by-week basis. Integrate
your proposed supervision meetings and writing, and re-writing of chapters.
FURTHER READING
Notes
1 Bell, J. (1997) Doing your own Research Project; A Guide for First-Time Researchers in Education
and Social Sciences. Buckingham: Open University Press.
2 Clegg, F. (1998) Simple Statistics: A Course Book for the Social Sciences. Cambridge: Cambridge
University Press.
3 Denscombe, M. (1998) The Good Research Guide for Small-Scale Social Research Projects.
Buckingham: Open University Press.
4 Bell, J. (1997) Doing your own Research Project; A Guide for First-Time Researchers in Education
and Social Sciences. Buckingham: Open University Press.
Glossary of Terms
Case study method: gathering and analysing data from an individual example as a means
of making broader generalisations.
Causality (‘cause and effect’ or causation): the relationship between two variables when
one causes a change in the character of the other.
Census: count of 100% of population.
Central limit theorem: this states that, the larger the sample, the greater the tendency for
the sampling distribution of the means to follow a normal distribution.
Central tendency: concentration (cf. dispersion) of values statistically represented by mean,
mode, median, variance and standard deviation.
Classification data: information sought in questionnaire surveys which relate to the circum-
stances of the subject rather than their beliefs and attitudes. They include: sex, age group,
socio-economic group, education, housing tenure and dependants. Some can be obtained by
proxy (e.g. newspaper readership as an indicator of social class). Others can be guessed by
careful observation but should be checked with the subject. These variables may well include
important independent variables. For example, research has shown that older people are more
likely to participate in political activity than others.
Class interval: groupings of data selected by the researcher to enable a frequency distribution
to be constructed to represent and analyse data, e.g. ages 36–45, etc.
Closed questions: questions which seek – or receive – closed answers. Closed answers are
generally short and confined to yes, no or don’t know or specific answers, e.g. date of birth.
Coding: essentially the process of replacing or substituting groups of words, phrases or
sentences by letters or numbers (or a combination). Unlike a cipher, a code is not designed to
hide the original meaning of the word or phrase. Indeed, an essential property of an effective
code is that it should be readily understandable to users and readers. A word or phrase can be
given several different codes.
Cohort: groups sharing characteristic(s), e.g. males 18–29.
Comparative method: obtaining data from a population or sample of equivalent states or
sub-units, sectors or groups at the same points in time. It is the principal method used in
comparative politics and international relations.
Concept: basic idea.
Content analysis: set of techniques to systematically analyse contents of books, reports and
transcripts of speeches, etc. by measuring repetitions and bias.
Contingency: conditional relationship between variables.
Control Group: sample not subjected to changes in independent variable.
Correlation: statistically proven relation between two variables. But correlation does not
necessarily indicate causation. It is measured statistically by the correlation coefficient which
extends from +1 (perfect positive correlation) through 0 (no correlation) to −1 (perfect negative
correlation, i.e inverse relationship).
Counterfactual: what you would expect to happen but didn’t (e.g. Sherlock Holmes’ ‘dog
that didn’t bark in the night’). Counterfactuals may be possible evidence of unseen, dominant
power.
Glossary of Terms 321
Covariance: phenomenon where two variables appear to change at the same time.
Data: raw material which may be sorted and processed into information. Data has no
meaning by itself. Note that although data is plural, writing data are is now considered pedantic.
Decile: a tenth part.
Declaration: a statement that follows the Acknowledgements page of the research report
which states that ‘This dissertation is entirely my own, original work with the exception of those
academic and other sources which are separately identified in the text, fully attributed in the
footnotes and listed in the bibliography. Signed ... Date ...’.
Deductive research: the research approach which develops specific hypotheses from
general principles or theories and then seeks to confirm or infirm the hypotheses: ’moving
from the general to the specific’ (cf. deductive research: moving from specific to the
general).
Demography: the study of population and influences. Demographic data therefore includes
population size and density, age and male/female distribution, household size, income, health
and life expectancy, socio-economic distribution, ethnicity and migration, etc.
Dependent variable: consequent event; outcome; variable which changes as a consequence
of change in the independent variable; in social research, this is generally represented by y.
Descriptive statistics: quantitative, numeric information which describes or summarises
primary data.
Diachrony: the study of the historical development of language.
Discourse: ‘a specific ensemble of ideas, concepts and categorisations that are produced,
reproduced, and transformed in a particular set of practices and through which meaning is
given to physical and social realities’ (Hajer, 1995: 44).
Discourse analysis: ‘analysing the way systems of meaning or discourses shape the way that
people understand their roles in society and influence their political activity’ (Howarth, 1995).
Directional hypothesis: (one-tailed test): an experimental hypothesis which states a partic-
ular direction of outcome, e.g. that the dependent variable will increase as the independent
variable changes. A non-directional hypothesis – where a causal relationship is hypothesised
but what happens to the dependent variable when the independent variable changes is unclear
– is called two-tailed.
Ecological fallacy: false reasoning which allocates attributes to individuals from information
about groups.
Eigenvalue: (Eigenwerte) used in Principal Component and Factor Analysis as a measure of
the variation in a group of variables attributable to one factor.
Empirical: data collected by systematic observation or experience (cf. theoretical).
Enumeration District (ED): the basic building block of the UK census consisting of around
200 households. They are the lowest level of census data publicly available until individual
household forms are released after 100 years.
Epistemology: study of knowledge.
Ethnography: study of social and cultural life of social or ethnic groups often by participant
observation.
322 Glossary of Terms
life in naturally-occurring situations. Naturalism is experiental: researchers seek to see the world
through the eyes of the subject and to understand what people feel, interpret and do. Moods,
ideas, identity and beliefs are the stuff of naturalistic research.
Nomination: method of recruiting a non-probability sample in which a social gatekeeper or
other intermediary is asked to nominate – name – potential recruits.
Non-probability samples: samples where members of the population do not have an equal
chance of being selected. They are not statistically reliable. They cannot generate generalisable
data.
Null hypothesis: ‘the statistical proposition of no difference’ (Clegg, 1998: 61). The
proposition – which must be refuted – that data favourable to our experimental hypotheses
occurred by chance (rather than any causal relationship between the variables). In sampling
research, the null hypothesis is that the sample has not been drawn randomly from or
is representative of the population and that therefore no generalisable inferences can
be made.
Ockham’s razor: ‘the principle of parsimony’: the simplest theory is the best.
Odds: ratio of probable outcome in sequence of events, e.g. odds of a coin falling heads is
1:2. Also expressed as a probability of 0.5 (i.e., 5 out of 10) or 50%.
Operationalisation: the process of transposing abstract theoretical concepts into observable,
measurable variables.
Outliers: exceptional lowest or highest terms (or first or last ranked terms) which lie outside
the general distribution and which can skew measures of central tendency and distort
interpretation.
Panel: a sample of individuals from a population who are repeatedly surveyed over time to
provide longitudinal or tracking data. They do not meet.
Poisson distribution: a special distribution used when the sample size is very large and the
probability of incidents, e.g. illness, is very small. (cf. Binomial Distribution used where there are
only two potential outcomes, e.g. heads or tails).
Political elites: individuals who exercise disproportionately high influence on the outcome
of events or policies in the research topic.
Population: the entirety of the group – of people or objects – under study and from which
the sample is drawn.
Positivism: After Comte, the doctrine that the only true knowledge is scientific knowledge.
Positivism emphasises scientific, controlled, replicable experimentation. Auguste Comte (1798–
1859) argued that all societies were fated to move from a theological stage of ‘fictitious
knowledge’ (in which all otherwise inexplicable phenomena were attributed to ‘spiritual’ forces)
via an intermediate metaphysical stage to a ‘positive’ stage. The underlying beliefs of the
theological stage were medieval faith and custom in which the family was the social base.
Those of the metaphysical stage were Enlightenment philosophy, the ‘scientific revolution’ and
the nation state. The state of knowledge of the positivist stage was scientific when rational
logic and humanity prevailed.
Power of a test: sensitivity of a test to identify relationships between variables.
Glossary of Terms 325
Preface: a personal statement explaining why the researcher has chosen the topic, their
starting biases and prejudices and what the research means to them, i.e. the reflexive relations
between them and their social world.
Primary: data or information is original, unedited and first-hand (cf. secondary information).
Probability: the likelihood that an event will occur. For example, if an event is certain – like
death albeit in the distant future – then the probability is 100% or 1.00. Alternatively, a remote
possibility – like winning the UK national lottery next week – may be 0.001% or 0.00001. A
one-in-four likelihood would be expressed as a probability of 25% or 0.25. A bookmaker would
give odds of 4-1 on an event having a 25% probability.
Proposition: an unproven, generalised, theoretical explanation.
R2 : used in multivariate analysis as a measure of the extent to which the dependent variable
can be attributable to two or more independent variables.
Random Walk: method adopted by interviewers to access a sample of households. The
researcher begins at the centre of the town or city calling at every nth house in the first street,
turning left at the first intersection, right at the second and so on until the boundary of the
urban area is reached.
Rapport: French word used to describe a desirable state of mutual confidence, empathy, trust
and liking between the researcher and their subject(s).
Reflexivity: intellectual self-awareness gained through self-examination to identify deep-
seated biases.
Regression analysis: analysis carried out to calculate the relationship between the depen-
dent variable (y) and one (linear regression) or more (multivariate regression) independent
variables (x, x 1 . . .) represented in the formula y = a + bx where b is the regression coefficient
and gradient (or slope) of the best fit line.
Reliability: literally, the extent to which we can rely on the source of the information and,
therefore, the information. Reliable information is dependable, trustworthy, unfailing, sure,
authentic, genuine, reputable. Consistency is the main measure of reliability. Note that a
measure may be reliable but not accurate and vice-versa, e.g. a reliable weighing machine
may give an inaccurate but consistent recording of the same weight.
Research component analysis: method used to evaluate published research in which the
researcher dissects the published research into 15 or more components which are assessed
separately.
Research effect: the tendency for the population being studied to modify its behaviour and,
therefore, provide unrepresentative data.
Residual error: the difference between predicted and actual data.
Sample: a group of subjects chosen randomly or non-randomly from the population and
from whom it is intended that generalisations can be made.
Sampling error: potential variance between an attribute of the sample and the population.
Sample frame: a list or schedule of the population from which the sample will be drawn. It
may be a membership list, a directory of engineering firms or electoral roll.
326 Glossary of Terms
t-Test: statistical test of the significance of the variance between two groups.
Tells: term given by body language analysts to the inadvertent signs given by subjects.
Theoretical saturation: in grounded research, term used by Glaser and Strauss to describe
the stage reached when additional data fail to reveal any further significant findings.
Theory: simply stated, a statement of general principles of the underlying relationship in
phenomena or events. Theory may be expressed as laws, propositions, arguments or hypotheses.
Historically, theory has generally been descriptive in terms of describing and, therefore,
explaining relationships. Some descriptive theories may be called laws, for example, Newton’s
law of universal gravitation, where they are accepted as having been universally verified by
observation. Newton’s law was subsequently superseded by Einstein’s theory of relativity. The
title law is therefore rarely given to theories. Alternatively, theory may be normative where it
proposes what ought to be the relationship. For example, the theory of egalitarianism is that
all people should be treated equally regardless of origin or circumstances.
‘thick/thin’: case study and a quarter; term used to describe the research method used when
the researcher seeks to extend the findings of their single case study by quickly testing them
against another comparable case.
Triangulation: term derived from navigation and surveying; a method of corroborating data
by seeking accounts from three or more perspectives and media.
Truth: the reality behind the facts (the available information). Sometimes the facts may
obscure the truth – perhaps deliberately so.
Type I Error: wrongly rejecting the null hypothesis.
Type II Error: wrongly accepting the null hypothesis.
Universe: population.
Validity: accuracy and appropriateness of measurement; ‘the extent to which a measure,
indicator or method of data collection possesses the quality of being sound or true as far as
can be judged. . . . in the social sciences generally, the relationship between indicators and
measures and the underlying concepts they are taken to measure is often contested’ (Jary &
Jary, 1995: 714).
Variance: a measure of central tendency calculated as the sum of the squares of the
differences between each term and the mean divided by the number of terms. Squaring the
difference makes negative differences positive. In a sample, the sum of the squared differences
is divided by the number of terms minus one, i.e. n − 1.
Verstehen: term adopted by Max Weber (1864–1920) to describe the necessary empathetic
understanding by researcher of their subject; ‘trying to see the world through the subjects’
eyes’.
Vignette: ‘Short story generated by the researcher and focusing on hypothetical characters
in particular situations. Interviewees are asked what they would do in these circumstances
or, alternatively, how they think that a third party might react. The latter mode of question
specifically distances the interviewer from the issues being studied and, in this sense, is
impersonal and less threatening’ (Arksey & Knight, 1999: 94–5).
328 Glossary of Terms
Wave: term used in longitudinal research to describe each phase of cross-sectional survey of
the research cohort or panel.
For a more comprehensive and technical glossary of terms with examples and illustrations, see:
Jary, D. and Jary, J. (1995) Sociology Dictionary. Glasgow: HarperCollins.
Vogt W. P. (1999) Dictionary of Statistics & Methodology. London: Sage Publications.
Key Formulae and Symbols
Population Sample
Number of cases or terms N n
Individual values X x
Arithmetic mean X x
Variance σ2 s2
Standard deviation σ or SD s or sd
(X − Xi )2 (x − xi )2
Variance
√ N √(n − 1) 2
(X − Xi )2 (x − xi )
Standard deviation
N (n − 1)
Standard error of the mean, SE n/a sd
√
n
Confidence limits 95% ±(1.96 × SE )
i.e. in 95 out of 100 samples, the population mean will lie between
x + (1.96 × SE ) and x − (1.96×SE)
Standard error of the proportion, SEp
√
(or percentage) (pq/n) (where q = 1 − p)
Bibliography
Amis, K. (1997) The King’s English – A Guide to Modern Usage, cited by Mount, H. (2006) Amo,
Amas, Amat and All That: How to Become a Latin Lover. London: Short Books. p. 40.
Arksey, H. and Knight, G. (1999) Interviewing for Social Scientists. London: Sage.
Austin, J. L. (1962) How to Do Things with Words. Oxford: Oxford University Press.
Bachrach, P. and Baratz, M. (1962) Two faces of power. In American Political Science Review,
56: 947–52.
Barthes, R. (1966) Introduction to the Structural Analysis of the Narrative. Birmingham:
University of Birmingham.
Bell, J. (1997) Doing your own Research Project; A Guide for First-Time Researchers in
Education and Social Science. Buckingham: Open University Press.
Beresford, P. and Hoban, M. (2005) Effective Participation in Anti-poverty and Regeneration
Work and Research. York: Joseph Rowntree Foundation.
Berg, B. (2001) Qualitative Research for the Social Sciences. London: Allyn & Bacon.
Berger, A.A. (1997) Narratives in Popular Culture, Media and Everyday Life. Thousand
Oaks: Sage.
Brier, A.P. and Hopp, B. (2005) HAMLET a multidimensional scaling approach to text-oriented
policy analysis. In Journal of Diplomatic Language, 2 (1).
Bruner, J.S. (1986) Actual Minds, Possible Words. Harvard, Mass: Harvard University Press.
Bryman, A. (1988/96) Quantity and Quality in Social Research. London: Routledge.
Budge, I. (1997) Chapter 1: Party policy and ideology: reversing the 1950s? In Evans, G., and
Norris, P. (1999) Critical Elections. London: Sage
Burke, K. (1966) Language as Symbolic Action. Berkeley: University of California Press.
Burnham, P., Gilland, K., Grant, W. and Layton-Henry, Z. (2004) Research Methods in Politics.
Basingstoke: Palgrave Macmillan.
Carr, E.H. (1990/1961) What is History? London: Penguin.
Carver, T. (2002) Discourse analysis and the ‘linguistic turn’: In European Political Science,
Autumn 2002.
Chomsky, N. (1986) Knowledge of Language. New York: Praeger.
Clegg, F. (1998) Simple Statistics: A Course Book for the Social Sciences. Cambridge:
Cambridge University Press.
Cole, G.D.H. (1938/66) The Common People. London: Methuen.
Cole, J. (1996) As it Seemed to Me: Political Memoirs. London. Weidenfeld & Nicolson. p. 64.
Crossman, R.H. (1976) The Diaries of a Cabinet Minister 1 Minister of Housing 1964–66.
London: Hamish Hamilton and Jonathan Cape. p. 590.
Crouch, C. (2004) Post-Democracy. Cambridge: Polity.
Crystal, D. (1995) The Cambridge Encyclopaedia of Language. Cambridge: Cambridge:
University Press.
Curt, Beryl C. (1994) Textuality and Tectonics; Troubling Social and Psychological Science.
Buckingham: Open University Press.
Bibliography 331
Held, D. and Leftwich, A. (1984) Chapter 8: A discipline of politics? In Leftwich, A. (ed.) What is
Politics? Its Activity and Study. Oxford: Blackwell.
Heywood, A. (2000) Key Concepts in Politics. Basingstoke: Palgrave Macmillan.
Hoinville, G., Jowell, R. et al. (1977) Survey Research Practice. London: Heinemann. p. 61 cited
in De Vaus, D.A. (2001) Surveys in Social Research. London: Routledge. p. 73
Honderich, T. (ed.) (1995) The Oxford Companion to Philosophy. Oxford: Clarendon Press.
pp. 405–6.
Hopkin, J. (2002) Chapter 12: Comparative methods. In Marsh, D. and Stoker, J. (eds) Theory
and Methods in Political Science. Basingstoke: Palgrave Macmillan.
Howarth, D. (2000) Discourse. Buckingham: Open University Press.
Hume, D. (1739) A Treatise on Human Nature. 1: 467–8.
Huxley, A. (1932/1994) Brave New World. London: HarperCollins.
Jary, D. and Jary, J. (1995) Sociology. Glasgow: HarperCollins.
Jenkins, R. (2001) Churchill: A Biography. London: Macmillan.
Kanji, G. K. (1999) 100 Statistical Tests. London: Sage.
Kinnear, P. R. and Gray, C.D. (2004) SPSS for Windows Made Simple. Hove: Psychology
Press Ltd.
Klingermann, H-D., Hofferbert, R. and Budge, I. (1994) Parties, Policies and Democracy.
Boulder: Westview Press.
Kohler Reissman, C. (1993) Narrative Analysis. London: Sage.
Krippendorff, K. (1980) Content Analysis: An Introduction to its Methodology. London: Sage.
Lacey, A. (1995) In Honderich, T., The Oxford Companion to Philosophy. Oxford: Oxford
University Press. pp. 145, 705–6.
Laclau, E. and Mouffé, C. (1985) Hegemony and Socialist Strategy. London: Verso.
Laclau, E. and Mouffé, C. (1987) Post-Marxism without apologies, New Left Review, 166: 79–106.
Landman, T. (2003) Issues and Methods in Comparative Politics: An Introduction. London:
Routledge.
Lasswell, H. (1958) Who gets What, When, How. New York: Meridian.
Lee, R. L. (1995) Dangerous Fieldwork. London: Sage.
Leftwich, A. (ed.) (1984) What is Politics? Its Activity and Study. Oxford: Blackwell.
Leftwich, A. (2000) States of Development: On the Primacy of Politics in Development.
Cambridge: Polity.
Leftwich, A. (ed.) (2004) What is Politics? Cambridge: Polity Press.
Levine, D. and Stephan, D. (2005) Statistics: Even you can Learn. London: Pearson
Prentice Hall.
Lewis-Beck, M. S. (1995) Data Analysis: An Introduction. London: Sage.
Lubiano, W. (1992) Black ladies, welfare queens and state minstrels. In Morrison, T. (ed.)
Race-ing Justice, En-Gendering Power: Essays on Anita Hill, Clarence Thomas and Social
Reality. New York: Pantheon.
Lukes, S. (1974) Power: A Radical View. London: Macmillan.
Mace, C.A. (1962) The Psychology of Study. Harmondsworth: Penguin.
Manning, P. K. and Cullum-Swan, B. (1998). Narrative, content, and semiotic analysis.
In Denzin, N.K. and Lincoln, Y.S. (eds), Collecting and Interpreting Qualitative Materials,
pp. 246–73. Thousand Oaks, CA: Sage.
Marsh, D. and Stoker, G. (eds) (1995) Theory and Methods in Political Science. Basingstoke:
Macmillan.
Bibliography 333
Marsh, D. and Furlong, D. (2002) Chapter 1: A skin is not a sweater: ontology and epistemology
in Political Science. In Marsh, D. and Stoker, G. (eds) Theory and Methods in Political Science.
Basingstoke: Palgrave Macmillan.
Marsh, D. and Stoker, G. (eds) (2002) Theory and Methods in Political Science. Basingstoke:
Palgrave. pp. 1–16.
Maslow, A.H. (1970) Motivation and Personality. New York: Harper and Row.
Mayer, L.C. (1989) Redefining Comparative Politics: Promise versus Performance. London: Sage.
Mayo, E. (1949) Hawthorne and the Western Electric Company. London: Routledge.
McEvoy, J. (2006) Elite interviewing in a divided society: lessons from Northern Ireland.
In Politics 26 (3): 184–91.
McLuhan, M. (1962) The Gutenberg Galaxy. London: Routledge and Kegan Paul.
Miles, M.B. and Huberman, A.M. (1994) Qualitative Analysis: An Expanded Sourcebook.
London: Sage.
McRobbie, A. (1982) The Politics of feminist research: between talk, text and action. In Feminist
Review, 12, pp. 46–58.
Mill, J.S. (1843) A System of Logic. London: Longman.
Moore, B. (1966) Social Origins of Dictatorship and Democracy. Boston: Beacon Press.
Morris, D. (1977) Manwatching; A Field Guide to Human Behaviour. London: Jonathan Cape.
Morris, D. (1994) Bodytalk: A World Guide to Gestures. London: Jonathan Cape.
Morris, D., Collett, P., Marsh, P., and O’Shaughnessey, M. (1979) Gestures: Their Origins and
Distribution. London: Jonathan Cape.
Mumby, D.K. (1993) Narrative and Social Control. Newbury Park, Calif.: Sage.
Neuman, W.L. (2003) Social Research Methods: Qualitative and Quantitative Approaches.
London: Allyn and Bacon.
Nicolson, N. (1953) King George V. London: Routledge. Chapter XXVII.
Norris, P. and Lovenduski, J. (1995) Political Recruitment: Gender, Race and Class in the British
Parliament. Cambridge: Cambridge University Press.
Oakley, A. (2000) Experiments in Knowing: Gender and Methods in the Social Sciences.
Cambridge: Polity Press. pp. 37–8.
O’Sullivan, T., Hartley, J., Saunders, D., Montgomery, M. and Fiske, J. (1997) Key Concepts in
Communications and Cultural Studies. London: Routledge.
Parker, I. (1992) Discourse Dynamics. London: Routledge.
Pennings, P., Keman, H. and Kleinnijenhuis, J. (2006) Doing Research in Political Science: An
Introduction to Comparative Methods and Statistics. London: Sage.
Plummer, K. (1995) Telling Sexual Stories: Power, Change and Social Worlds. London:
Routledge.
Przeworski, A., Alvarez, M., Cheibub, J.A. and Limongi, F. (1996) What makes democracies
endure? In Journal of Democracy, 7 (1): 35–55.
Race, K.E., Hotch, D.F. and Parker, T. (1994) Rehabilitation programme evaluation: use of focus
groups to empower clients. In Evaluation Review, 18 (6): 730–40.
Reed, M. and Marsh, D. (2002) Chapter 11: Combining quantitative and qualitative method. In
Marsh, D. and Stoker, G. (eds) Theory and Methods in Political Science. Basingstoke:
Macmillan, pp. 231–48.
Richards, D. (1996) Elite interviewing: approaches and pitfalls. In Politics, 16 (3): 199–204.
Ritchie, J. and Lewis, J. (2003) Qualitative Research Practice: A Guide for Social Science
Students and Researchers. London: Sage.
Robertson, D. (1993) Politics. London: Penguin.
334 Bibliography
3Rs, 305 n.26 Bergman, M., 129 (box) Cardinal numbers, 193–194
Absorbed actions, 163 Bernoulli, Jacques, 234 Carr, E.H., 299
Accessibility, 52 Bernoulli’s trials, 234–235 Carver, T., 280
ACORN, 148 Bevan, Aneurin, 84 case studies:
Action research method, 52, 62–63 Bias, 17–18 case study meetings, 260
All-postal voting, 54–55 Biblical narrative, 299 Evaluating information 86–88
Amis, Kingsley, 80 Bibliographies, 107 (box) Fairclough’s critical discourse
ANOVA, 209 Binomial distribution, 234–236 analysis, 290–291, 291–297
Archives, 104–105 Biography, 84 interim case study, 260
Aristotle, 175 Blair, Tony, 291 narrative analysis, 302–303
Arithmetic mean, 185 Boas, Franz, 282 qualitative information
Arksey, H. and Knight, G., Body language, 161–162 analysis case study, 243–259
133, 137 claims made for, 162–163 single case study, 53–54
Assessment letter, sample, 77 (box) Morris on, 163–168 Categorical numbers, 193
Association, 31 recording and analysing, 168–171 Causality, 29–32
measuring, 208–210 Bogardus Social Distance Scale, Census returns, 103
multiple linear regression 149–150 Central limit theorem, 199
analysis, 213–217 Brier, A.P. and Hopp, B., 278 n.4 Chicago School, 221, 238 n.1
regression statistics, calculating, British Election Study (BES), 44, Chomsky, N., 282
210–213 49, 61 Churchill, Winston S., 279, 304 n.3
testing for, 206–208 British Household Panel Survey Clegg, F., 196, 204, 218, 310, 317
Association of Colleges on data, 14 (BHPS), 61 Coding, 153–154, 242–243
Auden, W.H., 140 Bruner, J.S., 298 Coefficient of correlation, 208
Austin, J. L., 300, 304 Bryman, A., 41, 42, 49 Cohort, 60–61
Budge, I., 268–270, 278 Cole, G.D.H., 88
Bachrach, P. and Baratz, M., 5, 26, Burke, K., 299 Cole, John, 81–82, 83
36 n.9 Burnham, P., Killand, K., Collett, Peter, 172 n.2
Barthes, Roland, 281, 298 Grant, W., and Layton- Comparative method, 51, 55–60
Bashir, Martin, interview of Henry, Z., 4, 8, 21–22, 137, Comte, Auguste, 23
Princess Diana: case study: 149–150, 196, 278, 283 Constructed memory, 60
narrative analysis, 302–303 Bush, George W.: Content analysis, 263–264
Baton signals, 164–165 State of the Union Address Hamlet II, 271–276, 278 n.4
Baudrillard, Jean, 282 (2005), 271–276 qualitative, 264–266
BBC News, 161 State of the Union Address software for, 270–271
Behaviouralism, 25–27 (2007): case study: structural, 267–268
Behaviourism, 25 Fairclough’s critical discourse substantive, 268–270
Bell. J., 309, 316, 317 analysis, 291–297 Counterfactual, 27, 36 n.12
Benn, Tony, 83–84 Covariation, 31
Beresford, P. and Hoban, M., 63, CACI, 148 Critical social theory, 62
66 n.16 CAQDAS (Computer-Assisted Crossman, Richard, 81–82, 83
Berg, B.L., 129 (box) Qualitative Data Analysis Crouch, C., 44, 48
Berger, A.A., 298 System) software, 41–42 Crystal, D., 281, 282
336 Index