Академический Документы
Профессиональный Документы
Культура Документы
QUALITATIVERESEARCHDESIGN Choosingamongresearchmethodsdependsonwhichtypesofriskthescholarismost comfortabletaking,amongotherthings.Quantitativeandqualitativemethodshave differentstrengths,andeveryresearchmethodeverinventedispoorasameanstoat leastonelegitimateobjective.Operatingunderthisassumption,thisseminaroffersto helpadvancedsocialsciencestudentsgetthegreatestpossiblevaluefromqualitative empiricalresearchdesigns,whetherornotthesearecombinedwithmathematicalor statisticaltechniques.Illustrativepublicationstendtocomeprimarilyfrompolitical scienceandpoliticaleconomyespeciallyattheinternationallevel,andtolesserdegrees fromeducation,history,andsociology. Theterm"qualitative"isusedbydiversescholarswhodisagreeonepistemological basics.Assumingsomepriorexposuretothesedebates,thisseminarworkswithinwhat couldbecalledbroadorpragmaticpositivism,themainstreamintheUSA.Thisinclusive positionwillbediscussedbrieflyattheoutset.Thisyearthisseminardoesnotattemptto teachhowtousemethodsthatregardthemselvesasalternativestothistradition.IR513 hasintroducedhistoricalandhumanisticmethodsanddiscussedprospectsfor synthesizingmethods.Appendix3listsadditionalreferencesfrominterpretivist traditions. Prerequisite:IR513oranotherbasiccourseinepistemologyandresearchdesign, includingsomeexposuretostatisticalmethods.Thiscourseismostappropriateafter completingothergraduatecourseswhereyouwillhavereadscholarshiponyour particularsubjectandbeguntoidentifyyourresearchtopics. Requirements:Throughoutthesemesterthestudentworksontwolevelsstudying generalworksintroducingmethodsideas,andusingthemtodevelopanoriginalproposal foraspecificproject.Exerciseswillprovideoccasionsforexperimentingwiththe techniquesonyourparticularsubject.Ifyouhavenotalreadyselectedatopicfor dissertationresearch,youmayselectanysubjecttemporarilyforthepurposeoflearning thetechniques. Atourmeetingsmembersareexpectedtobepreparedtoanswerquestionsaboutthe requiredreadingsorexercisesforthatweek,ortodiscussresultsofyourworkorgive suggestionstoacolleague.Twobooks(Kingetal.andMaxwell)havebeenorderedat theUniversityBookstoreandplacedonreserve.Othertitlesmarked[R]arealsoon reserveinLeaveyLibrary.Originalsforotherrequiredreadingswillbeavailablefor copyinginVKC300.IwillloanoptionaltitleswhenIhavethem.InVKC42Dyoumay readafileofsuccessfulpastproposals,includingUSCwinnersofnationalfellowship
1.Study:
o Kingetal.1994.DesigningSocialInquiry(KKV),pp.333 o J.Maxwell.1996.Qualitativeresearchdesign,pp.ix62 o ImreLakatos,"FalsificationandtheMethodologyof
ScientificResearchProgrammes,"inLakatos,ed., CriticismandtheGrowthofKnowledge(Cambridge UniversityPress,1970),pp.91138and173180.[R] 2.WriteMaxwellsexercise2.1,reflectingonyourpersonalpurposesin doingthisstudy(assumingitisoneyoureallywanttodo).Yourmemo canbeinoutlineformortext.Itcanbeasbrieforaslongasyoufind useful,butatleastmakeithonestandomitnosignificantgoal.Referto Maxwell,pp.1724ontheparticularstrengthsofqualitativemethods.Do yourpurposesmatchanyofhislist?(Naturallywearenotobligedto swallowMaxwellwholeyourteacherwillinfactpickafewsignificant
boneswithhim.)Turninacopyatclass.Thisdocumentwillnotbegraded orshowntoanyoneelsewithoutyourpermission. 3.WriteMaxwellsexercise3.2,creatingafirstprimitiveconceptmapfor yourprospectivestudy.Pullthisfirstversionout ofyourownmindasit isrightnowratherthanbyturningtoadditionalpublishedstudiesor evidence.Turnitinatclass.Itwillnotbegradedorcirculatedwithout yourpermission. 4.Selectaparticularresearchprogramwithinyourdisciplineforyour personalevaluationandproposalwriting.Comepreparedtogivea preliminaryoraldescriptionoftheresearchprogramyouhaveselectedfor thesemester. Thatis,tellusthemainquestionsorpuzzlesandthemain ideasorapproachforansweringthem thatunifythisbodyofscholarship, andnamesomeofthemostinfluentialstudies.(Later,on10/1youwill needtowriteacriticalevaluationofaresearchprogram.)Iwouldbe happytohelpevaluateyouroptionsintheoffice. 5.Selectthethreeormorespecializedarticlesorbooksthatcomethe closesttoansweringyourtopresearchquestionasitstandstoday,asfaras youknow.Foreachstudy,drawaconceptmaprepresentingthemain conceptsandmainrelationsamongthemintheauthorsarguments.A simplerdiagramisbetter,forthispurpose.Indicatethedirectioninwhich causalityorinfluenceisthoughttorunbetweenconcepts,whentheauthor makesthisclear.Recordyourevaluationsofthestudyinsomeway.Turn incopiesoftwoormoreofyourdiagramsatclass.
3.9/17
Focusingourresearchquestions
3.Experimentwithmentaltricksfromthe1985Odellmemoonresearch questions,andthelistofwaystomakeacontributioninKKV,pp.1617, generatingatleasttwoadditionalcandidateresearchquestionsstarting directlyfrompublishedliteratureonyoursubject.Generateatleastone questionbyfirstpickingaweaknessinscholarshiponyoursubject. Generateatleastonebyborrowingandproposingtoapplyacausalideaor hypothesisfromsomefieldofscholarshipotherthanyourprimaryone. Whileamoreplausibleideaisbetterthanawildlyirrelevantone,againlet creativityflywithouthavingtodefendtheideaindepth,fornow. Turnin aonepageoutlinelistingtacticsyouusedandwhateverquestionsyou generatedthatway,atclasstime.Asimpleoutlinethatisintelligibleonits facewillbesufficient.
4.9/24 Privatetutorials:
5.10/1 Criticalessay(graded)onyourresearchprogramdue
II.METHODSFORSTRENGTHENINGCAUSALINFERENCES ANDMAKINGOTHERTHEORETICALCONTRIBUTIONS
6.10/8Causalinferenceandcomparativemethods
1.Study:
o Maxwell,J.1996.QualitativeResearchDesign.Methods:
o o
o o
whatwillyouactuallydo?andvalidity:howmightyoube wrong?pp.6398 KKV,Descriptiveinference,causalityandcausalinference, pp.75114 Mill,J.S.1888[1970].TwoMethodsofComparison.InA. EtzioniandF.Dubow,eds.,ComparativePerspectives: TheoriesandMethods,205213.(TakenfromMill,A SystemofLogic,book3,chap.VIII,"ofthefourmethods ofexperimentalinquiry.") Lijphart,A.1971.Comparativepoliticsandthe comparativemethod. APSR65:689693. George,A.andT.McKeown.1985.Casestudiesand theoriesoforganizationaldecisionmaking.Advancesin InformationProcessinginOrganizations2:2158.
"manyvariablessmalln"problembyconceptually collapsingtwovariablesorvariableclassesintoone.
o Lieber,R.1970. BritishpoliticsandEuropeanunity:
parties,elites,andpressuregroups.
o George,A.andR.Smoke.1974. DeterrenceinAmerican
ForeignPolicy:TheoryandPractice.
o Skocpol,T.1979.Statesandsocialrevolutions:a o o o o o
comparativeanalysisofFrance,Russia,andChina. Bates,Robert.1981. MarketsandStatesinTropicalAfrica: ThePoliticalBasisofAgrarianPolicies. Janis,IrvingL.1982.Groupthink:psychologicalstudiesof policydecisions,2nded. Milner,Helen.1988.ResistingProtectionism:global industriesandthepoliticsofinternationaltrade. Goodman,J.1992. MonetarySovereignty:thepoliticsof centralbankinginWesternEurope. Threearticles:R.Mitchell.Summer1994.Regimedesign matters:intentionaloilpollutionandtreatycompliance,"IO 48:425458.G.M.Luebbert.July1987.Socialfoundations ofpoliticalorderininterwarEurope. WorldPolitics39: 449478.L.J.Schoppa.Summer1994.Twolevelgames andbargainingoutcomes:whygaitsusucceedsinJapanin somecasesbutnotothers.IO 47:353386.
Supplements: Weber,M.Objectivepossibilityandadequatecausationin historicalexplanation.InWeber,Methodologyofthesocial sciences. Moore,Jr.,Barrington.1966. Socialoriginsofdictatorship anddemocracy:lordandpeasantinthemakingofthe modernworld. Przeworski,A.andH.Teune.1970. Thelogicof comparativesocialinquiry. Smelser,N.1976. Comparativemethodsinthesocial sciences.
George,A.1979.Casestudiesandtheorydevelopment:the methodofstructured,focusedcomparison. Katzenstein,P.1985.Smallstatesinworldmarkets: industrialpolicyinEurope. McCloskey,D.N.1990. IfYouresosmart:thenarrative ofeconomicexpertise. Collier,D.1991.TheComparativemethod:twodecadesof change.In ComparativePoliticalDynamics:Global ResearchPerspectives,ed.D.A.RustowandK.P. Erickson.
7.10/15Singlecasedesigns
1.Study:
o ReviewA.Lijphart.1971. o ReviewGeorgeandMcKeown.1985. o Geertz,C.1973. TheInterpretationofCultures,Thick
2.Chooseoneofthetypesof singlecasestudyidentifiedbyLijphart,and considerhowyoumightusethatresearchdesignastheprimarymethod foryourproposedproject. Turninaonetotwopagememo(tobegraded) identifyingwhichtypeorpurposeyourstudywouldserveandselectinga caseforthatpurpose.Assume(contrarytoLijphart)thatan"interpretive" casestudycouldmakeavaluablecontributionbyshowingthataknown hypothesisortheoryhelpstoexplainorinterpretsomenewevent,evenif itdoesnotgenerateanewhypothesis.(IsGeertzrelevanthere?)Alsonote fromEcksteinthatacasewillbeespeciallypowerfulforconfirminga theoryifitisa"leastlikely"case,andviceversaforinfirmingatheory. Youmay,ifyouprefer,substituteGeorge/McKeownforLijphart.
pluralismanddemocracyintheNetherlands. o LeoGrande,W.July1979.Cubandependency. CubanStudies. o Haggard,S.1988.Theinstitutional foundationsof hegemony:explainingtheReciprocalTradeAgreements actof1934.InternationalOrganization42:91120. TypeC:Russett,B.1967.Pearlharbor:deterrencetheory anddecisiontheory.JournalofPeaceResearch2:81106. Rpt.in Theoryandresearchonthecausesofwar,ed.D. PruittandR.Snyder,pp.127135. TypeD
o Winham,G.October1977.Negotiationasamanagement
process.WorldPolitics.
o Deudney,D.Spring1995.ThePhiladelphiansystem.
InternationalOrganization49:191228. TypeE
o George,A.andJ.George.1956. WoodrowWilsonand
variable(p.140),
o selectingarangeofvaluesofthedependentvariable(141), o selectingobservationssothedependentvariableisconstant
(147),
o selectingobservationstocontrolforomittedvariables(179
182),and
o oneremedytoavoidendogeneity(185196).
inD.Campbell1988.MethodologyandEpistemologyfor SocialScience. Geddes,B.1990.Howthecasesyouchooseaffectthe answersyouget:selectionbiasincomparativepolitics. PoliticalAnalysis,vol.2,J.A.Stimson,ed. Thequalitativequantitativedisputation:reviewsymposium onKKV.June1995.AmericanPoliticalScienceReview 89:454478. Tetlock,P.andA.Belkin,eds.1996.Counterfactual ThoughtExperimentsinWorldPolitics.
9.10/29Combiningquantitativeandqualitativemethods
exclusivesuccessionandpublicpolicyundercapitalism andsocialism. o Janis,IrvingL.1982.Groupthink:psychologicalstudiesof policydecisions.2nded.,plusG.M.Herek,I.L.Janis,and P.Huth.1987.Decisionmakingduringinternationalcrises: isquality ofprocessrelatedtooutcome? Journalof ConflictResolution31:203226.Alsorecommended:M. SchaferandS.Crichlow.September1996.Antecedentsof groupthink:aquantitativestudy.JCR40:415435. o Laba,R.1991. Therootsofsolidarity:apoliticalsociology ofPolandworkingclassdemocratization. o Martin,L.1992.Coercivecooperation:explaining multilateraleconomicsanctions.
o Putnam.R.D.1993. Makingdemocracywork:civic
traditionsinmodernItaly.
o Simmons,B.1994. WhoAdjusts?DomesticSourcesof
ForeignEconomicPolicyduringtheInterwarYears.
III.TECHNIQUESOFOBSERVATIONAND STRONGERDESCRIPTIVEINFERENCES
10.11/5
o Babbie,E.1992. Thepracticeofsocialresearch,6thed.,
o Cox,R.W.andH.K.Jacobson.1974.Theanatomyof
influence:decisionmakingininternationalorganization. Pp.437465[indicatorsforstatepower,statepowerin threespecialissueareas,andclassificationsofcountries accordingtotypeofpoliticalregimeandlevelofeconomic development] Hopmann,P.T.Summer1974.BargaininginArmscontrol negotiations:theSeabedsdenuclearizationtreaty. InternationalOrganization28:313344[bargaining strategies,styles,andoutcomes] Butterworth,R.L.1976.Managinginterstateconflict, 194574:datawithsynopses,pp.48198[anexampleofa codingmanualforcreatingbothquantitativeandqualitative dataforquestionssuchas"whichtypeofpowersexercised leadershipinconflictmanagement?""howwidewas agreementintheinternationalorganizationonthe managementactionsittook?""whatwasthestrongest actionittook?" Odell,J.1985.Theoutcomesofinternationaltrade conflicts:theUSandSouthKorea19601981. InternationalStudiesQuarterly29:263286.[rates outcomesof13tradedisputescomparablytoreflectwho gainedhowmuch] Destler,I.M.andJ.Odell,1987.AntiProtection: ChangingForcesinUSTradePolitics,pp.17,skim921, read2326,143157.[comparingthelevelofpolitical activityagainstimportprotectionindifferentepisodes]
o Hudec,R.E.1993. EnforcingInternationalTradeLaw.
Theappendixreportsreliable,consistentdescriptionsofall 207legalcomplaintsbroughtundertheGATTbetween 1948andtheendof1989,includingindicatorsofhowwell thelegalsystemfunctioned.Includedarethedataentry formusedtocreatecasedescriptions(pp.58889). Conceptsincludetheproceduraloutcome(legalrulingbya panelv.settledorconcededbythedefendantv.withdrawn orabandoned),substantiveoutcomesofrulings(defendant violatedv.didnotviolatetherules),andhowcountries respondedtoadverserulingsagainstthem(gavefull satisfactionv.partialsatisfactionv.negativeoutcome). Whichcountrymostfrequentlyresistedlegalrulings, wouldyouguess?
3.Exercisedueatclass:Afterstudyingtheforegoingmaterial,writea memodraftingpreliminaryoperationaldefinitionsforthreekeyconcepts inyourstudy.Forthisexercisetrytoexpressyourconceptsasmattersof degreeratherthanqualitiesthatcanonlybepresentorabsent,andrather thannominalcategories,unlessdoingsoseemsmisleading.Forexample, "democratic"and"authoritarian"mightbereplacedwith"degreeof politicalopenness."Yourmemoshouldgiveme,yourresearchassistant, rulesansweringallpossiblequestionsonhowtosorttheevidenceyou collectintoconceptual"bins."Trytoanticipateasmanydifficultboundary casesaspossible,sinceotherwiseIwillrelyonmyintuitions,whichmight notbeconsistentovertime.Todiscovermypossiblequestions, experimentwithyourrulesonseveralconcreteexamples.Thememo shouldcontain:
o foreachconcept,yourbestnominaldefinition o foreach,yourbestoperationaldefinition(classification
Supplements: Webb,Eugeneetal.1966.Unobtrusivemeasures:Non reactiveresearchinthesocialsciences Lazarsfeld,Paul.1972.Developmentofatestforclass consciousness.In ContinuitiesintheLanguageofSocial Research,ed.Lazarsfeld,Pasanella,andRosenberg,pp.41 43.[Thefamousscholarrevealshowhecreatedthis indicatorforan earlystudyofAmericanvotersbyrecalling whatheandothersbelievedasyoungmembersofthe AustrianSocialDemocraticparty] Gurr,T.R.1974.Persistenceandchangeinpolitical systems,18001971. Am.Pol.Sci.Review,68:14821582. [Classifieseachintooneofsixorderedtypes,basedon indexcombiningseveralregimecharacteristics] Snyder,G.andP.Diesing.1977.Conflictamongnations, pp.340361[typesofdecisionmakingstructure] Putnam,R.andN.Bayne.1984,1987.Hangingtogether: cooperationandconflictinthesevenpowersummits,chap 11[thedegreeofcooperationachievedinsummit meetings]. Underdal,Arild.1993.Measuringandexplainingregime effectiveness.In Complexcooperation,ed.H.Hveem,pp. 92124. Henning,C.R.1994.CurrenciesandpoliticsintheUnited States,Germany,andJapan,chap.3.[classifiesthedegree ofcentralbankindependencefromthegovernmentinthree countries] George,A.,andW.Simons,eds.1994. Thelimitsof coercivediplomacy,2ded.,pp.267294 forsummary,and passimforconceptsanddefinitions[coercivediplomacy,
itssuccessandfailure,andpresenceorabsenceof conditionsfavorableforsuccess]
11.11/12Observingindirectlythroughinterviews
1.StudyeitherAorBdependingonyourinterests: A.Interviewingordinarypeople
o Spradley,James.1979.Theethnographicinterview,pp.vii
39
o Hochschild,J.L.1981.Whatsfair?AmericanBeliefs
aboutdistributivejustice,pp.1745and148191[R]
o Scott,James.1985.Weaponsoftheweak:everydayforms
ofpeasantresistance,pp.127. B.Interviewingelites
o Dexter,L.A.1970. Eliteandspecializedinterviewing,pp.
IV.DISCUSSIONOFRESEARCHPROPOSALS Classes13&14
Appendix1.Othertextbooksandpracticaladvice
Becker,H.W.1986.Writingforsocialscientists:howtostartandfinishyourthesis, bookorarticle.UniversityofChicagoPress.Howbadwritingreallyisnotrequiredto makesocialsciencegoodcontrarytotheimpressionyougetfromtoomanyjournals. Patton,MichaelQuinn.1990.QualitativeEvaluationandResearchMethods,2d.ed. Sage. Miles,M.B.andA.M.Huberman.1994.QualitativeDataAnalysis,2ded.Sage. Booth,W.C., etal.1995. TheCraftofResearch.University ofChicagoPress.The writingprocessaskingquestions,makingaclaimandsupportingit,predraftingand drafting,revising,andintroductions. Becker,H.1996. TricksoftheTrade:ThinkingaboutyourResearchwhileDoingIt
Appendix2.Additionalinterpretivistreferences
Mead,G.H.1934. Mind,Self,andSociety. Abel,T.1948.TheoperationcalledVerstehen.AmericanJournalofSociology 54:211 218. Blumer,H.1969. Symbolicinteractionism:perspectiveandmethod. Dallmayr,F.R.andT.A.McCarthy,eds.1977.UnderstandingandSocialInquiry. Neufeld,M.1993.Interpretationandthescienceofinternationalrelations.Reviewof InternationalStudies19:3961. Denzin,N.K.andY.S.Lincoln,eds.1994. HandbookofQualitativeResearch Puchala,D.J.1995.Thepragmaticsofinternationalhistory.MershonInternational StudiesReview 39:118. Alker,H.,Jr.1996. Rediscoveriesandreformulations:humanisticmethodologiesfor internationalstudies.