Today's Plan

! !

Upcoming Schedule
!

Planning the next few weeks Talk about writing and evaluating mixed methods research (including the structure of your class project papers) Examine the structure of a few mixed methods studies Share your project research questions and analysis plans
1

April 13: Reflections on mixed methods

! !

Read: MMReader: Ch. 13 & 14 Student presentations:

a. Aaron b. Stu c. Chandra d. Jolene e. Gerard f. Kathie g. Michele h. Zantel

April 20:
! !

All project papers due! Student presentations:

a. Suzi b. Francisco c. Amy d. Megan e. Theresa f. Virginia g. Mary h. Carmen

April 27:
!

Student presentations:
a. Sara b. Ted c. Rosemary d. Olha e. Debbie f. Sai g. Sherry h. Meryem
2

Mixed Methods Research

EDPS 936 Chapter 8 -- Writing and Evaluating Mixed Methods Research

Writing and evaluating

!

General writing guidelines for mixed methods research How to organize the structure of a mixed methods research report Ways to evaluate the quality of a mixed methods study

General writing guidelines

! ! !

Resources for assistance with general writing

!

Write with proper grammar, syntax, and scholarly style Consider your audience Educate the reader about mixed methods by including definitions, methodological references, and signposts such as a purpose statement and a mixed methods research question Provide a logical story: give a reason for needing both data types and link the two datasets Consider what point of view you want to use (personal or impersonal) Adapt the writing structure to match the type of manuscript and the type of design
5

UNL's Writing Center

! !

FREE assistance for UNL students! http://www.unl.edu/writing/about/index.shtml

Locate good proposals, completed dissertations, or published journal articles for models Learn from feedback you receive; keep your own "writing guide" of issues you need to watch for when you write scholarly papers

Writing a proposal for a dissertation or thesis

!

Outline of the structure of a proposal for a dissertation, thesis, or study

Title (Foreshadows mixed methods study and type of design) Introduction
The research problem Past research on the problem Deficiencies in past research and one deficiency related to a need to collect both quantitative and qualitative data The audiences that will benefit from the study The purpose of the project and reasons for design type The research questions or hypotheses (order according to timing or priority)
Quantitative research questions/hypotheses Qualitative research questions Mixed methods research question

Need to convince your advisor and committee that

! ! !

Topic is worth studying It will be studied in a rigorous fashion That you have a complete, well-thought plan that is also feasible

Purpose

You may have to educate them about mixed methods

!

Bring an article from your field of study that used the same design to your committee meeting
7

Philosophical Foundations (worldview and assumptions for using mixed methods and type of design) Literature Review (include quantitative, qualitative, and mixed methods studies, if they are available) Creswell & Plano Clark (2007)

Outline of the structure of a proposal for a dissertation, thesis, or study (cont.)

Methods
Definition of mixed methods research The type of design used and its definition Challenges in using this design and how they will be addressed Examples of using the type of design (in your field, if possible) Reference to and inclusion of a procedural diagram in appendix Quantitative data collection and analysis Qualitative data collection and analysis Mixed methods data analysis procedures Validity approaches (quantitative, qualitative, and mixed methods research)

Outline of the structure for a mixed methods journal article

Title (foreshadows the mixed methods research and design) Introduction Statement of a problem or issue Literature on the research problem or issue (focused on establishing the need for studying the research problem or issue) Deficiencies in previous studies (incorporate need for collecting both quantitative and qualitative data) Audiences for the study Purpose statement (written using script that applies to type of design) Research questions (order according to timing and priority) 1. Quantitative questions or hypotheses 2. Qualitative questions 3. Mixed methods questions Related Literature Review (optional, depending on priority; a broad literature review about the topic of the study that narrows the focus to the specific issue or problem of the proposed study)

Potential Ethical Issues Researchers Resources and Skills Timeline for Completing the Study References Appendices with instruments/protocols/procedural diagram
Creswell & Plano Clark (2007) 9

10

Outline of the structure for a mixed methods journal article (cont.) Methods Type of research design used and definition of mixed methods Type of mixed methods design used (define, give reasons for using design, cite studies using design in field) Diagram of procedures included as a figure or appendix Data collection (order quantitative and qualitative collection methods based on timing and priority) Data analysis (order quantitative and qualitative analyses based on timing and priority) Validity Results Two models 1. Merge results in Triangulation or Embedded concurrent design (sometimes we see separate reports of quantitative and qualitative results, with merging in the discussion section) 2. Report results in sequence (qualitative followed by quantitative in Exploratory; quantitative followed by qualitative in Explanatory) Discussion Summarize results (merged, embedded, connected) Explain results Limitations Future research

Outline of the structure for a NIH proposal narrative (new format!)

A. Specific Aims (Limit to one page)

Goals of the proposed research (include a mixed methods purpose statement with quantitative questions or hypotheses, qualitative questions, and mixed methods questions). Mention the impact the proposed research will have on the content field as well as the mixed methods literature. Discuss reasons for using mixed methods research and how the study will advance understanding of mixed methods research. Specify objectives of the proposed research (include objectives that will be accomplished through the mixed methods design).

B. Research Strategy (6 or 12 pages, depending on proposal type)

(a) Significance (mention how mixed methods will enhance the study of the problem)
Explain the importance of the problem or critical barrier to progress in the field that the proposed project addresses. Explain how the proposed project will improve scientific knowledge, technical capability, and/or clinical practice in one or more broad fields. Describe how the concepts, methods, technologies, treatments, services, or preventative interventions that drive this field will be changed if the proposed aims are achieved.

(b) Innovation (mention the innovative use of mixed methods as an approach) Explain how the application challenges and seeks to shift current research or clinical practice paradigms.
Describe any novel theoretical concepts, approaches or methodologies, instrumentation or intervention(s) to be developed or used, and any advantage over existing methodologies, instrumentation or intervention(s). Explain any refinements, improvements, or new applications of theoretical concepts, approaches or methodologies, instrumentation or interventions.

12

Outline of the structure for a NIH proposal narrative (cont.)

(c) Approach
Describe the overall strategy, methodology, and analyses to be used to accomplish the specific aims of the project. Include how the data will be collected, analyzed, and interpreted as well as any resource sharing plans as appropriate. Include:

Structure of Mixed Methods Study by Design

!

Explanatory sequential design

! ! !

- Overall approach (mixed methods) and definition of mixed methods research - Type of mixed methods design used (define, give reasons for using design, cite studies using design in field) -Diagram of procedures (may include as appendix) -Data collection (order quantitative and qualitative collection methods according to design) -Data analysis (order quantitative and qualitative analyses according to design) -Validity (quantitative, qualitative, and mixed methods) -Discuss potential difficulties and limitations of the proposed procedures (include the challenges to the design and how they will be addressed) -Provide a tentative sequence or timetable for the project (include this timetable in the mixed methods diagram)

Data collection quan, then qual Results - quan, then qual Conclusions quan, then qual, then integration Data collection qual, then quan Results qual, then quan Conclusions qual, then quan, then integration Data collection quan, then qual or qual, then quan Results integration of qual and quan Conclusions integration of qual and quan
14

Exploratory sequential design

! ! !

Discuss potential problems, alternative strategies, and benchmarks for success anticipated to achieve the aims. If the project is in the early stages of development, describe any strategy to establish feasibility, and address the management of any high risk aspects of the proposed work. Point out any procedures, situations, or materials that may be hazardous to personnel and precautions to be exercised. Add preliminary studies for new applications (these studies can include research that uses quantitative, qualitative, and mixed methods approaches). Add in experiences and 13 competence of the researchers (include individual and team skills in quantitative, qualitative, and mixed methods research).

Concurrent designs
! ! !

Evaluating a mixed methods study

!

Activity
!

Does the study meet the definition of mixed methods? Does the study demonstrate rigorous mixed methods research? Does the report include advanced mixed methods features consistent with a design? Were the procedures sensitive to the challenges of using the design?
15

Let's apply these ideas to examine the writing structure of and evaluate a few mixed methods studies
!

If you are using a concurrent approach:

!

Examine: MM Reader chapter 15 or 18

If you are using a sequential QUAN ! QUAL approach:

!

Examine: MM Reader chapter 20

If you are using a sequential QUAL ! QUAN approach:

!

Examine: D&CMMR Appendix D or MM Reader chapter 22

If you are using a methodological approach:

!

Examine: MM Reader chapter 10 or 5

16

Sharing your data analysis plans