At a Glance
In Step 1, you will analyze the data you have collected and identify any gaps between what should be happening and what is happening.
Tools to Help
Who is Involved
The M&E Specialist and Facilitator conduct analyses with input, as needed, from Steering Committee members.
Output
Move on to the next step when you completed the analysis and drafted the results for each investigative question, which includes a draft list of identified needs to assure performer excellence.
1 How to Get Started
Review the Acceptable Evidence Worksheet to ensure the parameters for identifying needs are fresh in mind.
2 Next
Conduct the appropriate type of analysis on each form of data. For example, conduct qualitative thematic analysis on focus group data and quantitative, statistical analysis on data from electronic questionnaires. Here is where reliance on the expertise of your M&E Specialist is most important. Be sure to note any differences by group, which should be fairly straight forward if you have triangulated your data by getting input on the same question from multiple sources.
3 Finally
Capture the results of the analysis, by data source, for each item in the Question Matrix, and note those areas that fall short of expected minimums on the Acceptable Evidence Worksheet.
Once you have completed Steps 3A through 6A with the support of your measure and evaluation specialist, please continue to Step 7: Summarize Findings & Prioritize Actions.
At a Glance
In Step 6B, you will analyze the data you have collected and identify any gaps between what should be happening and what is happening.
Tools to Help
Who is Involved
The Facilitator should conduct this work, with support from the Steering Committee.
Output
Move on to the next step when you completed the analysis and drafted the results for each investigative question, which includes a draft list of identified needs to assure performer excellence.
1 How to Get Started
Review the Acceptable Evidence Worksheet to ensure the parameters for identifying needs are fresh in mind.
2 Next
Conduct an initial review of the Phase 2 interview data to look for themes and answers to your investigative questions. This is best accomplished by having two or more people code both success case and non-success case interview data. Coding is a process of identifying portions of qualitative data that exhibit relation to a particular theme or topic. Multiple coders help ensure validity for your codes, and ensure a single individual’s biases do not influence the findings. In our situation, your coders should be focused on two specific areas:
- Coding on the four essential factors and the Question Matrix items associated with them, and
- Coding on general themes that are consistent within success and non-success cases, or are opposing in the two groups
3 Then
Once the codes are identified they should be reviewed to determine if the themes are consistent across groups of specific interest, such as gender or geography.
- Are there consistent issues raised over and over?
- Or is there great variance?
- Where do you see the greatest differences between success and non-success responses in terms of the four essential factors of expectations, ability, opportunity, and motivation? Of the motivational items, are they primarily internally or externally focused?
- In the area of motivation, are there specific challenges (a) meeting personal needs, (b) social status and social support, (c) family support, (d) self-efficacy, (e) connectedness, or (f) social and gender norms?
- What factors seem to be most essential for good performance in success cases?
- Is there any evidence that these factors are missing, or surface as clear needs in the non-success cases?
If you do not see any consistency in the responses from either success or non-success groups, you may choose to hold additional interviews in order to ensure all key issues are being uncovered. In most cases, however, you will likely have at least some issues in clear patterns that help highlight needs and answer your investigative questions.
4 Finally
Map out the thematic differences between success and non-success cases for each of the four essential factors and determine how you can apply these themes in answering the items in the Question Matrix. Do any of them rise to the level of a need as defined by the Acceptable Evidence Worksheet?
No Comments