Scenario: Pathways High School
Pathways is an alternative high school. Pathways allows students with behavior challenges to complete their high school experience with a more flexible and positive approach.
Their mission is to create an environment that allows students to consistently exceed expectations, maintain high levels of student and family satisfaction, and meet cost effectiveness standards.
They strive to provide the highest education possible to students from a variety of communities and cultural backgrounds.
Acme, Inc., assisted Pathways with the creation of individual behavior intervention plans (BIP) for students displaying high levels of inappropriate behaviors. In addition, ACME used behavior skills training (BST) to train all staff on the basics of ABA and how to implement each BIP.
A behavior management division headed by a full-time behavior specialist at the school is responsible for implementing the plans that were originally created in collaboration with Pathways’ staff. In addition, Acme is responsible for ongoing staff training and monitoring the effectiveness of each plan.
You are asked to do a follow-up to determine the success of the procedures that were put in place. In addition, you are asked to conduct some inter-observer Agreement (IOA) probes and determine whether the staff has maintained the skills taught during training.
You are provided with a variety of data to analyze and will need to use the data to determine the effectiveness of the current interventions.
The behavior specialist has been collecting and compiling data and presents them in the figures displayed in the Spreadsheet.
Figure 1: Summary of comments from staff questionnaires related to the success of the intervention and satisfaction with training.
Figure 2: Line graph of the frequency of aggressive behavior incidents for the entire school reported before (Baseline) and after (Treatment) the program began.
Figure 3: Frequency data from an observation session with two different teachers and one student’s behavior. Figure 3 reflects the frequency of physical aggression during the sessions.
Figure 4: Data from Staff Integrity Checklist.
You must now review the data and present a summary of your findings to your supervisor at ACME, Inc., as well as the school. You should include the following in your summary:
For all Figures:
Determine the purpose and importance of the data above by discussing how it can be used in the program evaluation process. Discuss the importance of data collection and analysis in program design and evaluation.
Discuss the role of employee engagement and social validity of the procedures related to the program measures and the success of the intervention as a whole.
Identify the data collected as either “quantitative” or “qualitative.” Discuss whether the type of data is appropriate for the context of the evaluation.
For Figure 1:
Determine the purpose and importance of the data above by discussing how it can be used in the program evaluation process.
Discuss the importance of data collection and analysis in program design and evaluation.
Discuss the role of employee engagement and social validity of the procedures related to the program measures and the success of the intervention as a whole.
Identify the data collected as either “quantitative” or “qualitative.” Discuss whether the type of data is appropriate for the context of the evaluation.
Discuss the overall purpose of this data and how it should be used in analyzing the effectiveness of the program.
Using the data contained in this figure, discuss the implications with regard to the effectiveness of the program.
For Figure 2:
Determine the purpose and importance of the data above by discussing how it can be used in the program evaluation process.
Discuss the importance of data collection and analysis in program design and evaluation.
Discuss the role of employee engagement and social validity of the procedures related to the program measures and the success of the intervention as a whole.
Identify the data collected as either “quantitative” or “qualitative.” Discuss whether the type of data is appropriate for the context of the evaluation.
Use visual analysis and discuss the level, trend, and variability of the challenging behavior incidents reported during baseline (before) and treatment (during the intervention).
Using the data, describe the effect that the intervention had on the frequency of behavior incidents within Pathways.
Considering the level of data, as well as any trends in the data, discuss the effectiveness of the program.
For Figure 3:
Determine the purpose and importance of the data above by discussing how it can be used in the program evaluation process.
Discuss the importance of data collection and analysis in program design and evaluation.
Discuss the role of employee engagement and social validity of the procedures related to the program measures and the success of the intervention as a whole.
Identify the data collected as either “quantitative” or “qualitative.”
Discuss whether the type of data is appropriate for the context of the evaluation.
Calculate the total frequency of physical aggression for each observer.
Using the total count method of IOA; calculate the percentage of IOA.
Discuss the result of the IOA
Is the IOA percentage within acceptable range?
Discuss what changes should be considered to increase the IOA percentage. If changes are not necessary, discuss what factors contribute to high percentage of IOA.
For Figure 4:
Determine the purpose and importance of the data above by discussing how it can be used in the program evaluation process.
Discuss the importance of data collection and analysis in program design and evaluation.
Discuss the role of employee engagement and social validity of the procedures related to the program measures and the success of the intervention as a whole.
Identify the data collected as either “quantitative” or “qualitative.”
Discuss whether the type of data is appropriate for the context of the evaluation.
Calculate the percent results of the treatment integrity checklist before intervention; one day after the intervention; and at the 3-month follow-up.
This is the total factors with a “Yes” out of the total number of factors, multiplied by 100.
Relate these treatment integrity measures to the effectiveness of the program.
Discuss the importance of treatment integrity in relation to the success of behavior management programs.