This will be an outcomes focused evaluation since we need a user-centered approach for assessment of programs/services that are provided to address particular user needs and designed to achieve change for the user.
Who will use the evaluation?
AR21C stakeholders that will use the information are the program director, teachers, volunteers, and school district administration.
How will the results be used?
The results of the evaluation will be used to focus on areas that need improvement as well as the areas that are successful. This will allow for program improvement that will benefit the school-aged children that participate in the program.
What is the key question to be answered?
Is the before and after school program helping students to achieve better academic progress, assist with socialization, and increase self-esteem/confidence?
What evidence or theory supports your program/activity (specific to this question)?
A study in 2007 by Vandell, Reisner, and Pierce at the University of California, Irvine, the University of Wisconsin-Madison and Policy Studies Associates, Inc. finds that regular participation in high-quality afterschool programs is linked to significant gains in standardized test scores and work habits as well as reductions in behavior problems among disadvantaged students. These gains help offset the negative impact of a lack of supervision after school. The two-year study followed almost 3,000 low-income, ethnically diverse elementary and middle school students from eight states in six major metropolitan centers and six smaller urban and rural locations. About half of the young people attended high-quality afterschool programs at their schools or in their communities.
The expected output or outcomes will be:
Provide supervised before and after school activities
Help increase self-esteem/confidence
Provide a safe environment for socialization
Provide tutoring to those children that need additional help with school work
To provide breakfast for those attending the before school program and a healthy snack in the after school program
How could they be engaged?
Supervision of the children and the activities such as games, tutoring, and self-esteem building activities such as counseling.
Developing games that help children feel more confident about their abilities. Provide tutoring for the children that are having academic struggles, and be a mentor for those children that need a relationship with an adult role model.
Participants in the before and after school programs
Participate in the before school program of eating breakfast and socializing with other children while building a trusting relationship with the teachers/volunteers.
Participate in the after school program by using the offered tutoring services to help with academic improvement, participate in the games for socialization and enjoy sharing an afternoon snack with the teachers, volunteers, and other children.
Encourage their children to participate in the before and after school programs
Parents could discuss the benefits of having extra help with school work that is causing the child to struggle academically; provide encouragement to the children to participate in the games, and confidence activities; and encourage the development of a mentor-mentee relationship between the teachers/volunteers and the children.
Evaluate the programs for areas of improvement and areas that are working well.
Program directors need to be engaged through active observation, possible participation when time permits, and through speaking with the teachers, volunteers, parents, and the children.
School Administration/ School Board
To ensure funding is continued and to review suggestions for improvements to existing programs as well as suggestions for additional programs
Engagement would be maintained by receiving reports and analysis about the programs that provide information about whether the programs are working or need adjustments in areas for improvement.
Collecting the Data: key indicators and data sources
Indicator or measure
When is data collected?
What is expected to change?
Participation of children in program has increased, decreased, or stayed the same
The data source is the attendance records that are kept by each teacher/volunteer each day for the before and after school programs
At the end of the week and then added to ongoing data collection of participation
There will be an increase in the number of children participating in the before and after school programs.
Children feel that they are safe and protected during the before and after school programs
Children will verbalize to the teachers/volunteers that they either feel safe or do not feel safe when asked directly and the teachers/volunteers will record the answers to the interview questions
At the beginning of the school year, during the middle of the school year, and at the end of the school year
The children will verbalize an increase in feeling safe and protected throughout the course of the school year.
Children are improving academically with the continued use of tutoring services
Individual grades in areas of tutoring focus from the beginning of the school year throughout to the end of the school year
Data would be collected during each semester reporting period and compared to the previous data
Academic scores and ability would improve over the course of the school year for the children using the tutoring services
Parents express satisfaction about the child's participation in the before and after school programs
Surveys would be handed out to parents at the end of each semester when picking up their child(ren)
Parents are satisfied with their child's socialization skills, improvement in academic areas, and the feeling that their children are safe and protected during the program.
Analysis, interpretation and reporting
How will the data be analyzed?
Who will perform the analysis?
Evaluation team consisting of the Assistant Superintendent, program director, and the director of curriculum and instruction
What tools does that team need to conduct the analysis?
Academic grades at the beginning of the school year, and each semester after for comparison
Attendance records for the before and after school programs
Records of the interviews prepared by the teachers/volunteers when children are asked if they feel safe and protected during the before and after school programs
Written surveys answered by the parents
List audiences and how findings will be presented to them
School Administration/Board - Written report with graphs and tables explaining the information collected and analyzed, and any recommendations.
Program Director, Teachers, and Volunteers - Power Point presentation with handouts of the pertinent data analysis, and recommendations.
Parents and children participants - would receive a newsletter indicating in basic terms the information collected, what that information means for the programs, and the recommendations for improving or maintaining the programs.