Applied Sciences Signature

As a BCBA, you are responsible for training your staff and implementing programs with fidelity. In your midterm assignment, you described how you are going to train and support staff as they acquire and implement behavioral interventions. In the signature assignment, you will develop a system for evaluating the success of your staff development efforts by determining the overall success of your program. The overall success of a program is determined by variables you will select. For example, variables might look very different if you are evaluating a private organization delivering home based services, a center-based adult-life skills program, or a school-based program. The overall purpose for your evaluation is to determine if your program is being implemented with fidelity resulting in positive program outcomes for children/clients and a supportive work environment. You should use the materials provided for you in this course to support your plan.

Elements to address in the paper. Each bullet point should be a section header for your paper.

● Description of the program goals (Should link to the Mission Statement you developed in week 1 and identify stakeholder)
● Staff skill at delivering programs (think implementation fidelity
● Staff accountability (think professional behaviors, quality of data and record keeping)
● Staff development and professional growth
● Program activities (e.g., parent training, paraprofessional training, staff meetings, sufficiency of supervision sessions)
● Client/student outcomes

For each element of the evaluation, you should identify and/or report each of the following:

  • The criteria to assess
  • Data that you will use to assess those criteria
  • Actions to take following assessment (e.g., should remediation be called for)
  • What skill sets are they measuring staff on
  • Impact of the element (e.g., see Miller 2016 in week 7 folder)

Full Answer Section

      Staff Skill at Delivering Programs (Implementation Fidelity) Criteria to Assess:
  • Accuracy:Staff members accurately implement all components of the behavioral intervention plan (BIP) as designed by the BCBA.
  • Consistency:Staff consistently deliver interventions across all settings (classroom, playground, etc.) and throughout the day.
  • Competence:Staff demonstrate proficiency in using data collection tools and applying evidence-based principles of Applied Behavior Analysis (ABA).
Data to Assess:
  • Direct observation of staff implementing the BIP using a fidelity checklist.
  • Review of data collection sheets for accuracy and completeness.
  • Staff self-assessment surveys on their confidence in implementing the program.
Actions Following Assessment:
  • Remediation:Staff scoring low on fidelity checklists will receive targeted coaching and additional training on specific intervention components.
  • Positive Reinforcement:Staff demonstrating high fidelity will be acknowledged and praised to maintain motivation.
  • Ongoing Support:Regular supervision sessions will be provided to address questions and ensure ongoing fidelity.
Skill Sets Measured:
  • Knowledge of ABA principles and intervention strategies.
  • Ability to implement interventions with accuracy and consistency.
  • Data collection skills.
  • Communication skills to effectively collaborate with children, parents, and other staff members.
Impact: Implementing programs with fidelity is crucial for achieving positive client outcomes. Research by Miller (2016) suggests that interventions delivered with high fidelity are more likely to produce significant improvements in behavior compared to those with low fidelity. Staff Accountability (Professional Behaviors, Data Quality & Record Keeping) Criteria to Assess:
  • Professionalism:Staff demonstrate punctuality, respectful communication, and ethical behavior.
  • Data Quality:Data collected is accurate, complete, and recorded in a timely manner.
  • Record Keeping:All documentation related to the program, including BIPs, progress reports, and data sheets, are maintained securely and organized.
Data to Assess:
  • Supervisor observations of staff behavior and interactions.
  • Review of data collection sheets for missing entries or inconsistencies.
  • Audits of staff records to ensure proper documentation and filing.
Actions Following Assessment:
  • Performance Improvement Plans (PIPs):Staff exhibiting consistent issues with professionalism or data quality may require a PIP outlining expectations and corrective actions.
  • Positive Reinforcement:Recognize staff who consistently meet or exceed expectations for data quality and record keeping.
  • Training:Provide additional training on data collection procedures and record-keeping protocols if needed.
Impact: Staff accountability ensures the program runs smoothly and provides reliable data for measuring progress. Accurate data collection is essential for monitoring client outcomes and making data-driven decisions about intervention strategies. Staff Development and Professional Growth Criteria to Assess:
  • Participation:Staff actively participate in training sessions and supervision meetings.
  • Knowledge Acquisition:Staff demonstrate understanding of new concepts and skills presented during training.
  • Application:Staff apply newly acquired skills during program implementation.
Data to Assess:
  • Attendance records for training sessions and supervision meetings.
  • Pre- and post-training assessments to measure knowledge gain.
  • Observation of staff implementing new skills with fidelity.
  • Staff self-reflection on learning and professional development goals.
Actions Following Assessment:
  • Targeted Training:Based on assessment results, offer additional training sessions to address specific skill gaps or areas for improvement.
  • Mentorship Programs:Pair experienced staff members with new staff to provide ongoing support and guidance.
  • Professional Development Opportunities:Encourage and support staff participation in conferences, workshops, and continuing education courses.
Impact: Investing in staff development ensures staff possess the necessary skills and knowledge to deliver programs effectively. Continuous learning fosters professional growth, improves staff morale, and ultimately benefits client outcomes. Program Activities Activities:
  • Parent Training:Train parents on ABA principles and strategies to support their child's progress at home.
  • Paraprofessional Training:Train paraprofessionals on implementing specific interventions outlined in the BIPs.
  • Staff Meetings:Hold regular staff meetings for case discussions, data review, and program updates.
  • Supervision Sessions:Provide regular individual and group supervision to staff members.
Impact: These program activities contribute to improved program implementation and positive client outcomes. Parent involvement is crucial for reinforcing interventions at home. Paraprofessional training ensures consistent implementation across settings.  

Sample Answer

   

Evaluation System for Staff Development and Program Success

Description of the Program Goals

This program aims to improve the social and communication skills of children with Autism Spectrum Disorder (ASD) in a school setting. It aligns with the school's mission statement of providing a nurturing and inclusive environment that fosters the academic, social, and emotional well-being of all students. Stakeholders include the children with ASD, their parents, teachers, paraprofessionals, and the BCBA who oversees the program.