Table 2

Descriptive Statistics and Scale Reliability for Staff and Youth Environmental Adherence Measures

SubscaleEnvironmental Adherence Measurement ToolDescriptive StatisticsScale Reliability
RangeM (SD)scale mean (sd)alphaICC
Youth ratings (n = 2,570)
 Overall organizationItem 6. Did staff explain to you how to earn privileges?0–42.78 (1.30)2.65 (0.91)0.630.37
Item 7. Do you know what structure/activities to expect on a daily basis?0–42.52 (1.15)
Item 8. Do staff lead activities in the program?0–42.60 (1.11)
 Staff connectednessItem 1. Does the staff’s voice remain firm and supportive when a youth is not following directions?0–42.37 (1.01)––0.29a
 Social supportItem 2. Would you describe staff as “excited to work with youth” during interactions?0–42.21 (1.07)2.57 (0.89)0.780.39
Item 3. Are staff working with you to accomplish your treatment goals?0–42.79 (1.07)
Item 4. Do staff assist you in resolving treatment concerns you may have?0–42.67 (1.07)
 Future orientation of  the programItem 10. Do staff work with you on how to apply your skills to your community/home setting?b0–42.39 (1.24)––0.50a
 Treatment milieuItem 5. Are you practicing new skills to earn reinforcements (token incentives) from staff?0–42.53 (1.24)2.57 (1.01)0.61c0.34
Item 9. Do staff help coach you on how to use your skills?0–42.59 (1.11)
Expert ratings (n = 677)
 Overall organizationItem 5. Program is structured in a way that ensures treatment is occurring0–31.96 (0.91)1.77 (0.79)0.80–
Item 6. Youth have structured programming on the floor (behavior permitting)0–31.63 (0.95)
Item 7. Important treatment specific information is communicated among staff daily0–31.72 (0.95)
 Staff connectednessItem 1. Staff are respectful in their communication with youth0–32.40 (0.74)1.83 (0.60)0.69–
Item 9. Staff structures milieu to actively engage youth in generalizing skills0–31.66 (0.80)
Item 10. There is a clear programmatic structure that pairs privilege to treatment performance0–31.44 (0.76)
 Social supportItem 2. Staff convey genuine regard and liking toward youth0–32.06 (0.76)2.03 (0.56)0.83–
Item 3. Staff demonstrate that they listen to youth0–32.23 (0.64)
Item 4. Behavior is described in an empathetic, objective and nonjudgmental way0–32.15 (0.67)
Item 11. Staff help youth accomplish treatment goals that are important to the youth0–31.69 (0.67)
 Future orientation of  the program––––––
 Treatment milieuItem 8. Program effectively reinforces behaviors0–31.41 (0.71)1.66 (0.55)0.78–
Item 12. Staff apply treatment strategies in the milieu0–31.68 (0.67)
Item 13. Staff support each other in delivering the treatment with fidelity0–31.89 (0.59)

  • ↵a Based on single item.

  • ↵b n = subsample of 908 ratings from new version of tool only (i.e., item was not included on old version).

  • ↵c Pearson correlation coefficient = 0.44, p < .001.