Article Figures & Data
Figures
- Figure 1
The 10 raters' prorated total BRACHA 0.9 scores for the 24 videos. The scores were a summary of five numbers: smallest score, lower quartile, median score, upper quartile, and largest score.
- Figure 2
Plots of scores assigned by each rater show that Raters 1 and 6 tended to score videos lower than the others.
Tables
Item Abbreviated BRACHA Items Response Options 1 Previous psychiatric hospitalization or day treatment placement □ Yes □ No 2 School suspension or expulsion □ Yes □ No 3 Trouble accepting adult authority at home or at school □ Little or none □ Some □ A lot 4 Frequency of physical aggression toward others (e.g., hitting, kicking punching, biting, slapping, fights at school, throwing objects at others) □ Never □ Occasionally □ Often 5 Impulsiveness in the emergency department (e.g., often needing redirection, throwing objects, running out of the room, yelling at the interviewer, extremely talkative, etc.) □ No Incidents □ One or more incidents 6 Intrusiveness in the emergency department (e.g., invading personal space, asking personal questions, etc.) □ No incidents □ One or more incidents 7 Attempts to harm others or violent acts with intent to seriously harm others (includes all weapons use, even without injury, if used with harmful intent) □ Never □ Once □ More than once 8 Violent ideation towards others (i.e., thoughts, wishes, or desires to harm other people) □ Never □ Occasionally □ Often 9 Actual expressions of violent intentions or plans to hurt others (includes text messages and e-mails) □ Never □ Occasionally □ Often 10 Acts that intentionally destroyed property (e.g., breaking objects, vandalism, fire setting, making holes in the walls; does not include accidents or throwing things) □ Never □ Occasionally □ Often 11 Threats or physical aggression towards self or others in the past 24 hours □ Yes □ No 12 Pattern of either verbal or physical aggression towards self or others □ Yes □ No 13 Aggressive behavior before age 10 years (e.g. firesetting, destruction of property, stealing, trying to seriously hurt a person or animal, bullying, frequent fights; does not include lying) □ Never □ Occasionally □ Often 14 Signs of remorse (such as responsibility, shame, and/or guilt) after violence or aggressive acts □ Not aggressive, or if aggressive, displays remorse, guilt, shame, or responsibility □ If aggressive, displays no remorse, guilt, shame, or sense of responsibility ↵* A full version of the BRACHA 0.9 and scoring instructions may be obtained by contacting the first author.
Item Kendall's W Fleiss' κ + SE† Gwet's AC + SE‡ W χ2 (df = 23)* 1 0.932 213.4 0.905 ± 0.051 0.937 ± 0.034 2 0.885 194.0 0.851 ± 0.065 0.917 ± 0.040 3 0.794 182.6 0.698 ± 0.053 0.683 ± 0.050 4 0.818 188.1 0.780 ± 0.045 0.782 ± 0.047 5 0.814 146.8 0.585 ± 0.075 0.729 ± 0.076 6 0.773 127.9 0.492 ± 0.153 0.886 ± 0.036 7 0.484 90.6 0.349 ± 0.141 0.844 ± 0.057 8 0.661 152.0 0.568 ± 0.108 0.743 ± 0.070 9 0.802 180.6 0.671 ± 0.087 0.884 ± 0.038 10 0.621 117.2 0.385 ± 0.095 0.849 ± 0.038 11 0.616 141.6 0.565 ± 0.084 0.565 ± 0.083 12 0.671 154.3 0.625 ± 0.095 0.627 ± 0.094 13 0.754 171.9 0.536 ± 0.135 0.840 ± 0.046 14 0.763 168.4 0.703 ± 0.091 0.826 ± 0.051 df Sum of Squares Mean Square F Between raters 9 2,030.67 225.63 5.62 Between cases 23 112,035.20 4,871.09 121.41 Within cases 216 10,335.69 47.85 Residual 207 8,305.02 40.12 Total 239 122,370.80 -
ICC = 0.9099
-
Node Mean SD 2.5% Median 97.5% ICC 0.9097 0.02577 0.8530 0.9119 0.9533 σa2 10.3 3.414 5.655 9.733 18.78 σw2 0.9461 0.09194 −0.7828 0.9402 1.142 Deviance: D¯ = 666.619; DIC = 691.498.
B. Model 2:
ICC=σ2aσ2a+σ2b+σ2ω
Node Mean SD 2.5% Median 97.5% b1 −0.5125 0.2166 −0.9567 −0.5054 −0.1074 b2 0.1487 0.21 −0.2577 0.146 0.5705 b3 0.3413 0.2131 −0.06605 0.3368 0.7739 b4 0.4272 0.2153 0.02044 0.4213 0.8669 b5 0.1998 0.2106 −0.2077 0.1973 0.6226 b6 −0.5122 0.2172 −0.9586 −0.505 −0.1055 b7 0.0672 0.2094 −0.3421 0.06645 0.4842 b8 0.0267 0.2092 −0.3856 0.0263 0.4399 b9 −0.3972 0.2136 −0.8346 −0.3919 0.006401 b10 0.2163 0.2102 −0.1886 0.2131 0.6413 ICC 0.9062 0.02869 0.8416 0.9093 0.9526 σa2 10.39 3.409 5.690 9.766 18.74 σb2 0.1952 0.1454 0.05085 0.1585 0.5565 σw2 0.7953 0.07901 0.6558 0.7901 0.9643 -
Deviance: D¯ = 624.948; DIC=657.596.
-
C. Model 3:
Node Mean SD 2.5% Median 97.5% b1 −0.5156 0.2222 −0.9651 −0.5113 −0.09033 b2 0.1659 0.2191 −0.2592 0.1629 0.607 b3 0.3656 0.2216 −0.0563 0.3603 0.8178 b4 0.4529 0.2232 0.03095 0.447 0.9103 b5 0.2184 0.2199 −0.2049 0.2143 0.6642 b6 −0.5157 0.2222 −0.9666 −0.5109 −0.08992 b7 0.08211 0.219 −0.3448 0.08011 0.5194 b8 0.03979 0.2188 −0.3872 0.0379 0.477 b9 −0.3965 0.2203 −0.8403 −0.3933 0.02854 b10 0.236 0.2196 −0.1873 0.2321 0.6808 c −0.5156 0.2222 −0.9651 −0.5113 −0.09033 ICCModel 2 0.9035 0.02976 0.8367 0.9066 0.952 ICCModel 3 0.8901 0.03456 0.8125 0.8939 0.9462 Diff3−2 −0.01335 0.01244 −0.04756 −0.009631 −0.001874 σa2 9.04 3.154 4.767 8.427 16.87 σb2 0.226 0.1568 0.06714 0.1861 0.6212 σw2 1.35 1.775 0.3154 0.9307 4.887 σw2 0.7942 0.07886 0.6543 0.789 0.9631 Deviance: D¯ = 624.572; DIC=657.308.
