Introduction
Adolescents with substance-related disorders present serious health problems, and the correlation with school lag, criminal behavior, pregnancy, and family problems is high. There is evidence that the use of substances is related to violent behavior (Peltzer & Pengpid, 2012).
Substance use disorder in adolescents has been associated in 75% of the cases with comorbidity of conduct disorder with limited prosocial emotions, oppositional defiant disorder, and attention-deficit hyperactivity disorder (Brook, Brook, Zhang, & Koppel, 2010). Therefore, having an instrument to assess and detect the risk of developing behavioral and substance use problems in Mexican population is important.
One of the most important instruments to evaluate criminal behavior and antisocial personality in adolescents is the Antisocial Process Screening Device (APSD) developed by Frick, Bodin and Barry (2000). The instrument is a screening device to evaluate psychopathy based on the psychopathy Checklist-Revised (PCL-R) (Hare, 1991). The instrument originally evaluates three dimensions: narcissism, impulsivity, and Callous-Unemotional (CU). This factorial structure shows variants in the different countries where it has been adapted. The principal debate has been if two, three, or four dimensions are relevant to identify adolescents with potential psychopathy (de Weid, van der Baan, Raaijmakers, de Ruiter, & Meeus, 2014; Laajasalo et al., 2014; Pechorro, Gonçalves, Andershed, & DeLisi, 2017; Shaffer et al., 2016; Van Damme, Colins, & Vanderplasschen, 2016). Nevertheless, the APSD shows general good psychometric properties. The criteria validation of APSD has demonstrated to be useful not only for clinical psychology but also for forensics due to the sensitivity and specificity on detecting criminal behavior and conduct disorders (Shaffer et al., 2016; Van Damme et al., 2016). However, the narcissism and impulsivity subscales have shown higher correlation with violent behavior than CU, this last subscale needs further research which in theory is implied in the development of antisocial personality disorder (Frick & Ray, 2015).
The aim of this research was to call out a translation and cross-cultural adaptation of the APSD for the Mexican population and to analyze its psychometric properties (criterion-related validity, and reliability) in this setting. The present study also contributes to the analysis of the factorial structure of the APSD (construct validity) in Latin American cultures besides evaluating its forensic utility in regards to criminal and drug use behavior.
Method
Participants and procedure
We worked within three samples in the northwest region of Mexico: Public school students enrolled in junior high school and high school, juvenile detention centers for minor faults (e.g., drug consumption in public places; assaults to private property; quarrels), and imprisonment within juvenile detention centers. They were provided with recruitment materials presenting the details of the study. Once the permission had been granted, the participants completed a series of self-report questionnaires, including the self-report APSD. This study was approved by the ethics committee of the Psychology Department in the Sonora Institute of Technology.
Measures
We obtained written authorization from one of the authors of the original version of the APSD (Frick et al., 2000), Professor Paul J. Frick, to perform a cross-cultural adaptation of the instrument for the Mexican population. The translation and Mexican context adaptation was done by two clinical psychologists (two of the authors: DM and SMC). This translation was sent to three clinical psychologists, who are experts in antisocial behavior (Addiction psychology, Master’s degree). The reviewers’ feedback was integrated into the final version. We followed the retroversion procedure according test translation guidelines with a native speaker (Hambleton, 2001).
Beside the self-report APSD (20 items), the participants also completed 114 items from the national survey of drug consumption in students ENCODE (Villatoro et al., 2015). The survey consisted of: number of criminal behavior (12 items), drug abuse (11 items), bullying (10 items), violence observation within the family (10 items), self-esteem (9 items), anxiety (8 items), maternal abuse (24 items) and parental abuse (24 items), and care neglect (6 items).
Statistical analysis
The data were analyzed using the SPSS v.24 (Arbuckle, 2012). A normality analysis (Kolmogorov-Smirnov test and Shapiro/Wilk test) was carried out for each variable to determinate whether use parametric or no parametric test of correlation and intergroup comparison. For the criterion-related validity analysis, we computed Pearson correlations and regression model among the APSD total score and the total score in the ENCODE scales: total of conduct disorder (CD), total of violence observation (VO), total of drug problems (DP), total of bullying problems (BP), total of self-esteem (SE), total of anxiety (AA), total of maternal and parental abuse (MA, PA), and total of neglect care (NC). We used all the sample to make this analysis. Then we made a multivariate analysis to compare three samples and the quantity of drug consumption as two factor variables, and the same variables used in the regression including the total APSD score. For the construct validity, we used AMOS v.23 (Arbuckle, 2012). We fitted the two and three-factor models of the APSD (Frick et al., 2000) by kind of sample, and compared the two models. For the confirmatory factorial analysis (CFA), we used the maximum likelihood (ML) method (Byrne, 2010; Tarka, 2017). The Model fit was assessed using χ2, root mean square error of approximation (RMSEA), Tucker–Lewis index (TLI), and comparative fit index (CFI) (Jackson, Gillaspy, & Purc-Stephenson, 2009; Byrne, 2010). We used the following cut-off scores: RMSEA scores below .05 indicate good fit, whereas scores between .05 and .08 indicate acceptable fit. A CFI score of .95 or above indicates excellent fit, and TLI score .95 or more indicates good fit (Hu & Bentler, 1999). With regard to chi square, a good fit is indicated when χ2 / df ≤ 2, whereas χ2 / df ≤ 3 is indicative of an acceptable fit (Schermelleh-Engel, Moosbrugger, & Müller, 2003). The assessment of reliability was done by the analysis of internal consistency (Cronbach’s α).
Results
Data were collected from 1 070 participants (958 students from public school, 72 from the juvenile detention centers for minor faults, and 40 from the Imprisonment within juvenile detention center). The ages of the participants ranged between 11 and 28 years. From the students-sample (M = 14.72, SD = 1.79), minor faults (M = 15.43, SD = 1.22), detention center (M = 17.78, SD = 2.43). According to gender, the samples were: in schools (50.4% men), minor faults (86% men), and detention center (100% men).
The dependent measures had p values > .05 in the Kolmogorov-Smirnov test and Shapiro/Wilk test. The APSD scores correlated significantly with all the ENCODE variables: VO (r = .163, p = .01), CD (r = .345, p = .01), B (r = .341, p = .01), SE (r = -.241, p = .01), AA (r = .347, p = .01), PD (r = .341, p = .01), MA (r = .348, p = .01), CN (r = .205, p = .01), PA (r = .312, p = .01). In the regression analyses to predict APSD score, we found a significant model (F [9 849] = 44.73, p < .000). Parental abuse and care neglect were no significant predictors (p > .05). While the anxiety and drug problems had more impact in the model, respectively (β = .217, β = .169). The amount of variance explained with the model was 31.4%. For all predictors, collinearity values were acceptable, with the variance inflation factor ranging from 1.072 to 1.74. In the multivariate analysis, the independent variables (sample and quantity of drugs) did not have a significant interaction in almost none of the dependent variables, including APSD (p > .05). We found interaction in the variables CD (F [6 847] = 2.63, p = .015), and DP (F [6 847] = 6.14, p = .000). The variable sample had it main effect in the variables MA (F [2 847] = 5.36, p = .005), NC (F [2 847] = 3.84, p = .022), and SE (F [2 847] = 5.01, p = .007). We found a main effect with the variable quantity of drug consumption in the variables APSD (F [3 847] = 7.53, p = .000), AA (F [3 847] = 6.01, p = .000), and PA (F [3 847] = 10.68, p = .000). The post hoc analysis with Tukey Test showed significant differences between community sample and the two forensic samples in the variables APSD, CD, DP, SE, MA, and NC (p < .05). In the quantity of drugs, we found with the Tukey Test significant differences between used zero to three drugs and four to nine drugs in the variables PA, AA, and APSD (p < .05), the scores increased in all the variables with the quantity of drugs (Figure 1). The CFA with three factors had the best fit when items 2 and 13 were deleted (Table 1). Reliability analysis suggests acceptable internal consistency (α = .79). The factors have the following values: impulsivity α = .70, CU α = .31, narcissism α = .64.
Model | X 2 | df | X 2 / df | RMSEA | 90% CI | TLI | CFI |
---|---|---|---|---|---|---|---|
Total sample | |||||||
Two-factor | 984.4 | 169 | 5.82 | .067 | (.063 - .071) | .768 | .794 |
Three-factor | 732.257 | 132 | 5.54 | .065 | (.061 - .070) | .797 | .825 |
Three-factor (exc 2 &13) | 171 | 132 | 4.58 | .580 | (.053 - .063) | .846 | .867 |
Community | |||||||
Two-factor | 896.609 | 169 | 5.30 | .067 | (.063 - .071) | .773 | .798 |
Three-factor | 681.86 | 132 | 5.16 | .066 | (.610 - .71) | .790 | .825 |
Four-factor | 592.04 | 132 | 4.48 | .060 | (.055 - .065) | .837 | .859 |
Forensic | |||||||
Two-factor | 310.2 | 169 | 1.83 | .087 | (.710 - .102) | .601 | .645 |
Three-factor | 243.59 | 132 | 1.84 | .087 | (.070 - .104) | .616 | .669 |
Three-factor (exc 2 &13) | 208.63 | 132 | 1.58 | .072 | (.530 - .090) | .734 | .771 |
Discussion and conclusion
This is a study report of the adaptation of the APSD to Mexican population. We reported its reliability and criteria validation with drug consumption and conduct disorder. The total APSD scores have significant positive correlations with conduct disorder, bullying, anxiety, problems with drugs, maternal abuse, care neglect, parental abuse and a negative correlation with self-esteem. The regression analysis shows that drug problems and conduct disorder are the best predictors of the APSD score in the sample. These facts imply that the APSD Mexican version has a good criteria validation, which is similar to other studies (de Weid et al., 2014; Laajasalo et al., 2014; Pechorro et al., 2017; Shaffer et al., 2016; Van Damme et al., 2016).
The APSD originally showed three dimensions by confirmatory factor analysis (CFA), and several studies have confirmed this factorial structure (Frick et al., 2000; Laajasalo et al., 2014); However, some studies have found two factor solutions supported by CFA (de Weid et al., 2014; Fite, Greening, Stoppelbein, & Fabiano, 2009). In contrast, other studies have found a better fit in community samples with the three-factor model than forensic or clinical samples (Shaffer et al., 2016). The current study compared the two-factor model and the three-factor model. We found a better fit with the three-factor model when we excluded items 2 and 13. The three-factor model obtained adequate fit indexes for both samples; these are: RMSEA < .05, X2 / df < 5 (Jackson et al., 2009), TLI and CFI indexes do not represent a good fit in the three different models in the community and forensic samples. However, these difficulties have been seen in other countries validations (de Weid et al., 2014; Laajasalo et al., 2014; Pechorro et al., 2017; Shaffer et al., 2016; Van Damme et al., 2016). The reliability of the scale is acceptable, but the CU reliability is low, as it has been shown in other studies (Frick & Ray, 2015). Which implies further research in the Latin American population about the limited prosocial emotions. We suggest to incorporate biological correlates and cognitive tasks. This could help to elucidate the reason as to why these dimensions show difficulties in their measurements.
Finally, we found an interesting effect between the quantity of drugs and the APSD score, where the involvement of drug usage/consumption raises antisocial behavior, even in the community sample. Some studies have found that drugs damage the brain especially the frontal lobe which implies a more impulsive behavior and low self-regulation (Kalivas & O’Brien, 2008). The drugs effect makes us reconsider psychopathic or antisocial personality disorders as a disorder that can decrease the intensity of its symptoms when people stop using drugs. This is what Fridell, Hesse, and Billsten (2007) found in a five and fifteen follow-up, where criminal behavior had a significant reduction when people stopped using drugs, even with antisocial personality disorder.
One of the principal limitations in this research is the cross-sectional design. It is important to include follow-ups in the three samples that we had. In order to have a more precise picture of the APSD reliability. We suggest that future studies include multilevel analysis to control demographic variables and psychiatric comorbidity, and evaluate executive functions as a measure of frontal lobe problems. This last point is very important due raise rates of drug use in Mexican adolescents (Villatoro et al., 2017). And the fact that the drug use in adolescence affects executive functions in adulthood (Pope, Boomhower, Hutsell, Teixeira, & Newland, 2016). We need future research using the APSD test to verify the screening performance to make it a useful tool in schools and clinical centers. The APSD could help us to provide prevention and treatment for the Mexican population.