Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Reliability and validity of the Autism Screen for Kids and Youth

Reliability and validity of the Autism Screen for Kids and Youth Few instruments screen for autism spectrum disorder (ASD) among kindergarteners and older children. The Autism Screen for Kids and Youth (ASKY) is a 30-item parental questionnaire for 4- to 18-year-old children and adolescents available in Arabic, English, and Hebrew. We examined the sensitivity, specificity, and temporal stability of the Hebrew ASKY’s categorizations (“probable ASD” versus “probable non-ASD”) of 167 autistic and non-autistic 4- to 18-year olds. Algorithm-based categorization following The Diagnostic and Statistical Manual of Mental Disorders: Fifth Edition (DSM-5) rules demonstrated 91.8% sensitivity, 71.7% specificity, and excellent test–retest reliability (κ = 0.783, 95% confidence interval (CI) = 0.583–0.983, p < 0.001). Total score-based categorization using a cutoff of 9 demonstrated high receiver operating characteristics area under the curve (AUC = 0.874) and high sensitivity (93.4%), specificity (78.3%), internal consistency (Cronbach’s α = 0.954), and test–retest reliability (κscores = 0.674, κinstrument = 0.783). Discussing both categorization approaches, we show that the ASKY is a promising instrument for ASD screening of older children.Lay AbstractIt is important that autistic children be diagnosed as early as possible so their needs can be met and their families can gain important insights into their behavior and interact with them appropriately. However, very few autism screening instruments are appropriate for children who have outgrown early childhood. The Autism Screen for Kids and Youth (ASKY) presents parents of children aged 4–18 years with 30 items that relate to autistic behaviors as defined by the current clinical diagnostic criteria for autism spectrum disorder (DSM-5 ASD). We evaluated the Hebrew instrument’s performance on 167 autistic and non-autistic children and adolescents. We found that the ASKY algorithm correctly identified 92% of the autistic individuals as “probable ASD” and correctly identified 72% of the non-autistic individuals as “probable non-ASD,” with these classifications showing excellent stability over time. Using total questionnaire score instead of the algorithm improved the ASKY’s ability to correctly identify autistic individuals as “probable ASD” and non-autistic individuals as “probable non-ASD” to 93% and 78%, respectively. Overall, the ASKY is a promising instrument for ASD screening of older children. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Autism: The International Journal of Research and Practice SAGE

Reliability and validity of the Autism Screen for Kids and Youth

Download PDF
15 pages

Loading next page...
 
/lp/sage/reliability-and-validity-of-the-autism-screen-for-kids-and-youth-Zs49ZKC05b
Publisher
SAGE
Copyright
© The Author(s) 2023
ISSN
1362-3613
eISSN
1461-7005
DOI
10.1177/13623613221149542
Publisher site
See Article on Publisher Site

Abstract

Few instruments screen for autism spectrum disorder (ASD) among kindergarteners and older children. The Autism Screen for Kids and Youth (ASKY) is a 30-item parental questionnaire for 4- to 18-year-old children and adolescents available in Arabic, English, and Hebrew. We examined the sensitivity, specificity, and temporal stability of the Hebrew ASKY’s categorizations (“probable ASD” versus “probable non-ASD”) of 167 autistic and non-autistic 4- to 18-year olds. Algorithm-based categorization following The Diagnostic and Statistical Manual of Mental Disorders: Fifth Edition (DSM-5) rules demonstrated 91.8% sensitivity, 71.7% specificity, and excellent test–retest reliability (κ = 0.783, 95% confidence interval (CI) = 0.583–0.983, p < 0.001). Total score-based categorization using a cutoff of 9 demonstrated high receiver operating characteristics area under the curve (AUC = 0.874) and high sensitivity (93.4%), specificity (78.3%), internal consistency (Cronbach’s α = 0.954), and test–retest reliability (κscores = 0.674, κinstrument = 0.783). Discussing both categorization approaches, we show that the ASKY is a promising instrument for ASD screening of older children.Lay AbstractIt is important that autistic children be diagnosed as early as possible so their needs can be met and their families can gain important insights into their behavior and interact with them appropriately. However, very few autism screening instruments are appropriate for children who have outgrown early childhood. The Autism Screen for Kids and Youth (ASKY) presents parents of children aged 4–18 years with 30 items that relate to autistic behaviors as defined by the current clinical diagnostic criteria for autism spectrum disorder (DSM-5 ASD). We evaluated the Hebrew instrument’s performance on 167 autistic and non-autistic children and adolescents. We found that the ASKY algorithm correctly identified 92% of the autistic individuals as “probable ASD” and correctly identified 72% of the non-autistic individuals as “probable non-ASD,” with these classifications showing excellent stability over time. Using total questionnaire score instead of the algorithm improved the ASKY’s ability to correctly identify autistic individuals as “probable ASD” and non-autistic individuals as “probable non-ASD” to 93% and 78%, respectively. Overall, the ASKY is a promising instrument for ASD screening of older children.

Journal

Autism: The International Journal of Research and Practice – SAGE

Published: Jan 1, 2023

Keywords: adolescents; autism; autism spectrum disorder; pre-school children; school-age children; screening

References

  • Validation of the Arabic version of the Social Communication Questionnaire
    Aldosari, M.; Fombonne, E.; Aldhalaan, H.; Ouda, M.; Elhag, S.; Alshammari, H.; Ghazal, I.; Alsaleh, A.; Alqadoumi, T.; Thomson, R.; Al Khasawneh, M.; Tolefat, M.; Alshaban, F.
  • The Childhood Asperger Syndrome Test (CAST): Test-retest reliability in a high scoring sample
    Allison, C.; Williams, J.; Scott, F.; Stott, C.; Bolton, P.; Baron-Cohen, S.; Brayne, C.
  • Prevalence and correlates of autism spectrum disorder in Qatar: A national study
    Alshaban, F.; Aldosari, M.; Al-Shammari, H.; El-Hag, S.; Ghazal, I.; Tolefat, M.; Ali, M.; Kamal, M.; Abdel Aati, N.; Abeidah, M.; Saad, A. H.; Dekair, L.; Al Khasawneh, M.; Ramsay, K.; Fombonne, E.
  • Predicting young adult outcome among more and less cognitively able individuals with autism spectrum disorders
    Anderson, D. K.; Liang, J. W.; Lord, C.
  • Subclinical autism spectrum symptoms in pediatric obsessive-compulsive disorder
    Arildskov, T. W.; Højgaard, D. R. M. A.; Skarphedinsson, G.; Thomsen, P. H.; Ivarsson, T.; Weidle, B.; Melin, K. H.; Hybel, K. A.
  • Factors associated with a delayed autism spectrum disorder diagnosis in children previously assessed on suspicion of autism
    Avlund, S. H.; Thomsen, P. H.; Schendel, D.; Jørgensen, M.; Carlsen, A. H.; Clausen, L.
  • Assessing the use of back translation: The shortcomings of back translation as a quality testing method
    Behr, D.
  • Referral, assessment and use of screening measures related to autism spectrum disorder at a tertiary hospital setting
    Bernie, C.; Williams, K.; O’Connor, B.; Rogers, S.; May, T
  • What’s going on? The question of time trends in autism
    Blaxill, M. F.
  • A review of sensitivity, specificity, and likelihood ratios: Evaluating the utility of the electrocardiogram as a screening tool in hypertrophic cardiomyopathy
    Bolin, E.; Lam, W.
  • Factors affecting age at ASD diagnosis in UK: No evidence that diagnosis age has decreased between 2004 and 2014
    Brett, D.; Warnell, F.; McConachie, H.; Parr, J. R.
  • Sample-size calculations for Cohen’s kappa
    Cantor, A. B.
  • Serbian language version of the Modified Checklist for Autism in Toddlers, Revised, with Follow-Up: Cross-cultural adaptation and assessment of reliability
    Carakovac, M.; Jovanovic, J.; Kalanj, M.; Rudic, N.; Aleksic-Hil, O.; Aleksic, B.; Villalobos, I. B.; Kasuya, H.; Ozaki, N.; Lecic-Tosevski, D.; Pejovic-Milovancevic, M.
  • Investigating the validation of the Chinese Mandarin version of the Social Responsiveness Scale in a mainland China child population
    Cen, C. Q.; Liang, Y. Y.; Chen, Q. R.; Chen, K. Y.; Deng, H. Z.; Chen, B. Y.; Zou, X. B.
  • Validation of Social Responsiveness Scale for Korean preschool children with autism
    Chun, J.; Bong, G.; Han, J. H.; Oh, M.; Yoo, H. J.
  • Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology
    Cicchetti, D. V.
  • School age outcomes of children diagnosed early and later with autism spectrum disorder
    Clark, M. L. E.; Vinen, Z.; Barbaro, J.; Dissanayake, C.
  • Autism spectrum symptoms in a Tourette’s disorder sample
    Darrow, S. M.; Grados, M.; Sandor, P.; Hirschtritt, M. E.; Illmann, C.; Osiecki, L.; Dion, Y.; King, R.; Pauls, D.; Budman, C. L.; Cath, D. C.; Greenberg, E.; Lyon, G. J.; McMahon, W. M.; Lee, P. C.; Delucchi, K. L.; Scharf, J. M.; Mathews, C. A.
  • Late diagnosis of autism spectrum disorder after initial negative assessment by a multidisciplinary team
    Davidovitch, M.; Levit-Binnun, N.; Golan, D.; Manning-Courtney, P.
  • Age-specific time trends in incidence rates of autism spectrum disorder following adaptation of DSM-5 and other ASD-related regulatory changes in Israel
    Davidovitch, M.; Slobodin, O.; Weisskopf, M. G.; Rotem, R. S.
  • Prevalence of autism spectrum disorder in 7-9-year-old children in Denmark, Finland, France and Iceland: A population-based registries approach within the ASDEU project
    Delobel-Ayoub, M.; Saemundsen, E.; Gissler, M.; Ego, A.; Moilanen, I.; Ebeling, H.; Rafnsson, V.; Klapouszczak, D.; Thorsteinsson, E.; Arnaldsdóttir, K. M.; Roge, B.; Arnaud, C.; Schendel, D.
  • Stigma, incommensurability, or both? Pathology-first, person-first, and identity-first language and the challenges of discourse in divided autism communities
    Dwyer, P.
  • GP training in mental health needs urgent reform
    England, E.; Nash, V.; Hawthorne, K.
  • Epidemiology of pervasive developmental disorders
    Fombonne, E.
  • Enhancing the primary care pediatrician’s role in managing psychosocial issues: A cross sectional study of pediatricians and parents in Israel
    Gadassi, H.; David, I. M.; Yaari, M.; Kerem, E.; Katz, M.; Porter, B.; Stein-Zamir, C.; Grossman, Z.
  • Missed opportunities: An investigation of pathways to autism diagnosis in Australia
    Gibbs, V.; Aldridge, F.; Sburlati, E.; Chandler, F.; Smith, K.; Cheng, L.
  • The Autism-Spectrum Quotient–Hebrew version: Psychometric properties of a full and a short form, adapted for DSM-5
    Golan, O.; Terner, M.; Israel-Yaacov, S.; Allison, C.; Baron-Cohen, S.
  • ASD traits among youth with obsessive-compulsive disorder
    Griffiths, D. L.; Farrell, L. J.; Waters, A. M.; White, S. W.
  • The relationship between clinicians’ confidence and accuracy, and the influence of child characteristics, in the screening of autism spectrum disorder
    Hedley, D.; Brewer, N.; Nevill, R.; Uljarević, M.; Butter, E.; Mulick, J. A.
  • Autism and convictions for violent crimes: Population-based cohort study in Sweden
    Heeramun, R.; Magnusson, C.; Gumpert, C. H.; Granath, S.; Lundberg, M.; Dalman, C.; Rai, D.
  • Pathways to a diagnosis of autism spectrum disorder in Germany: A survey of parents
    Höfer, J.; Hoffmann, F.; Kamp-Becker, I.; Poustka, L.; Roessner, V.; Stroth, S.; Wolff, N.; Bachmann, C. J.
  • The cost of autism spectrum disorders
    Horlin, C.; Falkmer, M.; Parsons, R.; Albrecht, M. A.; Falkmer, T.
  • Barriers to the identification and management of psychosocial problems: Changes from 2004 to 2013
    Horwitz, S. M.; Storfer-Isser, A.; Kerker, B. D.; Szilagyi, M.; Garner, A.; O’Connor, K. G.; Hoagwood, K. E.; Stein, R. E. K.
  • Age at autism spectrum disorder (ASD) diagnosis by race, ethnicity, and primary household language among children with special health care needs, United States, 2009–2010
    Jo, H.; Schieve, L. A.; Rice, C. E.; Yeargin-Allsopp, M.; Tian, L. H.; Blumberg, S. J.; Kogan, M. D.; Boyle, C. A.
  • Shared brain connectivity issues, symptoms, and comorbidities in autism spectrum disorder, attention deficit/hyperactivity disorder, and Tourette syndrome
    Kern, J. K.; Geier, D. A.; King, P. G.; Sykes, L. K.; Mehta, J. A.; Geier, M. R.
  • Autism and anxiety: Overlap, similarities, and differences
    Kerns, C. M.; Kendall, P. C.; Davis, T. E.; White, S. W.; Ollendick, T. H.
  • The importance of early identification and intervention for children with or at risk for autism spectrum disorders
    Koegel, L. K.; Koegel, R. L.; Ashbaugh, K.; Bradshaw, J.
  • Brief report: Gender and age of diagnosis time trends in children with autism using Australian Medicare data
    May, T.; Williams, K.
  • Sex differences in age of diagnosis and first concern among children with autism spectrum disorder
    McDonnell, C. G.; DeLucia, E. A.; Hayden, E. P.; Penner, M.; Curcin, K.; Anagnostou, E.; Nicolson, R.; Kelley, E.; Georgiades, S.; Liu, X.; Stevenson, R. A.
  • Pediatric residency education and the behavioral and mental nealth crisis: A call to action
    McMillan, J. A.; Land, M.; Leslie, L. K.
  • Factors associated with parental stress and satisfaction during the process of diagnosis of children with autism spectrum disorders
    Moh, T. A.; Magiati, I.
  • Screening for autism with the SRS and SCQ: Variations across demographic, developmental and behavioral factors in preschool children
    Moody, E. J.; Reyes, N.; Ledbetter, C.; Wiggins, L.; Diguiseppi, C.; Alexander, A.; Jackson, S.; Lee, L.-C.; Levy, S. E.; Rosenberg, S. A.
  • The Childhood Autism Spectrum Test (CAST): Spanish adaptation and validation
    Morales-Hidalgo, P.; Roigé-Castellví, J.; Vigil-Colet, A.; Canals Sans, J.
  • Prevalence and characteristics of autism spectrum disorder among Spanish school-age children
    Morales-Hidalgo, P.; Roigé-Castellví, J.; Hernández-Martínez, C.; Voltas, N.; Canals, J.
  • Differentiating autism spectrum disorder from ADHD using the Social Communication Questionnaire
    Mouti, A.; Dryer, R.; Kohn, M.
  • The involvement of community pediatricians in the treatment of developmental-behavioral difficulties as perceived by directors of child development centers
    Nissanholtz-Gannot, R.; Michael, D.; Ashkenazi, Y.; Grossman, Z.
  • Parental report of the diagnostic process and outcome: ASD compared with other developmental disabilities
    Oswald, D. P.; Haworth, S. M.; Mackenzie, B. K.; Willis, J. H.
  • Translation and back—translation methodology in health research—A critique
    Ozolins, U.; Hale, S.; Cheng, X.; Hyatt, A.; Schofield, P.
  • Diagnosis of autism spectrum disorder after age 5 in children evaluated longitudinally since infancy
    Ozonoff, S.; Young, G. S.; Brian, J.; Charman, T.; Shephard, E.; Solish, A.; Zwaigenbaum, L.
  • Temporal and geographical variability of prevalence and incidence of autism spectrum disorder diagnoses in children in Catalonia, Spain
    Pérez-Crespo, L.; Prats-Uribe, A.; Tobias, A.; Duran-Tauleria, E.; Coronado, R.; Hervás, A.; Guxens, M.
  • Comparing rates of diagnosis using DSM-IV-TR versus DSM-5 criteria for autism spectrum disorder
    Peters, W. J.; Matson, J. L.
  • Using latent profile analysis to evaluate the utility of a DSM-5 symptom checklist in screening children for autism spectrum disorder
    Pulsipher, D. T.; Lieb, R. W.
  • Prevalence of autism spectrum disorder phenomenology in genetic disorders: A systematic review and meta-analysis
    Richards, C.; Jones, C.; Groves, L.; Moss, J.; Oliver, C.
  • Validation of the modified checklist for autism in toddlers, revised with follow-up (M-CHAT-R/F)
    Robins, D. L.; Casagrande, K.; Barton, M.; Chen, C. M. A.; Dumont-Mathieu, T.; Fein, D.
  • The economic costs of autism spectrum disorder: A literature review
    Rogge, N.; Janssen, J.
  • The diagnosis of autism: From Kanner to DSM-III to DSM-5 and beyond
    Rosen, N. E.; Lord, C.; Volkmar, F. R.
  • Do communication and social interaction skills differ across youth diagnosed with autism spectrum disorder, attention-deficit/hyperactivity disorder, or dual diagnosis?
    Salley, B.; Gabrielli, J.; Smith, C. M.; Braun, M.
  • Teaching undergraduate medical students child and adolescent psychiatry (CAP): A Delphi study on curriculum content
    Salmon, G.; Tombs, M.
  • The Study to Explore Early Development (SEED): A multisite epidemiologic study of autism by the Centers for Autism and Developmental Disabilities Research and Epidemiology (CADDRE) network
    Schendel, D. E.; Diguiseppi, C.; Croen, L. A.; Fallin, M.; Daniele Reed, P. L.; Schieve, L. A.; Wiggins, L. D.; Daniels, J.; Grether, J.; Levy, S. E.; Miller, L.; Newschaffer, C.; Pinto-Martin, J.; Robinson, C.; Windham, G. C.; Alexander, A.; Aylsworth, A. S.; Bernal, P.; Bonner, J. D.; . . .Newschaffer, C.
  • What drives detection and diagnosis of autism spectrum disorder? Looking under the hood of a multi-stage screening process in early intervention
    Sheldrick, R. C.; Frenette, E.; Vera, J. D.; Mackie, T. I.; Martinez-Pedraza, F.; Hoch, N.; Eisenhower, A.; Fettig, A.; Carter, A. S.
  • Age at first identification of Autism Spectrum Disorder: An analysis of two US surveys
    Sheldrick, R. C.; Maye, M. P.; Carter, A. S.
  • When autistic behavior suggests a disease other than classic autism
    Simms, M. D.
  • Back translation as a documentation tool
    Son, J.
  • Chinese perspectives on primary care for common mental disorders: Barriers and policy implications
    Sun, K. S.; Lam, T. P.; Wu, D.
  • Autism prevalence in China is comparable to western prevalence
    Sun, X.; Allison, C.; Wei, L.; Matthews, F. E.; Auyeung, B.; Wu, Y. Y.; Griffiths, S.; Zhang, J.; Baron-Cohen, S.; Brayne, C.
  • Gaps in developmental pediatrics training: A Canadian resident physician perspective
    Tassone, M. C.; Jegathesan, T.; Han, R.; Atkinson, A.; Ng, S.; Young, E.
  • The translator’s perspective on translation quality control processes for international large-scale assessment studies
    Upsing, B.; Rittberger, M.
  • Anxiety disorders in children and adolescents with autistic spectrum disorders: A meta-analysis
    van Steensel, F. J. A.; Bögels, S. M.; Perrin, S
  • Autism spectrum traits in children with anxiety disorders
    van Steensel, F. J. A.; Bögels, S. M.; Wood, J. J
  • Ask the editor: What is the most appropriate way to talk about individuals with a diagnosis of autism?
    Vivanti, G.
  • Clinical judgment and child development, revisited
    Voigt, R. G.
  • Autism spectrum disorder in anorexia nervosa: An updated literature review
    Westwood, H.; Tchanturia, K.
  • The epidemiology of autistic spectrum disorders: Is the prevalence rising?
    Wing, L.; Potter, D.
  • Audit of outcomes following a community-based early intensive behaviour intervention program for children with autism in Australia
    Wood, S.; Christian, M. P.; Sampson, A.
  • From toddlerhood to adolescence, trajectories and predictors of outcome: Long-term follow-up study in autism spectrum disorder
    Zachor, D. A.; Ben-Itzchak, E.
  • Validity and reliability analysis of the Chinese parent version of the Autism Spectrum Rating Scale (6-18 years)
    Zhou, H.; Zhang, L.; Wu, L.; Zou, X.; Luo, X.; Xia, K.; Wang, Y.; Xu, X.; Ge, X.; Sun, C.; Deng, H.; Fombonne, E.; Jiang, Y. H.; Yan, W.; Wang, Y.