Cognitive Flexibility Scale for Indonesian Adolescents: Reliability and Validity
DOI:
https://doi.org/10.11113/sh.v17n3-2.2266Keywords:
Cognitive flexibility, adolescents, validity, reliability, emotion dysregulationAbstract
Cognitive flexibility is the ability to perceive alternatives in various situations, facilitating adaptation and resilience. Given developmental challenges many groups of adolescents face, it is important to ensure the availability of practical, reliable, and valid assessments to measure cognitive flexibility in this population. This study aims to evaluate the psychometric properties of the self-report Cognitive Flexibility Scale (CFS) Indonesian Version for the Indonesian adolescent population. Through convenience sampling approach, 644 adolescents, aged 12 to 18, living in Jabodetabek, completed the Indonesian version of the CFS in a classroom setting. Confirmatory factor analysis tested both unidimensional and two-factor models, revealing superior fit for the two-factor structure. Internal reliability was evaluated using Cronbach's alpha and McDonald’s Omega, demonstrating adequate reliability (α = 0.72, ω = 0.70). In the second phase, criterion validity was assessed using Spearman’s correlation with the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) completed by a subsample of 151 adolescents, revealing a significant negative correlation between cognitive flexibility and emotional dysregulation. This correlation underscores the importance of cognitive flexibility in emotion regulation, highlighting its relevance in the context of providing psychological support. Overall, this study supports the CFS Indonesian version as a practical, reliable, and valid instrument for cognitive flexibility assessment among Indonesian adolescents. Future research should focus on more diverse samples to validate the scale further and explore its applicability across different subgroups within Indonesia, especially communities with high social vulnerability.
References
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. DOI: https://doi.org/10.1016/j.sapharm.2018.03.066
Ardra, O., & Hendrawan, D. (2024). Adolescent executive function measurements in Indonesia: Systematic review and implications in educational settings. Jurnal Kependidikan: Jurnal Hasil Penelitian Dan Kajian Kepustakaan Di Bidang Pendidikan, Pengajaran Dan Pembelajaran, 10(3), 952. DOI: https://doi.org/10.33394/jk.v10i3.12356
Anika, N. (2019). Pengalaman adaptasi remaja pasca bencana gempa di Lombok, Nusa Tenggara Barat [Skripsi, Universitas Airlangga]
Baghestani, A. R., Ahmadi, F., Tanha, A., & Meshkat, M. (2019). Bayesian critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development, 52(1), 69–73. DOI: https://doi.org/10.1080/07481756.2017.1308227
Best, J. R., & Miller, P. H. (2010). A Developmental Perspective on Executive Function. Child Development, 81(6), 1641–1660. DOI: https://doi.org/10.1111/j.1467-8624.2010.01499.x
Bonanno, G. A., Chen, S., Bagrodia, R., & Galatzer-Levy, I. R. (2024). Resilience and disaster: Flexible adaptation in the face of uncertain threat. Annual Review of Psychology, 75(1), 573–599. DOI: https://doi.org/10.1146/annurev-psych-011123-024224
Cañas, J. J., Fajardo, I., & Salmeron, L. (2006). Cognitive flexibility. International Encyclopedia of Ergonomics and Human Factors, 1(3), 297–301.
Çelikkaleli, Ö. (2014). The Validity and Reliability of the Cognitive Flexibility Scale. Education & Science/Egitim ve Bilim, 39(176).
Chesebro, J. L., & Martin, M. M. (2003). The relationship between conversational sensitivity, cognitive flexibility, verbal aggressiveness and indirect interpersonal aggressiveness. Communication Research Reports, 20(2), 143–150. DOI: https://doi.org/10.1080/08824090309388810
Chung, J. J., Heakes, M., & Kaufman, E. A. (2024). The role of cognitive flexibility in self-injurious thoughts and behaviors: A systematic review. Clinical Psychology: Science and Practice, 31(1), 42–56. DOI: https://doi.org/10.1037/cps0000163
Claro, A., Dostaler, G., & Shaw, S. R. (2022). Clarifying the Relationship Between Executive Function and Risky Behavior Engagement in Adolescents. Contemporary School Psychology, 26(2), 164–172. DOI: https://doi.org/10.1007/s40688-020-00287-9
Cobos-Sánchez, L., Flujas-Contreras, J. M., & Becerra, I. G. (2022). Relation between psychological flexibility, emotional intelligence and emotion regulation in adolescence. Current Psychology, 41(8), 5434–5443. DOI: https://doi.org/10.1007/s12144-020-01067-7
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. DOI: https://doi.org/10.1037/0021-9010.78.1.98
Dajani, D. R., & Uddin, L. Q. (2015). Demystifying cognitive flexibility: Implications for clinical and developmental neuroscience. Trends in Neurosciences, 38(9), 571–578. DOI: https://doi.org/10.1016/j.tins.2015.07.003
Dennis, J. P., & Vander Wal, J. S. (2010). The Cognitive Flexibility Inventory: Instrument development and estimates of reliability and validity. Cognitive Therapy and Research, 34(3), 241–253. DOI: https://doi.org/10.1007/s10608-009-9276-4
Doebel, S. (2020). Rethinking Executive Function and Its Development. Perspectives on Psychological Science, 15(4), 942–956. DOI: https://doi.org/10.1177/1745691620904771
Fu, F., & Chow, A. (2017). Traumatic exposure and psychological well-being: The moderating role of cognitive flexibility. Journal of Loss and Trauma, 22(1), 24–35. https://doi.org/10.1080/15325024.2016.1161428
Gilbert, G. E., & Prion, S. (2016). Making sense of methods and measurement: Lawshe’s content validity index. Clinical Simulation in Nursing, 12(12), 530–531. DOI: https://doi.org/10.1016/j.ecns.2016.08.002
Gottwald, J., de Wit, S., Apergis-Schoute, A. M., Morein-Zamir, S., Kaser, M., Cormack, F., Sahakian, B. J. (2018). Impaired cognitive plasticity and goal-directed control in adolescent obsessive–compulsive disorder. Psychological Medicine, 48(11), 1900–1908. DOI: 10.1017/S0033291717003464
Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 26(1), 41–54. DOI: https://doi.org/10.1023/B:JOBA.0000007455.08539.94
Hall, S., Sloan-Aagard, C., Harris, R., Emmett, C., Prasetyadi, C., Pettersson, J., Cope, A., & Hamson Cox, M. (2022). Perceptions of tsunami susceptibility and self-efficacy among adolescents in Indonesia: The influence of gender, religion, location, age, hazard information source, and past experience. International Journal of Disaster Risk Reduction, 79, 103151. DOI: https://doi.org/10.1016/j.ijdrr.2022.103151
Hamtiaux, A. & Houssemand, C. (2012). Adaptability, cognitive flexibility, personal need for structure, and rigidity. Journal of Psychology Research, 2(10), 563-585 DOI: https://doi.org/10.17265/2159-5542/2012.10.001
Hauser, T. U., Iannaccone, R., Walitza, S., Brandeis, D., & Brem, S. (2015). Cognitive flexibility in adolescence: Neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development. NeuroImage, 104, 347–354. DOI: https://doi.org/10.1016/j.neuroimage.2014.09.018
Hayes, A. F., & Coutts, J. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But… Communication Methods and Measures, 14(1), 1–24. DOI: https://doi.org/10.1080/19312458.2020.1718629
Holochwost, S. J., Winebrake, D., Brown, E. D., Happaney, K. R., Wagner, N. J., & MillsKoonce, W. R. (2023). An Ecological Systems Perspective on Individual Differences in Children’s Performance on Measures of Executive Function. Journal of Cognition and Development, 24(2), 223–240. DOI: https://doi.org/10.1080/15248372.2022.2160721
Ionescu, T. (2012). Exploring the nature of cognitive flexibility. New Ideas in Psychology, 30(2), 190–200. DOI: https://doi.org/10.1016/j.newideapsych.2011.11.001
Johnco, C., Wuthrich, V. M., & Rapee, R. M. (2014). Reliability and validity of two self-report measures of cognitive flexibility. Psychological assessment, 26(4), 1381–1387. DOI: https://doi.org/10.1037/a0038009
Juth, V., Silver, R. C., Seyle, D. C., Widyatmoko, C. S., & Tan, E. T. (2015). Post-Disaster Mental Health Among Parent–Child Dyads After a Major Earthquake in Indonesia. Journal of Abnormal Child Psychology, 43(7), 1309–1318. DOI: https://doi.org/10.1007/s10802-015-0009-8
Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. DOI: https://doi.org/10.1007/s10862-015-9529-3
Kurginyan, S. S., & Osavolyuk, E. Y. (2018). Psychometric Properties of a Russian Version of the Cognitive Flexibility Inventory (CFI-R). Frontiers in Psychology, 9, 350589. DOI: https://doi.org/10.3389/fpsyg.2018.00845
Kuriansky, J., & Nemeth, D. G. (2020). Rebuilding executive functions in environmentally traumatized children and adolescents. In Evaluation and Treatment of Neuropsychologically Compromised Children (pp. 221–247). Elsevier. DOI: https://doi.org/10.1016/B978-0-12-819545-1.00012-6
Kusi-Mensah, K., Nuamah, N. D., Wemakor, S., Agorinya, J., Seidu, R., Martyn-Dickens, C., & Bateman, A. (2022). A systematic review of the validity and reliability of assessment tools for executive function and adaptive function following brain pathology among children and adolescents in low- and middle-income countries. Neuropsychology Review, 32(4), 974–1016. https://doi.org/10.1007/s11065-022-09538-3
Kyndt, E., & Onghena, P. (2014). The integration of work and learning: Tackling the complexity with structural equation modelling. In C. Harteis, A. Rausch, & J. Seifried (Eds.), Discourses on Professional Learning (Vol. 9, pp. 255–291). Springer Netherlands. DOI: https://doi.org/10.1007/978-94-007-7012-6_14
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. DOI: https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
López, M. B., Arán Filippetti, V., & Krumm, G. L. (2024). Validity and internal consistency of a Spanish version of the Cognitive Flexibility Scale (CFS). International Journal of Psychological Research, 17(1), 53–62. DOI: https://doi.org/10.21500/20112084.6106
MacPherson, H.A., Kim, K.L., Seymour, K.E. et al. Cognitive Flexibility and Impulsivity Deficits in Suicidal Adolescents. Res Child Adolesc Psychopathol 50, 1643–1656 (2022). DOI: https://doi.org/10.1007/s10802-022-00952-y
Martin, M. M., & Anderson, C. M. (1998). The cognitive flexibility scale: Three validity studies. Communication Reports, 11(1), 1–9. DOI: https://doi.org/10.1080/08934219809367680
Martin, M. M., & Rubin, R. B. (1995). A new measure of cognitive flexibility. Psychological Reports, 76(2), 623–626. DOI: https://doi.org/10.2466/pr0.1995.76.2.623
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex "Frontal Lobe" tasks: a latent variable analysis. Cognitive psychology, 41(1), 49–100. DOI: https://doi.org/10.1006/cogp.1999.0734
Moore, B. A. (2013). Propensity for experiencing flow: The roles of cognitive flexibility and mindfulness. The Humanistic Psychologist, 41(4), 319–332. DOI: https://doi.org/10.1080/08873267.2013.820954
Morera, O. F., & Stokes, S. M. (2016). Coefficient α as a measure of test score reliability: Review of 3 popular misconceptions. American Journal of Public Health, 106(3), 458–461. DOI: https://doi.org/10.2105/AJPH.2015.302993
Morrish, L., Rickard, N., Chin, T. C., & Vella-Brodrick, D. A. (2018). Emotion Regulation in Adolescent Well-Being and Positive Education. Journal of Happiness Studies, 19(5), 1543–1564. DOI: https://doi.org/10.1007/s10902-017-9881-y
Oshiro, K., Nagaoka, S., & Shimizu, E. (2016). Development and validation of the Japanese version of cognitive flexibility scale. BMC Research Notes, 9(1), 275. DOI: https://doi.org/10.1186/s13104-016-2070-y
Peters, S., & Crone, E. A. (2014). Cognitive flexibility in childhood and adolescence. In J. Grange & G. Houghton (Eds.), Task Switching and Cognitive Control (pp. 332–349). Oxford University Press. DOI: https://doi.org/10.1093/acprof:osobl/9780199921959.003.0013
Rahayu, M. N. M., Aprodita, N. P., & Rasyida, A. (2022). Adapting and Testing the Indonesian Version of the Psychometric Properties of the Cognitive Flexibility Inventory (CFI) Measuring Tool. Indigenous: Jurnal Ilmiah Psikologi, 7(3), 246–262. DOI: https://doi.org/10.23917/indigenous.v7i3.18851
Rahmadian, A. A., Furqon, Yusuf, S. L. N., Rusmana, N., & Downs, L. L. (2016). Prevalensi PTSD dan karakteristik gejala stres pascatrauma pada anak dan remaja korban bencana alam. Edusentris, Jurnal Ilmu Pendidikan dan Pengajaran, 3(1), 563-585
Roche, S. P., Lee, H., Pickett, J. T., Graham, A., & Cullen, F. T. (2024). Validation of short-form scales of self-control, procedural justice, and moral foundations. Justice Quarterly, 1–30. DOI: https://doi.org/10.1080/07418825.2024.2406535
Rubin, R. D., Watson, P. D., Duff, M. C., & Cohen, N. J. (2014). The role of the hippocampus in flexible cognition and social behavior. Frontiers in Human Neuroscience, 8. DOI: https://doi.org/10.3389/fnhum.2014.00742
Santander, R. J. L. (2024). Cognitive flexibility and socioemotional competences as a modulating factor of psychopathological symptoms in adolescence. Journal of Affective Disorders Reports, 16, 100752. DOI: https://doi.org/10.1016/j.jadr.2024.100752
Setyaningrum, R., Wijaya, A. R., & Subagyo, S. (2022). The Characteristics of Society in Indonesian Based on the Hofstede Cultural Dimensions: Measuring the Five Indonesian Island. International Journal of Cultural and Art Studies, 6(1), 60–74. DOI: https://doi.org/10.32734/ijcas.v6i1.8720
Stange, J.P., Connolly, S.L., Burke, T.A., Hamilton, J.L., Hamlat, E.J., Abramson, L.Y. and Alloy, L.B. (2016), Inflexible Cognition Predicts First Onset Of Major Depressive Episodes In Adolescence. Depress Anxiety, 33: 1005-1012. DOI: https://doi.org/10.1002/da.22513
Steinberg, L. (2005). Cognitive and affective development in adolescence. Trends in Cognitive Sciences, 9(2), 69–74. DOI: https://doi.org/10.1016/j.tics.2004.12.005
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. DOI: https://doi.org/10.5116/ijme.4dfb.8dfd
Uddin, L. Q. (2021). Cognitive and behavioural flexibility: Neural mechanisms and clinical considerations. Nature Reviews Neuroscience, 22(3), 167–179. DOI: https://doi.org/10.1038/s41583-021-00428-w
Widiawati, A. (2017). Resiliensi pada remaja yang tinggal di daerah rawan bencana [Skripsi, Universitas Muhammadiyah Surakarta]
