Adaptation and Psychometric Evaluation of the Feedback Orientation Scale Among Indonesian Employees
DOI:
https://doi.org/10.52690/jswse.v7i3.1675Keywords:
Confirmatory Factor Analysis, Feedback Orientation Scale, Indonesian Employees, Psychometrics Evaluation, Scale AdaptationAbstract
The growing use of performance feedback systems in Indonesian organizations has increased the need for valid instruments that can assess how employees respond to feedback. However, validated Indonesian-language measures of employees’ receptivity to feedback remain limited. This study aimed to adapt and validate the Feedback Orientation Scale (FOS) for use in the Indonesian employee context. The FOS assesses an individual’s general tendency to receive, value, use, and feel accountable for feedback through four dimensions: Utility, Accountability, Social Awareness, and Feedback Self-Efficacy. The adaptation process followed the International Test Commission Guidelines for Translating and Adapting Tests and included translation, expert review, readability testing, item analysis, reliability testing, exploratory factor analysis, and confirmatory factor analysis. A total of 326 employees from various organizations in Indonesia participated in the study. Item analysis showed that one negatively worded item in the Accountability dimension had a low item-rest correlation and was therefore removed. The final Indonesian version consisted of 19 items. The psychometric findings indicated that all retained items demonstrated adequate item discrimination and that the four dimensions showed satisfactory internal consistency. Confirmatory factor analysis further indicated that the original four-factor structure provided a better fit than the alternative two-factor model identified through exploratory analysis. Overall, the adapted Indonesian FOS demonstrated acceptable validity and reliability for assessing feedback orientation among employees. The findings support the use of the 19-item Indonesian FOS in research and organizational practice, particularly in studies and interventions related to performance management, coaching, employee development, and feedback-based learning in diverse Indonesian workplaces.
References
Afrianty, T. W., Utami, H. N., Sasmita, E. E., Putra, F. R. R., & Wulandari, T. D. (2025). Linking servant leadership and career development to employee voice behaviour through engagement and commitment: evidence from State Polytechnics in East Java, Indonesia. Cogent Business and Management, 12(1). https://doi.org/10.1080/23311975.2025.2460628
Ahorsu, D. K., Lin, C. Y., Imani, V., Saffari, M., Griffiths, M. D., & Pakpour, A. H. (2022). The Fear of COVID-19 Scale: Development and Initial Validation. International Journal of Mental Health and Addiction, 20(3), 1537–1545. https://doi.org/10.1007/s11469-020-00270-8
Alexandro, R. (2025). Strategic human resource management in the digital economy era: an empirical study of challenges and opportunities among MSMEs and startups in Indonesia. Cogent Business and Management, 12(1). https://doi.org/10.1080/23311975.2025.2528436
Arifin, B., Rokhman, M. R., Zulkarnain, Z., Perwitasari, D. A., Manggau, M., Rauf, S., Noor, R., Padmawati, R. S., Postma, M. J., Massi, M. N., & van der Schans, J. (2022). Adaptation and validation of the HIV Knowledge Questionnaire-18 for the general population of Indonesia. Health and Quality of Life Outcomes, 20(1), 1–12. https://doi.org/10.1186/s12955-022-01963-5
Barbado, D., Gomez-Illan, R., Moreno-Navarro, P., Valero-Conesa, G., Reina, R., & Vera-Garcia, F. J. (2020). Postural control quantification in minimally and moderately impaired persons with multiple sclerosis: The reliability of a posturographic test and its relationships with functional ability. Journal of Sport and Health Science, 9(6), 677–684. https://doi.org/10.1016/j.jshs.2018.06.008
Bean, G. J., & Bowen, N. K. (2021). Item Response Theory and Confirmatory Factor Analysis: Complementary Approaches for Scale Development. Journal of Evidence-Based Social Work (United States), 18(6), 597–618. https://doi.org/10.1080/26408066.2021.1906813
Brown, G. T. L., & Zhao, A. (2023). In defence of psychometric measurement: a systematic review of contemporary self-report feedback inventories. Educational Psychologist, 58(3), 178–192. https://doi.org/10.1080/00461520.2023.2208670
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. In Asia Pacific Journal of Management (Vol. 41, Number 2). Springer US. https://doi.org/10.1007/s10490-023-09871-y
Commission, I. T. (2017). The ITC guidelines for translating and adapting tests.
Cruchinho, P., López-Franco, M. D., Capelas, M. L., Almeida, S., Bennett, P. M., da Silva, M. M., Teixeira, G., Nunes, E., Lucas, P., & Gaspar, F. (2024). Translation, Cross-Cultural Adaptation, and Validation of Measurement Instruments: A Practical Guideline for Novice Researchers. Journal of Multidisciplinary Healthcare, 17, 2701–2728. https://doi.org/10.2147/JMDH.S419714
Fuady, A., Arifin, B., Yunita, F., Rauf, S., Fitriangga, A., Sugiharto, A., Yani, F. F., Nasution, H. S., Putra, Iw. G. A. E., Mansyur, M., & Wingfield, T. (2023). Stigma towards people with tuberculosis: a cross-cultural adaptation and validation of a scale in Indonesia. BMC Psychology, 11(1), 1–11. https://doi.org/10.1186/s40359-023-01161-y
García-Batista, Z. E., Guerra-Peña, K., Garrido, L. E., Cantisano-Guzmán, L. M., Moretti, L., Cano-Vindel, A., Arias, V. B., & Medrano, L. A. (2021). Using Constrained Factor Mixture Analysis to Validate Mixed-Worded Psychological Scales: The Case of the Rosenberg Self-Esteem Scale in the Dominican Republic. Frontiers in Psychology, 12(August). https://doi.org/10.3389/fpsyg.2021.636693
Hillman, J. G., Fowlie, D. I., & MacDonald, T. K. (2023). Social Verification Theory: A New Way to Conceptualize Validation, Dissonance, and Belonging. Personality and Social Psychology Review, 27(3), 309–331. https://doi.org/10.1177/10888683221138384
Jaspal, R., Fino, E., & Breakwell, G. M. (2022). The COVID-19 Own Risk Appraisal Scale (CORAS): Development and validation in two samples from the United Kingdom. Journal of Health Psychology, 27(4), 790–804. https://doi.org/10.1177/1359105320967429
Kausar, M. N., Fitriana, E., Khairunnisa, K., Faruque, M. O., Bahar, M. A., Alfian, S. D., & Pradipta, I. S. (2023). Development and Validation of the Knowledge, Attitude, and Practice Questionnaire for Community Pharmacy Personnel in Tuberculosis Case Detection, Drug Monitoring, and Education: A Study from Indonesia. Infection and Drug Resistance, 16, 3729–3741. https://doi.org/10.2147/IDR.S409107
Khan, K. A., Aigerim, D., Xueqing, Z., Adil, A., Ghayas, S., Yasmeen, S., Khalid, K., & Tahir, A. (2021). Construction and Piloting of Attitude Towards Research Participation Scale for University Students. Psychology Research and Behavior Management, 14, 2071–2079. https://doi.org/10.2147/PRBM.S333450
Kitt, A., & Sanders, K. (2024). Imprinting in HR process research: a systematic review and integrative conceptual model. International Journal of Human Resource Management, 35(12), 2057–2100. https://doi.org/10.1080/09585192.2022.2131457
Koncar, P., Santos, T., Strohmaier, M., & Helic, D. (2022). On the application of the Two-Factor Theory to online employer reviews. Journal of Data, Information and Management, 4(1), 1–23. https://doi.org/10.1007/s42488-021-00061-3
Kubara, M., & Kopczewska, K. (2024). Akaike information criterion in choosing the optimal k-nearest neighbours of the spatial weight matrix. Spatial Economic Analysis, 19(1), 73–91. https://doi.org/10.1080/17421772.2023.2176539
Li, J., Zhang, L., Zhou, J., Wang, G., Zhang, R., Liu, J., Liu, S., Chen, Y., Yang, S., Yuan, Q., & Li, Y. (2022). Development and validation of self-management scale for tuberculosis patients. BMC Infectious Diseases, 22(1), 1–13. https://doi.org/10.1186/s12879-022-07483-3
Linderbaum, Beth A.; Levy, P. E. (2010). No TitleThe Development and Validation of the Feedback Orientation Scale (FOS). Journal of Management, 36(6), 1372–1405. https://doi.org/10.1177/0149206310373145
Lo Piccolo, E., Mariani, M. G., & Petruzziello, G. (2025). Italian Validation of the Feedback Orientation Scale: Psychometric Properties and Cultural Adaptation. Behavioral Sciences, 15(12). https://doi.org/10.3390/bs15121740
Mostafa, A. M. S., Wu, C. H., Yunus, S., Deng, H., & Zaharie, M. (2025). Perceived Abusive Supervision and Service Performance: An Attachment Theory Perspective. Human Performance, 38(2), 81–106. https://doi.org/10.1080/08959285.2025.2463647
Moullin, J. C., Sklar, M., Green, A., Dickson, K. S., Stadnick, N. A., Reeder, K., & Aarons, G. A. (2020). Advancing the pragmatic measurement of sustainment: a narrative review of measures. Implementation Science Communications, 1(1). https://doi.org/10.1186/s43058-020-00068-8
Muliadi, R., Jatnika, R., Hanami, Y., & Adishesa, M. S. (2025). Evaluation of an environmentally friendly behavior scale among Indonesian university students using the Rasch model. Acta Psychologica, 257(May), 105087. https://doi.org/10.1016/j.actpsy.2025.105087
Permana, M. Y. (2025). Working remotely in the city? Regional embeddedness of online platform workers in Indonesia’s secondary cities. Regional Studies, 59(1). https://doi.org/10.1080/00343404.2025.2506603
Perry, J. L., Temple, E. C., Worrell, F. C., Zivkovic, U., Mello, Z. R., Musil, B., Cole, J. C., & McKay, M. T. (2020). Different Version, Similar Result? A Critical Analysis of the Multiplicity of Shortened Versions of the Zimbardo Time Perspective Inventory. SAGE Open, 10(2). https://doi.org/10.1177/2158244020923351
Qian, Z., Yang, Y., Tan, J., Li, Y., Zhou, J., Huang, J., Assanangkornchai, S., & Chen, J. (2025). Psychometric Evaluation of the Chinese Version of the Mental Health System Responsiveness Questionnaire for Psychiatric Outpatients: Classical Test Theory and Item Response Theory Approaches. Patient Preference and Adherence , 19, 729–740. https://doi.org/10.2147/PPA.S503016
Rand, S., Towers, A. M., Allan, S., Webster, L., Palmer, S., Carroll, R., Gordon, A., Akdur, G., & Goodman, C. (2024). Exploratory factor analysis and Rasch analysis to assess the structural validity of the Adult Social Care Outcomes Toolkit Proxy version (ASCOT-Proxy) completed by care home staff. Quality of Life Research, 33(6), 1555–1567. https://doi.org/10.1007/s11136-024-03631-1
Shams, K., Steffensmeier, T. R., & Wefald, A. J. (2025). Bridging the Assessment Gaps: The Engaged Validation of Adaptive Leadership Behavior and Self-Awareness Scales. Journal of Leadership and Organizational Studies, 32(1), 49–70. https://doi.org/10.1177/15480518241296665
Singh, R., Chua, K. C., Pant, S. B., Paudel, R., Gautam, K., Luitel, N. P., Garman, E., Eleftheriou, G., Wahid, S. S., Kohrt, B. A., Jefferies, P., Jordans, M. J. D., & Lund, C. (2025). Translation and Adaptation of the Child and Youth Resilience Measure-Revised and Rugged Resilience Measure: A Mixed-Method Study Among Adolescents in Nepal. Child Psychiatry and Human Development. https://doi.org/10.1007/s10578-025-01944-x
Soemarko, D. S., Halim, F. A., Kekalih, A., Yunus, F., Werdhani, R. A., Sugiharto, A., Mansyur, M., Wingfield, T., & Fuady, A. (2023). Developing a tool to measure tuberculosis-related stigma in workplaces in Indonesia: An internal validation study. SSM - Population Health, 21(December 2022), 101337. https://doi.org/10.1016/j.ssmph.2023.101337
Suhandiah, S., Suhariadi, F., Yulianti, P., & Abbas, A. (2023). Autonomy and feedback on innovative work behavior: The role of resilience as a mediating factor in Indonesian Islamic banks. Cogent Business and Management, 10(1). https://doi.org/10.1080/23311975.2023.2178364
Tahernejad, A., Sohrabizadeh, S., Mehrabi, Y., & Mashhadi, A. (2025). Investigating the conceptual model of the formation of psychological resilience in farmers affected by droughts in Iran using structural equation modeling. BMC Public Health, 25(1). https://doi.org/10.1186/s12889-025-23098-0
Teig, C. J. P., Bond, M. J., Grotle, M., Kjøllesdal, M., Saga, S., Cvancarova, M. S., Engh, M. A. E., & Martini, A. (2023). A novel method for the translation and cross ‑ cultural adaptation of health ‑ related quality of life patient ‑ reported outcome measurements. Health and Quality of Life Outcomes, 1–10. https://doi.org/10.1186/s12955-023-02089-y
Teshome, D. F., Balcha, S. A., Ayele, T. A., Atnafu, A., & Gelaye, K. A. (2021). Development and psychometric validation of the hypertension beliefs assessment tool among adult population in northwest Ethiopia. Patient Preference and Adherence, 15, 2659–2671. https://doi.org/10.2147/PPA.S335070
Teshome, F., Birhanu, Z., & Kebede, Y. (2022). Development and validation of preconception care improvement scale (PCIS) in a resource-limited setting. BMC Pregnancy and Childbirth, 22(1), 1–12. https://doi.org/10.1186/s12884-021-04338-8
Wang, Z., Panaccio, A., Raja, U., Donia, M., Landry, G., Pereira, M. M., & Ferreira, M. C. (2022). Servant leadership and employee wellbeing: A crosscultural investigation of the moderated path model in Canada, Pakistan, China, the US, and Brazil. International Journal of Cross Cultural Management, 22(2), 301–325. https://doi.org/10.1177/14705958221112859
Wardiyanto, B., Setijaningrum, E., Samad, S., & Kandar, A. H. (2025). Mending the mismatch of minds and mandates: reimagining competency-centric public service delivery in Bojonegoro Regency, Indonesia. Cogent Business and Management, 12(1). https://doi.org/10.1080/23311975.2024.2442538
Weidlich, J., Fink, A., Frey, A., Jivet, I., Gombert, S., Menzel, L., Giorgashvili, T., Yau, J., & Drachsler, H. (2025). Highly informative feedback using learning analytics: how feedback literacy moderates student perceptions of feedback. International Journal of Educational Technology in Higher Education, 22(1). https://doi.org/10.1186/s41239-025-00539-9
Xu, J. (2021). Chinese University Students ’ L2 Writing Feedback Orientation and Self-Regulated Learning Writing Strategies in Online Teaching During COVID-19. The Asia-Pacific Education Researcher, 30(6), 563–574. https://doi.org/10.1007/s40299-021-00586-6
Yan, N., Batako, A., Czanner, G., & Zhang, A. (2025). Teacher Satisfaction in Online Education: A Two-Factor Model of Extrinsic and Intrinsic Factors Across Diverse Contexts. Technology, Knowledge and Learning, 30(2), 711–739. https://doi.org/10.1007/s10758-024-09799-2
Zhu, O. Y., Greene, D., & Dolnicar, S. (2024). Should the risk of social desirability bias in survey studies be assessed at the level of each pro-environmental behaviour? Tourism Management, 104(March), 104933. https://doi.org/10.1016/j.tourman.2024.104933
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Andry Yanti, Anjani Arum Safitri, Fitria Rahayu, Aneuke Yu’dzia M, Mutiara Vinanda, Deni Agung Wicaksono, Agung Wicaksono, Sofi Nurul, Christiany Suwartono
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
