Journal of Human Resource Management

Journal of Human Resource Management

Designing Performance Evaluation Tools in Assessment Centers Using Cognitive Tools

Document Type : Original Article

Authors
1 Ph.D. Candidate, Department of Public Administration, Faculty of Management and Accounting, Qazvin Branch, Islamic Azad University, Qazvin, Iran.
2 Associate Prof., Department of Public Administration, Faculty of Management and Accounting, Qazvin Branch, Islamic Azad University, Qazvin, Iran.
3 Assistant Prof., Department of Public Administration, Faculty of Management and Accounting, Qazvin Branch, Islamic Azad University, Qazvin, Iran.
4 Prof., Department of Public Administration, Faculty of Management and Accounting, Qazvin Branch, Islamic Azad University, Qazvin, Iran.
10.22034/jhrs.2024.461105.2258
Abstract
Background & Purpose: Selection and evaluation of people and managers has always been one of the concerns of organizations. In recent years, the employment administrative organization of the country formulated a model to evaluate professional managers, but this model was encountered with weaknesses. Accordingly, the general goal of this research is to design a performance evaluation tool in evaluation centers using cognitive tools.
Methodology: This research is applied in terms of purpose and mixed in terms of approach. In this research, the meta-synthesis method was used. Therefore, the period from 2015 to 2023 was determined for the review of researches. The articles in this period were screened and confirmed using experts’ opinions and Glynn's evaluation tool. Among the 608 articles found, 50 articles were selected from scientific references such as Elsevier, Emerald, Springer, etc. The collected studies were analyzed using content analysis based on the seven-step method of Sandelowski and Russo (2007). The results of meta-synthesis method were evaluated and screened by experts using fuzzy Delphi technique. In this technique, the fuzzy triangle method was used to evaluate and analyze the experts’ opinions. Finally, using the results, the native model was prepared and developed.
Findings: The results of this research included six dimensions, 20 components, and 115 indicators. According to the findings, the identified dimensions included decision-making, cognitive abilities, cognitive processes, problem solving, and interactive and behavioral cognition.
Conclusion: The use of cognitive factors in evaluation centers can evaluate managers more accurately and provide a better understanding of their performance.
Keywords

Abedi Ardakani, M., Sarlak, M.A., Darvish, H. & Farati, H. (2022). Designing the model of employee competency development using the evaluation and development center. Human Capital Empowerment Journal, 5(1), 1-14. (in Persian)
Afrosheh, R. & Mehrani, R. (2015). Performance evaluation of concepts and perspectives. International conference on new researches in economic management and accounting.
(in Persian)
Akbari, M., Fayazi, M. & Jamshidi, H. (2015). Identifying and prioritizing complications of evaluation and development centers in Iran. Human Resource Management Research, 8(1), 103- 130. (in Persian)
Amador, L., Brañas-Garza, P., Espín, A.M., García, T. & Hernández, A. (2021). Cognitive abilities and risk-taking: Errors, not preferences. European Economic Review, 134, 103694.
Asadi, E. & Oreyzi, H. (2023). Designing exercises and tools of the assessment center based on the organization's competencies, the first national conference of the assessment center of Iran, Isfahan. (in Persian)
Bararti Ahmadabadi, H. & Oreyzi, H. (2021). The effect of cognitive and personality factors on drivers' risky behaviors. Traffic Management Studies, (60), 71-110. https://sid.ir/paper/955611/en (in Persian)
Barkova, Y.K., Selezneva, E. V. & Sinyagin, Y. V. (2021). The relationship between managerial potential and cognitive characteristics of managers at different levels. Administrative Consulting, (5).‌ DOI: 10.22394/1726-1139-2021-5-17-31
Berg, V. (2021). A game-based online tool to measure cognitive functions in students. International Journal of Serious Games, 8(1), 71-87.‌
Bian, Y., Lu, Y. & Li, J. (2022). Research on an Artificial Intelligence‐Based Professional Ability Evaluation System from the Perspective of Industry‐Education Integration. Scientific Programming, 2022(1), 4478115.
Bracken, D. W., Timmreck, C. W. & Church, A. H. (Eds.). (2001). The handbook of multisource feedback. San Francisco, CA: Jossey-Bass.
Campion, M. A., Fink, A. A., Ruggeberg, B. J., Carr, L., Phillips, G. M. & Odman, R. B. (2011). Doing competencies well: Best practices in competency modeling. Personnel Psychology, 64(1), 225-262.
Campion, M. A., Palmer, D. K. & Campion, J. E. (1997). A review of structure in the selection interview. Personnel Psychology, 50(3), 655- 702.
Carter, M. A. (2023). Equity in Employment Assessment: Addressing Biases for Better Hiring Practices. Human Resource Management Review, 33(1), 72-86.
Chams, N. & García-Blandón, J. (2019). On the importance of sustainable human resource management for the adoption of sustainable development goals. Resources, Conservation and Recycling, 141, 109-122.‌
Chernova, L.S., Zhuravel, A., Chernova, L., Chernov, S. & Trushliakova, A. (2022). Application of the Cognitive Approach in the Field of Project Management. DTESI.
Darvishi P. (2022). Identifying and prioritizing the effective factors on the evaluation of employee performance and social capital with the mediating role of environmental monitoring in the electric power distribution company of Khuzestan province. Scientific Journal of New Research Approaches in Management and Accounting, 5(17), 183- 206. (in Persian)
Das, B. K. & Rajini, G. (2023). Leadership development through 360-degree multi-rater feedback—An experience sharing of need, approach, roll-out, and the impact. Environment and Social Psychology, 9(2).‌
Dewey, J. (1938). Experience and Education. New York: Macmillan.
Domen, A.C., van de Weijer, S.C., Jaspers, M.W., Denys, D.A. & Nieman, D.H. (2019). The validation of a new online cognitive assessment tool: The MyCognition Quotient. International Journal of Methods in Psychiatric Research, 28(3), e1775.
Ejimabo, N. O. (2015). The influence of decision making in organizational leadership and management activities. Journal of Entrepreneurship & Organization Management, 4(2), 2222-2839. http://dx.doi.org/10.4172/2169-026X.1000138
Emadani, R., Rudgar Nezhad, F., Kiakeyjoori, D. & Taghi Pouryan, M.J. (2023). Providing a model for improving organizational behavior based on cognitive-behavioral components: A qualitative study. Shenakht Journal of Psychology and Psychiatry, 10(1), 128-138.
Eun, S. J., Kim, E. J. & Kim, J. Y. (2022). Development and evaluation of an artificial intelligence–based cognitive exercise game: A pilot study. Journal of Environmental and Public Health, 2022(1), 4403976. ‌
Fan, J., Bainbridge, W.A., Chamberlain, R. & Wammes, J.D. (2023). Drawing as a versatile cognitive tool. Nature Reviews Psychology, 2(9), 556-568.
Faragó, Á., Holmén, M., Holzmeister, F., Kirchler, M. & Razen, M. (2019). Cognitive Skills and Economic Preferences in the Fund Industry. The Economic Journal, 132(645), 1737-1764.
Fathi Vajargah, K., Mostafavi Montazeri, S. A., Khorasani, A. (2022). Identifying and modeling the challenges of effective use of the Development Center in Tehran Oil Refining Company. Strategic studies in the oil and energy industry, 13 (52), 59-80. (in Persian)
Fernyhough, C. & Borghi, A.M. (2023). Inner speech as language process and cognitive tool. Trends in Cognitive Sciences, 27, 1180-1193.
Ford, C.B., Kim, H.Y., Brown, L., Aber, J.L. & Sheridan, M.A. (2019). A cognitive assessment tool designed for data collection in the field in low- and middle-income countries. Research in Comparative and International Education, 14(1), 141-157.
Ghavamifar, A. & Hassanpoor, H. (2021). Identifying the Affecting Functions the Cognitive Performance of Strategic Managers. Journal of Human Resource Management, 11(2), 50-70. doi: 10.22034/jhrs.2021.281368.1666 (in Persian)
Gilbert, G. E. & Prion, S. (2016). Making sense of methods and measurement: Lawshe's content validity index. Clinical Simulation in Nursing, 12(12), 530-531.
Goleman, D. (1995). Emotional Intelligence: Why It Can Matter More Than IQ. New York: Bantam Books.
Gottfredson, L. S. (2003). The challenge and promise of cognitive career assessment. Journal of Career Assessment, 11(2), 115-135.‌
Grudinin, V. A. (2022). The interrelationship of cognitive and personal characteristics with the success of problem solving. ВЕСТНИК РГГУ, 120.‌
Habibi, A. & Afridi, Sanam (2023). Multi-indicator decision making, Tehran: Naron Publications. (in Persian)
Habibi, A., Jahantigh, F. F. & Sarafrazi, A. (2015). Fuzzy Delphi technique for forecasting and screening items. Asian Journal of Research in Business Economics and Management, 5(2), 130-143.
Hashem Khani, A., Shahrakipour, H. & Zalfaqari Zafarani, R. (2019). Designing a model for evaluating the cognitive ability of faculty members in universities in Tehran province. Bi-Quarterly Journal of Higher Education Curriculum Studies, 11(21), 291- 323. (in Persian)
Haupt, G. (2018). Hierarchical thinking: a cognitive tool for guiding coherent decision making in design problem solving. International Journal of Technology and Design Education, 28, 207-237.
Heikkinen, A. L., Hänninen, T., Kuikka, P., Akila, R., Savolainen, A., Valtonen, T., ... & Paajanen, T. (2023). The Cognitive Function at Work Questionnaire (CFWQ): A new scale for measuring cognitive complaints in occupational population. Applied Neuropsychology: Adult, 30( 6), 649-660.‌
Helfat, C. E. & Peteraf, M. A. (2015). Managerial cognitive capabilities and the microfoundations of dynamic capabilities. Strategic management journal, 36(6), 831-850.‏
Herrmann, W., Beckmann, J. F. & Kretzschmar, A. (2023). The role of learning in complex problem solving using MicroDYN. Intelligence, 100, 101773.
Hoffman, B. J., Kennedy, C. L., LoPilato, A. C., Monahan, E. L. & Lance, C. E. (2015). A review of the content, criterion-related, and construct-related validity of assessment center exercises. Journal of Applied Psychology, 100(4), 1143.‌
Hue, J. C. (2020). Multifaceted Approaches to Job Assessment: Enhancing Hiring Outcomes. International Journal of Selection and Assessment, 28(3), 241-254.
ISO 10015 (2019). Quality management — Guidelines for competence management and people development. International Standard
Jafari, S.Gh., Foroghipour, H. & Sabunuchi, R. (2019). Development of sports success model with emphasis on mental and psychological factors. Journal of the Faculty of Medicine of Mashhad University of Medical Sciences, 63(6), 3008-3020. (in Persian)
Jonassen, D.H. (1992). What are Cognitive Tools?. In: Kommers, P.A.M., Jonassen, D.H., Mayes, J.T., Ferreira, A. (eds) Cognitive Tools for Learning. NATO ASI Series, vol 81. Springer, Berlin, Heidelberg.
Kartini, D., Kristiawan, M., Fitria, H., Negeri, S. & Sugihan, M. (2020). The influence of principal’s leadership, academic supervision, and professional competence toward teachers’ performance. International Journal of Progressive Sciences and Technologies (IJPSAT), 20(1), 156-164.‌
Khalatbari, M. , yazdani, H. R. and Asgari, N. (2022). Meta-synthesizing of Practices and Results of Corporate Social Responsibility: A Human Resource Approach. Journal of Human Resource Management, 12(2), 1-24. doi: 10.22034/jhrs.2022.158889 (in Persian)
Khanifar, H., Ebrahimi, S., Seyfi, A. & Fayyazi, M. (2020). Designing a Model for the Competency of education Administrators for Use in the Evaluation Center. Journal of School Administration, 8(2), 118-139. SID. https://sid.ir/paper/401486/en (in Persian)
Khoshouei, M.S., Oreyzi, H. & Jahanbazi, A. (2018). Validation of Managers’ Promotional Assessment Center in Isfahan Gas Company. Knowledge & Research in Applied Psychology, 19(3), 33-48. Sid. Https://Sid.Ir/Paper/163720/En (in Persian)
Lamb, K. J. (2021). Soft Skills in Professional Assessment: Connecting Competencies to Success. Journal of Career Development, 48(4), 542-556.
Landis, J. R. & Koch, G. G. (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics, 33(1), 159- 174.
Lumsden, J., Edwards, E. A., Lawrence, N. S., Coyle, D. & Munafò, M. R. (2016). Gamification of cognitive assessment and cognitive training: a systematic review of applications and efficacy. JMIR serious games, 4(2), e5888.‏
Mechera-Ostrovsky, T., Heinke, S., Andraszewicz, S. & Rieskamp, J. (2022). Cognitive abilities affect decision errors but not risk preferences: A meta-analysis. Psychonomic Bulletin & Review, 29, 1719- 1750.
Mumford, M. D., Todd, E. M., Higgs, C. & McIntosh, T. (2017). Cognitive skills and leadership performance: The nine critical skills. The Leadership Quarterly, 28(1), 24- 39. ‌
Nejad Irani, F., Makhdoomi, H., Rahimi, G. & Hojati, S. (2020). Explaining and designing a performance appraisal model for the staff of Kurdistan University of Medical Sciences with a data theory approach. Research in Teaching, 8(4), 34-13. (in Persian)
Nikzaman, A. (2019). Psychological and Environmental Factors Affecting Information Encountering. Library and Information Science Research, 8(2), 339-354. doi: 10.22067/riis.v0i0.59631 (in Persian)
Noe, R. A. & Steffy, B. D. (1998). The Influence of Individual Characteristics and Assessment Center Evaluation on Career Exploration Behavior and Job Involvement, Journal of Vocational Behavior, 30(2), 187-202.
Oelkers, G. & Elsey, B. (2004). The'strategic magnifier'-a cognitive tool for strategic thinking. Problems and perspectives in management, (3), 196-209.Oppong, S. (2020). Towards a model of valued human cognitive abilities: An African perspective based on a systematic review. Frontiers in Psychology, 11, 538072.
Oreizy, H.R., Khoshouei, M.S. & Nouri, A. (2012). Assessment center and job analysis application in determination of managerial competencies. Biannual Journal of the Iranian Psychological Association,7(1), 85- 98. (in Persian)
Oreyzi, H.Z. & Asadi, E. (2017). Designing and Implementing Assessment Center of Strategic Thinking competency for Managers of the National Iranian Oil Refining & Distribution Company. Biannual Journal of the Iranian Psychological Association, 12(1), 53-62. (in Persian)
Pakdaman-Savoji, A., Nesbit, J.C. & Gajdamaschko, N. (2019). The conceptualisation of cognitive tools in learning and technology: A review. Australasian Journal of Educational Technology, 35(2).
Piaget, J. (1952). The Origins of Intelligence in Children. New York: International University Press.
Prihodko, A. (2018). Category of evaluation as the object of linguistics: prospects of communication aspects of study. Odessa linguistic journal, 11, 64-70.
Putra, M. R. & Gupron, G. (2020). Employee performance models: Competence, compensation and motivation (Human resources literature review study). Dinasti International Journal of Education Management And Social Science, 2(1), 185-198. ‌
Raffaelli, R., Glynn, M. A. & Tushman, M. (2019). Frame flexibility: The role of cognitive and emotional framing in innovation adoption by incumbent firms. Strategic Management Journal, 40(7), 1013-1039. https://doi.org/10.1002/smj.3011
Roozbeh, M. H., Mousakhani, M. & Rahmani, H. (2023). Key Competencies for Selection and Promotion of Professional Managers in the Assessment Centers: Based on Gamification Tools. Journal of Management Development Process, 36(1), 31-57. (in Persian)
Ross, D. R. (2022). “Big Data in Job Assessment: Shaping the Future of Employment Decisions”. International Journal of Human Resource Management, 33(4), 569-586.
Rudnev, E. (2022). Between the assessment centre and reality: how and why biographical psychology makes human resource management more effective. European Journal of Management and Business Economics, 31(2), 210-218.‌
Rybakova, L. V. (2023). Cognitive Management and its Importance in Modern Management Practice. Bulletin of Amur State University. Series: Natural and Economic Sciences, (101), 193-198.
Sadeghi, A., Zainali, Sh. & Foroughi, Z. (2019). The Effect of Cognitive Skills Training on the Performance and Cognitive Abilities of Children with Learning Disabilities. Journal of Learning Disabilities, 8(2 (29) ), 38-57. SID. https://sid.ir/paper/210234/en (in Persian)‌
Salem Qahfarkhi, A., Alikhah, S., Rostami, M. & Rezaei, S.R. (2019). Investigation of psychological factors effective in decision making. Shabak, 6(6), 199-208. (in Persian)
Sandelowski, M. & Barros, J. (2007). Handbook for synthesizing Qualitative Research. Springer Publishing Company Inc.
Sans Pinillos, A. (2023). Silence as a Cognitive Tool to Comprehend the Environment. Foundations of Science, 1-27.
Sarlak, M. A., Abedi Ardakani, M., Darvish, H. & Forati, H. (2022). Identifying indicators of staff competency development in the center of evaluation and development with an interpretive structural modeling approach. Interdisciplinary Studies on Strategic Knowledge, 5(20), 37-58. (in Persian)
Sehat, S., Dehghanan, H., Dehdashti Shahrokh, Z. & Karimkhani, L. (2023). Introducing a Molel of Multi-level Performance Appraisal of Health Centers: A Meta-Synthesizing Approach. Journal of Human Resource Management, 13(3), 131-165. doi: 10.22034/jhrs.2023.184124  (in Persian)
Shadpour, S., Shafqat, A., Toy, S., Jing, Z., Attwood, K., Moussavi, Z. & Shafiei, S. B. (2023). Developing cognitive workload and performance evaluation models using functional brain network analysis. NPJ Aging., 9(1).Shevchenko, G., Shumeiko, O. & Bilozubenko, V. (2021). Capabilities of Data Mining As a Cognitive Tool: Methodological Aspects.
Shokri, O., Tamizi, N., Azad Abdollahpour, M. & Mohsen Khodami, M. (2016). Psychometric Analysis of the ‘Stress Appraisal Measure-Revised’ among University Students . Advances in Cognitive Sciences, 18 (2), 1-11. (in Persian)
Skagerlund, K., Forsblad, M., Tinghög, G. & Västfjäll, D. (2022). Decision-making competence and cognitive abilities: Which abilities matter? Journal of Behavioral Decision Making, 35(1), e2242.‌
Sommers, K. N. (2023). Post-Integration Effects of Behavioral Interview Techniques in the Resident Assistant Selection Process (Doctoral dissertation, Marshall University).
Speer, A. B., Christiansen, N. & Honts, C. (2015). Assessment of personality through behavioral observations in work simulations. Personnel Assessment and Decisions, 1(1), 6. ‌
Sun, S. (2011). Meta-analysis of Cohen’s kappa. Health Services and Outcomes Research Methodology, 11, 145-163.‌
Thornton, G. C. & Rupp, D. E. (2006). Assessment centers in human resource management: Strategies for prediction, diagnosis, and development. Mahwah, NJ: Lawrence Erlbaum Associates. New York. https://doi.org/10.4324/9781410617170
Tishchenko, N. A. & Luchinkina, I. S. (2022). Study of cognitive characteristics in employees of small businesses: standardization of the method. Scientific result. Pedagogy and educational psychology, 8(3), 120-127.‌
Tong, T., Li, H. & Greiff, S. (2019). Human capital and leadership: the impact of cognitive and noncognitive abilities. Applied economics, 51(53), 5741- 5752.‌
Troth, A.C., Townsend, K., Loudoun, R. & Burgess, M. (2022). Frontline managers’ task-related emotion regulation, emotional intelligence, and daily stress. Australian Journal of Management, 48, 108-129.
Uvarova, I.A. (2022). Features of value-motivational and cognitive components of readiness-for-change competence in managers. Bulletin of Krasnoyarsk State Pedagogical University named after V.P. Astafiev.
Wang, X. H. F., Kim, T. Y. & Lee, D. R. (2016). Cognitive diversity and team creativity: Effects of team intrinsic motivation and transformational leadership. Journal of business research, 69(9), 3231-3239. https://doi.org/10.1016/j.jbusres.2016.02.026
Wolff, J. (2004). Meaning in the Sciences: An Interdisciplinary Perspective. Brill.
Wood, J. (2022). Psychometric Testing in Career Assessment: Bridging Theory and Practice. Journal of Business and Psychology, 37(2), 345-362.
Yarahmadi Khorasani, M., Naseri, N. S. & Fariborzi, E. (2022). Designing a Model of Center for Evaluation and Development of Managers' Competencies to Achieve the Desired System of Organizational Performance Improvement: A Qualitative Approach. Transformation Management Journal, 13(2), 125-156. doi: 10.22067/tmj.2021.67290.0 (in Persian)
Zebua, S. & Chakim, M. H. R. (2023). Effect of Human Resources Quality, Performance Evaluation, and Incentives on Employee Productivity at Raharja High School. APTISI Transactions on Management, 7(1), 1-7.
Volume 14, Issue 4
Autumn 2024
Pages 33-62

  • Receive Date 11 August 2024
  • Revise Date 06 December 2024
  • Accept Date 15 December 2024