Darya Glebova1, Pavel Degtyarev2 1 HSE University, 20 Myasnitskaya, Moscow 101000, Russian Federation
2 ECOPSY Consulting, 2 build. 1 Novodmitrovskaya Str., Moscow, Russian Federation This paper aims to develop a solution for content analysis automation for answers to openended questions in engagement studies. Responses to two open questions by more than 16,000 employees of five Russian companies were processed using a natural language processing method and a multilabel classification. The categories used for classification were obtained by building a co-occurrence matrixfrom the results of manual content analysis. The solution contains two separate models developed with supervised machine learning algorithms — random forest and gradient boosting. These model sautomate the content analysis process for answers to open questions in engagement studies with the accuracy of .86 and .70 respectively. Aggregated and potentially universal categories of engagement studies were identified, the categories being independent of the context of data collection. They also were compared with the engagement factors defined by other authors. Besides, the most important speech patterns (words and phrases) that predict to which of the categories a particular employee’s response would be assigned were named. The solution can be used by companies for benchmarking factors of engagement in different domain areas. Research opportunities for the categories as regards their possible internal relationship are discussed. Improvement of the tool is also considered, as well as adding topic modeling and sentiment analysis methods to refine its predictive power.

Citation: Glebova D., Degtyarev P. (2024) Universalizatsiya kategoriy i avtomatizatsiya protsessa kontent-analiza otvetov na otkrytye voprosy v issledovaniyakh vovlechennosti personala [The universalization of categories and process automation for content analysis in engagement surveys with open questions]. Organizational Psychology, vol. 14, no 2, pp. 80-111 (in Russian)

 Full text Кодировка UTF-8Кодировка WIN-1251Кодировка KOI8-R

BiBTeX

941837579.bibtex

RIS

941837579.ris