Русская версия English version

Synthesis of control questions on learning outcomes using the axiom inversion method of subject knowledge model

E.R. Panteleev

Vestnik IGEU, 2025 issue 6, pp. 86—93

Download PDF

Abstract in English: 

Background. Development of control tests of learning outcomes requires creation of test question. The number of these questions should be sufficient for reliable knowledge assessment, and their content should comprehensively reflect knowledge in the subject area of control. Currently, methods of automatic question generation based on machine learning models and rational models of knowledge representation are used. Their application completely removes the quantitative component of the problem. However, machine learning models do not guarantee a holistic representation of knowledge, and rational ones, although they provide integrity, do not solve the problem of generating questions that control understanding of the simple rules necessary to obtain a given result.  The purpose of the study is to solve this problem.

Materials and methods. The rational model of subject knowledge is presented according to the web ontology language standard. This choice is justified due to wide use of the standard, the availability of accessible documentation and freely distributed applications, in particular, the Protégé ontology editor and the SWI Prolog programming environment, which declarative knowledge representation model is compatible with the web ontology model.

Results. A method for synthesizing control questions based on a model of subject knowledge has been developed. Synthesis is performed by inversion of axioms of the following form: “if the properties of an entity satisfy the constraints of an OWL class, it belongs to this class.” The result of the inversion is a question of the following form: “what constraints should the properties of an entity satisfy if it belongs to an OWL class?” Inversion is a feature of the method, which, unlike the known ones that generate questions for understanding the consequences of known causes, synthesizes questions for understanding the causes of a given consequence. The validity of results is confirmed by their comparison with the “axiom-consequence” pairs of the ontological model.

Conclusions. The method ensures control of understanding of the rules necessary to obtain a given solution using the axioms of OWL classes. It has been used to develop tests for engineering training courses. The use of a standard format for knowledge representation allows the method to be used for developing control questions in other subject domains.

 

References in English: 

1. Papasalouros, A., Chatzigiannakou, M. Semantic Web and Question Generation: An Overview of the State of the Art. International Association for Development of the Information Society, 2018.

2. Rakangor, S., Ghodasara, Y.R. Literature review of automatic question generation systems. International journal of scientific and research publications, 2015, vol. 5, no. 1, pp. 1–5.

3. Das, B., Majumder, M., Phadikar, S., Sekn, A.A. Automatic question generation and answer assessment: a survey. Research and Practice in Technology Enhanced Learning, 2021, vol. 16, no. 1, p. 5. DOI: http://dx.doi.org/10.1186/s41039-021-00151-1

4. Blšták, M., Rozinajová, V. Automatic question generation based on sentence structure analysis using machine learning approach. Natural Language Engineering, 2022, vol. 28, no. 4, рр. 487–517. DOI: http://dx.doi.org/10.1017/S1351324921000139

5. Zoumpatianos, K., Papasalouros, A., Kotis, K. Automated Transformation of SWRL Rules into Multiple-Choice Questions. FLAIRS, 2011.

6. Papasalouros, A., Kanaris, K., Kotis, K. Automatic Generation Of Multiple Choice Questions From Domain Ontologies. e-Learning, 2008, vol. 1, pp. 427–434.

7. Sergushicheva, A.P., Shvetsov, A.N. Metod postroeniya komp'yuternykh testiruyushchikh sistem dlya obucheniya v tekhnicheskom vuze [Method of constructing computer testing systems for training in a technical university]. Algoritmy, metody i sistemy obrabotki dannykh, 2005, no. 10, pp. 168–180.

8. Kruchinin, V.V., Morozova, Yu.V. Modeli generatorov voprosov dlya komp'yuternogo kontrolya znaniy [Models of question generators for computer-based knowledge control]. Otkrytoe i distantsionnoe obrazovanie, 2004, no. 2, pp. 52–62.

9. Li, V. Ontologicheskiy podkhod k avtomaticheskoy generatsii voprosov v intellektual'nykh obuchayushchikh sistemakh [Ontological approach to automatic question generation in intelligent learning systems]. Doklady Belorusskogo gosudarstvennogo universiteta informatiki i radioelektroniki, 2020, vol. 18, no. 5, pp. 44–52. DOI: http://dx.doi.org/10.35596/1729-7648-2020-18-5-44-52

10. Vinu, E.V., Kumar, P.S. Automated generation of assessment tests from domain ontologies. Semantic Web, 2015, vol. 8, no. 6, pp. 1023–1047.

11. Le, N.T. Using Semantic Web for Generating Questions: Do Different Populations Perceive Questions Differently? Transactions on Computational Collective Intelligence XVIII. Berlin, Heidelberg: Springer Berlin Heidelberg, 2015, pp. 1–19.

12. Studer, R., Benjamins, R., Fensel, D. Knowledge Engineering: Principles and methods. Data and knowledge engineering, 1998, vol. 25, pp. 161–197.

 

Key words in Russian: 
компьютерный контроль знаний, автоматическая генерация вопросов, онтология предметной области, аксиомы вывода, инверсия
Key words in English: 
computerized knowledge control, automatic question generation, subject domains ontology, inference axioms, inversion
The DOI index: 
10.17588/2072-2672.2025.6.086-093
Downloads count: 
10