Improvement of Individual Performance on Standardized Assessments Based on Identification of Difficult Areas

Improvement of Individual Performance on Standardized Assessments Based on Identification of Difficult Areas

Liyanage I.M Department of Software Engineering

Sri Lanka institute of information technology, Sri Lanka

Dr. Lakmal Rupasinghe Department of Cyber Security Sri Lanka institute of information technology, Sri Lanka

Shashiprabha T.A.S Department of Software Engineering

Sri Lanka institute of information technology, Sri Lanka

Abstract – The different learners have different capacity when they are studying. After a learner goes through the learning materials, the learner will be given to do a question paper of the subject that he intended to learn. The questions will be categorized into five levels considering the difficulty of the question and all the questions will be stored in a question bank. Afterwards, the system identifies what areas the user is weak by using their answer sheet. Answering pattern includes identifying the correct answers out of the questions given and the area the user is needed to study further. Then, the system identifies the percentages of the questions which need to be added in the next question paper. The mechanism behind creating the next question paper can be identified as users will be given more questions related to the areas which they performed less in previous paper. By continuously evaluating each learner, the average progress percentage each student will be calculated using machine learning algorithms. Also, by finding the correct answer percentage of each learner and the knowledge level of the subject are identified. Further, the instructors or the lecturers do not need to assess learners individually since the proposed system detect the answering style and the performance of each learner automatically. This indicates that a personalized evaluation mechanism will be carried out to evaluate each learners performance. This assists the learners to make self-study plan without giving any efforts.

Eventually, recommendations will be made to enhance learners knowledge in identified weak areas in learning. i.e. Suggest other learning resources (web sites, videos etc.).

Keywords – computerized adaptive testing; adaptive learning system.

through various ways such as reading, listening and watching. But they cant get the best knowledge as much as they expected. As their individual performance directly affects the success rate of learning, they must concern about their individual performance in each subject. To evaluate their performance against the efforts they put on their learning process, first they must understand their level of knowledge in each subject. Then the progress presentation can be obtained. To get an exact idea of the progress percentage, they must follow some evaluation methods to assess which can be either self-assessments or competency- based assessments.

To increase individual performance, use Computerized Adaptive Testing (CAT) system. then, the Computerized Adaptive Testing system provide a question papers and assess the students through the system. The questions are dividing into five different levels and add a weightage to considering level of difficulty.

1. INTRODUCTION

   Nowadays, the knowledge is the key to make everything success. Everyone starts their education since they are in mothers womb and it will never end. There is at least one thing to learn every day. When considering the learning process of a student, their learning styles are different. That said, the students gain their knowledge

   Table 1: Level of Difficulty of the questions

   Weight is added when a question is adding to the system by a tutor or a responsible person.

   Datasets

   In this model used two kinds of dataset fist one is the question dataset. It is used to generate question papers and the second one is five result answer datasets. which is used

   to calculate the average progress percentage using machine learning algorithms.

2. LITERATURE REVIEW

   There are many methods to support student studying. Several organizations provide systems to support their studying. but no one hasn't found learning progress percentage. In the literature review has found mostly used question bank and provide question papers. After, the system gave the correct answers count. further, the system gave correct answers to the incorrect answers. then learner can check the correct answers to the wrong answers.

3. METHODOLOGY

   In general, the adaptive learning system is composed of domain model, instruction model, adaptive model, student model and the user interface. In order to more effectively evaluate the learner's individual performance and supports the personalized learning, we integrate the computerized adaptive testing (CAT) module into an adaptive learning system. The novel architecture of CAT in the adaptive learning system is illustrated in figure 3. The computerized adaptive testing (CAT) the module includes a predefined question database. The basic principles of the system are described as follows: First of all, according to the domain model, teachers set up the question bank and determine the question parameters. Secondly, a student requests a question paper selecting a specific area, the system will fetch the questions from the database and generate a question paper and provide it to the student. after finished the question paper the student will submit the paper to the system. moreover, students get the question papers again and again based on identifying his wrong answers areas. The question papers are given until the correct number of questions exceeds 75%.the tutor can decide the percentage.

   Figure 1. Architecture of CAT in adaptive learning system

   1. Find Gradient of a Question Paper

      After completing the question paper, take the answer sheet. then get how long did it take for each question and how much weight is taken into for a question. Then we mark on a graph the allocated weight for a question for the x axis and the time taken for each question on the y axis.

      Then a straight line is drawn for the marked data using a machine learning algorithm. the two algorithms linear regression and support vector regression are used to draw the line.

      In this case, to select the best line, take the R-Squared value is higher and get the best line with that value. The gradient is obtained according to the line drawn at the end.

      What is required here is that the gradient should be less from a question paper to a question paper. which is that the time taken by the student to complete each question is less, which means that the student's progress on the new question paper is more than the progress of the old question paper. After the gradient, the question paper number and student information will be stored in the database

   2. Calculate Average Progress Percentage

   For calculate average learning progress at the begining learning progress of each question paper should be calculated. It is calculating by looking at how much the gradient of the second question paper different from the order of the first paper. The following formula is used to get the progress percentage.

   Average progress percentage can be obtained by the following formula. after finding the progress percentage of all the question papers.

   n = No of question papers

   Above formula, shows the addition of the progress percentage of all question papers and divide it to the number of question papers to get the average progress percentage.

4. RESULTS

After processing the data sets the results are shown below figure. to get the result used five-question answer sheets.

Figure 2. Average progress percentage

The above figure shows how the progress is changed by question paper to paper. the progress percentage has gone up and down. the average progress percentage shows in a red line it is 25.45% compared to the first question paper.

CONCLUSION

This research is focused on finding the progress of a student who is studying in ICT subject. but, this model can be applied to any subject to find their learning progress. using five datasets calculated the progress percentage. a student can know their percentage a particular subject which is he can know the progress of their hard work. also, this model helps to the teachers to know their student's progress.

REFERENCE

1. "Essentials: System Development Life Cycle [Guide]", Intellectsoft Blog, 2020. [Online]. Available: https://www.intellectsoft.net/blog/what-is-system-development-life- cycle/. [Accessed: 17- Feb- 2020].

2. "SDLC – Software Development Life Cycle – javatpoint", www.javatpoint.com, 2020. [Online]. Available: https://www.javatpoint.com/software-engineering-software- development-life-cycle. [Accessed: 17- Feb- 2020].

3. "What Are The Benefits of Planning a Project?", Activia Training, 2020. [Online]. Available: https://www.activia.co.uk/blog/what-are- the-benefits-of-planning-a-project. [Accessed: 17- Feb- 2020].

4. S. Chen and J. Zhang, "Ability Assessment Based on CAT in Adaptive Learning System", 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing, 2008. Available: https://ieeexplore.ieee.org/document/5070106?arnumber=5070106. [Accessed 17 February 2020].

5. M. Antal and S. Koncz, "Student modeling for a web-based self- assessment system", Expert Systems with Applications, vol. 38, no. 6, pp. 6492-6497, 2011. Available: https://www.sciencedirect.com/science/article/pii/S09574174100133

   45. [Accessed 17 February 2020].

6. J. Vaca, J. Agudo and M. Rico, "Adaptive Competence-Based System in an E-learning Platform: Adapting Support Tasks to Students", 2012 IEEE 12th International Conference on Advanced Learning Technologies, 2012. Available: https://www.researchgate.net/publication/244483454_Adaptive_Co mpetence-Based_System_in_an_E- learning_Platform_Adapting_Support_Tasks_to_Students. [Accessed 17 February 2020].

7. M. Comas-Lopez, P. Molins-Ruano, S. Atrio and G. Sacha, "Sequential adaptive tests to improve the assimilation of contents during learning", 2018 International Symposium on Computers in Education (SIIE), 2018. Available: https://ieeexplore.ieee.org/document/8586732. [Accessed 17 February 2020].

8. S. Jadhav, P. Jain, Y. Bhansali, S. Jain and D. Jain, "Adaptive and Automated Assessment System to Decide the Difficulty Level of Questions", 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA), 2018. Available: https://ieeexplore.ieee.org/abstract/document/8697433. [Accessed 17 February 2020].

9. "Insights to Agile Methodologies for Software Development", Hackernoon.com, 2020. [Online]. Available: https://hackernoon.com/a-case-study-type-insight-into-agile- methodologies-for-software-development-cd5932c6. [Accessed: 17- Feb- 2020].

10. "How to Write a Good Project Plan in 10 Steps | Project Management Guide", Teamgantt.com, 2020. [Online]. Available: https://www.teamgantt.com/guide-to-project-management/how-to- plan-a-project. [Accessed: 19- Feb- 2020].