Exam Assessor Tool: An Automated System for Efficient Answer Sheet Evaluation

Vaibhav Shikhar Singh

Department of Computer Science, ASET, Amity University Uttar Pradesh, Lucknow Campus, India.

Avni Verma

Department of Computer Science, ASET, Amity University Uttar Pradesh, Lucknow Campus, India.

Garima Srivastava *

Department of Computer Science, ASET, Amity University Uttar Pradesh, Lucknow Campus, India.

Sachin Kumar

Department of Computer Science, ASET, Amity University Uttar Pradesh, Lucknow Campus, India.

*Author to whom correspondence should be addressed.


Abstract

With Education 4.0 and four quadrant approach number of innovations have gone into academics for efficient, experiential, and outcome-based education however assessment schemes are still very much dependent on manual assessment methods which are time-consuming and cumbersome. The grading system can sometimes be irrational, with diversified schemes for the same course and can also be biased. Covid 19 pandemic caused a global economic avalanche like we’ve never experienced in our lifetime. Many countries have implemented control measures such as blockades and curfews. The education system in this chaos saw a silver lining with academics shifting to online mode, with paradigm shift in teaching, assessment techniques too need to evolve. Work done is an effort to ease the process of assessment, a machine learning assisted model is developed that automates subjective answer evaluation in the education sector. Our project involved several crucial steps, including grayscale conversion, Natural Language Processing (NLP) for data cleansing, data splitting, and training an artificial neural network (ANN) to predict scores based on extracted features. ANN-based system grades subjective responses without human intervention, reducing the workload of teachers and professors. Model constructed an ANN architecture with three layers using Rectified Linear Activation Unit (ReLU) and Sigmoid activation functions. Trained model was incorporated into a user-friendly web application using the Streamlit library. Model design gives a major boost in grading efficiency and accuracy while providing valuable feedback to students. Research surveys were conducted, and a dataset was constructed for training and testing the model. study yielded an accuracy of 83.14% after employing techniques such as text cleaning, preprocessing, and feature extraction.

Keywords: Automated evaluation, handwritten answers, deep learning, natural language processing, subjective answer evaluation, artificial neural networks


How to Cite

Singh , V. S., Verma , A., Srivastava , G., & Kumar , S. (2024). Exam Assessor Tool: An Automated System for Efficient Answer Sheet Evaluation. Asian Journal of Research in Computer Science, 17(6), 36–57. https://doi.org/10.9734/ajrcos/2024/v17i6455

Downloads

Download data is not yet available.

References

Sultan MA, Salazar C, Sumner T, Fast and Easy Short Answer Grading with High Accuracy. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Austin, Texas. 2016;1565-1570.

Bonthu S, Sree SR, Krishna Prasad MHM, Automated short answer grading using deep learning: a survey. International Journal of Engineering & Technology. 2018;7(4):121-127.

Singh B, Kapoor J, Nagpure SM, Kolhatkar SS, Chanore PG, Vishwakarma MM, Kokate RB. An Analysis of Automated Answer Evaluation Systems based on Machine Learning. In: Proceedings of the 3rd International Conference on Intelligent Computing and Control Systems, Madurai, India. 2019;696-702.

Burstein J, Leacock C, Swartz R. Automated Evaluation of Essays and Short Answers. In: Proceedings of the 15th International Conference on Artificial Intelligence in Education, Springer, Amsterdam. 2011;21-28.

Johri E, Dedhia N, Bohra K, Chandak P, Adhikari H, ASSESS - Automated subjective answer evaluation using Semantic Learning. In: Proceedings of the 2020 International Conference on Machine Learning and Data Science, ACM, New York, NY. 2020;147-153.

Dhokrat A, Hanumant GR, Mahender CN. Automated Answering for Subjective Examination." In: Proceedings of the 2018 International Conference on Computing, Communication and Security, IEEE, Pune, India. 2018;143-147.

Sanuvala G, Fatima SS. A study of automated evaluation of student's examination paper using Machine Learning Techniques. International Journal of Computer Science and Information Security. 2018;16(5):13-20.

Dumal PAA, Shanika WKD, Pathinayake SAD, Sandanayake TC. Adaptive and Automated Online Assessment Evaluation System." In: Proceedings of the 2017 International Conference on Advances in Computing, Communications and Informatics, IEEE, Udupi, India. 2017;301-306.

Rowtula V, Oota SR, Jawahar CV. Towards Automated Evaluation of Handwritten Assessments. In: Proceedings of the. International Conference on Computer Vision and Image Processing, Springer, Singapore. 2019;179-184.

Rahman MA, Mahmud H. Automated Evaluation of Handwritten Answer Script Using Deep Learning Approach. In: Proceedings of the International Conference on Data Science and Information Technology, ACM, New York, NY. 2020;109-115.

Rahman MM, Akter F. An Automated Approach for Answer Script Evaluation Using Natural Language Processing. In: Proceedings of the 2018 2nd International Conference on Computer and Communication Systems IEEE, Nagoya, Japan. 2018;382-386.

Kumar C, Sunil RJ. Rama Sree. Assessment of performance of various machine learning algorithms during automated evaluation of descriptive answers” ICTACT Journal on Soft Computing: Special Issue on Soft Computing in System Analysis, Decision and Control. 2014;04:04.

Durmus E, He H, Diab M. FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019;6254–6264.

Loukina A, Zechner K, Bruno J, Klebanov BB. Using exemplar responses for training and evaluating automated speech scoring systems. Proceedings of the Ninth Workshop on Innovative Use of NLP for Building Educational Applications. 2014; 163–170.

Kundal R, Parekh B. Automated Assessment and Grading System for Short Answers. In 2018 3rd International Conference on Computational Systems and Information Technology for Sustainable Solutions (CSITSS). 2018; 132-136.

Blessing G, Azeta A, Misra S, Chigozie F, Ahuja R. A Machine Learning Prediction of Automatic Text Based Assessment for Open and Distance Learning: A Review. In 2019 4th International Conference on Communication System, Computing and IT Applications (CSCITA). 2019;1-5.

George N, PJ S, Varghese SM. Grading Descriptive Answer Scripts Using Deep Learning. In 2018 2nd International Conference on Inventive Communication and Computational Technologies (ICICCT). 2018;646-650.

Shashavali D, Vishwjeet V, Kumar R, Mathur G, Nihal N, Mukherjee S, Patil SV. Sentence Similarity Techniques for Short vs Variable Length Text using Word Embeddings. In 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon). 2019;1-5.

Brill E, Lin J, Banko M, Dumais S, Ng A. Data- Intensive Question Answering. In Proceedings of the tenth international conference on World Wide Web (WWW). 2002;366-375.

Gupta P, Gupta V. A Survey of Text Question Answering Techniques. In 2018 3rd International Conference on Computational Systems and Information Technology for Sustainable Solutions (CSITSS). 2018;295-299.

Samadi N, Ravana SD. Xml Clustering Framework Based on Document Content and Structure in a Heterogeneous Digital Library. Malaysian Journal of Computer Science. 2023;36(2):124–147. Available:https://doi.org/10.22452/mjcs.vol36no2.2

Kaur W, Balakrishnan V, Wong KS. Improving Multi-Label Text Classification Using Weighted Information Gain and Co-Trained Multinomial Naïve Bayes Classifier. Malaysian Journal of Computer Science, 35(1), 21–36. (2023). Available:https://doi.org/10.22452/mjcs.vol35no1.2

Das, Bidyut, Mukta Majumder, Arif Ahmed Sekh, and Santanu Phadikar. Automatic question generation and answer assessment for subjective examination. Cognitive Systems Research 2022;72:14-22.