Thematic analysis of students' lived experiences of online tests in the context of a SHAD network

Authors
Islamic Azad University, Sanandaj branch
Abstract
The aim of this study was to identify students' lived experiences of online tests in a SHAD network. The nature of this research was qualitatively phenomenological. Accordingly, the researchers in the present study tried to analyze the students' experience of online tests in the context of a SHAD network. The research field consisted of all first grade high school students in Sanandaj. Participants included girl and boy students in districts one and two of Sanandaj city, amounting to 112 junior high school students. The data of the present study were collected through semi-structured interviews individually and online. The available data were analyzed using the crystallization method. From the analysis of the obtained data including 15 organizing themes including positive attitude; Negative attitude; To be neutral; Software and hardware problems and support; Causing stress and anxiety; Low level learning; Creating opportunities for widespread fraud; Testing skills, variety of questions and easy review; Low score credit validity; Face-to-face preference online; Lack of student observation; Whenever and wherever the online test is; New and sometimes not so good experiences; Safeguarding against endangering health and preventing the formation of equal and healthy competition. In general, the results of the present study emphasize the need to identify the disadvantages and advantages of online exams, the need for culture building, empowering teachers and students in cyberspace and reviewing the method of conducting online exams and learning and improving students' academic performance through online exams.
Keywords

Abbasi, F., Hejazi, E., & Hakimzadeh, R. (2021). The lived experience of elementary school teachers of the opportunities and challenges of teaching in the student education network (Shad): a phenomenological study. Scientific Quarterly of Teaching Research, 3 (18), 1-24.[Persian ].
Abbasi, F., Hijaz, G., & Hakim Zadeh, R. (2020). Experience living elementary school teachers the opportunities and challenges of teaching in educational network of students (Shad): a phenomenological study. Teaching research, 8(3), 20-40.[Persian ].
Abbasi Kesani, H., Shams Morkani, Gh., Seraji, F., & Rezaeizadeh, M. (2018). Learners evaluation tools in e-learning environment. Journal of Technology Development, 61, 23 -33.[Persian ].
Abdoli, S., & Mohammad Hassani, N. (2015). Synthesis research of components, tools and methods used in e-learning evaluation. Provide a comprehensive model for e-learning evaluation. Educational Measurement and Evaluation Studies, 9, 153-172.[Persian ].
Abu al-Ma'ali al-Husseini, K. (2020). Psychological and educational consequences of coronary heart disease in students and strategies to deal with them. Journal of Educational Psychology, Allameh Tabatabai University, 15, 153-166. [Persian ].
Akcay, A O., Guven, U., & Karahan, E. (2021). The Views of Pre-Service Elementary Teachers About Online and Traditional Peer Assessment. International Journal of Assessment Tools in Education, 8(2), 409–422.
Elzainy, A., El Sadik, A., & Al Abdulmonem, A .(2020). Experience of e-learning and online assessment during the COVID-19 pandemic at the College of Medicine, Qassim University, Journal of Taibah University Medical Sciences, 15(6),456-462.
Alderson, J. C., & Wall, D. (1993). Does washback exist?. Applied Linguistics, 14(2), 115–129.https://doi.org/10.1093/applin/14.2.115.
Amin Khandaghi, M., & Baghani, M. (2018). Evaluation of learners in e-learning environment with a review of GPAM-WATA model Fifth National Conference and Second International Conference on E-Learning, Tehran. [Persian ]. https://civilica.com/doc/111601/.
Anger, C., & Plünnecke, A. (2020). Schulische Bildung zu Zeiten der CoronaKrise [School education in times of the coronavirus crisis]. Perspektiven der Wirtschaftspolitik, 21 (4), 353–360. doi:10.1515/pwp-2020-0055
Anwar, A., Seger, C., Tollefson, A., Diachun, CAB., Tanaka, P., & Umar, S. (2020) Medical education in the COVID-19. era: Impact on anesthesiology trainees. Journal of Clinical Anesthesia 66109949.https://doi.org/10.1016/j.jclinane.2020.109949
Appiah, M., & Van Tonder, F. (2018). E-Assessment in Higher Education: A Review. International Journal of Business Management & Economic Research, 9(6), 1454- 1460.
Aref, H., Boladi, H., & Beigi, V. (2015). The Phenomenology of the Dismissal Experience. Quarterly Journal of Public Management, 3, 594-573.[Persian ].
Arnold, L., & Sinha, G. (2018). Classroom instruction results in better exam performance than online instruction in a hybrid course. The Journal of General Psychology.145(4). 362-376.
Asgari, M., & Goya, Z. (2012). Philosophy of Smart Schools in Malaysia. Growth of Mathematics Education, 2, 12-19. [Persian ].
Azmi, F. M., & Kankarej, M. M. (2015). The role of formative assessment in teaching mathematics. In Proceedings of the 4th International Conference for e-learning and Distance Education, Riyadh, Saudi Arabia.
Bailey, K. M. (1996). Working for washback: A review of the washback concept in languagetesting. LanguageTesting, 13(3),257–279.
Baleni, Z. G. (2015). Online Formative Assessment in Higher Education: Its Pros and Cons. Electronic Journal of e-Learning, 13(4), 228-236.
Barry, N., Announcement, F., Rezaeizadeh, M., & Khorasani, A. (2019). Evaluate the goals of higher levels of learning in e-learning environments (standards and indicators). Scientific Journal of Education and Evaluation, 45, 132-111. [Persian ].
Behrangi, M.R. (2002). Supervision in management, Tehran: Kamal Tarbiat. [Persian ].
Benson, R., & Brack, C. (2010). Online learning and assessment in higher education; A planningguide. Chandos Publishing.
Boyle, P., Pettigrove, M., & Atkinson, C. (2001). Australian national university student evaluation of teaching ANUSET: a guide for academic staff. 3rd ed. Canberra: Australian National University.
Butler-Henderson, K., & Crawford, J. (2020). A systematic review of online examinations: A pedagogical innovation for scalable authentication and integrity. Computers and Education, 159, 104024. https://doi.org/10.1016/j.compedu.2020.104024
Cassady, J. C. (2004). The influence of cognitive test anxiety across the learningtesting cycle.Learning and instraction 14(6), 569-592.
Cassady, J. C., & Gridley, B. E. (2005). The Effects of online formative and summative assessment on test anxiety and performance. The Journal of Technology, Learning and Assessment, 4(1), 31.
Cheng, L., Rogers,T., & Hu, H., (2004). ESL/EFL instructors’ classroom assessment practices:purposes, methods, and procedures. Language Testing, 21(3), 360-389
Colaizzi, P. F. (1969). The descriptive methods and the types of subject-matter of a phenomenologically based psychology exemplified by the phenomenon of learning (Doctoral dissertation, ProQuest Information & Learning).
Crisp, G. (2011). Teacher’s handbook on e-Assessment: A handbook to support teachers in using e- assessment to improve and evidence student learning and outcomes. San Francisco, California: Creative Commons.
Daffin, Jr., L.W., & Jones, A.A. (2018). Comparing student performance on proctored andnon-proctored exams in online psychology courses. Online Learning, 22(1), 131-145.doi:10.24059/olj.v22i1.1079
Dendir, S., & Stockton Maxwell, R. (2020). Cheating in online courses: Evidence from online proctoring. Computers in Human Behaviour Reports, 2, https://doi.org/10.1016/j.chbr.2020.100033 .
Durrani, K, Hamza., Qalavandi, H., Karamdoost, N., & Robati M. (2014). Assessing the current situation of smart schools in Mazandaran province based on the conceptual model of smart school development. The Future of Medical Education, 3, 47-39. [Persian ].
David, E., & Astutik I. I .(2021). Web Based Online Exam Application for Junior High School. DOI:10.21070/pels.v1i2.1000
Dwivedi, Y. K., Rana, N. P., Jeyaraj, A., Clement, M., & Williams, M. D. (2019). Re-examining the unified theory of acceptance and use of technology (UTAUT): Towards a revised theoretical model. Information Systems Frontiers. 21,719–734.
Ebrahimpour, M., & Sobhaninejad, M. (2015). Assessing the current and desirable status of the virtual university curriculum from the students' point of view. Journal of Shahed University, 7, 89-106. [Persian ].
Erdemir, M. (2021). Preservice Teachers' Views on Online Assessment. i-manager's Journalof Educational Technology, 18(3), 42-53. https://doi.org/10.26634/jet.18.3.18261
Farrell, T., & Rushby, N. (2016). Assessment and learning technologies: An overview. British Journal of Educational Technology, 47(1), 106-120. https://doi.org/ 10.1111/bjet.12348
Fitriyah, I., & Jannah, M. (2021). Online Assessment Effect in EFL Classroom: An Investigation on Students and Teachers’ Perceptions. Indonesian Journal of English Language Teaching and Applied Linguistics, 5(2),265-284.
Goran, Sh., Salehi, K., & Javadipour, M. (2018). Representation of elementary teachers' life experiences of changes in the assessment system and its role in the teaching-learning process: A phenomenological study. Research in Teacher Training, 4, 135-163. [Persian ].
Ha, N. T. T. (2019). A Literature Review of Washback Effects of Assessment on Language Learning. Journal of Science Ho Chi Minh City Open University, 9(5), 3–15.
Haji, J., Mohammadi Mehr, M., & Mohammad Azar, H. (2021). Representing the Problems of Education in Cyberspace Using a Shad Program in the Corona Pandemic Course A Phenomenological Study. Information and Communication Technology Quarterly in Educational Sciences, 11 (3) ,153_174. [Persian ].
Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The Difference between Emergency Remote Teaching and Online Learning, EDUCAUSE Review. March27https://er.educause.edu/articles/2020/3/.
Howarth, P. (2015). The opportunities and challenges faced in utilizing e-Based assessment.http://www.educationalrc.org/oldconf/old/pdf/Paul%20Howarth%20-%20Beirut%20Presentation.
Huber, S. G., Günther, P. S., Schneider, N., Helm, C., Schwander, M., Schneider, J. A., et al. (2020). COVID-19 und aktuelle Herausforderungen in Schule und Bildung [COVID-19 and the current challenges in education]. Münster, Germany: Waxmann. doi:10.31244/9783830942160.
JISC (Joint Information Systems Committee). (2004). Effective practice with e-learning: A good practice guideindesigningforlearning.http://webarchive.nationalarchives.gov.uk/20140702233839/http:/www.jisc.ac.uk/media/documents/publications/
Khaled, M. H., & Patrick ,M. (2021). The effect of online quizzes in improving physical therapy students’ exam scores in a pharmacology course. Physical Therapy Reviews, 27(1), 68-72.
Khoshkhalq, I., & Islamieh, M.M. (2007). Develop a model to provide qualitative feedback in the evaluation of academic achievement. Educational innovations, 5 (18), 57-78. [Persian ].
Kampen, M. (2020). The 6 type of assessments. https://www.prodigygame.com/main-en/blog/types-of-assessment
Karimian, J. (2020). Assessing the quality of virtual distance education in the 99-98 academic year. Tehran: Center for Strategic Studies of the Presidency. [Persian ].
Kazemi Jafarloo, N., Parnian, A., Hadizadeh, M, H., & Jamalianzadeh, B. (2021). Investigating the Opportunities and Challenges of Teaching in the Student (Shad) Educational Network from the Perspective of Elementary Teachers. Twelfth National Conference on Psychology, Educational and Social Sciences, Babol, https://civilica.com/doc/1253002. .[Persian ].
Keppell, M., Kitoi, E. A., & Wing, A.M.W. (2006). Authentic Online Assessment: Three Case Studies in Teacher Education. In S. Howell., M. Hricko.On line Assessment and Measurement: Case Studies from Higher Education, k-12 and Corporate. London: Information Science Publishing
Ketuki, A. (2016). Investigating the obstacles to achieving the goals of descriptive evaluation from the perspective of primary school teachers in Bandar-e-Turkmen. Shahid Chamran Campus, Tehran.[Persian ].
Khlaif, Z. N., Salha, S., Fareed, S., & Rashed, H. (2021). The Hidden Shadow of Coronavirus on Education in Developing Countries. Online Learning, 25 (1), 269–285. doi:10.24059/olj.v25i1.2287
Khalifa, QH., & Razavi, S. A. (2012). Evaluation and quality assurance in e-learning using significance-performance analysis model. University Journal of E-Learning (Media) Department of Educational Sciences, Faculty of Educational Sciences and Psychology, Shahid Chamran University, Ahvaz, Iran, 1, 33-44. [Persian ].
Kidd, w., & Murray, j. (2020). The Covid-19 pandemic and its effects on teacher education in England: how teacher educators moved practicum learning online. European Journal of Teacher Education, 43, 542-558.
Kossingou, . G. M., Dégboé B. M., Kokou Gaglo, S., & Ouya, G. Mendy. (2021). Sharing of experience in the organization of distance exams within African universities in the context of Covid-19: case of the Central School of Free Software and Telecommunications of Dakar. IEEE Global Engineering Education Conference… DOI: 10.1109/EDUCON46332.2021.9453847
Kurdloo, M. (2020). Practical evaluation solutions in Shad Network. Educational Technology Development, 43, 1.[Persian ].
Lubis, M., Ariffin, S., Muhamad, T., Ibrahim, L., & Weke, I. (2010). The Integration of ICT in the Teaching and Learning Processes: A Study on Smart School of Malaysia. Proceedings of the 5th WSEAS/IASME International Conference on educational Technologies (EDUTE' 09).
Mahjoub Ishratabadi, H., Vosoughi Nairi, A., Qaroneh, D., & Mehri, Dariush. (2014). Reviewing the evaluation criteria of e-learning quality in organizational training and providing a framework for evaluating this type of training. Third Conference on Organizational Education Pathology with an Approach Based on Organizational Experiences. .[Persian ].
McKeown, P., & Maclean, G. (2012). Is activity in online quizzes correlated with higher exam marks?. Innovation in Teaching Undergraduate Economics, 47(3), 276-287.
Mirzaei, V., Rahimnia, F., Mortazavi, S., & Shirazi, A. (2018). Nurses' organizational pessimism: A phenomenological study of phenomenology. Journal of Qualitative Research in Health Sciences, 1, 88-102. [Persian ].
Mohamadi, Z. (2018). Comparative effect of online summative and formative assessment on EFL student writing ability. Studies in Educational Evaluation, 59,29–40.[Persian ].
Mohammadi, M., Keshavarzi, F., Naseri Jahromi, R., Naseri Jahromi, R., Hesampour, Z., Mirghafari, F., & Ebrahimi Sh. (2020). Analysis of the experiences of parents of elementary school students from the challenges of elearning with social networks during the outbreak of Corona virus. Educational Research,8 (40), 74-101.[Persian ].
Mohammadifar, M A., Najafi Samad Razmara, M., & Mohammadzadeh, A. (2010). The effect of descriptive and traditional evaluations on academic achievement and exam anxiety of second grade elementary students in Tehran. Educational Psychology, 20, 33-49. [Persian ].
Naranji Thani, F., Pourkarimi, J., & Hejazi, S. (2020). Identifying the evaluation components of the e-learning system in the University of Tehran. Scientific Journal of Education Technology, 2 (15).
Obasa, A. I., Eludire, A. A., & Ajao, T. A. (2013). A comparative study of synchronous and asynchronous e-learning resources. International Journal of Innovative Research inScience, Engineering and Technology, 2(11), 5938–5946.
Özenç, M., & Çakır, M. (2015). Sınıf öğretmenlerinin alternatif ölçme ve değerlendirme
yeterliklerinin belirlenmesi [Exploring primary school teachers’ competencies of
alternative assessment and evaluation]. Elementary Education Online, 14(3), 914-933.
Polkinghorne, D. (1983). Methodology for the human sciences: Systems of inquiry. Albany. NY: State University.
Rahman, A. (2018). Building autonomous learners in English as a foreign language (EFL)Classroom. Proceedings of the International Conference on Education in Muslim Society(ICEMS 2017). International Conference on Education in Muslim Society (ICEMS 2017),Banten, Indonesia. https://doi.org/10.2991/icems-17.2018.44
Rarkryan, P. A. (2020). Challenges of home learning during a pandemic through the eyes of a student. Retrieved from https://www. thejakartapost.com/ life /2020/04/11/challenges-of-home-learningduring-a-pandemic-through-the-eyes-of-a-student.html
Rezaei, A. (2020). Evaluating what students have learned during the Corona: Challenges and solutions. Journal of Educational Psychology, 55, 179-214.[Persian ].
Richardson , S. (2021). Mathematics assessment integrity during lockdown: experiences in running online un-invigilated exams. International Journal of Mathematical Education in Science and Technology. 53(3) 662-672.
Safania, P., Safania, A., & Ariadoost, H. (2020). Investigating the educational and physiological structures of the corona crisis in the sports industry. Educational Psychology, 56, 91-99.[Persian ].
Saif Naraghi, M., & Naderi, E. (2016). Specific learning disabilities and how to diagnose and rehabilitation methods. Tehran: Makial.[Persian ] .
Salehi, K., Bazargan, A., Sadeghi., & Shokoohi Yekta, M. (2015). Phenomenological analysis of elementary school teachers' perceptions and lived experiences of the strengths and weaknesses of the descriptive evaluation program. Journal of Research in Educational Systems, 9, 19-68.[Persian ].
Samari, I., & Atashk, M. (2009). The effect of knowledge and application of educational technology by teachers in improving the quality of students' learning process. Journal of Education Technology, 2, 101-111. [Persian ].
Seraji, F. (2014). Evaluation in cyberspace. Curriculum and Information and Communication Technology. Iranian Curriculum Encyclopedia, 9, 1-5. [Persian ].
Sepúlveda-Escobar, P., & Morrison, A. (2020). Online teaching placement during the COVID-19 pandemic in Chile: Challenges. The European Journal of Teacher Education. http://www.tandfonline.com/10.1080/02619768.2020.1820981
Schneider, R., Sachse, KA., Schipolowski, S., & Enke, F. (2021). Teaching in Times of COVID-19: The Evaluation of Distance Teaching in Elementary and Secondary Schools in Germany. doi: 10.3389/feduc.2021.702406
Stadler, M., Kolb, N., & Sailer, M. (2021). The right amount of pressure: Implementing time pressure in online exams. Distance Education, 42(2), 219-230, DOI: 10.1080/01587919.2021.1911629
Stefan, N. S., Olić, N. T., & Lazarević, J A. (2021) . Serbian teachers’ perceptions of online assessment during COVID-19 school closure: the role of teachers’ self-efficacy. Educational Studies. https://doi.org/10.1080/03055698.2021.1960151
Spivey, M. F., & McMillan, J. J. (2014). classroom versus online assessment. Journal of Education for Business, 89(8), 450–456. https://doi.org/10.1080/08832323.2014.937676
Thies, L., & Klein, Y. (2020). Unter Druck. Die Situation von Eltern und ihren schulpflichtigen Kin-dern während der Schulschließungen [Under pressure. The situation of parents and their school-age children during the school closures]. Düsseldorf, Germany: Vodafone Stiftung Deutschland. Available at: https://www.vodafone-stiftung.de/wp-content/uploads/2020/04/VodafoneStiftung-
Turner, C. E. (2000). Investigating Wash back from empirically derived rating scales: Background and initial step in a study focusing on ESL speaking at the secondary level in Quebec schools. Paper presented at the annual language test-ing research colloquium, Vancouver, BC. 22’nd.
Valentina, A., & Nelly, A. (2014). The role of e-learning, the advantages and disadvantages of its adoption inHigher Education. International Journal of Education and Research, 2 (12), 397-410.
Wang, C., Yan, J., & Liu, B. (2014). An empirical study on washback effects of the internet-based college English test band 4 in China. English Language Teaching, 7(6),p26.https://doi.org/10.5539/elt.v7n6p26
Wößmann, L., Freundl, V., Grewenig, E., Lergetporer, P., Werner, K., and Zierow, L. (2020). Bildung in der Coronakrise: Wie haben die Schulkinder die Zeit der Schulschließungen verbracht, und welche Bildungsmaßnahmen befürworten die Deutschen? [Education during the coronavirus crisis: How have school children spent the time over the school closures and which educational measures Do Germans prefer?]. Ifo Schnelldienst, 73 (09), 25–39.
Williams, S. (2021) . Advantages & Disadvantages of Online Assessment. Retrieved from https://www.theclassroom.com/advantages-disadvantages-online-assessment-8243449.html.