Analysis of Information Systems Acceptance and Success Models in Higher Education

Reni Haerani; Titik Khawa Abdul Rahman; Dwi Ismiyana Putri; Rika Apriani; Mardi Yudhi Putra

doi:10.29407/intensif.v10i1.24969

Authors

Reni Haerani Universitas Pamulang https://orcid.org/0000-0002-1645-4133
Titik Khawa Abdul Rahman Asia e University https://orcid.org/0000-0002-7174-7625
Dwi Ismiyana Putri Universitas Bina Insani https://orcid.org/0000-0001-8069-6324
Rika Apriani Universitas Bina Insani https://orcid.org/0009-0007-6506-2017
Mardi Yudhi Putra Universitas Bina Insani https://orcid.org/0009-0007-7866-8106

DOI:

https://doi.org/10.29407/intensif.v10i1.24969

Keywords:

Analysis, Information System, Acceptance, Success Models

Abstract

Background: The integration of Information Systems (IS) in higher education has transformed interactions among students, lecturers, and administrative staff, making system acceptance and success essential for effective academic processes. Various evaluation frameworks have been developed, with the DeLone and McLean Information System Success Model being one of the most widely applied. Objective: This study aims to analyze factors influencing the adoption of academic information systems in higher education using the DeLone and McLean model and to evaluate system success from the perspectives of lecturers, students, and administrative personnel. Methods: A quantitative research approach was employed using questionnaire-based data collection. Data analysis was conducted using SmartPLS 3.0 to assess validity, reliability, and structural relationships among variables. A total of 252 respondents were selected using the Slovin formula and proportional stratified random sampling. The evaluated constructs included system quality, information quality, service quality, system use, user satisfaction, and benefits. Results: The results show that system quality, information quality, and service quality have a positive and significant effect on system use and user satisfaction. Furthermore, system use and user satisfaction contribute to perceived net benefits, such as improved learning outcomes, increased management efficiency, and academic productivity. High service quality also supports continued system usage. All measurement constructs met validity and reliability criteria, with loading factors above 0.7 and Average Variance Extracted (AVE) values exceeding 0.50. Conclusion: In conclusion, the DeLone and McLean model effectively explains academic information system success in higher education, highlighting the importance of system quality, user satisfaction, and generated benefits.

Downloads

Download data is not yet available.

Abstract views: 4 , PDF downloads: 4

References

[1] A. Subiyakto, A. R. Ahlan, M. Kartiwi, and H. T. Sukmana, “Measurement of information system project success based on perceptions of the internal stakeholders,” Int. J. Electr. Comput. Eng., vol. 5, no. 2, pp. 271–279, 2015, doi: 10.11591/ijece.v5i2.pp271-279.

[2] H. N. Sabeh, M. H. Husin, D. M. H. Kee, A. S. Baharudin, and R. Abdullah, “A Systematic Review of the DeLone and McLean Model of Information Systems Success in an E-Learning Context (2010-2020),” IEEE Access, vol. 9, pp. 81210–81235, 2021, doi: 10.1109/ACCESS.2021.3084815.

[3] D. Al-Fraihat, M. Joy, R. Masa’deh, and J. Sinclair, “Evaluating E-learning systems success: An empirical study,” Comput. Human Behav., vol. 102, pp. 67–86, 2020, doi: 10.1016/j.chb.2019.08.004.

[4] R. E. Mayer, “Where is the learning in mobile technologies for learning?,” Contemp. Educ. Psychol., vol. 60, p. 101824, 2020, doi: 10.1016/j.cedpsych.2019.101824.

[5] Y. C. Chang, J. W. Li, and D. Y. Huang, “A Personalized Learning Service Compatible with Moodle E-Learning Management System,” Appl. Sci., vol. 12, no. 7, 2022, doi: 10.3390/app12073562.

[6] R. M. Tawafak et al., “Analysis of E-Learning SystemTawafak, R. M., Al-Rahmi, W. M., Almogren, A. S., Al Adwan, M. N., Safori, A., Attar, R. W., & Habes, M. (2023). Analysis of E-Learning System Use Using Combined TAM and ECT Factors. Sustainability (Switzerland), 15(14). https,” Sustain., vol. 15, no. 14, 2023.

[7] T. Vuckovic, D. Stefanovic, D. Ciric Lalic, R. Dionisio, Â. Oliveira, and D. Przulj, “The Extended Information Systems Success Measurement Model: e-Learning Perspective,” Appl. Sci., vol. 13, no. 5, 2023, doi: 10.3390/app13053258.

[8] Y. Edhie Rachmad, A. Ady Bakri, S. Irdiana, J. Waromi, and A. A. Jansen Sinlae, “Analysis of The Influence of Financial Information Systems, Internal Control Systems, and Information Technology on Quality of Financial Reports,” J. Inf. dan Teknol., vol. 6, no. 1, pp. 266–271, 2024, doi: 10.60083/jidt.v6i1.513.

[9] A. Granić and N. Marangunić, “Technology acceptance model in educational context: A systematic literature review,” Br. J. Educ. Technol., vol. 50, no. 5, pp. 2572–2593, 2019, doi: 10.1111/bjet.12864.

[10] V. Alejandro, C. Salim, and B. Jonathan, “A proposed model of e-learning tools acceptance among university students in developing countries,” Educ. Inf. Technol., vol. 24, pp. 1057–1071, 2019.

[11] P. F. Kubrushko, A. Y. Alipichev, E. N. Kozlenkova, L. I. Nazarova, and A. S. Siman, “Digital competence as the basis of a lecturer’s readiness for innovative pedagogical activity,” J. Phys. Conf. Ser., vol. 1691, no. 1, 2020, doi: 10.1088/1742-6596/1691/1/012116.

[12] E. King and R. Boyatt, “Exploring factors that influence adoption of e-learning within higher education,” Br. J. Educ. Technol., vol. 46, no. 6, pp. 1272–1280, 2015, doi: 10.1111/bjet.12195.

[13] M. C. , J. Torrentira, “Online Data Collection As Adaptation in Conducting Quantitative and Qualitative Research During the Covid-19 Pandemic,” Eur. J. Educ. Stud., vol. 7, no. 11, pp. 78–87, 2020, doi: 10.46827/ejes.v7i11.3336.

[14] S. Campbell et al., “Purposive sampling: complex or simple? Research case examples,” J. Res. Nurs., vol. 25, no. 8, pp. 652–661, 2020, doi: 10.1177/1744987120927206.

[15] I. Etikan, “Sampling and Sampling Methods,” Biometrics Biostat. Int. J., vol. 5, no. 6, pp. 5–7, 2017, doi: 10.15406/bbij.2017.05.00149.

[16] J. F. Hair, J. J. Risher, M. Sarstedt, and C. M. Ringle, “The Results of PLS-SEM Article information,” Eur. Bus. Rev., vol. 31, no. 1, pp. 2–24, 2018, doi: 10.1108/EBR-11-2018-0203.

[17] S. Ama Amoo and N. Innocentia Ebu Enyan, “Clinical learning experiences of nursing and midwifery students; a descriptive cross-sectional study,” Int. J. Africa Nurs. Sci., vol. 17, no. July, p. 100457, 2022, doi: 10.1016/j.ijans.2022.100457.

[18] R. K. Jena, “Measuring the impact of business management Student’s attitude towards entrepreneurship education on entrepreneurial intention: A case study,” Comput. Human Behav., vol. 107, no. January, p. 106275, 2020, doi: 10.1016/j.chb.2020.106275.

[19] J. F. Hair, M. Sarstedt, L. Hopkins, and V. G. Kuppelwieser, “Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research,” Eur. Bus. Rev., vol. 26, no. 2, pp. 106–121, 2014, doi: 10.1108/EBR-10-2013-0128.

[20] M. Sarstedt, J. F. Hair, J. H. Cheah, J. M. Becker, and C. M. Ringle, “How to specify, estimate, and validate higher-order constructs in PLS-SEM,” Australas. Mark. J., vol. 27, no. 3, pp. 197–211, 2019, doi: 10.1016/j.ausmj.2019.05.003.

[21] A. Nurabadi, J. Irianto, I. Bafadal, Juharyanto, I. Gunawan, and M. A. Adha, “The effect of instructional, transformational and spiritual leadership on elementary school teachers’ performance and students’ achievements,” Cakrawala Pendidik., vol. 40, no. 1, pp. 17–31, 2021, doi: 10.21831/cp.v40i1.35641.

[22] A. Dos Santos, A. J. Santoso, and D. B. Setyohadi, “The analysis of academic information system success: A case study at Instituto Profissional de Canossa (IPDC) Dili timor-leste,” Proc. - 2017 Int. Conf. Soft Comput. Intell. Syst. Inf. Technol. Build. Intell. Through IOT Big Data, ICSIIT 2017, vol. 2018-Janua, pp. 196–201, 2018, doi: 10.1109/ICSIIT.2017.14.

[23] D. Al-Fraihat, M. Joy, R. Masa’deh, and J. Sinclair, “Evaluating E-learning systems success: An empirical study,” Comput. Human Behav., vol. 102, no. June 2019, pp. 67–86, 2020, doi: 10.1016/j.chb.2019.08.004.

[24] R. P. Bagozzi and Y. Yi, “On the evaluation of structural equation models,” J. Acad. Mark. Sci., vol. 16, no. 1, pp. 74–94, 1988, doi: 10.1007/BF02723327.

[25] I. Z. Rela, A. H. Awang, Z. Ramli, S. Md Sum, and M. Meisanti, “Effects of environmental corporate social responsibility on environmental well-being perception and the mediation role of community resilience,” Corp. Soc. Responsib. Environ. Manag., vol. 27, no. 5, pp. 2176–2187, 2020, doi: 10.1002/csr.1956.

[26] B. M. Byrne, Structural Equation Modeling With AMOS. 2016.

[27] A. Bandura, “Toward a Psychology of Human Agency: Pathways and Reflections,” Perspect. Psychol. Sci., vol. 13, no. 2, pp. 130–136, 2018, doi: 10.1177/1745691617699280.

[28] T. Luken, “Easy does it: an innovative view on developing career identity and self-direction,” Career Dev. Int., vol. 25, no. 2, pp. 130–145, 2020, doi: 10.1108/CDI-05-2019-0110.

[29] M. A. Almaiah and A. Al Mulhem, Analysis of the essential factors affecting of intention to use of mobile learning applications: A comparison between universities adopters and non-adopters, vol. 24, no. 2. Education and Information Technologies, 2019.

[30] M. I. Alkhawaja, M. S. A. Halim, M. S. S. Abumandil, and A. S. Al-Adwan, “System Quality and Student’s Acceptance of the E-learning System: The Serial Mediation of Perceived Usefulness and Intention to Use,” Contemp. Educ. Technol., vol. 14, no. 2, 2022, doi: 10.30935/CEDTECH/11525.

[31] A. H. Muhammad et al., “A hierarchical model to evaluate the quality of web-based E-learning systems,” Sustain., vol. 12, no. 10, pp. 1–23, 2020, doi: 10.3390/SU12104071.

[32] M. A. Uppal, S. Ali, and S. R. Gulliver, “Factors determining e-learning service quality,” Br. J. Educ. Technol., vol. 49, no. 3, pp. 412–426, 2018, doi: 10.1111/bjet.12552.

[33] D. Ayuni and A. Mulyana, “Applying service quality model as a determinant of success in e-learning: The role of institutional support and outcome value,” Rev. Integr. Bus. Econ. Res., vol. 8, no. 1, pp. 145–159, 2019.

[34] R. D. Hariadi and S. Sulistiono, “Pengaruh Kualitas Situs Website, Kepercayaan Konsumen, Dan Pengalaman Berbelanja Terhadap Minat Beli Ulang Di Situs Jual Beli Online OLX,” J. Inform. Kesatuan, vol. 1, no. 1, pp. 1–12, 2021, doi: 10.37641/jikes.v1i1.402.

[35] S. L. Wara, L. Kalangi, and H. Gamaliel, “Pengujian Model Kesuksesan Sistem Informasi Delone dan Mclean pada Sistem Aplikasi Pemeriksaan (SIAP) di Badan Pemeriksa Keuangan Republik Indonesia Perwakilan Provinsi Sulawesi Utara,” J. Ris. Akunt. dan Audit. “GOODWILL,” vol. 12, no. 1, pp. 38–50, 2021.

[36] J. Basel, Ali, R. Bakar, W. Ahmad, and W. A. Wan Omar, “The Critical Success Factors of Accounting Information System (Ais) and It’S Impact on Organisational Performance of Jordanian Commercial Banks,” Int. J. Econ. Commer. Manag., vol. IV, no. 4, pp. 658–677, 2016.

[37] Z. Zhang, T. Cao, J. Shu, and H. Liu, “Identifying key factors affecting college students’ adoption of the e-learning system in mandatory blended learning environments,” Interact. Learn. Environ., vol. 30, no. 8, pp. 1388–1401, 2022, doi: 10.1080/10494820.2020.1723113.

[38] F. Bouilheres, L. T. V. H. Le, S. McDonald, C. Nkhoma, and L. Jandug-Montera, “Defining student learning experience through blended learning,” Educ. Inf. Technol., vol. 25, no. 4, pp. 3049–3069, 2020, doi: 10.1007/s10639-020-10100-y.

[39] A. Jeyaraj, “DeLone & McLean models of information system success: Critical meta-review and research directions,” Int. J. Inf. Manage., vol. 54, no. April, p. 102139, 2020, doi: 10.1016/j.ijinfomgt.2020.102139.

[40] S. Z. Mustafa, A. K. Kar, and M. F. W. H. A. Janssen, “Understanding the impact of digital service failure on users: Integrating Tan’s failure and DeLone and McLean’s success model,” Int. J. Inf. Manage., vol. 53, no. March, p. 102119, 2020, doi: 10.1016/j.ijinfomgt.2020.102119.

[41] Y. Nuryanti, D. Hutagalung, M. Nadeak, S. Abadiyah, and D. Novitasari, “Understanding the Links between System Quality , Information Quality , Service Quality , and User Satisfaction in the Context of Online Learning,” Int. J. Scoial Manag. Stud., vol. 02, no. 04, pp. 54–64, 2021, [Online]. Available: https://www.ijosmas.org/index.php/ijosmas/article/view/51%0Ahttps://www.ijosmas.org.

[42] D. Guslan and M. April Yani, “Pengaruh Kualitas Informasi, Harga Produk Dan Kepercayaan Pelanggan Terhadap Minat Beli Konsumen di Zalora,” J. Logistik Bisnis, vol. 11, no. 1, pp. 24–36, 2021, doi: 10.46369/logistik.v11i1.1375.

[43] T. C. Zagita, P. W. Handayani, and N. F. A. Budi, “Analysis of factors affecting the loyalty of using online health services: Case study of alodokter,” 2019 Int. Conf. Adv. Comput. Sci. Inf. Syst. ICACSIS 2019, pp. 279–284, 2019, doi: 10.1109/ICACSIS47736.2019.8979973.

[44] P. Sahu, “Closure of Universities Due to Coronavirus Disease 2019 (COVID-19): Impact on Education and Mental Health of Students and Academic Staff,” Cureus, vol. 2019, no. 4, 2020, doi: 10.7759/cureus.7541.

[45] Z. Jin and C. K. Lim, “Structural relationships among service quality, systemic characteristics, customer trust, perceived risk, customer satisfaction and intention of continuous use in mobile payment service,” J. Syst. Manag. Sci., vol. 11, no. 2, pp. 48–64, 2021, doi: 10.33168/JSMS.2021.0204.

[46] Q. Zhou et al., “A study on factors affecting service quality and loyalty intention in mobile banking,” J. Retail. Consum. Serv., vol. 60, no. December 2020, p. 102424, 2021, doi: 10.1016/j.jretconser.2020.102424.

[47] Buanawati et al., “Role of Equality of Services and Quality of Enterprise Resource Planning (ERP) Systems in Improving Satisfaction of Environmental Users in Padjadjaran University,” J. Apl. Ipteks untuk Masy., vol. 8, no. 1, pp. 20–28, 2019.

[48] A. I. Alzahrani, I. Mahmud, T. Ramayah, O. Alfarraj, and N. Alalwan, “Extending the theory of planned behavior (TPB) to explain online game playing among Malaysian undergraduate students,” Telemat. Informatics, vol. 34, no. 4, pp. 239–251, 2017, doi: 10.1016/j.tele.2016.07.001.

[49] L. R. Kalankesh, Z. Nasiry, R. Fein, and S. Damanabi, “Factors Influencing User Satisfaction with Information Systems: A Systematic Review,” Galen Med. J., vol. 9, p. e1686, 2020, doi: 10.31661/gmj.v9i0.1686.

[50] A. A. Mohammad Salameh, H. Ahmad, F. Zulhumadi, and F. M. Abubakar, “Relationships between system quality, service quality, and customer satisfaction,” J. Syst. Inf. Technol., vol. 20, no. 1, pp. 73–102, 2018, doi: 10.1108/jsit-03-2017-0016.

[51] A. A. Alalwan, “Mobile food ordering apps: An empirical study of the factors affecting customer e-satisfaction and continued intention to reuse,” Int. J. Inf. Manage., vol. 50, no. February 2019, pp. 28–44, 2020, doi: 10.1016/j.ijinfomgt.2019.04.008.

[52] A. U. Wusko, “Pengaruh Kualitas Pelayanan Terhadap Kepuasan Pengguna Jasa Pada Rumah Sakit Umum Daerah Bangil Kabupaten Pasuruan,” Sketsa Bisnis, vol. 1, no. 1, 2015, doi: 10.35891/jsb.v1i1.23.

[53] MD Main Uddin, A. Ghosh, and O. Isaac, “Impact of the System, Information, and Service Quality of Online Learning on User Satisfaction among Public Universities Students in Bangladesh,” Int. J. Manag. Hum. Sci., vol. 3, no. 2, pp. 1–10, 2019.

[54] H. Annisa Islam and T. Ezni Balqiah, “Loyalty and Customer Engagement in Online Grocery Shopping in Indonesia,” ACM Int. Conf. Proceeding Ser., pp. 53–59, 2021, doi: 10.1145/3466029.3466036.

[55] Y. Li, “Empirical Study of Influential Factors of Online Customers’ Repurchase Intention,” iBusiness, vol. 08, no. 03, pp. 48–60, 2016, doi: 10.4236/ib.2016.83006.

[56] A. Lutfi, “Factors Influencing the Continuance Intention to Use Accounting Information System in Jordanian SMEs from the Perspectives of UTAUT: Top Management Support and Self-Efficacy as Predictor Factors,” Economies, vol. 10, no. 4, 2022, doi: 10.3390/economies10040075.

[57] J. Marzal, E. Saputra, T. Suratno, Mauladi, Saharudin, and E. Elisa, “The use of ADDIE model to re-create academic information systems to improve user satisfaction,” J. Phys. Conf. Ser., vol. 1567, no. 3, 2020, doi: 10.1088/1742-6596/1567/3/032033.

[58] N. Meilatinova, “Social commerce: Factors affecting customer repurchase and word-of-mouth intentions,” Int. J. Inf. Manage., vol. 57, no. December 2020, p. 102300, 2021, doi: 10.1016/j.ijinfomgt.2020.102300.

[59] R. Sijabat, “Digitalization in Business: Examining the Antecedents of Repurchase Intention Using Traveloka Application,” J. Manaj. Indones., vol. 20, no. 3, p. 224, 2020, doi: 10.25124/jmi.v20i3.3519.

[60] N. Wilson, “the Impact of Perceived Usefulness and Perceived Ease-of-Use Toward Repurchase Intention in the Indonesian E-Commerce Industry,” J. Manaj. Indones., vol. 19, no. 3, p. 241, 2019, doi: 10.25124/jmi.v19i3.2412.

[61] E. Nachrowi, Yani Nurhadryani, and Heru Sukoco, “Evaluation of Governance and Management of Information Technology Services Using Cobit 2019 and ITIL 4,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 4, no. 4, pp. 764–774, 2020, doi: 10.29207/resti.v4i4.2265.

[62] Z. Zamir and D. Kim, “the Effect of Quality Dimensions of Information Systems on Knowledge Sharing and User Satisfaction,” Int. J. Entrep. Knowl., vol. 10, no. 1, pp. 1–19, 2022, doi: 10.37335/ijek.v10i1.153.

[63] S. Akter, K. Michael, M. R. Uddin, G. McCarthy, and M. Rahman, “Transforming business using digital innovations: the application of AI, blockchain, cloud and data analytics,” Ann. Oper. Res., vol. 308, no. 1–2, pp. 7–39, 2022, doi: 10.1007/s10479-020-03620-w.

[64] S. M. Chege, D. Wang, and S. L. Suntu, “Impact of information technology innovation on firm performance in Kenya,” Inf. Technol. Dev., vol. 26, no. 2, pp. 316–345, 2020, doi: 10.1080/02681102.2019.1573717.

[65] A. Purwanto, J. T. Purba, I. Bernarto, and R. Sijabat, “Effect of Transformational Leadership, Job Satisfaction, and Organizational Commitments on Organizational Citizenship Behavior,” Inovbiz J. Inov. Bisnis, vol. 9, no. 1, p. 61, 2021, doi: 10.35314/inovbiz.v9i1.1801.

[66] M. Salam and M. S. Farooq, “Does sociability quality of web-based collaborative learning information system influence students’ satisfaction and system usage?,” Int. J. Educ. Technol. High. Educ., vol. 17, no. 1, 2020, doi: 10.1186/s41239-020-00189-z.

[67] E. S. Panjaitan, S. F. Hasibuan, and ..., “Analisis Faktor-Faktor yang Mempengaruhi Manfaat Bersih yang di Mediasi oleh Kepuasan Pengguna Sistem Informasi Administrasi Kependudukan,” … Nas. Sains dan …, pp. 394–399, 2019, [Online]. Available: https://www.prosiding.seminar-id.com/index.php/sensasi/article/view/334.