Evaluation of the Utilization of the Learning Management System (LMS) Using the CIPP Model

Authors

  • Bagas Aditya Putra Universitas Negeri Jakarta Author
  • Soeprijanto Universitas Negeri Jakarta Author
  • Daryanto Universitas Negeri Jakarta Author

DOI:

https://doi.org/10.61667/dp8q3757

Keywords:

Evaluation, LMS, CIPP Model

Abstract

The increasing reliance on LMS for delivering educational content necessitates an evaluation framework to ensure its effectiveness in meeting educational goals. The CIPP model provides a comprehensive approach to evaluate various aspects of LMS utilization. The primary objectives are to evaluate the contextual relevance, resource adequacy, implementation processes, and outcomes of LMS usage in educational settings. This study employs a mixed-method approach, utilizing the CIPP evaluation checklist for data collection, supplemented by semi-structured interviews, document analysis, and observations. The population includes students and educators using the LMS, with a representative sample selected for detailed analysis.  The research results of Context evaluation revealed that the LMS aligns well with institutional educational goals and user needs. The Input phase highlighted sufficient technical and support resources, though some gaps in training were identified. The Process evaluation indicated high user engagement but pointed out areas for improvement in system usability. Finally, the Product evaluation showed positive outcomes in terms of user satisfaction and achievement of educational objectives, though continuous improvements are needed to maintain effectiveness. This research provides valuable insights into the strengths and weaknesses of LMS implementation, guiding future enhancements for better educational outcomes.

 

 

 

References

Al-Shanawani, H. M. (2019). Evaluation of Self-Learning Curriculum for Kindergarten Using Stufflebeam’s CIPP Model. SAGE Open, 9(1). https://doi.org/10.1177/2158244018822380

Ali, M., Han, S. C., Bilal, H. S. M., Lee, S., Kang, M. J. Y., Kang, B. H., Razzaq, M. A., & Amin, M. B. (2018). iCBLS: An interactive case-based learning system for medical education. International Journal of Medical Informatics, 109, 55–69. https://doi.org/10.1016/j.ijmedinf.2017.11.004

Amin, F. M., & Sundari, H. (2020). Efl students’ preferences on digital platforms during emergency remote teaching: Video conference, lms, or messenger application? Studies in English Language and Education, 7(2), 362–378. https://doi.org/10.24815/siele.v7i2.16929

Besterman-Dahan, K., Hathaway, W. A., Chavez, M., Bradley, S., Orozco, T., Panaite, V., Lind, J., & Berumen, J. (2023). Multisite Agricultural Veterans Affairs Farming and Recovery Mental Health Services (VA FARMS) Pilot Program: Protocol for a Responsive Mixed Methods Evaluation Study. JMIR Research Protocols, 12. https://doi.org/10.2196/40496

Bilan, N., Negahdari, R., Hazrati, H., & Moghaddam, S. F. (2021). Examining the quality of the competency-based evaluation program for dentistry based on the cipp model: A mixed-method study. Journal of Dental Research, Dental Clinics, Dental Prospects, 15(3), 203–210. https://doi.org/10.34172/JODDD.2021.034

Bodur, N. C., Tuysuz, C., & Ugulu, I. (2022). Qualitative Evaluation of the Science Curriculum Applied in Science and Art Centers (SACs) for Gifted Students in Turkey Within the Framework of the CIPP Approach. Journal of Advanced Academics, 33(4), 604–635. https://doi.org/10.1177/1932202X221119535

Duan, P., Xiang, J., Niu, H., & Han, C. (2023). Construction of Evaluation Index for Chinese Engineering Undergraduates Based on CIPP Model. SAGE Open, 13(1). https://doi.org/10.1177/21582440221149415

Ebner, C., & Gegenfurtner, A. (2019). Learning and Satisfaction in Webinar, Online, and Face-to-Face Instruction: A Meta-Analysis. Frontiers in Education, 4(September), 1–11. https://doi.org/10.3389/feduc.2019.00092

Finney, T. L. (2020). Confirmative Evaluation : New CIPP Evaluation Model. Journal of Modern Applied Statistical Methods, 18(2), 1–24. https://doi.org/10.22237/jmasm/1598889893

Kim, C. J., Mo, H., & Lee, J. Y. (2022). Evaluation of an ultrasound program in nationwide Continuing Professional Development (CPD) in Korean public health and medical institutions. BMC Medical Education, 22(1), 1–9. https://doi.org/10.1186/s12909-022-03271-4

Landrum, B. (2020). Examining students’ confidence to learn online, self-regulation skills and perceptions of satisfaction and usefulness of online classes. Online Learning Journal, 24(3), 128–146. https://doi.org/10.24059/olj.v24i3.2066

Lee, S. Y., Lee, S. H., & Shin, J. S. (2019). Evaluation of medical humanities course in college of medicine using the context, input, process, and product evaluation model. Journal of Korean Medical Science, 34(22), 1–13. https://doi.org/10.3346/jkms.2019.34.e163

Nguyen, J. J., & Condry, D. L. J. (2023). Evaluating differences in community-engaged learning and service-learning via the context, input, process, and product model. Frontiers in Education, 8(December), 1–13. https://doi.org/10.3389/feduc.2023.1289322

Oliveira, L., Mesquita, A., Sequeira, A., Oliveira, A., & Silva, P. (2021). Context, Input and Process as Critical Elements for Successful Emergency Remote Learning. In R. A., A. H., D. G., M. F., & C. A.M.R. (Eds.), Advances in Intelligent Systems and Computing: Vol. 1367 AISC (pp. 81–91). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-72660-7_9

Sagin, A., Balmer, D., Rose, S., Musheno, R., Olenik, J. M., Dingfield, L., Dine, C. J., & Bennett, N. L. (2024). Evaluation of a Palliative Care Longitudinal Curriculum for Medical Students Using the Context-Input-Process-Product Model. American Journal of Hospice and Palliative Medicine, 41(2), 158–166. https://doi.org/10.1177/10499091231165504

Downloads

Published

2024-08-03