Examining the Perceived Consequences and Usage of MOOCs on Learning Effectiveness

Document Type: Research Paper

Authors

1 Faculty of Computer Sciences and Information Technology, Islamic Azad University, Parand Branch, Tehran, Iran

2 Faculty of Management, University of Tehran, Tehran, Iran

3 Faculty of Management, Islamic Azad University, Tehran Central Branch, Tehran, Iran

Abstract

Massive Open Online Courses (MOOCs) have recently received a great deal of attention from the academic communities. However, these courses face low completion rates and there are very limited research pertaining to this problem. Therefore, this study uses Triandis theory to better understand variables that are indicative of MOOC completion. Furthermore, this study scrutinizes the quantitative relationship between MOOC usage and learning effectiveness. Two hundred and thirty-four users from selected Coursera participated in this study to evaluate the proposed model. The partial least squares (PLS) were used to analyze the collected data and test the research hypotheses. The results indicated that perceived consequences (including knowledge growth, social interaction, and compatibility) and affect have a significant impact on intention to use MOOC. In contrast, social factors delineated the insignificant effects on intention to use MOOC. The findings indicated that facilitative conditions and intentions to use MOOC have a strong and positive impact on the actual use of MOOC. Hypotheses regarding the influence of perceived consequences and the actual usage of MOOC on learning effectiveness were upheld.

Keywords

Main Subjects


Article Title [Persian]

ارزیابی پیامدهای ادراکی دوره های آزاد انبوه برخط(MOOCs)و تاثیر آنها بر اثربخشی یادگیری

Authors [Persian]

  • علیرضا تمجید یامچلو 1
  • رحمت الله قلی پور 2
  • محمدعلی افشار کاظمی 3
1 دانشکده علوم کامپیوتر و فناوری اطلاعات، دانشگاه آزاد اسلامی، واحد پرند، تهران، ایران
2 دانشکده مدیریت ، دانشگاه تهران، تهران، ایران
3 گروه مدیریت، دانشگاه آزاد اسلامی، واحد پرند، تهران، ایران
Abstract [Persian]

درصد کمی از شرکت کنندگان دوره های آزاد انبوه برخط(MOOCs) این دوره ها را به اتمام میرسانند وپژوهشهای بسیار محدودی در مورد این مشکل وجود دارد. هدف اصلی مطالعه حاضر، کشف عوامل مختلف تاثیرگذار به استفاده از MOOC با استفاده از نظریه ترایدس است. علاوه بر این،مطالعه جاری رابطه کمی بین پیامدهای درک شده و استفاده واقعی از MOOC رابا اثربخشی یادگیری را بررسی می کند . نتایج پژوهش نشان داد که پیامدهای درک شده تاثیر قابل توجهی بر قصد استفاده از MOOC دارد. در مقابل، عوامل اجتماعی تأثیر ناچیزی بر قصد استفاده از MOOC دارد. یافته های پژوهش نشان داد که شرایط تسهیل گر و قصد استفاده بر روی استفاده واقعی از MOOCتاثیر گذار است. فرضیه های مربوط به تأثیر پیامدهای درک شده و استفاده واقعی از MOOC بر اثربخشی یادگیری تأیید شدند.

Keywords [Persian]

  • دوره های آزاد انبوه برخط
  • اثربخشی یادگیری
  • تئوری ترایندس
Alves, H. (2011). The measurement of perceived value in higher education: a unidimensional approach. The Service Industries Journal, 31(12), 1943-1960.

Aleven, V., Sewall, J., Andres, J. M., Sottilare, R., Long, R., & Baker, R. (2018, June). Towards adapting to learners at scale: integrating MOOC and intelligent tutoring frameworks. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale (pp. 1-4).

Anwar, R. (2019). Framework for the implementation of knowledge sharing behavior in global software development organizations (Doctoral dissertation, UTAR).

Ajzen, I. & Fishbein, M. (1980). Understanding attitudes and predicting social behavior.

Aparicio, M., Oliveira, T., Bacao, F., & Painho, M. (2019). Gamification: A key determinant of massive open online course (MOOC) success. Information & Management, 56(1), 39-54.

Al-Shanfari, I., Yassin, W., & Abdullah, R. (2020). Identify of factors affecting information security awareness and weight analysis Process.

Berman, A. H., Biguet, G., Stathakarou, N., Westin-Hägglöf, B., Jeding, K., McGrath, C., ... & Kononowicz, A. A. (2017). Virtual patients in a behavioral medicine massive open online course (MOOC): a qualitative and quantitative analysis of participants’ perceptions. Academic Psychiatry, 41(5), 631-641.

Chan, C., & Chan, Y. (2011). Students' views of collaboration and online participation in Knowledge Forum. Computers & Education, 57(1), 1445-1457.

Chang, H., & Chuang, S. (2011). Social capital and individual motivations on knowledge sharing: Participant involvement as a moderator. Information & Management, 48(1), 9-18.

Chang, M. K., Cheung, W., Cheng, C. H., & Yeung, J. H. (2008). Understanding ERP system adoption from the user's perspective. International Journal of production economics, 113(2), 928-942.

Chang, M. & Cheung, W. (2001). Determinants of the intention to use Internet/WWW at work: a confirmatory study. Information & Management, 39(1), 1-14.

Chen, L., Nath, R., & Tang, Z. (2020). Understanding the determinants of digital distraction: An automatic thinking behavior perspective. Computers in Human Behavior, 104, 106195.

Chen, Y., & Chen, P. (2015). MOOC study group: Facilitation strategies, influential factors, and student perceived gains. Computers & Education, 86, 55-70.

Chen, J., Feng, J., Sun, X., Wu, N., Yang, Z., & Chen, S. (2019). MOOC dropout prediction using a hybrid algorithm based on decision tree and extreme learning machine. Mathematical Problems in Engineering, 2019.

Darban, M., Kwak, D. H. A., Deng, S. L., Srite, M., & Lee, S. (2016). Antecedents and consequences of perceived knowledge update in the context of an ERP simulation game: A multi-level perspective. Computers & Education, 103, 87-98.

Doty, D. H., Wooldridge, B. R., Astakhova, M., Fagan, M. H., Marinina, M. G., Caldas, M. P., & Tunçalp, D. (2020). Passion as an excuse to procrastinate: A cross-cultural examination of the relationships between Obsessive Internet passion and procrastination. Computers in Human Behavior, 102, 103-111.

Dwivedi, Y. K., Rana, N. P., Jeyaraj, A., Clement, M., & Williams, M. D. (2019). Re-examining the unified theory of acceptance and use of technology (UTAUT): Towards a revised theoretical model. Information Systems Frontiers, 21(3), 719-734.

Evans, C. (2008). The effectiveness of m-learning in the form of podcast revision lectures in higher education. Computers & Education, 50(2), 491-498.

Faulkner, N., Jorgensen, B., & Koufariotis, G. (2019). Can behavioural interventions increase citizens' use of e-government? Evidence from a quasi-experimental trial. Government Information Quarterly, 36(1), 61-68.

Fang, Y., & Chiu, C. (2010). In justice we trust: Exploring knowledge-sharing continuance intentions in virtual communities of practice. Computers in Human Behavior, 26(2), 235-246.

Garay, L., Font, X., & Corrons, A. (2019). Sustainability-oriented innovation in tourism: An analysis based on the decomposed theory of planned behavior. Journal of Travel Research, 58(4), 622-636.

Goel, S., Sabitha, A. S., Choudhury, T., & Mehta, I. S. (2019). Analytical Analysis of Learners’ Dropout Rate with Data Mining Techniques. In Emerging Trends in Expert Applications and Security (pp. 583-592). Springer, Singapore.

Hackel, L. M., Mende-Siedlecki, P., & Amodio, D. M. (2020). Reinforcement learning in social interaction: The distinguishing role of trait inference. Journal of Experimental Social Psychology, 88, 103948.

Hao, L., & Tan, Y. (2019). Who wants consumers to be informed? Facilitating information disclosure in a distribution channel. Information Systems Research, 30(1), 34-49.

Haggard, S., Brown, S., Mills, R., Tait, A., Warburton, S., Lawton, W., & Angulo, T. (2013). The Maturing of the MOOC: Literature review of massive open online courses and other forms of online distance learning. Department for Business, Innovation and Skills, UK Government.

He, W., & Wei, K. (2009). What drives continued knowledge sharing? An investigation of knowledge-contribution and-seeking beliefs. Decision Support Systems, 46(4), 826-838.

Ho, C., & Dzeng, R. (2010). Construction safety training via e-Learning: Learning effectiveness and user satisfaction. Computers & Education, 55(2), 858-867.

Hair Jr., J. F., Howard, M. C., & Nitzl, C. (2020). Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. Journal of Business Research, 109, 101-110.

Hagger, M. S., Polet, J., & Lintunen, T. (2018). The reasoned action approach applied to health behavior: Role of past behavior and tests of some key moderators using meta-analytic structural equation modeling. Social Science & Medicine, 213, 85-94.

Houghton, D., Pressey, A., & Istanbulluoglu, D. (2020). Who needs social networking? An empirical enquiry into the capability of Facebook to meet human needs and satisfaction with life. Computers in Human Behavior, 104,106153.

Hone, K. S., & El Said, G. R. (2016). Exploring the factors affecting MOOC retention: A survey study. Computers & Education, 98, 157-168.

Hsu, C., & Lin, J. (2008). Acceptance of blog usage: The roles of technology acceptance, social influence and knowledge sharing motivation. Information & Management, 45(1), 65-74.

Hwang, S. H., Lim, W., Neary, P., & Newton, J. (2018). Conventional contracts, intentional behavior and logit choice: Equality without symmetry. Games and Economic Behavior, 110, 273-294.

Huang, C. (2009). Knowledge sharing and group cohesiveness on performance: An empirical study of technology R&D teams in Taiwan. Technovation, 29(11), 786-797.

Jeon, S., Kim, Y., & Koh, J. (2011). Individual, social, and organizational contexts for active knowledge sharing in communities of practice. Expert Systems with Applications, 38(10), 12423-12431.

Jacobsen, D. Y. (2019). Dropping out or dropping in? A connectivist approach to understanding participants’ strategies in an e-learning MOOC pilot. Technology, Knowledge and Learning, 24(1), 1-21.

Jia, Q., Guo, Y., & Barnes, S. J. (2017). Enterprise 2.0 post-adoption: Extending the information system continuance model based on the technology-Organization-environment framework. Computers in Human Behavior, 67, 95-105.

Jung, I., & Lee, J. (2019). The effects of learner factors on MOOC learning outcomes and their pathways. Innovations in Education and Teaching International, 1-12.

Kim, H. S., Cho, K. M., & Kim, M. (2019). Information-sharing behaviors among sports fans using# hashtags. Communication & Sport, 2167479519878466.

Kgasago, K. J. O., & Jokonya, O. (2018). Determinants of business intelligence system acceptance in an emerging country. Journal of Governance and Regulation,7(4),42-50.

Koutsakas, P., Karagiannidis, C., Politis, P., & Karasavvidis, I. (2020). A computer programming hybrid MOOC for Greek secondary education. Smart Learning Environments, 7(1), 1-22.

Larue, G., Rakotonirainy, A., Haworth, N., & Darvell, M. (2015). Assessing driver acceptance of Intelligent Transport Systems in the context of railway level crossings. Transportation Research Part F: Traffic Psychology and Behaviour, 30,1-13.

Liaw, S. (2008). Investigating students’ perceived satisfaction, behavioral intention, and effectiveness of e-learning: A case study of the Blackboard system. Computers & Education, 51(2), 864-873.

Lo, A., & Qu, H. (2015). A theoretical model of the impact of a bundle of determinants on tourists’ visiting and shopping intentions: A case of mainland Chinese tourists. Journal of Retailing and Consumer Services, 22, 231-243.

Islam, A. N. (2016). E-learning system use and its outcomes: Moderating role of perceived compatibility. Telematics and Informatics, 33(1), 48-55.

Ma, L., & Lee, C. (2019). Investigating the adoption of MOOCs: A technology–user–environment perspective. Journal of Computer Assisted Learning, 35(1), 89-98.

Nguyen, T. M., Nham, P. T., & Hoang, V. N. (2019). The theory of planned behavior and knowledge sharing: A systematic review and meta-analytic structural equation modelling. VINE Journal of Information and Knowledge Management Systems, 49(1), 76-94.

Nguyen, K., & Schumann, R. (2019). An exploratory comparison of behavioural determinants in mobility modal choices. In Proceedings of the Social Simulation Conference 2019 (No. CONFERENCE). 23–27 September 2019.

Nikou, S. (2019). Factors driving the adoption of smart home technology: An empirical assessment. Telematics and Informatics, 45, 101283.

Nahapiet, J., & Ghoshal, S. (1998). Social capital, intellectual capital, and the organizational advantage. Academy of management review, 23(2), 242-266.

Oyemomi, O., Liu, S., Neaga, I., Chen, H., & Nakpodia, F. (2019). How cultural impact on knowledge sharing contributes to organizational performance: Using the fsQCA approach. Journal of Business Research, 94, 313-319.

Peñarroja, V., Sánchez, J., Gamero, N., Orengo, V., & Zornoza, A. M. (2019). The influence of organisational facilitating conditions and technology acceptance factors on the effectiveness of virtual communities of practice. Behaviour & Information Technology, 38(8), 845-857.

Porter, L. W., & Lawler, E. E. (1968). Managerial attitudes and performance.

Ramayah, T., Chin, L. G., & Ahmad, N. H. (2008). Internet Piracy among Business Students: An Application of Triandis Model. International Journal of Business & Management Science, 1(1).

Rejón-Guardia, F., Polo-Peña, A. I., & Maraver-Tarifa, G. (2019). The acceptance of a personal learning environment based on Google apps: the role of subjective norms and social image. Journal of Computing in Higher Education, 1-31.

Reich, J., & Ruipérez-Valiente, J. A. (2019). The MOOC pivot. Science, 363(6423), 130-131.

Reith, R., Fischer, M., & Lis, B. (2019). Explaining the intention to use social trading platforms: An empirical investigation. Journal of Business Economics, 1-34.

Reich, J. (2015). Rebooting MOOC Research. Science, 347(6217), 34-35.

Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019). Diffusion of Innovations 1. In An Integrated Approach to Communication Theory and Research (pp. 415-434). Routledge.

Rogers, E. M. (2019). Introduction: The Emergence of Information Societies. In Mediation, Information, and Communication (pp. 185-192). Routledge.

Romero-Rodríguez, L. M., Ramírez-Montoya, M. S., & González, J. R. V. (2020). Incidence of digital competences in the completion rates of MOOCs: Case study on energy sustainability courses. IEEE Transactions on Education.

Sanco, S., Harmein, N., & Rahim, M. (2019, May). Integrated model development in information technology adoption. In IOP Conference Series: Materials Science and Engineering (Vol. 505, No. 1, p.012126), IOP Publishing.

Sari, A. R., Bonk, C. J., & Zhu, M. (2020). MOOC instructor designs and challenges: What can be learned from existing MOOCs in Indonesia and Malaysia? Asia Pacific Education Review, 21(1), 143-166.

Siemens, G. (2019). Learning analytics and open, flexible, and distance learning. Distance Education, 40(3), 414-418.

Siemens, G., Gašević, D., & Dawson, S. (2015). Preparing for the digital university: A review of the history and current state of distance, blended, and online learning.

Shi, S., Wang, Y., Chen, X., & Zhang, Q. (2020). Conceptualization of omnichannel customer experience and its impact on shopping intention: A mixed-method approach. International Journal of Information Management, 50, 325-336.

Son, H., Lee, S., & Kim, C. (2015). What drives the adoption of building information modeling in design organizations? An empirical investigation of the antecedents affecting architects' behavioral intentions. Automation in Construction, 49, 92-99.

Tan, C. N. L., & Ramayah, T. (2018). Exploring the individual, social and organizational predictors of knowledge-sharing behaviours among communities of practice of SMEs in Malaysia. Journal of Systems and Information Technology.

Tamjidyamcholo, A., Baba, M. S. B., Shuib, N. L. M., & Rohani, V. A. (2014). Evaluation model for knowledge sharing in information security professional virtual community. Computers & Security, 43, 19-34.

Taranto, E., & Arzarello, F. (2019). Math MOOC UniTo: An Italian project on MOOCs for mathematics teacher education, and the development of a new theoretical framework. ZDM, 1-16.

Tarhini, A., Teo, T., & Tarhini, T. (2015). A cross-cultural validity of the E-learning Acceptance Measure (ElAM) in Lebanon and England: A confirmatory factor analysis. Education and Information Technologies, 1-14.

Taherdoost, H. (2018). A review of technology acceptance and adoption models and theories. Procedia manufacturing, 22, 960-967.

Teo, T., Sang, G., Mei, B., & Hoi, C. K. W. (2019). Investigating pre-service teachers’ acceptance of Web 2.0 technologies in their future teaching: A Chinese perspective. Interactive Learning Environments, 27(4), 530-546.

Triandis, H. C., & Values, A. (1979). Interpersonal behavior. In Nebraska Symposium on Motivation (pp. 195-259).

Tsai, W., & Ghoshal, S. (1998). Social capital and value creation: The role of intrafirm networks. Academy of management Journal, 41(4), 464-476.

Tsai, J. M., Hung, S. W., & Yang, T. T. (2020). In pursuit of goodwill? The cross-level effects of social enterprise consumer behaviours. Journal of Business Research, 109, 350-361.

Venkatesh, V., & Bala, H. (2008). Technology acceptance model 3 and a research agenda on interventions. Decision sciences, 39(2), 273-315.

Vaterlaus, J. M., Spruance, L. A., Frantz, K., & Kruger, J. S. (2019). College student television binge watching: Conceptualization, gratifications, and perceived consequences. The Social Science Journal, 56(4), 470-479.

Vroom, V. (1964). Motivation and work. New York: Wiley.

Weinhardt, J. M., & Sitzmann, T. (2019). Revolutionizing training and education? Three questions regarding massive open online courses (MOOCs). Human Resource Management Review, 29(2), 218-225.

Xie, Z. (2019). Modelling the dropout patterns of MOOC learners. Tsinghua Science and Technology, 25(3), 313-324.

Yuriev, A., Dahmen, M., Paillé, P., Boiral, O., & Guillaumie, L. (2020). Pro-environmental behaviors through the lens of the theory of planned behavior: A scoping review. Resources, Conservation and Recycling, 155, 104660.

Yang, H. L., & Lin, R. X. (2019). Why do people continue to play mobile game apps? A perspective of individual motivation, social factor and gaming factor. Journal of Internet Technology, 20(6), 1925-1936.

Zhang, D., Zhou, L., Briggs, R., & Nunamaker, J. (2006). Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & Management, 43(1), 15-27.

Zolait, A. H. S. (2014). The nature and components of perceived behavioural control as an element of theory of planned behaviour. Behaviour & Information Technology, 33(1), 65-85.

Zulfiqar, S., Sarwar, B., Aziz, S., Ejaz Chandia, K., & Khan, M. K. (2019). An analysis of influence of business simulation games on business school students’ attitude and intention toward entrepreneurial activities. Journal of Educational Computing Research, 57(1), 106-130.