Designing a visual analytics system to support a re-designed flipped learning programming class
DOI:
https://doi.org/10.52731/liir.v004.129Keywords:
Flipped learning, Learning analytics dashboard, Programming education, self-regulated learningAbstract
Enhancing students’ programming skills has become a critical issue. The development of video streaming technology makes MOOCs an innovative and convenient way to learn programming. However, programming novices were still plagued by the high failure rate of conventional teaching methods. Therefore, this study aims to design a visual analytics system based on the re-designed flipped learning programming class. The re-designed flipped learning model contains a collaborative and co-regulation process. This study designed the instruction activity with SPOCs video. Moreover, to promote students’ self-regulation, we create a visual analytics system to collect students’ coding logs, video-clicking data, and results of peer assessments. The system contains the coding log dashboard, video clicking dashboard and peer assessment dashboard respectively, so students can easily evaluate their learning process. Moreover, this study conducts the experiment to check whether the proposed system and the new class module enhance students’ learning achievement and motivation.
References
A. Littlejohn, N. Hood, C. Milligan, and P. Mustain, "Learning in MOOCs: Motivations and self-regulated learning in MOOCs," The Internet and Higher Education, vol. 29, pp. 40-48, 2016, doi: 10.1016/j.iheduc.2015.12.003.
X.-H. Wang, J.-P. Wang, F.-J. Wen, J. Wang, and J.-Q. Tao, "Exploration and Practice of Blended Teaching Model Based Flipped Classroom and SPOC in Higher University," Journal of Education and Practice, vol. 7, no. 10, pp. 99-104, 2016.
B. J. Zimmerman, "Becoming a Self-Regulated Learner: An Overview," Theory Into Practice, vol. 41, no. 2, pp. 64-70, 2002, doi: 10.1207/s15430421tip4102_2.
A. López de la Serna, "Integración de los MOOC en la enseñanza universitaria. El caso de los SPOC," 2016.
C. Gardair et al., "Les coulisses d’un massive open online course (MOOC) Sur le diagnostic des cancers," in Annales de Pathologie, 2016, vol. 36, no. 5: Elsevier, pp. 305-311, doi: 10.1016/j.annpat.2016.08.013.
T. H.-C. Chiang, "Analysis of learning behavior in a flipped programing classroom adopting problem-solving strategies," Interactive Learning Environments, vol. 25, no. 2, pp. 189-202, 2017, doi: 10.1080/10494820.2016.1276084.
D. Topalli and N. E. Cagiltay, "Improving programming skills in engineering education through problem-based game projects with Scratch," Computers & Education, vol. 120, pp. 64-74, 2018, doi: 10.1016/j.compedu.2018.01.011.
I. Blau and T. Shamir-Inbal, "Re-designed flipped learning model in an academic course: The role of co-creation and co-regulation," Computers & Education, vol. 115, pp. 69-81, 2017, doi: 10.1016/j.compedu.2017.07.014.
M. Konecki, "Problems in programming education and means of their improvement," DAAAM international scientific book, vol. 2014, pp. 459-470, 2014, doi: 10.2507/daaam.scibook.2014.37.
A. Gomes and A. J. Mendes, "An environment to improve programming education," in Proceedings of the 2007 international conference on Computer systems and technologies, 2007, pp. 1-6, doi: 10.1145/1330598.1330691.
P. Blikstein, M. Worsley, C. Piech, M. Sahami, S. Cooper, and D. Koller, "Programming Pluralism: Using Learning Analytics to Detect Patterns in the Learning of Computer Programming," Journal of the Learning Sciences, vol. 23, no. 4, pp. 561-599, 2014, doi: 10.1080/10508406.2014.954750.
D. Song, H. Hong, and E. Y. Oh, "Applying computational analysis of novice learners' computer programming patterns to reveal self-regulated learning, computational thinking, and learning performance," Computers in Human Behavior, vol. 120, p. 106746, 2021, doi: 10.1016/j.chb.2021.106746.
A. Altadmri and N. C. Brown, "37 million compilations: Investigating novice programming mistakes in large-scale student data," in Proceedings of the 46th ACM technical symposium on computer science education, 2015, pp. 522-527.
A. S. Carter, C. D. Hundhausen, and O. Adesope, "The normalized programming state model: Predicting student performance in computing courses based on programming behavior," in Proceedings of the Eleventh Annual International Conference on International Computing Education Research, 2015, pp. 141-150, doi: 10.1145/2787622.2787710.
C. Watson, F. W. Li, and J. L. Godwin, "Predicting performance in an introductory programming course by logging and analyzing student programming behavior," in 2013 IEEE 13th international conference on advanced learning technologies, 2013: IEEE, pp. 319-323, doi: 10.1109/ICALT.2013.99.
T. J. Francl, "Is flipped learning appropriate?," Journal of Research in Innovative Teaching, vol. 7, no. 1, 2014.
C.-L. Lai and G.-J. Hwang, "A self-regulated flipped classroom approach to improving students’ learning performance in a mathematics course," Computers & Education, vol. 100, pp. 126-140, 2016, doi: 10.1016/j.compedu.2016.05.006.
J. C.-Y. Sun, Y.-T. Wu, and W.-I. Lee, "The effect of the flipped classroom approach to OpenCourseWare instruction on students’ self-regulation," British Journal of Educational Technology, vol. 48, no. 3, pp. 713-729, 2017, doi: 10.1111/bjet.12444.
A. Fox, "From MOOCs to SPOCs," Communications of the ACM, vol. 56, no. 12, pp. 38-40, 2013, doi: 10.1145/2535918.
A. López, "Integración de los MOOC en la enseñanza universitaria," El caso de los SPOC, 2016. [Online]. Available: http://hdl.handle.net/10810/21968.
A. M. Kaplan and M. Haenlein, "Higher education and the digital revolution: About MOOCs, SPOCs, social media, and the Cookie Monster," Business Horizons, vol. 59, no. 4, pp. 441-450, 2016, doi: 10.1016/j.bushor.2016.03.008.
A. Escudero-Nahón, "Análisis crítico al término “masivo” en los MOOC: una Cartografía Conceptual," Edmetic, vol. 9, no. 1, pp. 188-212, 2020, doi: 10.21071/edmetic.v9i1.12252.
S. Järvelä, J. Malmberg, and M. Koivuniemi, "Recognizing socially shared regulation by using the temporal sequences of online chat and logs in CSCL," Learning and Instruction, vol. 42, pp. 1-11, 2016/04/01/ 2016, doi: 10.1016/j.learninstruc.2015.10.006.
A. Hadwin, S. Järvelä, and M. Miller, "Self-regulation, co-regulation, and shared regulation in collaborative learning environments," in Handbook of self-regulation of learning and performance: Routledge, 2017, pp. 83-106.
A. F. Hadwin, M. Oshige, C. L. Z. Gress, and P. H. Winne, "Innovative ways for using gStudy to orchestrate and research social aspects of self-regulated learning," Computers in Human Behavior, vol. 26, no. 5, pp. 794-805, 2010/09/01/ 2010, doi: 10.1016/j.chb.2007.06.007.
J. Ruiz-Palmero, J.-M. Fernández-Lacorte, E. Sánchez-Rivas, and E. Colomo-Magaña, "The implementation of Small Private Online Courses (SPOC) as a new approach to education," International Journal of Educational Technology in Higher Education, vol. 17, no. 1, 2020, doi: 10.1186/s41239-020-00206-1.
R. S. Jansen, A. van Leeuwen, J. Janssen, R. Conijn, and L. Kester, "Supporting learners' self-regulated learning in Massive Open Online Courses," Computers & Education, vol. 146, 2020, doi: 10.1016/j.compedu.2019.103771.
W. Matcha, N. A. Uzir, D. Gasevic, and A. Pardo, "A Systematic Review of Empirical Studies on Learning Analytics Dashboards: A Self-Regulated Learning Perspective," IEEE Trans. Learn. Technol., vol. 13, no. 2, pp. 226-245, 2020, doi: 10.1109/tlt.2019.2916802.
J. Kim, I.-H. Jo, and Y. Park, "Effects of learning analytics dashboard: analyzing the relations among dashboard utilization, satisfaction, and learning achievement," Asia Pacific Education Review, vol. 17, no. 1, pp. 13-24, 2015, doi: 10.1007/s12564-015-9403-8.
K. Verbert, E. Duval, J. Klerkx, S. Govaerts, and J. L. Santos, "Learning Analytics Dashboard Applications," American Behavioral Scientist, vol. 57, no. 10, pp. 1500-1509, 2013, doi: 10.1177/0002764213479363.
B. A. Schwendimann et al., "Perceiving learning at a glance: A systematic literature review of learning dashboard research," IEEE Trans. Learn. Technol., vol. 10, no. 1, pp. 30-41, 2016, doi: 10.1109/TLT.2016.2599522.
I. Jivet, M. Scheffel, H. Drachsler, and M. Specht, "Awareness is not enough: Pitfalls of learning analytics dashboards in the educational practice," in European conference on technology enhanced learning, 2017: Springer, pp. 82-96, doi: 10.1007/978-3-319-66610-5_7.
M. D. Pistilli and K. E. Arnold, "Purdue Signals," About Campus: Enriching the Student Learning Experience, vol. 15, no. 3, pp. 22-24, 2010, doi: 10.1002/abc.20025.
S. J. Aguilar, S. A. Karabenick, S. D. Teasley, and C. Baek, "Associations between learning analytics dashboard exposure and motivation and self-regulated learning," Computers & Education, vol. 162, 2021, doi: 10.1016/j.compedu.2020.104085.
R. Ferguson, "Learning analytics: drivers, developments and challenges," International Journal of Technology Enhanced Learning, vol. 4, no. 5/6, pp. 304-317, 2012, doi: 10.1504/ijtel.2012.051816.
P. R. Pintrich, "A manual for the use of the Motivated Strategies for Learning Questionnaire (MSLQ)," 1991.
C. Shi, S. Fu, Q. Chen, and H. Qu, "VisMOOC: Visualizing video clickstream data from massive open online courses," in 2015 IEEE Pacific visualization symposium (PacificVis), 2015: IEEE, pp. 159-166, doi: 10.1109/PACIFICVIS.2015.7156373.
