Assessment for Learning MOOC’s Updates

Click, Learn, Adapt: Navigating the Future and Risks of Digital Learning Analytics

The Power of Data in Digital Classrooms

Embedded learning analytics can really change how we understand student progress. In a digital classroom, every action a student takes, like how long they spend on a task, what comments they make in discussion forums, or how they navigate through an online lesson, is tracked automatically. This means teachers get real-time feedback about how well students are learning. Instead of waiting until the end of the semester for a final grade, teachers can see early signs of struggles or strengths and adjust lessons right away. For instance, the CG Scholar platform, discussed in the course videos, serve as an example to this shift. Its activity stream records classroom discussions in granular detail, ensuring every student’s voice is captured, unlike traditional settings where only a few raise their hands.

One big potential is that this system lets instruction become more personalized. Each student can get help when they need it, and teachers can design activities that match different learning speeds. It also promotes a more continuous learning process, where feedback is given all the time rather than at one end-of-course test.

However, there are challenges too. For one, privacy becomes a huge issue when so much personal data is collected. There’s a risk that sensitive information might not be well-protected. Also, the huge amount of data can be overwhelming. Teachers might struggle to figure out which data points really matter, and the focus could shift from actual learning to simply monitoring numbers. Finally, over-reliance on data might reduce the personal connection between teachers and students, making learning feel too mechanical. Balancing these benefits and challenges is key to making embedded learning analytics work well.

Digital Dashboards: A Window into Real-Time Learning Analytics

One example of a learning and assessment environment with embedded analytics is a modern Learning Management System (LMS) that uses digital dashboards. In these systems, every interaction, whether clicking through lessons, participating in discussions, or submitting assignments, is logged as "digital traces" (Zhang et al., 2023). This data is then organized into visual dashboards that show real-time progress, much like a fitness tracker for learning.

Research by Caspari-Sadeghi (2022) also shows that such dashboards automatically capture student engagement by tracking metrics like time-on-task and participation frequency. For instance, if a student repeteadly accesses supplementary materials or actively comments in discussion forums, the system flags these behaviors. Rakovic et al. (2023) explain that these digital dashboards provide both quantitative data (e.g., click counts and scores) and qualitative insights (e.g., nature of online interactions), enabling teachers to quickly identify areas where a student needs extra help or where they excel.

The case studies mentioned in this course deepen this concept. CG Scholar’s aster plot, for example, operationalizes Benjamin Bloom’s mastery learning framework by translating abstract goals into observable metrics. The plot visualizes progress across three sectors: focus (effort), knowledge (peer-rated critical thinking), and help (collaboration). By four weeks into an eight-week course, students in the Learning Design Leadership program could see their progress mastery (e.g., 62% class average), with each petal representing a specific expectation like annotation quality or peer review depth.

Schumacher (2019) also emphasized that integrating assessment with real-time analytics transforms traditional formative assessments. Instead of relying solelyon one final exam, students receive ongoing feedback that helps them adjust their learning strategies continuously. Although the benefits, such as personalized instruction and timely interventions are promising, issues like data overload and privacy concerns must be managed carefully to ensure that the system truly enhances learning.


References:

  1. Caspari-Sadeghi, S. (2022). Applying learning analytics in online environments: Measuring learners’ engagement unobtrusively. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.840947
  2. Raković, M., Gašević, D., Hassan, S. U., Ruipérez Valiente, J. A., Aljohani, N., & Milligan, S. (2023). Learning analytics and assessment: Emerging research trends, promises and future opportunities. British Journal of Educational Technology, 54(1), 10–18. https://doi.org/10.1111/bjet.13301
  3. Schumacher, C. (2020). Linking Assessment and Learning Analytics to Support Learning Processes in Higher Education. In Learning, Design, and Technology (pp. 1–40). Springer International Publishing. https://doi.org/10.1007/978-3-319-17727-4_166-1
  4. Zhang, K., Yilmaz, R., Ustun, A. B., & Yilmaz, F. G. K. (2023). Learning analytics in formative assessment: A systematic literature review. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 14(Özel Sayı), 359–381. https://doi.org/10.21031/epod.1272054