TeamLearn Teamwork analytics for training collaborative problem solving in professional higher education

Duration
01.12.2021–30.11.2026

TeamLearn studies how digital technologies, multimodal learning analytics and automated feedback can be employed to study collaborative problem solving and team-based learning in higher education.

Colleagues in a meeting room with laptops, participating in a Scrum meeting with Post-it notes on a wall.

Photo: Jason Goodman/ Unsplash

Contact

About the project

Student teams from medical interprofessional, nursing and legal education are studied while they solve complex problems, for example, a patient diagnosis, a critical intensive care situation or an ill-defined complex legal problem.

The project uses design-based research and develops multimodal learning analytics dashboards (MAD), which visualizes multimodal data (e.g. micro-location sensors, audio, video, object use logs, text) as feedback on the team activities. The feedback is shared with students and teachers in interventions aimed at supporting collaborative problem solving and team-based learning.

A speaker points to a PowerPoint presentation while an audience follows along in a dimly lit room.
Crina Damsa presents the Multimodal Learning Analytics Dashboard (MAD) in a lecture at the University of Oslo. Photo: Gina Paola Carrillo

Objectives

The project has four objectives

  1. Develop methodologies and indicators for the real-time feedback and guidance of teamwork in collaborative problem solving in professional education;
  2. Adapt, test, and implement a learning tool for providing automated feedback based on multimodal analytics on teamwork during learning collaborative problem solving;
  3. Generate knowledge about the effects of interventions and learning designs based on multimodal teamwork analytics on the collaborative problem-solving process and outcomes;
  4. Develop and disseminate knowledge and instruments based on multimodal teamwork analytics to support collaborative problem-solving and teamwork across professional education contexts.

Background

The project combines learning research, computer sciences and learning analytics, and includes Norwegian partners and collaboration with universities from Australia, USA, Finland and the Netherlands.

Research design

Phases

The project has four phases

Phase 1: We gather insights from stakeholders about their experiences and support needs related to teamwork and collaborative problem solving.

Phase 2: We co-design and pilot a multimodal teamwork analytics dashboard in three higher education courses. Researchers and teachers develop learning scenarios where the dashboard provides feedback to support students’ collaboration.

Phase 3: We conduct formative interventions to impact on team collaboration and performance, and collect data to document qualitative effects.

Phase 4: We carry out dissemination and exploitation activities to share results and promote broader use of the tools and findings.

Empirical Cases

Case 1. Medical Interprofessional Education

Students from various disciplines (medicine, psychology, nutrition, pharmacy, theology, pedagogy, and dentistry) engage in realistic simulations of sub-acute patient assessments. The data about team interactions and interaction with patients is visualized and used in data-supported reflection sessions with the students.

Case 2. Simulation in Nursing Education

Nursing students participate in high-fidelity acute care simulations. The multimodal analytics dashboard integrate video and physiological data to highlight key teamwork dynamics, such as closed-loop communication, task and role distribution, and stress responses, to support debriefing after the simulations.

Case 3. Legal Technology and AI in Law Education

Law students work in teams to solve open-ended legal problems using AI and technology. Groups of students collaborate in hybrid seminars and project work, addressing legal, ethical, and technological issues. The multimodal analytics dashboard providessupport reflection on collaboration by providing meeting, document and collaborative process analytics.

Participants

Collaborators

  • Centre for Experiential Legal Learning, Faculty of Law, University of Oslo (UiO)
  • Institute of Health and Society, Faculty of Medicine, UiO
  • Institute for Nursing and Healthcare, University of South-East Norway
  • Centre for Learning Analytics, Monash University, Australia

Scientific Advisory Board 

Publications

Articles in journals

Kaliisa, R., Eagan, B., Damşa, C., & Misiejuk, K. (2026). Do Modes of Presence Matter - Regulation and Participation in Graduate Students’ Hybrid Synchronous Group-based Collaboration, Learning & Instruction

Sánchez, D. & Esterhazy, R. (2025). Unpacking the Observational Feedback Generation Process in High-Fidelity Simulations. Assessment and Evaluation in Higher Education.

Esterhazy, R., Kaliisa, R., Sanchez, D., Langford, M., & Damşa, C. (2025). Advancing Multimodal Collaboration Analytics: A Scoping Review. Journal of Learning Analytics

Kaliisa, R., Lopez-Pernas, S., Misiejuk, K., Damşa, C., Sobocinski, M., Jarvela, S., & Saqr, M. (2025). A Topical Review of Research in Computer-Supported Collaborative Learning: Questions and Possibilities. Computers & Education, 10.1016/j.compedu.2025.105246 

Sánchez, D., Damşa, C., & Heyn, L., (under review). Collaborative sense-making of simulation events: A micro-ecological approach using multimodal data, Special issues in Learning and Instruction

Kaliisa, R., Eagan, B., Damşa, C., & Misiejuk, K. (under review). How Did TeamLearn—an AI-Supported Multimodal Dashboard—Impact Students’ Reflection During Collaborative Problem-Solving? Findings from a Three-Iteration Design Study, Special issues in Learning and Instruction

Kaliisa, R., Eagan, B., Damşa, C., & Misiejuk, K. (under review). How Did TeamLearn—an AI-Supported Multimodal Dashboard—Impact Students’ Reflection During Collaborative Problem-Solving?, British Journal of Educational Technology

Sánchez, D. & Kaliisa, R. (under review). Multimodal analytics dashboards to support reflection in high-fidelity nursing education, Journal of Learning Analytics

Kaliisa, R., Esterhazy, R., Damşa, C., Sánchez, D.  (in progress). An analytical framework for collaborative problem solving.

Damşa, C., & Heyn, L., Johansen, E.A., Wesenberg, E.L, Eide, H., Sanchez, D., Esterhazy, R. & Louwerens, C. (in progress). Challenging the standards of simulation: Designs for multimodal data-supported debriefing in high-fidelity in simulations.

Esterhazy, R., Brouwer, J., Damşa, C., (in progress). Leadership in teams in interprofessional education.

Esterhazy, R., Wøien, H. Mathiesen, L., Damşa, C. (in progress). Pedagogical and technological designs for supporting interprofessional collaborative learning.

Damşa, C., Esterhazy, R., Dolonen, J.A., & Karlgren, K. (in progress). AI-supported coding of multimodal interaction data.

Papers in conference proceedings

Kaliisa, R., Damşa, C., et al. (2026) TeamLearn: A Multimodal, AI-enhanced Dashboard for Reflection During Collaborative Problem-Solving, Proceedings of the Anual Meeting of the International Society of the Learning Sciences, Irvine, CA, US.

Damşa, C., Echeverria, V., et al., (2025). Enhancing Team-Based Medical Simulations: Learning through Reflection with Analytics and AI Tools, In Oshima, J., Chen, B., Vogel, F., & Järvelä, J. (Eds.). (2025). Proceedings of the 18th International Conference on Computer-Supported Collaborative Learning - CSCL 2025. Helsinki, Finland: International Society of the Learning Sciences.

Damşa, C., Kaliisa, R., et al. (2025). Towards Supporting Group Learning through Design-based Research and Multimodal Data-based Tools, In Oshima, J., Chen, B., Vogel, F., & Järvelä, J. (Eds.). (2025). Proceedings of the 18th International Conference on Computer-Supported Collaborative Learning - CSCL 2025. Helsinki, Finland: International Society of the Learning Sciences.

Sanchez, D., Damşa, C., et al. (2025). Sense-making through Reflection supported by Multimodal Dashboards in Team-based Simulations in Nursing Education, In Oshima, J., Chen, B., Vogel, F., & Järvelä, J. (Eds.). (2025). Proceedings of the 18th International Conference on Computer-Supported Collaborative Learning - CSCL 2025. Helsinki, Finland: International Society of the Learning Sciences.

Damşa, C., Esterhazy, R., et al. (2025). Group-based simulations in interprofessional medical education: A micro-ecological approach for learning analysis and design, In Rajala, A., Cortez, A., Hofmann, R., Jornet, A., Lotz-Sisitka, H., & Markauskaite, L. (Eds.). (2025). Proceedings of the 19th International Conference of the Learning Sciences - ICLS 2025. Helsinki, Finland: International Society of the Learning Sciences.

Kaliisa, R., Damşa, C., Misiejuk, K., & Eagan, B. (2025, June). Understanding the impact of physical, online, and hybrid modalities on self and co-regulation during collaborative problem solving. Paper presented at the ISLS Annual Meeting, Helsinki, Finland.

Kaliisa, Rogers & Damsa, Crina I. (2025). Understanding the impact of physical, online, and hybrid modalities on self and co-regulation during collaborative problem solving. ISLS2025: CSCL – The International Conference on Computer-Supported Collaborative Learning 2025

Sánchez, D., Kaliisa, R., Esterhazy, R., & Damsa, C. (2024). Unpacking the Elicitation Process for Multimodal Learning Analytics based Feedback. Companion Proceedings 14th International Conference on Learning Analytics & Knowledge (LAK24), Kyoto, Japan.

Sánchez, D. (2024). Learning Under Stress: Enhancing Team-Based Simulation Training with Multimodal Data. Proceedings of the 17th International Conference on Computer-Supported Collaborative Learning. International Society of the Learning Sciences, Buffalo, USA

Kaliisa, R., Dane, J. O., Sanchez, D., Pratt, J., Damsa, C., & Scianna, J. (2023). Understanding group dynamics during synchronous collaborative problem-solving activities: an epistemic network approach. In International Conference on Quantitative Ethnography (pp. 81-95). Cham: Springer Nature Switzerland. Damsa, C. I.; Muukkonen, H., Gasevic, D., Janssen, J. J. W. M., Van Leeuwen, A.& Esterhazy, R. et al. (2022). Contrasting analytical approaches to trace collaborative learning with knowledge object . Computer-Supported Collaborative Learning Series (CSCL). ISSN 1573-4552.

Kaliisa, R., López-Pernas, S., Misiejuk, K., Saqr, M., & Damsa, C. (2024). Exploring the Dynamics and Trends of Knowledge Exchange: A Structured Topic Modeling Approach of the CSCL Conference Proceedings. In Proceedings of the 17th International Conference on Computer-Supported Collaborative Learning-CSCL 2024, pp. 261-264. International Society of the Learning Sciences.

Presentations in international and national conferences

Sanchez, Daniel; Damsa, Crina I.; Carrillo, Gina Paola; Heyn, Lena & Olesen, Susanne (2026). Multimodal Data-supported Debriefing: Enabling collaborative sense-making through video, transcripts and physiological data in Nursing education, 31st Annual Meeting of the Society for Simulation in Europe (SESAM 2026)

Kaliisa, Rogers; Mladenovici, Velibor; Damsa, Crina (2026). Rethinking Learning and Collaboration in the Age of Generative AI, Paper presentation at the EARLi SIG4 & 11 conference, Helsinki, Finland. 

Esterhazy, Rachelle; Arnim, Hugh Alexander von & Damsa, Crina I. (2025). Multimodal learning analytics to explore key moments of interdisciplinary knowledge-construction, LAK25 - The International Conference on Learning Analytics & Knowledge

Esterhazy, R., von Arnim, H., Damşa, C. (2024). Poster: Multimodal learning analytics to explore key moments of interdisciplinary knowledge construction, EARLI-SIG27 Conference, Trondheim, Norway.

Kaliisa, R., Esterhazy, R., Damsa, C., Dolonen, J., Eagan, B. (2024). The temporality of epistemic, procedural, and social dynamics in collaborative problem-solving. EARLI-SIG27 Conference, Trondheim, Norway.

Sánchez, D., Damsa, C., Esterhazy, R., von Arnim, H. (2024). Sense-making and Use of Multimodal Feedback in Team-based Simulations in Nursing Education. EARLI-SIG27 Conference, Trondheim, Norway.

Esterhazy, R., Kaliisa, R., Sanchez, D., Langford, M., Damşa, C., (2023). Multimodal collaboration analytics in collaborative problem solving – a scoping review, EARLI2023, Thessaloniki, Greece.

Kaliisa, R., Esterhazy, R., Sánchez, D., Damsa, C. (2023). Towards a conceptual framework for assessing collaborative problem solving in co-located settings using multimodal analytics. Nordic LASI, Oulu, Finland.

Sánchez, D., Kaliisa, R., Esterhazy, R., Damsa, C. (2023). From multimodal data to meaning: Developing interpretations of learning in team-based simulations, Nordic LASI, Oulu, Finland.

Sánchez, D., Esterhazy, R., Damsa, C. (2023). Automated Feedback and Learning Design for Collaborative Problem Solving in Simulation Scenarios, EARLI2023, Thessaloniki, Greece.

Damşa, C. (2023). Keynote presentation: Together for Learning: Understanding the Ecosystem of Collaborative Learning, EARLI2023; Thessaloniki, Greece.

Damşa, C. (2023). Keynote presentation: Understanding and teaching collaborative learning, Learning conference, University of Bergen

Crina Damsa, Rachelle Esterhazy, Daniel Sanchez, Rogers Kaliisa (2024, December). Teamwork analytics for training collaborative problem solving in professional higher education, USN Research forum

Crina Damsa, Rachelle Esterhazy, Daniel Sanchez, Rogers Kaliisa , TeamLearn (2024, May). Teamwork analytics for training collaborative problem solving in professional higher education, USN konferanse.

Crina Damsa, Rachelle Esterhazy, Daniel Sanchez, Rogers Kaliisa (2023, October). TeamLearn - Forskningsprosjekt om læringsanalyse som verktøy i problemløsning og teamarbeid i profesjonsutdanning, Nettverksmøte for Helsefaglig Simulering i Helse Sør-Øst

Crina Damsa, Rachelle Esterhazy, Daniel Sanchez, Rogers Kaliisa (2022, October), Samarbeidslæring –pedagogiske prinsipper med relevans for tverrprofesjonelt arbeid og utdanning

Susanne Olesen, Edda A. Johansen, Lena Heyn (2022). Simulation based training with data-driven feedback for ICU nurse students, SimPro2024, The Fourth International Conference on Analyzing practices and advancing pedagogies for professional Learning.

Norwegian version of this page
Published Sep. 23, 2024 10:18 AM - Last modified Oct. 5, 2026 7:16 PM