Workplace-based e-Assessment Technology for Competency-based Higher Multi-professional Education (WATCHME)

Summary:

In professional education, workplaces are crucial contexts for acquiring the necessary knowledge and skills. Often electronic portfolios (ePortfolios) are used providing a multitextured view of each trainee’s progress. However, necessary frequent, tailored feedback is scarce and such potentially rich data is untapped, negatively impacting on trainees’ learning.

WATCHME effectively deploys Learning Analytics (LA) tools to deliver personalized learning supporting learner empowerment, Quality-of-Experience, flexibility and mobility plus efficiency gains through workplace-based feedback and assessment by developing, implementing and evaluating a mobile, electronic portfolio-based system that utilises LA and student models to gather and produce tailored data and feedback via a visualisations dashboard.

Its exclusiveness lies in the use of authentic data from the workplace and the integration of narrative & quantitative data from various sources, e.g. videos and serious educational games enabling trainees to try various realistic scenario judgement calls in a motivational and safe environment. Multi-entity Bayesian Network will be used for the student models, enabling aggregation of data and tailored Just-in-Time feedback, visualised by intuitive interfaces.

This close cooperation of educational researchers and ICT developers will deliver a tool to map critical professional activities and link these with competencies; markers for feedback and assessment at the workplace; an easy access electronic portfolio system for data collection; LA-driven tools to inform trainees, teachers and supervisors about trainee’s progress and deliver tailored, Just-in-Time feedback with intuitive visualisation tools. Results will be empirically validated for their quality and contribution to trainees’ learning. The overall system is evaluated formatively and summatively in three professional environments (human medicine, veterinary medicine and teacher training) against existing data sets.

Funding period: 2013-2016

 

DSFZ project team:

Dr. Anna Renz (Kontakt), Ylva Holzhausen, Dr. Asja Maaz, Prof. Dr. Harm Peters

 

Partner universities:

Utrecht University, Department of Education and Faculty of Veterinary Medicine

Jayway, ICT

Mateum, ICT

NetRom, ICT

Szent Istvan University, Faculty of Veterinary Science

University of Tartu, Institute of Education

Maastricht University, Department of Educational Development and Research

University Medical Center Utrecht, Center for Research and Development of Education and Department of Anesthesiology

University of Reading, ICT

University of California San Francisco School of Medicine

 

Funding:

This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 619349. Program: Framework 7; ICT

Further information about the WATCHME project: