<img height="1" width="1" style="display:none;" alt="" src="https://dc.ads.linkedin.com/collect/?pid=166025&amp;fmt=gif">

Disciplines and Themes

  • Extra-curricular experiences
  • University-wide learning initiatives

Learning focus:  

  • International study experience

Design focus:

  • One-click submission process
  • Scaffolded peer review
  • Simple review and reporting process 

The Popularity Problem - Managing An Application Process At Scale

The University of Edinburgh has been using PebblePad for over ten years, which is now widely embedded in practice. In this project, PebblePad was employed to support the application process for a Go Abroad Fund offered by the University's Global department. The fund provides financial support for students to undertake a short-term international experience linked to their studies, and the scheme has proved so popular it posed the challenge of how to select 200 successful applicants from around 1,100 entrants. Previously, Adaptive Comparative Judgement software was used, but the department had neither the available time nor the resources to mark this initial level in the application process.

Image shows a happy smiling student using digital device

We needed a technical solution that, alongside an intuitive interface for uploading submissions, enabled peer marking at scale and scaffolded the peer marking experience. And, the students’ submissions must remain anonymised throughout the peer marking process.

UNIVERSITY OF EDINBURGH

TALK TO US ABOUT YOUR PROJECT

The Peer-Assessment Ambition 

In order to support this highly popular initiative, Randall Reinhard from Edinburgh Global, and Robert Chmielewski, Online Assessment and Feedback Adviser, designed a selection process that involved applicants becoming involved as reviewers. Peer marking was considered a valuable method of initially ranking applications as it provided a means of saving tutors time from the initial marking at scale, while also enabling a meaningful peer learning activity. Having decided on the process, the team was seeking a technical solution that, alongside an intuitive interface for uploading submissions, enabled peer marking at scale and scaffolded the peer marking experience.

 

Quote marks

PebblePad offered clear advantages; it was the only technical solution available that met the fundamental requirements of the project. The sign-up process is simple, removing additional steps that the design of an equivalent process in a VLE would require. Situating all activity in PebblePad’s assessment engine, ATLAS, enables students to submit and review applications anonymously, administrators to monitor and report, and the academic tutors to pick up the rest of the process - neatly containing all activity in one workspace.



The Successful Workflow

Students sign up to be eligible for the fund, submitting their application by following a direct ‘submit to ATLAS’ link that allows them to submit their application without having to familiarise themselves with the system, a user-friendly feature of PebblePad. Designing an equivalent system in a VLE would require the student to log in, navigate to their course, seek the specific topic or quiz and then work with the relevant information. Removing a couple of interaction steps is extremely helpful in terms of reducing barriers to engagement.

After submitting their work, students also act as tutors in order to mark their peers’ applications. In a tutor role, the applicants need to mark anonymous submissions to reduce bias. Anonymity is one of the biggest advantages that ATLAS offers over other assessment systems; the students can never see whose work they are marking, but staff members can. With the user experience at the forefront, the solution design does not inhibit participation from either user perspective. PebblePad’s flexibility with permissions allows one member to act in different roles, and situating all activity in ATLAS both enables students to act in both roles and also contains all activity in one workspace.

To support the students in the review task, a bespoke Feedback Template has been created, presenting standardised Likert-style questions for the student-tutor; this reduces burdens on the student in engaging with a professional level of assessment and instead focusses on their ability as a member of the university to identify value in the submission. For administrators, monitoring and reporting is all taken care of. The reporting functionality in ATLAS automates the administrative task of compiling reports, and the CSV report on over 5,000 assessment templates can be generated within just a couple of minutes.

The PebblePad Difference

This peer assessment process and subsequent reporting takes place all within one week, leaving very little room for error. Happily, the PebblePad system and assured design has enabled the Go Abroad Fund project to work effectively over repeated iterations for the 1,100 strong group of student applicants and staff overseeing the project. 

PebblePad has helped the University of Edinburgh achieve its key project goals ...

  • Ensure that students can easily engage with - and participate in - the process without needing to be familiar with the platform.

  • Enable the peer marking process to run smoothly for all roles involved - student-applicants, student-reviewers, tutors and administrators. 

  • Monitor the process and initiate reports easily. 


Want to learn more about how PebblePad can make a difference to your project?
Schedule a chat

Four reasons why institutions like The University of Edinburgh trust us to help them make a meaningful difference to learner success.

TRUSTED EXPERTS

We're more than a little proud of our 17-year track record of helping universities scaffold learning journeys which make a meaningful difference to student success. 

CUSTOMERS FIRST

We're big enough to be trusted by leading organisations across the globe, but small enough to value every partner. It's why our customer-base, just like our team, is growing year on year.

TRANSFORMATIONAL CAPABILITY 

PebblePad offers unrivalled capability when it comes to student-centred learning - helping universities transform the learning journey on and off campus - at any scale, across any context.

SECURE & RELIABLE

Our customers rely on us to support business-critical activity at scale, 24 hours a day. You only need to look at our uptime and usage data to see that PebblePad is a platform you can trust.

VIEW more CASE STUDIES

Talk to us about your project