Mobile Learning infokit / Evaluation
  • If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

  • Files spread between Dropbox, Google Drive, Gmail, Slack, and more? Dokkio, a new product from the PBworks team, integrates and organizes them for you. Try it for free today.

View
 

Evaluation

Page history last edited by Doug Belshaw 8 years, 5 months ago

 

A major task for educational evaluation is to identify and analyse learning within and across contexts. For mobile learning, the interest is not only in how learning occurs in a variety of settings, but also how people create new contexts for learning through their interactions and how they progress learning across contexts.

Vavoula & Sharples (2008)

Evaluating a change involving technology can be challenging for a variety of reasons, from the number of variables involved to the 'Hawthorne Effect' (explained in Cost/benefit section). For mobile learning the complexities surrounding evaluating the success of an initiative are often heightened because of the added difficulty of evaluating across various contexts. Vavoula and Sharples (2008) argue that "in order to establish, document and evaluate learning within and across contexts" it is necessary to analyse:

 

  • physical setting and layout of the learning space (the 'where')
  • social setting (who, with whom, from whom) 
  • learning objectives and outcomes (why and what)
  • learning methods and activities (how)
  • learning progress and history (when)
  • learning tools (how) 

 

In order to be able to evaluate the effectiveness of a change management initiative it is important to have a baseline from which to work as well as clear success criteria. Whilst projects may often yield unexpected benefits (and come up against unexpected barriers) it is important to share the key elements against which the project shall be judged.

JISC has a range of resources and publications to help institutions evaluate mobile learning initiatives:

 

 

Traxler (2007, p.8-9) points out that “there are no a priori attributes of a ‘good’ evaluation of learning” but that there are, however, some “tentative candidate attributes” of what would make a ‘good’ evaluation of mobile learning initiative. These are that mobile learning should be:

 

  • Rigorous (trustworthy and transferable conclusions)
  • Efficient (cost, effort, time)
  • Ethical
  • Legal
  • Proportionate (“not more ponderous, onerous, or time-consuming that the learning”)
  • Appropriate (technology, learners, ethos)
  • Consistent
  • Authentic
  • Aligned (to chosen medium/technology)

 

Using these as headings for the evaluation of a mobile learning initiative allows organisations to focus on those aspects of mobile learning that make a real and sustainable impact on an institution.

 

References

 

  • Traxler, J. (2007) 'Defining, Discussing, and Evaluating Mobile Learning: The moving finger writes and having writ…' (International Review of Research in Open and Distance Learning, 8(2), June 2007)
  • Vavoula, G.N. & Sharples, M. (2008) ‘Challenges in Evaluating Mobile Learning’ (in Traxler, J., Riordan, B., Dennett, C. (eds) Proceedings of the mLearn 2008 Conference (School of Computing and Information Technology, University of Wolverhampton, pp. 296-303)

 

Image CC BY James Bowe