A proposal for generic competence assessment in a serious game

  1. Bezanilla, María José
  2. Arranz, Sonia
  3. Rayón Jerez, Alex
  4. Rubio Florido, Isabel
  5. Menchaca Sierra, Iratxe
  6. Guenaga Gómez, Mariluz
  7. Aguilar Gutiérrez, Eduardo
Journal:
NAER: Journal of New Approaches in Educational Research

ISSN: 2254-7339

Year of publication: 2014

Issue Title: Videogames: Opportunities for learning

Volume: 3

Issue: 1

Pages: 42-51

Type: Article

DOI: 10.7821/NAER.3.1.42-51 DIALNET GOOGLE SCHOLAR lock_openDialnet editor

More publications in: NAER: Journal of New Approaches in Educational Research

Sustainable development goals

Abstract

This paper focuses on the design of a serious game for the teaching and assessment of generic competences, placing particular emphasis on the competences assessment aspect. Taking into account important aspects of competence assessment such as context, feedback and transparency, among other aspects, and using the University of Deusto's Generic Competences Assessment Model based on the defining of levels, indicators and descriptors as a reference point, a serious game has been designed for the development and evaluation of two Generic Competences: Problem Solving and Entrepreneurship, aimed at final-year undergraduate and first-year postgraduate students. The design process shows that having a Competence Assessment Model based on levels, indicators and descriptors is of great help in defining the game's scenarios and learning and assessment activities. Serious games can also be excellent resources to help in the development and assessment of generic competences, but not as a unique tool, since the concept of competence in itself is highly complex (integrating knowledge, skills, attitudes and values) and some elements might require other methods and techniques for its development. It also reveals the difficulties of evaluating competences in general and through serious games in particular.

Bibliographic References

  • Abt, C. C. (1970). Serious Games. New York: Viking Press.
  • ADESE (2012). Anuario de la industria del videojuego. Retrieved from http://www.adese.es/index.php?option=com_mtree&task=att_download&link_id=48&cf_id=30.
  • Basque Government / Gobierno Vasco (2012). Retratos de juventud 15. Medios de comunicación. Gobierno Vasco & Observatorio Vasco de la Juventud.
  • Biggs, J., & Tang, C. (2011). Teaching for quality learning at university (4th ed.) Maidenhead: Open university press.
  • Bologna Declaration (1999). Bologna Declaration. Retrieved from http://www.bologna-bergen2005.no/Docs/00-Main_doc/990719BOLOGNA_DECLARATION.PDF
  • Boud, D., & Falchikov, N. (2006). Aligning assessment with long-term learning. Special issue: Learning-oriented assessment: Principles and practice. Assessment & Evaluation in Higher Education, 31 (4), 399–413. doi: 10.1080/02602930600679050
  • Boud, D. & Falchikov, N. (2007). Rethinking assessment in higher education: Learning for the longer term. New York: Routledge.
  • Boyle, E. A., Connolly, T. M., & Hainey, T. (2011). The role of psychology in understanding the impact of computer games. Entertainment Computing, 2, 69–74. doi: 10.1016/j.entcom.2010.12.002
  • Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012). A Systematic Literature Review of Empirical Evidence on Computer Games and Serious Games. Computers y Education, 59(2), 661–686. doi: 10.1016/j.compedu.2012.03.004
  • Crawford, C. (1984). The art of game design. Berkeley: Mcgraw-Hill Osborne Media.
  • De Freitas, S. (2006). Learning in immersive worlds. London: Joint Information Systems Committee.
  • De la Orden, A. (2011). El problema de las competencias en la educación general. Bordón: Revista de Pedagogía, 63(1), 47–61.
  • De Miguel, M. (2006). Modalidades de enseñanza centradas en el desarrollo de competencias: Orientaciones para promover el cambio metodológico en el espacio europeo de educación superior. Oviedo: Universidad de Oviedo.
  • Del Castillo, H., Herrero, D., Monjelat, N., García, A., & Checa, M. (2011). Identity & performance: developing innovative educational settings through sport video games. In Proceedings of ICERI 2011 Conference (pp. 236-246). Madrid: International Association of Technology, Education and Development.
  • Fallows, S. & Steven, C. (2000). The skills agenda. In S. Fallows and C. Steven. Integrating key skills in higher education; employability, transferable skills and learning for life (pp. 3–14). London: Kogan Page.
  • Fernández, A. (2010). La evaluación orientada al aprendizaje en un modelo de formación por competencias en la educación universitaria. REDU. Revista de Docencia Universitaria, 8(1), 11–34. Retrieved from http://redaberta.usc.es/redu/index.php/REDU/article/view/144/120
  • Ferrell, G. (2012). A view of the assessment and feedback landscape: Baseline analysis of policy and practice from the the JISC assessment & feedback programme. JISC. Retrieved from http://www.jisc.ac.uk/media/documents/programmes/elearning/Assessment/JISCAFBaselineReportMay2012.pdf
  • Gee, J. P. (2003). What Video Games Have to Teach Us About Learning and Literacy. New York: Palgrave Macmillan.
  • Gee, J.P. (2008). Video Games and Embodiment. Games and Culture, 3 (3–4), 253–263. doi: 10.1177/1555412008317309
  • Gee, J.P. (2009). Deep learning properties of good digital games how far can they go. In U. Ritterfeld, M. J. Cody & P. Vorderer (Eds.), Serious Games: Mechanisms and Effects (pp. 65–80). Mahwah, NJ: Taylor & Francis.
  • GFK Emer Ad Hoc Research (2010). ¿Cómo se proyecta el videojuego del futuro? Retrieved from ADESE website: http://www.adese.es/pdf/videojuegosimport.pdf
  • Gonzalez, J. & Wagenaar, R. (Coords.) (2003). Tuning Educational Structures in Europe (Final Report Phase 1). Bilbao: Universidad de Deusto.
  • González-Anleo, J. M. et al. (2011). Jóvenes españoles 2010. Madrid: Fundación SM.
  • Griffin, P., McGaw, B., & Care, E. (2012). Assessment and teaching of 21st century skills. Dordrecht: Springer. doi: 10.1007/978-94-007-2324-5
  • Gros, B. & GRUP F9 (2004). Pantallas, juegos y alfabetización digital. Bilbao: Desclée de Brouwer.
  • Gros, B. (2008). Videojuegos y aprendizaje. Barcelona: Graó.
  • Guillen-Nieto, V. & Aleson-Carbonell, M. (2012). Serious games and learning effectiveness: The case of it's a deal! Computers y Education, 58 (1), 435–448. doi: 10.1016/j.compedu.2011.07.015
  • Haste, H. (2009). What is ‘competence’ and how should education incorporate new technology´s tools to generate ‘competent civic agents’. The curriculum journal, 20(3), 207–223. doi: 10.1080/09585170903195845
  • Holland, D. & Lave, J. (Eds.) (2001). History in person. Enduring struggles, contentious practice, intimate identities. Santa Fe (USA) & Oxford: School of American Research Press & James Currey.
  • Juul, J. (2005). Video Games and Classic Game Model. Half-Real: Video Games between Real Rules and Fictional Worlds. Cambridge: MIT Press.
  • Koster, R. (2004). Theory of Fun for Game Design. O'Reilly Media.
  • Lacasa, P., Méndez, L. & Martínez, R. (2008). Aprender a contar historias y a reflexionar con videojuegos comerciales. In B. Gros (Ed.). Videojuegos y aprendizaje (pp. 51–72). Barcelona: Graó.
  • Legault, A. L. (2012). ¿Una enseñanza universitaria basada en competencias?¿por qué?¿cómo? Revista Electrónica De Desarrollo De Competencias (REDEC), 5(9), 51–83.
  • Lu, J. & Law, N. (2012). Online peer assessment: Effects of cognitive and affective feedback. Instructional Science, 40 (2), 257–275. doi: 10.1007/s11251–011–9177–2
  • Marcano, B. (2008). Juegos serios y entrenamiento en la sociedad digital. Teoría de la Educación: Educación y Cultura en la Sociedad de la Información, 9(3), 93–107.
  • Michael, D. & Chen, S. (2006). Serious Games. Games that educate, train and infoms. Boston: Thompson Course Technology PTR.
  • O'Neil, H. F., Wainess, R., & Baker, E. L. (2005). Classification of learning outcomes: Evidence from the computer games literature. The Cirriculum Journal, 16(4), 455–474. doi: 10.1080/09585170500384529
  • Poblete, M. & García, A. (2007). Desarrollo de competencias y créditos transferibles: experiencia multidisciplinar en el contexto universitario. Bilbao: Mensajero.
  • Prensky, M. (2001). Digital Game-Based Learning. London: McGraw-Hill.
  • Prensky, M. (2002) The motivation of gameplay: the real twenty-first century learning revolution. On the Horizons, 10(1), 5–11.
  • Prensky, M. (2005). Engage Me or Enrage Me. What Today’s Learners Demand. Educause Review, 40(5), 60–65.
  • Rodríguez, A. & Vieira, M. J. (2009). La formación en competencias en la universidad: un estudio empírico sobre su tipología. Revista de Investigación Educativa RIE, 29(1), 27–47.
  • Salen, K., & Zimmerman, E. (2004). Rules of Play: Game Design Fundamentals. Cambridge: MIT Press.
  • Sedeño, A (2010). Videojuegos como dispositivos culturales: las competencias espaciales en educación. Comunicar, 34(17), 183–189.
  • Squire, K., & Jenkins, H. (2003). Harnessing the power of games in education. Insight, 3(1), 5–33
  • Tuning Project (2008). Tuning Educational Structures in Europe. Universities´contribution to the Bologna Process; An Introduction. (4nd ed.). Bilbao: University of Deusto.
  • Universidad de Deusto (2001). Marco Pedagógico UD. Bilbao: University of Deusto.
  • Villa, A. & Poblete, M. (2008). Competence Based Learning. A Proposal for the assessment of generic competences. Bilbao: University of Deusto.
  • Villa, A. & Poblete, M. (2011). Evaluación de competencias genéricas: principios, oportunidades y limitaciones. Bordón: Revista de Pedagogía, 63(1), 147–170.
  • Villa, A., Gonzalez, J., Auzmendi, E., Bezanilla, M. J. & Laka, J. P. (2003). Learning Outcomes: Competences. In J. Gonzalez & R. Wagenaar (Eds.). Tuning Educational Structures in Europe. Final Report. Phase 1 (pp. 59–98). Bilbao: University of Deusto.
  • Wu, W. H., Hsiao, H. C., Wu, P. L., Lin, C. H., & Huang, S. H. (2011). Investigating the learning‐theory foundations of game‐based learning: A metaanalysis. Journal of Computer Assisted Learning, 28(3), 265–279. doi: 10.1111/j.1365-2729.2011.00437.x
  • Wolf, M.J.P. & Perron, B. (Eds.) (2003). The video game theory reader. New York & London: Routledge