Evaluation of the CSU Online Learning Model

The evaluation report from our Phase 1 implementation of the Charles Sturt University Online Learning Model (OLM) is now available. The report, authored by Sarah Hyde, along with myself and Lindy Croft-Piggin includes some really interesting findings about what online students value and how we can improve their learning experiences.

Some of the key findings were as follows:

  • Online students crave interaction with the lecturer, with teacher presence aligning strongly with student satisfaction;
  • Online students are strategic in their engagement with content and are most likely to interact with other students when there is a clear purpose;
  • There is a very strong demand for high quality recorded online lectures with authentic assessment tasks and interactive quizzes also highly desired;
  • Implementation of the elements within the OLM align with measures of student engagement;
  • Academic staff and educational designers desire longer lead times and increased overall time allocation to the design and development of online subjects; and
  • Academic staff need to be consulted early and regularly with regard to any pedagogical strategy to improve student learning and need reassurance that the recommended strategies are based on evidence, will be supported, and will have a positive impact on student learning.

The evaluation focussed on the processes used to implement the model, student learning experiences, and student and staff perceptions about the elements of the model. The scope of the evaluation encompassed implementation of the model in 116 online subjects within the Bachelor of Accounting, Bachelor of Business (HRM), Bachelor of Social Science (Psychology), Bachelor of Social Science (Social Welfare), Bachelor of Social Work, Master of Social Work, Bachelor of Nursing, and Bachelor of Medical Science courses. All students and staff in the 116 subjects were invited to participate in the evaluation, and 1270 students, 34 academic staff and 12 education support staff responded to a survey and 19 students were interviewed.

The evaluation is likely to be of interest to anybody involved in improving the quality of their online subject design and teaching and can be downloaded from http://lou.uimagine.edu.au/olm-evaluation-report/ 


New book on Technology Enabled Learning Design by Matt Bower

Matt Bower’s new book, Design of Technology-Enabled Learning: Integrating Research and Practice, published by Emerald, is an excellent introductory text on educational technology theory, research, and scholarly practice. The book provides an excellent grounding in theory, drawing on foundational learning theories, ideas from cognitive psychology, seminal taxonomies and key concepts such as technology affordances. However, the stance on theory is inherently practical, with explicit connection to the practice of educational design and teaching in a technology rich context.

The publication of the book is timely, as it includes a comprehensive and critical coverage of many of the ideas that have occupied the attention of researchers and experienced practitioners in recent years, including the TPACK framework, the ‘digital natives’ debate, and the idea of connectivism as a new learning theory. Many of the applications of new technologies given attention within the book are those predicted by futurists to be important in coming years, including mobile, social media and virtual world technologies.

The book contains citations to key relevant literature throughout, including seminal theoretical publications and key research publications providing the evidence base for the design ideas presented. The reference list alone would make the book a vital source for any new research students in educational technology.

In addition to providing an excellent summary of the key educational technology research and implications for practice, the book also contains numerous original categorisations, taxonomies, visual representations and abstractions of ideas which will provide an excellent scaffold for learning designers trying to digest the material for use within their practice. Most importantly, the later chapters also provide explicit advice drawn from key learning design theorists to help teachers and designers to navigate a pathway from educational objectives to contemporary technology-enabled learning designs.

I would recommend this book as a foundational text for anybody commencing educational technology research, scholarly reflection on technology-enabled teaching, or learning design practice.

Can we achieve automated subject specific study advice for students at scale?

Many universities now have systems for monitoring students’ overall online engagement but such systems are blunt instruments because they don’t take into account the intended online behaviour for specific subjects. On the other hand, systems such as the SRES allow individual teachers to create tailored dashboards and notifications for students, but these systems require substantial commitment by teaching staff to undertake the customisation required.

At Charles Sturt University we are developing a system that simplifies the customisation process with the goal of scaling up implementation across entire programs and eventually across all online programs offered by the university. The system will allow the subject designer to easily tag individual online learning resources such as videos, animations and readings, and individual learning activities such as forum discussions, quizzes and simulations, as important to the completion of specific assessment tasks, and will then automatically provide students with study advice during the teaching session based on their individual online behaviour.

I’ll be talking about our plans in this space at the 2nd Annual Learning Analytics Summit in Melbourne in June. The session will illustrate:

  • The benefits of subject specific as distinct from generic analytic driven study advice for students;
  • Examples of different learning designs with different intended student online engagement patterns;
  • Existing solutions to providing automated study advice to students customised to specific learning designs; and
  • The alternative approach being taken within the system under development at CSU which simplifies the customisation process to allow at scale implementation.