Showing posts with label pedagogy. Show all posts
Showing posts with label pedagogy. Show all posts

Thursday, May 21, 2015

What to See in Cambridge (UK) in July

Any suggestions as to what to do in Cambridge (UK) in July? I have visited twice before by bus and bicycle.

I will be at Fitzwilliam College, Cambridge, 21 to 26 July 2015, to present a paper at the 10th International Conference on Computer Science and Education (ICCSE 2015). Normally when speaking at a conference I also give a free public talk for government, professionals and academics, hosted by a local body. Anyone willing to host a talk please let me know. On a previous visit I talked at the Cambridge Computer Lab.

The paper for the conference (prepared with Hao Wu), is "Time-shifted Learning: Merging Synchronous and Asynchronous Techniques for E-Learning":
E-learning techniques are usually classified into two broad categories: synchronous and synchronous. The core question of this research is how to combine synchronous and asynchronous techniques in e-learning software, so it can have a stronger connection with constructivist education. The benefits and drawbacks of existing e-learning software is looked at broadly. Three popular e-learning packages used at the Australian National University are investigated: Adobe Connect (synchronous), Moodle and edX (asynchronous). The results of a brief survey of edX students is reported. Using the results of this work a team of students at the ANU Research School of Computer Science is now implementing enhanced asynchronous software to be plugged into Moodle and other asynchronous e-learning packages.
Worthington, T. & Wu, H. (2015, July). Time-shifted Learning: Merging Synchronous and Asynchronous Techniques for E-Learning. In Computer Science & Education (ICCSE), 20152 10th International Conference on (accepted paper). Preprint: http://hdl.handle.net/1885/13554

ps: Any suggestions on where to stop and speak on the way from Australia to Europe would also be welcome. For example, in 2008 I stopped off in Kuala Lumpur and filled in for a missing speaker at the 2008 World Congress of Information Technology.

Thursday, July 11, 2013

Technology Outlook for Australian Tertiary Education 2013-2018

The report "Technology Outlook for Australian Tertiary Education 2013-2018" (Johnson, L., Adams Becker, S., Cummins, M., Freeman, A., Ifenthaler, D., and Vardaxis, N., 2013) was produced by New Media Consortium (NMC) and
Open Universities Australia. I found their short term topics of most interest. But in all of this I suspect the technology which will have most impact is the use of relatively conventional small scale, closed on-line learning for teaching teachers how to teach.

Time-to-Adoption:
  • One Year or Less:
    1. Learning Analytics,
    2. Massive Open Online Courses,
    3. Mobile Learning
    4. Social Media
  • Two to Three Years:
    1. 3D Printing
    2. Badges
    3. Information Visualisation
    4. Location-Based Services
  • Four to Five Years:
    1. Flexible Displays
    2. The Internet of Things
    3. Virtual and Remote Laboratories
    4. Wearable Technology

Tuesday, July 09, 2013

Higher Education Whisperer Helping Improve University Course Design

For the second year running I received high student feedback scores for the course "ICT Sustainability" I designed and run at the Australian National University. Other lecturers have asked how I did this and for tips on improving their courses. I didn't think I was doing anything exceptional with course design or assessment. But then realized I had spent a year studying for a Graduate Certificate in Higher Education and four years refining on-line course design and delivery. In that time I guess I learned a thing or two. So I thought I would offer some tips on how to improve courses.

The title "Higher Education Whisperer" is inspired by Dr Inger Mewburn's "Thesis Whisperer" blog. The term whispering is from horse whispering: training based on a rapport with the animal, observing behavior and having respect. I have found the same applies to students: you need to see things from the student's point of view, look at what they actually do and treat them as people. A teacher who assumes their students are stupid, lazy and dishonest should not be surprised if they do not inspire effort from the students and get poor feedback scores.

The best way I have found to see things from the student's perspective is to enroll in a course. The obvious course to enroll in is one on teaching, where you can look at the research available on student behavior. It can be difficult for a teacher to come to terms with student behavior, even when confronted by the evidence. The most obvious case is with assessment. Assessment is very important to students, which should be obvious to teachers, but many design courses with assessment as an afterthought.

The first thing to look at to improve a course is the assessment. In a recent case I looked at the assessment for a course which was not popular with students. The first obvious problem was that there was a 60% final examination. Such examinations are very stressful for students (and for staff making them), not useful aid to learning and not an effective way to assess what students have learned. So I suggested reducing the exam to 30%.

Also I suggested moving more of the assessment to the first half of the course (up from 20% to 44%). Staff complain that students don't study until just before the final exam, but if you design the assessment that way, what can you expect? Increasing an early assignment from 7% to 20% provided more reward for the student's effort and the opportunity for this to be a learning exercise not just final assessment. For simplicity I suggested also increasing the second assignment from 13% to 20% to match the first.

The course already had 15% allocated for small weekly assessment items. This is a good way to keep students working and also having them pay attention to feedback provided (as it has a mark attached). But the assessment scheme confusingly had the top 10 of 12 items assessed. I suggested a simple sum of all 12 weeks, increased to 24% (2% per week).

Also it is important that students get their mark and feedback promptly each week for the previous week. This is particularly important early in a course so that students who are not doing well (or not doing anything) get the message: "Shape up or ship out".

The final suggested scheme was:
  1. Weekly Work: 24% (+9%) 
  2. Assignment 1: 20% (+13%)
  3. Mid Semester Exam: 10% (+5%)
  4. Assignment 2:20% (+7%)
  5. Final Exam: 26% (-34%)
Obviously the assessment scheme could be revised further, but these changes should greatly reduce the stress on students (and on staff).

Another change is to make deadline firm. Teachers make the mistake of thinking if they provide "flexibility" with assessment it will be appreciated by students. But if you have rubbery deadlines you will cause confusion, stress and a perception of unfairness. If there is a deadline for an assignment, then make it firm: students who do not submit on time get zero marks. Obviously there needs to be provision for special circumstances, such as due to illness. But this should be exceptional, not routine.

Particularly when training professionals, on whom the lives of the community depends (such as doctors, engineers and computer programmers)  deadlines matter. A professional who does not learn to deliver work on time is a danger to the community.

Thursday, July 04, 2013

Google Glass Opportunities for Wrapping Old Ideas Up in New Techno-Babble


Mathews proposes streaming text chat to Google Glass while leading a discussion or lecturing. I have tried doing this while running a webinar. I found it very difficult to talk and follow the text back-channel at the same time. Most of the webinars I attend have a moderator, separate to the presenter, to handle the text. I can't see that having a head-up display for the text would imprve the situation.

Mathews suggests engaging students in the process of course creation. But creating a course takes months, if not years, of mostly tedious detail work. It seems unlikely that any student would want to sit through a live unedited recording from Google Glass of this. Students are likely to say that it is the lecturer's job to create the course, so they then get just the edited highlights.

I have produced several stream of consciousness type blogs while creating courses, but I would not expect my students to read all that waffle. As an example the 21 part series "e-Learning Course on Green ICT Strategies".

Mathews comments "... I have no real sense of how my students learn ...". There is extensive research on how students learn, some conducted using video recordings. Courses on teaching cover this material.

Mathews suggests cognitive life logging will have education value. Having read many postings with photos of what people had for lunch, I do not think this will be improved by a running commentary as they eat? ;-(

This back-story of a course, or someone life may be of interest, but will require considerable editing. It could be presented as pop-ups on a web page. I
can't see that a head-up display would really improve this.

Mathews envisions developing courses which incorporate self-reflexivity. However, such reflection is now a common part of advanced professional courses. The student submits a reflective journal, which can be text from their e-portfolio, video or some other format, such as interpretive dance (I am not making this up). At the moment I am trying a MOOC about vocational education, using a Moodle - Mahara interface. You fill in your Mahara e-portfolio and then press a button to submit it via Moodle for marking. So this is not new.

In education, we are continually looking at reflection, attitudes and cognition. But I can't see that a head-up display will help with this. Dressing up existing educational techniques in techno-babble to make it sound new will certainly not help.

My goal is to aid my students to be able to work with text. If they can do that they may then be able to tackle other media, such as video. Quality video is carefully planned in much the same way a written work is designed. You don't just turn on the camera and start talking.

Mathews concludes "Today I beheld the future… and it was beautiful. ...". Perhaps I am more cynical, as I work in a building where computer scientists and engineers invent new gadgets. Some of what they invent might be revolutionary one day (one example is WiFi developed by CSIRO, who have offices in the other half of the building). I occasionally asked to comment on new gadgets, most of which do not live up to their initial promise. So my conclusion is:
I have seen the future and it looks much like the present, but needs more batteries to operate.

Wednesday, July 03, 2013

Technology Plus Traditional Teaching for an On-line Education Revolution

My notes for "MOOCs with Books" at IR and Friends, 4pm 8 July, at CSIRO in Canberra, are available for comment. Both the Slides and notes are available.Book at Eventbrite.
I will be presenting again for the SA E-learning Support Services Webinar, 1pm 17 September and ACS Branch Forum, 12 November 2013 in Canberra.
A quiet revolution is taking place in Australia's schools, TAFEs and universities, with education moving on-line. Award winning education designer Tom Worthington will provide an overview of the trends and its implications for education:
  1. Massive Open Online Courses (MOOCS)
  2. Social media for education
  3. Open Source e-Portfolio software
  4. Cloud based Learning Management Systems (LMS)
  5. e-Book textbooks
  6. Portable course-ware formats
See also:
  1. Synchronizing Asynchronous Learning: Combining Synchronous and Asynchronous Techniques
  2. A Green Computing Professional Education Course Online
  3. On-line Professional Education For Australian Research-Intensive Universities in the Asian Century

Friday, June 28, 2013

Standards for e-Learning Modules

The Australian Government has issued "VET specifications for packaging and sharing content and courses".  The report looks at standards for allowing e-learning content to be easily installed in Lean ring Management Systems.Standards considered include:
  1. IMS Common Cartridge (IMS CC)
  2. Sharable Content Object Reference Model (SCORM 2004)
  3. Experience/Tin Can API (Tin Can)
  4. IMS Content Packaging (IMS CP)
  5. IMS Learning Tools Interoperability (IMS LTI)
One limitation I have found with the implementation of such package formats is the assumption that the central LMS will always be accessible to the student. Many people in the world have only intermittent Internet access and so are excluded from on-line education. This includes some people in developing nations, military personnel on deployment and even some in rural and remote Australia.

The packages are relatively compact zipped files of web based documents.  But to be used, the package is imported into a LMS and unzipped, where it becomes much larger and can only be used by the student while they are connected to the LMS via the Internet. Even though the student may be doing synchronous e-learning, they are forced to use a synchronous connection to do it.

It should be possible to use the same packaged formats off-line. That is, the student would bicycle to their local cyber-cafe, connect to the LMS, choose the package they wanted and then download it, still in its compact zipped format. They would then disconnect from the LMS, cycle home, and install the package on their, PC, laptop, tablet or smart phone. They could then interact with the package off-line. Occasionally they would need to connect to the Internet to upload a progress report, but that would only need a slow, brief connection, perhaps via a smart phone (or SMS).


ps: I will be speaking on "MOOCs with Books" in the CSIRO Seminar Room at ANU, 4pm, 8 July 2013.

Monday, June 24, 2013

ANU MOOCs for Exploring Education Not Profit

Greetings from the Australian National University in Canberra, where Professor Marnie Hughes-Warrington,  Deputy Vice-Chancellor (Academic) is reprising her keynote presentation to the THETA conference ‘Navigating the Edge of the World’. Professor Hughes-Warrington started by explaining that as a historian, she could use her skills to get a perspective on on-line education, and MOOCs in particular. When exploring a new territory, the explorers project their own wishes on the unknown.

Professor Hughes-Warrington explained that as a new initiative MOOCs are an exploration, not a business venture for ANU. At the same time she argued that MOOCs have very large numbers of students and so there is potential for this being treated as a startup, which would later earn income.

Professor Hughes-Warrington pointed out that many of those undertaking MOOCs are school students and those with degrees. The MOOC therefore can act as a way to connect with potential students.

Professor Hughes-Warrington discussed how ANU is adapting to on-line education. There are obvious synergies between MOOCs and traditional on-line courses. ANU has been offering on-line and blended courses for many years (I have been running COMP7310 on-line since 2009).

Professor Hughes-Warrington also discussed more flexible evidence based forms of assessment, using e-portfolios. This is particularly applicable, in my view, for postgraduate education.

Professor Hughes-Warrington poitned out ANU has a Course Assessment: Consultation and Finalisation policy. ANU students are required to be consulted about the proposed assessment at the start of a course. The logistics of how to do this with a course having a large number of students is challenging. In my view the ANU policy should be dropped for other reasons: it is unfair on the students. As a student, one of the primary criteria I use to select a course is the assessment. If the assessment is changed after the course starts, then the student is not getting what they signed up for.

One area I suggest need to be explored is to look at education from the point of view of the learner, not the educator. Spending a year as a student of higher education, the most important insight was how hard it was being a student and how administrative problems were so frustrating. One of the advantages of e-learning is that it puts problems with administration out in the open, where hopefully they will be solved.

ANU is taking a cautious approach to MOOCs, as was done with the ANU e-Press. In my view there is a risk that other institutions may over-invest in free on-line courses, with the irrationally exuberant idea that some time soon, somehow, this will make them money. We may be at the beginning of a MOOC bubble which will burst within a year, bankrupting universities and companies, much like the  1990s Dot.COM bubble.

ps: I will be speaking on "MOOCs with Books" in the CSIRO Seminar Room at ANU, 4pm, 8 July 2013.

Sunday, June 23, 2013

Australian Universities and the Global Gymnasium


Donald Meyers' book "Australian Universities: A Portrait of Decline" makes an interesting counterpoint to "Raising the Stakes: Gambling with the future of universities" (2013) by Peter Coaldrake and Lawrence Stedman. Both books criticize government interference in the running of universities, but Coaldrake and Stedman have a much more positive outlook on the future. Another difference is that Meyers' book is available free on-line, whereas the reader has to pay for access to Coaldrake and Stedman's words.

For a short summary of Meyers' book, see "The Academy in Decay" (Ruth F. G. Williams in Agenda, 19(2), ANU ePress 2012). This is available free online as a web pages, as well as free eBook and conventional paperback.

Ancient Agora (place of assembly) of Thessaloniki. A modern glass floor has been installed to show excavations under the amphitheatre.
For those wondering about the title of the first section of Williams' article "The academy and the agora", "The academy" was the site of a sacred grove of olive trees near Athens and Plato's school of philosophy (thus the prototype university) whereas the agora was the ancient town square, used for both political meetings and commerce (depicted in the 2009 film Agora). But another ancient site of learning and physical activity may also be relevant: Gymnasium (more on this later).

Publications detailing past experiments in Australian tertiary education are timely, as Australia embarks on another grand experiment, with federal funds being redirected from universities to schools. Already this has lead to some rationalizations, with the University of Canberra cutting some language courses and sending student to ANU language classes instead.

A different perspective of higher education is provided by "The Idea of the Digital University: Ancient Traditions, Disruptive Technologies and the Battle for the Soul of Higher Education" by Frank Bryce McCluskey and Melanie Lynn Winter (2012). This book is about what lessons the "American Public University System" (a for-profit company), can teach the public system.

ANU Budget Consultation Process

The ANU has embarked on an exercise to save about $50M a year, asking staff and students for suggestions. I had an entertaining few weeks submitting eight suggestions for improving administrative, research and educational practices at ANU. Part of the fun is in seeing how the suggestions were edited by the ANU secretariat for publication. ANU has done a reasonable job consulting staff and made the brave decision to make the suggestions public. The summarization of the suggestions is reasonable and it will be interesting to see what decisions the ANU Council makes.

The ANU suggestions were grouped into four clusters and here are some I found most interesting:
  1. Revenue
    • Grow student numbers (14 suggestions): The commentary suggests that domestic undergraduate students are the largest potential growth area, with the current deregulated environment, but ANU aims to remain a research-intensive university. Another reason not to pursue more domestic students is that the federal government, will likely introduce measures to curb government subsidies for these students in the next year. In Suggestion 101 "Professional development single courses" I proposed 'Rename the “Fee paying non-award” course option to “Professional development single courses”, as at USQ: This would encourage more full fee paying students.'
    • Pursue on-line courses (13 suggestions): Surprisingly, the commentary indicates that ANU has no strategy towards on-line courses. This is curious, as the university has invested in the technical infrastructure to support  on-line courses and use it to run the on-line ANU course COMP7310. The ANU  did not embark on a growth path with multiple Australian and international campuses, which has caused other universities financial problems. I suggest a relatively modest investment in training staff in on-line learning techniques and additional educational support staff could produce a growth in international student numbers (and revenue). Using new educational techniques this could also improve student outcomes. In  Suggestion 201 I proposed to "Convert the ... University Teaching and Learning modules to e-learning format. Make these a formal postgraduate course. Offer the course to ANU students. Encourage staff to use the course as a template for their own courses."
  2. Non-staff expenses
    • Improve energy efficiency and actively reduce usage of energy (27 suggestions): The commentary envisages a saving of 10% on energy use (about $2M per year). This seems easily achievable from the work my ICT Sustainability masters students have done, assessing energy use of campus buildings
    • Examine ANU procurement and enable areas to seek best value for money – examples include office supplies, IT, refurbishment and cleaning (41 suggestions): The commentary discusses consolidation of purchasing to save costs. However, it would be worthwhile first looking for over-provisioning. As an example, as part of energy reduction measures, I have students categorize staff in an organization and then allocate the appropriate IT equipment. As well as save energy, this can save costs.
  3. Staffing
    • Tighter and more transparent performance management, enforcement of performance expectations (28 suggestions): Measuring performance in a university can be difficult, with research delivering returns over a very long period and education subject to many external pressures. One measure not discussed by the commentary are performance measures on university departments (called "colleges" in ANU).
    • In Suggestion 178 I proposed 'Merge all the staff at ANU who support learning and course development at ANU into one organization along the lines of UniSA’s “Learning and Teaching Unit” (LTU)'.
  4. Administration and systems
    • Consolidation/removal of duplication – general (46 suggestions): The commentary notes that ANU professional (non-academic) staff numbers are higher than any other GO8 university. However, ANU's emphasis on research requires more support staff. As an example, the ANU can't just use off the shelf computer hardware and software to support research into new IT systems and these bespoke systems (which will become the products of tomorrow) require more support. One example is the development of new e-learning software. But streamlining can be a false economy, in Suggestion 258 I proposed "Move ANU email to servers in Australia, using commercial contractors and/or a consortium of Australian universities.".
    • Streamline business and student processes into single processes for the entire University – general (31 suggestions): The commentary notes ANU's paper-based approach to administrative processes, but questions how quickly this could be changed. One way I suggest the change could be accelerated is through training of staff in on-line working. In many cases paper based forms with signatures (or their PDF equivalent) are devised where there is no need. I discussed this in
      Suggestion 234 "Remove most paper and PDF forms from ANU administration. Make use of the ANU’s on-line systems to record information.". To improve the quality of coruses,as well as streamline processes, in
      Suggestion 190 I suggested 'Add a field to Study-at for each course, to indicate if the Student Experience of Learning and Teaching (SELT) survey is conducted and make “yes” the default. Course conveners would have the option of changing the setting to “no”. The ANU’s IT system would read the setting in Study-at and issue the survey if the setting is “yes”. Also include a one to five star rating for each course in StudyAt, with a link to the detailed SELT results.' In Suggestion 98
      I proposed to 'Flip the Graduation Process
      Make awards to students within one week of their completing their program. Send an email with a link to the electronic copy of their certificate and details of how to receive an optional paper copy and attend an award ceremony. Issue electronic tickets for guests to attend the ceremony.' In Suggestion 200
      I proposed to "Flip ANU’s governance, by using on-line tools for consultation and decision making, in the same way the “flipped classroom” improves education. Rather than communicating detailed information verbally face to face at meetings, it can be placed on-line and then the valuable meeting time used for discussion and feedback"

Open Access e-Publishing Part of the Academy

Getting back to the commentary by Williams, they note that Meyers' book is only available as a free PDF document with commercial and university presses declining to publish it. However, this may be due more to commercial decisions as to what would sell, rather than a form of censorship. The PDF version of the book is very well formatted and at less than 1 Mbte is easy to download so is not limited in its distribution by not being released by a commercial publisher of a quasi-commercial publisher (ie: a loss making university press). The book is cataloged by the national Library of Australia, with a link to the PDF.

Meyers might consider making a print edition available through a Print on Demand service, such as Lulu. As it is, the typesetting of the book is much better done than many commercial and university presses.

Back to the Gymnasium

Williams' article used the academy and agora in discussing the academic and financial pressures facing universities. I suggest another inspiration from ancient Greece is the Gymnasium. This word is now used in English to refer exclusively to a place for physical exercise. However, in ancient Greece there were also for scholarship (the word gymnasium refers to an advanced secondary school in much of Europe).

In the original Gymnasium of ancient Greece,  scholarship existed alongside physical exercise and academia was not isolated from the everyday world of politics and commerce. More integration with the world would help Australian universities.

In 2008 I visited Delphi in Greece. Walking the sacred way I received no advice from the oracle, just a phone call. On returning to the Australian National University a few weeks later I had the curious feeling of being back at Delphi. As I walked from my office to the cafe opposite, I noticed covered walkway outside the sports centre with adjacent trees resembled the stoa the Gymnasium of Delphi. At the cafe, as athletes go past, staff students, public servants and business people discuss matters large and small, much as they would have done at Delphi thousands of years ago. For me the task of universities is how to retain this dialogue in an on-line world.

ps: I will be speaking on "MOOCs with Books" in the CSIRO Seminar Room at ANU, 4pm, 8 July 2013.

Tuesday, June 18, 2013

Software for Synchronised Asynchronous Constructivist e-Learning

The ANU College of Engineering & Computer Science needed projects for students to do, I created one on "Software for Synchronised Asynchronous Constructivist e-Learning". This topic can then be tailored to the student's level (undergraduate to masters) and interests (software development or theory):

Student research opportunities

Software for Synchronised Asynchronous Constructivist e-Learning

Project Code: CECS_912

This project is available at the following levels:
CS single semester, Honours, Masters

Keywords:

asynchronous learning, synchronous learning, electronic learning, web conference, videoconferencing, pedagogy, MOOC

Supervisor:

Mr Tom Worthington

Outline:

On-line learning research literature uses the terms synchronous and asynchronous to describe tools and learning activities. This project will investigate software tools which will permit breaking down this division. It is proposed that syncronisation of asynchronous learning can address problems with large scale e-learning, such as Massive Open Online Courses (MOOCs). The combination of synchronous and asynchronous forms of on-line learning could be used to promote a constructivist approach. This could be done by relaxing the current lockstep approach of packages such as Blackboard Collaborate, where the aim is for all the class to see precisely the same images on screen at precisely the same time. As well as imposing severe limited on the equipment, this also limits the opportunity for the student to build their own internal model by exploring the topic for themselves, as they have to keep up with the live presentation. Relaxing the real time aspect would also the student time for reflection and to be able to explore the materials themselves, within a time limit.

Goals of this project

Provide a theoretical framework to synchronous and asynchronous forms of on-line learning and implement a free open source prototype to demonstrate this in practice.

Requirements/Prerequisites

Training, experience or an interest in teaching would be an advantage.

Student Gain

Software and tools to support e-learning is a growth industry worldwide.

Background Literature

Worthington, T. (2013). Synchronizing Asynchronous Learning: Combining Synchronous and Asynchronous Techniques. In Proceedings of 2013 8th International Conference on Computer Science & Education (ICCSE), 26 Apr - 28 Apr 2013 , Sri Lanka.

Preprint available at: http://hdl.handle.net/1885/9556

Presentation notes: http://www.tomw.net.au/technology/it/moocs_with_books/

Links

Synchronizing Asynchronous Learning: MOOCs with Books

Friday, June 07, 2013

Future of Education at ANU

Professor Marnie Hughes-Warrington will speak on the future of education at the Australian National University in Canberra, 24 June 2013 in a presentation entitled ‘Navigating the Edge of the World’.

Marnie Hughes-Warrington presenting at ANU IT Forum June 24
28 May, 2013 By Hayley Calderwood
Marnie Hughes-Warrington Deputy Vice-Chancellor (Academic) will present her keynote presentation from the THETA conference held in April, ‘Navigating the Edge of the World’ at the upcoming ANU IT Forum. Refreshments will be served. All ANU staff are welcome to attend. Please RSVP to communications.its@anu.edu.au

The forum will be held on Monday 24 June 2013, from 3–4.00pm in the Innovations Lecture Theatre, Building 124.

The history of education is punctuated by disruptive changes, and some people have even argued that it is the point of education to be disruptive. Drawing on her background in world history and her role as the head of ANU Online—a technology supported initiative that takes a new lens to programs, people and possible futures—Professor Marnie Hughes-Warrington will explore what it means for staff and students to navigate the edge of the world, including the critical role of relationships in education, and whether current trends in education are radically different to the past.


Website: http://itservices.anu.edu...forum/index.php

Thursday, May 16, 2013

Assessing Student Progress in an On-line Course

How does a teacher keep students working each week and review their progress? For the course "ICT Sustainability" (offered by ANU as COMP7310) and Open Universities Australia as ACS25) I use small weekly assessment tasks. This is using a Constructivist e-Learning approach, derived from UK Open University.

In practice what I do is look at each student's work a couple of times a week. I have Moodle forums set up with the marking option on. I read every new contribution from every student and quickly give it a mark of 0, 1, or 2. Then I have a quick look at the Moodle grade book to see how everyone is doing.

Moodle automatically adds up the marks for individual items of work and puts the average in the grade book. At the end of the week I go into the grade book and sort the list of students in ascending order by mark for that week.

First I look at those students with not submitted any work. I change their mark from a blank to zero and send them a reminder. Then I work my way up through those with zero and one, sending them an individual note praising something they did and making suggestions for improvements. For those who got top marks I will usually just send a "well done". As the course progresses I will tend to send less to students as they get into the rhythm of the work. But some students need extra attention.

As well as the individual feedback, I post a message to a forum each week, with the average mark for the class and the number of students with 0, 1, and 2, plus some general comments of praise and suggestions for improvement for the overall class.

Normally I don't comment on individual student's work in the forum to the class. Instead I leave t to the students to comment to each other. Occasionally I will need to comment to correct something the other students have not picked up on, but that might be only a couple of times during the course. More often I will comment privately to one student, who will then post it to the group. This can be frustrating as the students do not realize how much I am doing in the background to make the discussion flow.

Rather than email, I use Moodle's own message system to communicate with individual students. This is more cumbersome, but it keeps a log of the interchange with each student and keeps the student messages separate and safe. When sending comments for a week, I can see what I said last week and any reply from the student. This way I avoid admonishing the student for late work this week, when they told me about their sick relative last week.

Friday, April 05, 2013

Putting an e-Learning Course on Auto-pilot

As I will be overseas at a conference and perhaps unable to access the Internet for some days, I had to consider how to look after the students in my on-line ICT Sustainability course. Obviously, there is a second lecturer, as with any course, to step in. But I took the opportunity to see how much of the course routine could be automated. This also requires dealing with the confronting fact that much of what a teacher does the students do not notice or value.
  1. De-clutter the course page:  On-line courses can suffer from confusing content. Moodle in particular has by default one long web page, which can result in all the important information disappearing off the bottom of the screen. I arranged the course page with future modules hidden until the week they are presented. Each week I would manually reveal them. But even so I realized I had a paragraph of summary text for each module which took up space, but was not really needed. So I put this text in the HTML "TITLE" tag of the module name. This way the description will popup when the student puts their pointer over the title. Also I put a hypertext link on the title to the relevant section of the course e-book, for student who wants to read ahead. This way students can prepare for later sections of the course, but are not confronted with a lot of intimidating looking material they do not need to worry about yet.
  2. Set dates on the weekly content, so it will be revealed automatically each week: Rather than manually reveal the content of the module each week, I used the feature of Moodle which allows this to be hidden until a set date. Unfortunally Moodle does not seem to have a way to do this by default. If using a weekly course format, it would seem logical to have a way to hide each week's content until that week starts. But instead I had to set a date on each item of content for the week. This does allow for fine tuning, as I actually reveal the new week's work on Saturday, although the course weeks officially starts on the Monday (some students students like to get a head start working on the weekend).
  3. Set dates for assignment and survey reminders: Normally I would post a reminder a few weeks before assignments are due and a stronger one in the final week. I was able to use the same hide feature to automate these as well.  Also I included a reminder to do fill in the student feedback survey in the final week. One problem is that these reminders only appear on the web page. There does not seem to be any easy way to have them sent as notifications to students (such as by email).
These may sound like obvious and easy steps to take. But getting automated reveals to work is error prone. It could be very confusing for students if the forum needed to post their work does not appear at the right time, or the notes to help them disappear.

It would be interesting to take this automated approach further. As an example, the weekly marks for student forum postings could be changed from tutor to student peer assessment. This just requires a simple change in the Moodle settings. The education research literature shows that peer assessment is at least as good as tutor assessment. But would require providing the students with more guidelines on how to peer assess.

It may hurt my pride as an educator, I suspect that student's learning will not suffer from such automation. Feedback for common problems (such as forgetting to contribute to weekly forums) could be automated and also perhaps an automatic  "congratulations" to students getting top marks. While education forums are full of discussion of MOOCs with video lectures and highly sophisticated AI feedback, I suspect it is these simple techniques which will make the difference.

On the subject of Massive Open On-line Courses, after giving my "MOOCs with Books" talk at CPUG last night, I popped into the computer student club room next to the famous room N101 at the ANU Research School of Computer Science. Several of the students mentioned how they were taking MOOCs, as part of their ANU degree. There seem to be some informal arrangements where lecturers agree students can do a MOOC instead of part of the ANU course. Obviously the student would still have to provide evidence of their learning at the end of the course, as most MOOCs have no formal assessment. But this shows the students are leading the way with new educational techniques, and the staff have much to learn from them.

Tuesday, April 02, 2013

Summary of US e-Learning Trends

The report "Changing Course: Ten Years of Tracking Online Education in the United States" by I. Elaine Allen and Jeff Seaman (Babson Survey Research Group) was released in January 2013. An Infographic of Changing Course: Ten Years of Tracking Online Education in the United States is now available. It is an excellent summary of the full report.

In brief, US senior academics see MOOCs as a useful way to attract students and give them a taste of e-learning, but problematic as part of a formal program. Online learning is seen as strategic and more than half of senior academics see it as equal or superior to classroom teaching, but perceive a lack of acceptance by teaching staff as a barrier to adoption.

One reason for lack of enthusiasm by teaching staff was the staff time taken up by online teaching, with staff almost evenly divided as to if it takes more or less time than classroom teaching.  In my view this reflects the inadequate training and materials some staff receive for online courses. I will be discussing some of these issues in "MOOCs with Books" in Colombo at the end of April and at other locations in Australia, and the region.

Wednesday, March 27, 2013

Wikimedia in Higher Education Symposium in Sydney

The University of Sydney is hosting a free one-day "Wikimedia in Higher Education Symposium" 5 April 2013,  on the use of Wikipedia for teaching in universities. Speakers include Toby Hudson, School of Chemistry, (USYD),  Kerry Kilner, Research Fellow, School of English, Media Studies and  Art History, University of Queensland (UQ),  Liam Wyatt, Queensland University of Technology, James Neill, University of Canberra,  Kathryn Barwick and Mylee Joseph (State Library  of New South Wales).

Saturday, March 23, 2013

Concurrent Computing as a Metaphor for Flipped Learning

This is to suggest Concurrent computing be used as a metaphor for forms of e-learning, including a more advanced form of Flipped Learning. In "MOOCs with Books: Syncronisation of Large Scale Asynchronous e-Learning" I discuss how the terms synchronous and asynchronous from computer science, have been adopted by are used by educators to described forms of on-line learning. Concurrent computing provides a rich set of concepts which could be applied to help create and measure more efficient on-line courses. This could be sued to address problems with , particularly large scale on-line courses, including Massive Open On-line Courses (MOOCs).

With conventional teaching, the teacher (or university lecturer) first gives a verbal discourse (lecture) to the class of students "live" in a classroom face-to-face, or remotely via a video link. The students then are set homework tasks to undertake outside class. What is described as "Flipped Learning", "flipped classroom", "flip teaching" (or less commonly backwards classroom, reverse instruction, flipping the classroom, and reverse teaching), is a technique where the student first watches a video recording of a lecture on their own outside the classroom and then undertakes exercises in the classroom (face-to-face or via a video link) with the teacher and other students. This is "flipped" in the sense that the order is reversed: the individual work comes before the group activity.

A fuller version of Flipped Learning is described by Person Education in their Flipped Learning Professional Development, which adds a third mentoring stage after the classroom:
  1. On-line prework
  2. Onsite
  3. Remote mentoring
While Pearson refer to "Onsite" (ie: classroom work)  the same process can be used with pure on-line learning. In the terminology of e-learning, the pre-work is asynchronous, the on-site synchronous and the remote mentoring could be either synchronous or asynchronous.

Concurrent computing as a Metaphor for Flipped Learning

 The "Flipped Learning" metaphor breaks down when three stages are reached. While it makes sense to talk about flipping the sequence of classroom followed by homework, it does not work for classroom followed by homework followed by mentoring.  A more general metaphor might be derived from computer science, as were the terms "asynchronous" and "synchronous" used to describe e-learning. In computer science, Concurrent computing allows  many tasks to be carried out simultaneously using a computer with multiple processors. Synchronization is used to allow two or more tasks to coordinate their work. Granularity is the ratio of computation to communication for the tasks. A supervisory program or supervisor is a computer program which schedules other programs, in concurrent computing this is a particularly difficult task and may result in a large Parallel Overhead, with excessive time taken up  coordinating the parallel tasks. The overhead can lower scalability, where adding more processors does not increase the output proportionally, as the coordination task gets more complex.  Of most relevance a Rendezvous defines when two tasks synchronize, perhaps to exchange information. In concurrent computing, the aim is to maximize the parallelism, with multiple processors each being able to carry out work, without having to wait for each other. Massively parallel computing aims to have thousands, or tens of thousands, of processors working together.

Concurrent computing could be used as a metaphor for education, with each student as a processor and the teacher as the supervisor program. As with concurrent processing, the aim in education is to allow each student to learn independently at their own pace (maxim parallelism), not being slowed down by the teacher or other students. The tasks set in the course will need to be designed with maximum granularity, so that the student spends their time on task and not checking back with the teacher. Suitable points for rendezvous will need to be built in, so that the student has required interaction with other students and teachers, but is not held up unnecessarily waiting for a responses from them. The scalability of the course will depend on minimizing work for the supervisor/teacher,  while meeting the student's needs. Just as an optimized program could be sued for massive parallel computing, an optimized course design could be used for a massive on-line course, such as a MOOC.

The concurrent computing metaphor could be taken further with some of the numerical measures used to assess the performance of parallel systems applied to education. This could be applied to assess how technically efficient a course is, in terms of the processing and communications capacity needed and its educational efficiency, in terms of how much teacher and student communications is needed. This might also be applied more broadly to conventional off-line courses, as there appears to currently be little rigorous analysis of even the most basic aspects of courses, such as how many pages of reading a student has to do or how many hours of staff time is required to respond to student queries. Instead teachers and students appear to fall into the trap of complaining they have too much to do, without any clear idea how much it is or what to do about it.

Synchronization—the Production of the Present

In researching this topic I stumbled across "Synchronization: the Production of the Present", which is the Annual Research Topic (2012 to 2013) at the Internationales Kolleg für Kulturtechnikforschung und Medienphilosophie (IKKM), Bauhaus-Universität,  (Bauhaus University), Weimar, Germany. What drew my attention was the linking of synchronization to the definition of 'real-time':
"The process of synchronization is also called “real-time”. This denotes the opening of a temporal window, in which information is distributed, prepared, eventually visualized and which in the process allows intervention in the communicated process. Communication and the communicated become indistinguishable in the frame of the real-time window. Even a few decades ago, these real-time windows were bound to singular locations, which were highly specialized media installations and strictly secretive like military operations centers or government headquarters. Now they tend to detach themselves from a specialized fixed infrastructure. Instead they turn into “shells”, in which the individual moves more and more. The modern media habitat can therefore not be understood as a mere category of location (of a spatially shaped milieu). Rather, it becomes effective as a category of action, which is determined by a particular space-time. ..."
From: "Synchronization: the Production of the Present", IKKM, 2012

This  philosophical approach seem to have close parallels to the idea of synchronized asynchronous communication I have proposed for e-learning. That is, if the communication is synchronized sufficiently. 

It should be noted that Bauhaus University Weimar, is at the original location of the "Bauhaus" designed school named by  Walter Gropius in 1919. The Bauhaus design school moved to  Dessau in 1925, where it came to prominence and it is this (moving again, to Berlin, in 1932). The Bauhaus Dessau Foundation hosts research and education (I gave a talk on ICT and architecture for the Bauhaus Dessau Serve.city 3rd trimester", in 2002.

Thursday, March 21, 2013

MOOCs with Books: Syncronisation of Large Scale Asynchronous e-Learning

This is to invite corrections and suggestions for my presentation "MOOCs with Books: Syncronisation of Large Scale Asynchronous e-Learning" for the 8th International Conference on Computer Science & Education (ICCSE 2013) in Colombo in late April (web slides also available). The basic idea is that use of "real time" delivery of e-learning places an unnecessary burden on the Learning Management System (LMS) and networks used and is also not good for the students. Most supposedly "synchronous" education, on-line and in the classroom, is not really "real time". Relaxing the restrictions this imposes on the system will allow millions of students to be accommodated and also provide better learning. An easy way to explain this is with the example of an eBook, which the student can download and read when they want, attempt the exercises in the book and check their answers. It is only after doing their "homework" that the student needs to interact with the LMS, their fellow students and perhaps a teacher. Rather than build complete new Learning Management Systems for MOOCs, packages such as Moodle, can be upgraded to handle the load, using existing technology, such as SCORM and HTML5.

 This started as a scholarly paper on "Synchronizing Asynchronous Learning". But since submitting the paper last year, I have given a few presentations on how to have large on-line courses scale (both in terms of software and pedagogy), under the title "MOOCs with Books", so I added this to the conference presentation as a postscript. If anyone is interested I can give a practice run of the talk in Canberra, Sydney or Singapore.
Description: On-line learning uses the terms synchronous and asynchronous to describe tools and learning activities. This research looks into the origins of these terms, their use today and asks if these are the correct terms to use and if the use of these terms has held up the development of better tools and techniques. It is proposed that the use of syncronisation of asynchronous learning is particularly applicable to address issues with large scale e-learning, such as Massive Open Online Courses (MOOCs).
Keywords: Asynchronous Learning; Synchronous Learning; Electronic Learning; Web Conference; Videoconferencing; Pedagogy; Massive Open Online Courses, MOOC.
Please cite as:
Worthington, T. (2013). Synchronizing Asynchronous Learning: Combining Synchronous and Asynchronous Techniques. In Proceedings of 2013 8th International Conference on Computer Science & Education (ICCSE), 26 Apr - 28 Apr 2013 , Sri Lanka.
Preprint available at: http://hdl.handle.net/1885/9556

Saturday, March 16, 2013

MOOCs with Books at BarCamp Canberra

Greetings from the Inspire Centre at the University of Canberra where BarCamp Canberra 2013 just started. This is an "un-conference" with a more spontaneous presentations. My talk on how to blend traditional and on-line education last week in Sydney went well, so I thought I would do an expanded version today.

What is a MOOC?

  1. Massive: 100,000 students or more. Australia's large university has less than 50,000 students.
  2. Open: No scholastic or financial barrier to enrollment. Materials may also be  open educational resources.
  3. On-line: Materials delivered and students interact via the Internet.
  4. Course: Similar in size to an Australian university subject of about a 12 week semester one quarter full time student load (a US course). But does not provide a credential on completion.

Some MOOC Suppliers

Some MOOC Courses

  1. Harvard edX CS50x: Introduction to Computer Science 

  2. MIT edX 6.00x: Introduction to Computer Science and Programming (uses a textbook)

Software and Training for MOOCs

Implications

  1. Massive: Systems and software need to scale to deliver materials, provide automated student support and ways for students to interact.
  2. Open: Wider range of students will need more help. Ways for students to find their group needed.
  3. On-line: Ways to support students who have limited and intermittent Internet access are required.
  4. Course: Will need to integrate with conventional university programs or create a whole new on-line university system. Ways to credential students on-line required.

Traditional Teaching On-line

  1. Books: Course content provided in a down-loadable standalone structured module (textbook), using existing e-Book formats (web, Moodle Book Module, EPUB, IMS Content Package).
  2. Formative Feedback: Short tests can be used to aid learning by student.
  3. Groups: Students can be formed into groups for mutual support, on-line and off-line.

How Books Can Help

  • On-line courses tend to present material in small chunks which the designer decided
  • A book provides a carefully structured set of materials for the course, which can be used off-line.

How Software Can Help

  1. Massive: Develop plug-ins and upgrades for free open source systems, such as Moodle and Mahara, to allow the to handle millions of students.
  2. Open: Develop software which uses existing e-learning and e-book standards (web, Moodle Book Module, EPUB, IMS Content Package, SCORM Package).
  3. On-line: Develop off-line support for e-learning, using mobile devices.
  4. Course: Develop software which supports an integrated program, course module development process, not just delivery of isolated courses, so students get an education which meets community standards.

More Information

  1. Demonstration of Using Moodle for Postgraduate Professional Education with eBooks and Smart phones
  2. A Green Computing Professional Education Course Online 
  3. Demonstration of Using Moodle for Postgraduate Professional Education with eBooks and Smart phones
  4. On-line Professional Education For Australian Research-Intensive Universities in the Asian Century
  5. Synchronizing Asynchronous Learning: Combining Synchronous and Asynchronous Techniques

Thursday, March 07, 2013

Draft Australian Curriculum: Technologies Foundation to Year 10

The Australian Curriculum, Assessment and Reporting Authority (ACARA) has released a Draft Australian Curriculum: Technologies Foundation to Year 10 for comment. The document itself is well structured and written. It presents a coherent and ambitious curriculum. Unfortunately it is not clear if Australia is prepared to invest the resources to train teachers and equip they and the students with the resources required to implement such a Curriculum. Systems thinking and Project management are challenging topics for university IT students and it is not clear how these will be introduced at the school level. Shayne Flint has been looking into these issues at
the Australian National University for some time (see "Rethinking Systems Thinking") and some of this has been incorporated into the course "Unravelling Complexity").
The Curriculum document is 108 pages of PDF (a relatively small 606Kbytes). Unfortunately the ACARA has made the document hard to get, with excessive and incorrect instructions on their consultation page. This has a different name for the document in the title ("draft F-10 Australian Curriculum: Technologies"), puts the link to the document down in the second paragraph and claims erroneously that readers are required to register before they can access the document. It is not clear if this is a deliberate attempt to discourage reading of the document, or simply poor communication design (which is ironic given the document is about how to use IT). Also it is unfortunate the document is only provided as a PDF download, not in native web format, thus making it harder to access and read (ironically I had difficulty reading the section of the document on access for the disabled). One problem is that the document appears to lack a conventional table of contents, the PDF index being the only way to get an overview of the content.

Key ideas of the Technologies learning area

Systems thinking and the overarching idea: Creating preferred futures

The Technologies curriculum focuses on systems thinking to develop the technologies knowledge, understanding and skills to provide a method for identifying and moving towards ethical, socially responsible and sustainable patterns of living. Systems thinking is a holistic approach where parts of a system are analysed individually to see the whole, the interactions and interrelationships between the parts and how these parts or components
influence the system as a whole.

In both Design and Technologies and Digital Technologies this provides opportunities for students to engage in predicting outcomes and impacts of technological decisions for current and future generations and their environments. Students creatively and actively design solutions to meet present needs without compromising the ability of future generations to meet their needs. Both subjects acknowledge the strong connection with the Australian Curriculum: Sustainability cross-curriculum priority.

Project management

The Technologies curriculum ensures that students are explicitly taught how to manage projects. This includes planning; evaluating processes; considering constraints; risk assessment and management; decision-making strategies; quality control; developing resource, finance, work and time plans; and collaborating and communicating with others at different stages of the process. Every technologies project involves the use of resources and it is critical that there is planning for sustainable use of resources when managing projects.
Technologies projects involve ethical, health and safety considerations. They are designed for the different needs (including consideration of personal and social beliefs and values) of consumers and clients, and for commercial realities. Students learn that when they and others engage in design thinking and technologies processes, they are responsible and accountable for their designs and solutions.

Project management is an essential element in building students’ capacity to successfully innovate in both Technologies subjects. Project work and project management occur as a part of everyday life and are critical to many fields of technologies employment. Technologies education allows students to develop skills to manage projects from identification of need or opportunity through conception to realisation. Project management is addressed in all years of schooling as individuals and groups of students plan how they will work to bring a design idea to fruition.

Assessing and managing risk in Technologies learning addresses the safe use of technologies and the risks that can impact on project timelines. It covers all necessary aspects of health, safety and injury prevention at any year level and in any technologies context when using potentially dangerous materials, tools and equipment. It includes ergonomics, safety including cyber safety, data security, and ethical and legal considerations when communicating and collaborating online.

From: Draft Australian Curriculum: Technologies Foundation to Year 10, Australian Curriculum, Assessment and Reporting Authority (ACARA), February 2013

Wednesday, March 06, 2013

MOOCs with Books in Sydney on Thursday

The "Sydney Python Group" (SyPy) is meeting 7 March in Sydney. I have volunteered to give a short talk on: "MOOCs with Books":

MOOCs with Books

Tom Worthington FACS CP

Recent hype surrounding Massive Open On-line Courses (MOOCs) has promoted the idea that students can simply watch videos on-line to get an education. Real education takes real work on the part of the student. This can be done by blending traditional teaching with the on-line environment, or for short: "MOOCs with Books".

What is a MOOC?

  1. Massive: 100,000 students or more. Australia's large university has less than 50,000 students.
  2. Open: No scholastic or financial barrier to enrollment. Materials may also be  open educational resources.
  3. On-line: Materials delivered and students interact via the Internet.
  4. Course: Similar in size to an Australian university subject of about a 12 week semester one quarter full time student load (a US course). But does not provide a credential on completion.

Implications for Application Development

  1. Massive: Systems and software need to scale to deliver materials, provide automated student support and ways for students to interact.
  2. Open: Wider range of students will need more help. Ways for students to find their group needed.
  3. On-line: Ways to support students who have limited and intermittent Internet access are required.
  4. Course: Will need to integrate with conventional university programs or create a whole new on-line university system. Ways to credential students on-line required.

Traditional Teaching On-line

  1. Books: Course content provided in a down-loadable standalone structured module (textbook), using existing e-Book formats (web, Moodle Book Module, EPUB, IMS Content Package).
  2. Formative Feedback: Short tests can be used to aid learning by student, off-line: SCORM Package.
  3. Groups: Students can be formed into groups for mutual support, on-line and off-line.

How How Software Developers Can Help

  1. Massive: Develop plug-ins and upgrades for free open source systems, such as Moodle and Mahara, to allow the to handle millions of students.
  2. Open: Develop software which uses existing e-learning and e-book standards (web, Moodle Book Module, EPUB, IMS Content Package, SCORM Package).
  3. On-line: Develop off-line support for e-learning, using mobile devices.
  4. Course: Develop software which supports an integrated program, course module development process, not just delivery of isolated courses, so students get an education which meets community standards.

More Information

  1. Demonstration of Using Moodle for Postgraduate Professional Education with eBooks and Smart phones
  2. A Green Computing Professional Education Course Online 
  3. Demonstration of Using Moodle for Postgraduate Professional Education with eBooks and Smart phones
  4. On-line Professional Education For Australian Research-Intensive Universities in the Asian Century
  5. Synchronizing Asynchronous Learning: Combining Synchronous and Asynchronous Techniques
This is an update of my talk to the "Sydney Educational Technology (SydEduTech) Group" 5 March.

Monday, March 04, 2013

Necessity of Student Course Evaluation

In "The Unnecessary Agony of Student Evaluations", Spurgeon Thompson (1 March 2013,The Chronicle of Higher Education) writes that American universities are treating students too much like consumers, with excess emphasis placed on student feedback evaluations of courses and teachers. They contrast this with the European approach, where universities are mostly free, but difficult to get into and argue that American universities do not have as much consumer choice as it may appear.

In Australia, my impression is that we have, as in so many fields, steered a middle course, between the USA and Europe, with some use of student feedback. While lecturers grumble about the feedback results, it is having a positive effect. Some of my colleagues who have for years looked with at best tolerance on my use of new teaching practices are now coming t me to ask how it is done. The reason they are asking is that my student feedback scores are very high and theirs are very low. It is not that I set out to get high scores, it is just a by-product of good teaching. While lecturers may be reluctant to acknowledge that their teaching practices are out of date, it is hard to argue when the Dean wants to know why you are dragging the faculty results down.

One point I differ with Thompson on is the choices USA student have. Thompson argues that US universities effectively have a captive market, a US student has no choice but to attend a US institution. However, a student can choose to study overseas if they wish, they can do this by physically moving, or, increasingly, study on-line. Not only will US campuses have to increasingly have to compete with overseas ones, but also with their own virtual campuses. While much has been made of MOOCs, the real revolution is in the use of new more responsive teaching methods, which can be used on-line , in a classroom, or a blend of both. One a student has experienced teaching which does not talk down to them and responds to their needs in a timely and supportive fashion, they will not want to go back to old fashioned "Shut up and take notes" lectures.