Showing posts with label e-Portfolio. Show all posts
Showing posts with label e-Portfolio. Show all posts

Thursday, July 04, 2013

Google Glass Opportunities for Wrapping Old Ideas Up in New Techno-Babble


Mathews proposes streaming text chat to Google Glass while leading a discussion or lecturing. I have tried doing this while running a webinar. I found it very difficult to talk and follow the text back-channel at the same time. Most of the webinars I attend have a moderator, separate to the presenter, to handle the text. I can't see that having a head-up display for the text would imprve the situation.

Mathews suggests engaging students in the process of course creation. But creating a course takes months, if not years, of mostly tedious detail work. It seems unlikely that any student would want to sit through a live unedited recording from Google Glass of this. Students are likely to say that it is the lecturer's job to create the course, so they then get just the edited highlights.

I have produced several stream of consciousness type blogs while creating courses, but I would not expect my students to read all that waffle. As an example the 21 part series "e-Learning Course on Green ICT Strategies".

Mathews comments "... I have no real sense of how my students learn ...". There is extensive research on how students learn, some conducted using video recordings. Courses on teaching cover this material.

Mathews suggests cognitive life logging will have education value. Having read many postings with photos of what people had for lunch, I do not think this will be improved by a running commentary as they eat? ;-(

This back-story of a course, or someone life may be of interest, but will require considerable editing. It could be presented as pop-ups on a web page. I
can't see that a head-up display would really improve this.

Mathews envisions developing courses which incorporate self-reflexivity. However, such reflection is now a common part of advanced professional courses. The student submits a reflective journal, which can be text from their e-portfolio, video or some other format, such as interpretive dance (I am not making this up). At the moment I am trying a MOOC about vocational education, using a Moodle - Mahara interface. You fill in your Mahara e-portfolio and then press a button to submit it via Moodle for marking. So this is not new.

In education, we are continually looking at reflection, attitudes and cognition. But I can't see that a head-up display will help with this. Dressing up existing educational techniques in techno-babble to make it sound new will certainly not help.

My goal is to aid my students to be able to work with text. If they can do that they may then be able to tackle other media, such as video. Quality video is carefully planned in much the same way a written work is designed. You don't just turn on the camera and start talking.

Mathews concludes "Today I beheld the future… and it was beautiful. ...". Perhaps I am more cynical, as I work in a building where computer scientists and engineers invent new gadgets. Some of what they invent might be revolutionary one day (one example is WiFi developed by CSIRO, who have offices in the other half of the building). I occasionally asked to comment on new gadgets, most of which do not live up to their initial promise. So my conclusion is:
I have seen the future and it looks much like the present, but needs more batteries to operate.

Friday, June 28, 2013

Higher Education Academy Professional Recognition Scheme

The UK based Higher Education Academy (HEA) runs the HEA Professional Recognition Scheme.
This is intended to lift the professionalism of university teaching. The scheme is aligned to the UK Professional Standards Framework (UKPSF). There are four levels of recognition (and typical job descriptions):
  1. AFHEA – Associate Fellow of the Higher Education Academy (Graduate Teaching Assistant)
  2. FHEA – Fellow of the Higher Education Academy (Lecturer)
  3. SFHEA - Senior Fellow of the Higher Education Academy (academic leader or middle management)
  4. PFHEA – Principal Fellow of the Higher Education Academy (senior leader)
The HEA is promoting their scheme internationally, with the Australian National University the first Australian subscribing institution. The HEA is more general than the Certified Membership Scheme run by UK Association for Learning Technology (ALT), which was also extended to Australia last year. The way the HEAPRS/UKPSF is structured is similar to schemes run for other professions, such as ACS CP/IP3/SFIA for computer professionals.

UK Professional Standards Framework

The UK Professional Standards Framework (UKPSF) consists of:

Framework 

An Introduction.

Descriptors 

Four categories of level of teaching responsibility, corresponding to the four levels of HEA recognition:
  1. Associate
  2. Fellow
  3. Senior Fellow
  4. Principal Fellow

Dimensions of Practice 

Three dimensions of practice:
  1. Areas of activity:
    1. Design and plan learning activities and/or programmes of study
    2. Teach and/or support learning
    3. Assess and give feedback to learners
    4. Develop effective learning environments and approaches to student support and guidance
    5. Engage in continuing professional development in subjects/disciplines and their pedagogy, incorporating research, scholarship and the evaluation of professional practices
  2. Aspects of Core knowledge:
    1. The subject material
    2. Appropriate methods for teaching and learning in the subject area and at the level of the academic programme
    3. How students learn, both generally and within their subject/disciplinary area(s)  
    4. The use and value of appropriate learning technologies
    5. Methods for evaluating the effectiveness of teaching
    6. The implications of quality assurance and quality enhancement for academic and professional practice with a particular focus on teaching
  3. Professional values:
    1. Respect individual learners and diverse learning communities   
    2. Promote participation in higher education and equality of opportunity for learners
    3. Use evidence-informed approaches and the outcomes from research, scholarship and continuing professional development
    4. Acknowledge the wider context in which higher education operates recognising the implications for professional practice

Monday, April 08, 2013

Recognition of Prior Learning for University Teachers

Greetings from the Australian National University (ANU) in Canberra, where Richard Brawn, Head of the HEA's Teacher Excellence Team, is speaking on "Recognising and Promoting Staff Expertise in Teaching and Learning: the UK experience". The ANU is a subscribing institution of the UK Higher Education Academy (HEA). The HEA has a Professional Standards Framework (PSF) and HEA Fellowship. It should be noted that this is a separate program to the Certified Membership Scheme run by UK Association for Learning Technology (ALT), which was extended to Australia last year.

HEA's process is similar to Recognition to Prior Learning using an e-portfolio for Australian vocation teachers. In terms of positioning the organization, the ANU would see itself similar to the UK University of Cambridge, at least in the field of computing. Richard did not mention Cambridge, but I did a quick search and found a Higher Education Academy Briefing, scheduled for 13 May 2013.

The process, as Richard describes it, also has similarities to the Australian Computer Society's processes for promoting professionalism. It would be interesting to explore coordination between education certification and other professional certifications, including computing.

HEA Fellowships do not replace tertiary qualifications in Higher Education for ANU staff. The ANU Certificate of Higher Education was discontinued, but ANU staff can enroll in a program at another university to obtain tertiary qualifications in Higher Education (I undertook half my GCHE at USQ on-line).

At present I am certified by the ACS as a computer professional, have just finished the current ANU HE Certificate, applied for certification to teach in the vocational sector. If I need to be certified again through a UK based process to teach in a university, the regulatory burden starts to become high. It would be useful if these certifications were aligned. The ACS has achieved such an alignment internationally, through the "Seoul Accord", for IT professionals.

What can make such RPL processes easier is good on-line support. Learning Management Systems, such as Moodle, with  an e-portfolio package, such as Mahara, can be used for this.

Wednesday, March 27, 2013

ICT trends in Education

I will be speaking on "ICT trends in Education" at the Australian Computer Society meeting in Canberra, 12th November 2013. This will be a less academic version of my "MOOCs with Books: Syncronisation of Large Scale Asynchronous e-Learning" talk for the ICCSE conference in Colombo.
ACS Canberra Branch Forum

ICT trends in Education

A quiet revolution is taking place in Australia's schools, TAFEs and universities, with education moving on-line. Award winning education designer Tom Worthington will provide an overview of the trends and its implications for education.
  • Massive Open Online Courses (MOOCS)
  • Social media for education
  • Open Source e-Portfolio software
  • Cloud based Learning Management Systems (LMS)
  • e-Book textbooks
  • Portable course-ware formats

Biography: Tom Worthington FACS CP

Tom Worthington is an independent ICT consultant and an adjunct lecturer in computer science at the Australian National University. Tom designed the on-line sustainability courses for both the ACS certification program and the ANU Master of IT. In 1999 he was elected a Fellow of the Australian Computer Society for his contribution to the development of public Internet policy.   Tom is a Past President of the Australian Computer Society, Fellow, Honorary Life Member and Certified Computer Professional, as well as a voting member of the Association for Computing Machinery and a member of the Institute of Electrical and Electronics Engineers.

See also:

Tuesday, January 22, 2013

Using an e-Portfolio to Demonstrate Graduate Attributes

The University of New England UNE) "Guidelines for implementation of the Graduate
Attributes Policy and Quality Management processes" (June 2009), include the option of presentation of evidence via a personal ePortfolio. UNE reference UNSW's "Assessing with ePortfolios" and offer students the Mahara e-Portfolio tool.

Software Engineering Internship Requires E-Portfolio

The course Software Engineering Internship (COMP3820), offered by the ANU  Research School of Computer Science, requires students to reflect on their experience in an Internship Journal (e-Portfolio). This makes up 20% of their assessment, equal to the report by their Industry Supervisor. The students are intended to be able to demonstrate learning and professional development through mapped to Engineers Australia technical competencies. Accreditation by Engineers Australia, requires the equivalent of 12 weeks full-time work experience for each student. This course (COMP3820) satisfies the requirement and makes up one full time semester of study by the student.
The aim of this course is to use the internship experience to enable students to develop their software engineering skills and practice. Students will be placed in industry, working full-time and assessed for academic credit. The internships will be aligned with the aims of the software engineering program. Students will experience a real-life engineering workplace and understand how their software engineering and professional skills and knowledge can be utilised in industry. They will also be able to demonstrate functioning software engineering knowledge, both new and existing, and identify areas of further development for
From: Software Engineering Internship (COMP3820),Shayne Flint,  ANU  Research School of Computer Science, 2012

Assessing with ePortfolios

The University of NSW (UNSW) provides a useful set of guidelines on "Assessing with ePortfolios" (3 May 2012). ePortfolios are suggested to "support students in planning their personal, educational and career development", "present evidence of achieving program outcomes through artifacts that demonstrate transferable skills"and "in capstone courses and programs that require professional accreditation". UNSW provide a useful list of issues to consider with ePortfolios and further readings. UNSW have installed the Mahara e-portfolio tool (as used by ACS and USQ).

Tuesday, January 08, 2013

Portfollio for Professional Learning Technology Certification

The UK based Association for Learning Technology (ALT) last year announced extending their Certified Membership of the Association for Learning Technology (CMALT) to Australia. The CMALT process might make a good model for other portfolio based accreditation processes. For the final unit of my Certificate in Higher Education, I am looking at how university higher degree programs can be flexible enough to support both professional accreditation and research.

CMALT support for candidates and assessors

CMALT provides support for both the candidates and the assessors. Often such assessment schemes fall down because they assume that those doing the assessment know what to do. But just because someone is an expert in the area being assessed, that does not mean they know how to do assessment. Even those familiar with exam based assessment will need some help assessing a portfolio.

CMALT Provide:
  1. CMALT Prospectus: a guide to the process for candidates
  2. CMALT Community: An on-line forum for candidates to get mutual support. On the Crowdvine platform.
  3. Information for CMALT candidates: A short document to start the portfolio process.
  4. CMALT webinar: A live on-line session every few weeks, with questions and answers. There appears to be no stored alternative offered, for those who cannot attend the live webinar. Also there does not appear to be an on-line non-real-time forum for questions and answers.
  5. Guidelines for CMALT candidates and assessors: More detail on requirements for CMALT.
  6. FAQs: Frequently Asked Questions
  7. CMALT Development Group: The email addresses of the individual developers of the CMAL process are provided for queries. This is an unusual personal touch for such a process, which usually has an anonymous administrative point of contact.
  8. Portfolio submission form: A Microsoft Word document set up with fields to be completed (I was able to use LibreOffice to fill in the form).
  9. Email address: For submitting the form. It is curious that ALT are not using a Learning Management System, such as Moodle for managing the student interaction and document submission.
Assessors are recruited from those who have already been through the CMALT process and are thus familiar with it (as well as being certified in the subject matter). In addition to the material for candidates, assessors are offered:
  • CMALT webinar for assessors: A live on-line session, with questions and answers. It is not clear how often these are held (there were three webinars for candidates listed on the ALT Events Page, but none for assessors).
  • Assessment form: A Microsoft Word based form. The form is clearly alid out and only two pages long. However, it appears that two people need to fill out the one form: Lead and Second Assessor, which would complicate the process. The new Outcomes feature in Moodle 2 might be a better way to accomplish this.

Tuesday, December 18, 2012

Professional Learning Technology Accreditation in Australia

The UK based Association for Learning Technology (ALT) has announced "CMALT Australasia", an extension of the UK Certified Membershipof the Association for Learning Technology (CMALT) to Australia. The details of the Australia scheme are not yet released, but presumably will be similar to the UK approach, where the applicant submits a portfolio for assessment.

CMALT looks useful, but as a student of higher education (and someone who helped design a professional RPL process), I suggest that more support will be needed for the average person. Just giving people a template to fill in with their prior experience is a daunting task. Even with a support group, and a mentor, this is a difficult task.

While I am an experienced course designer and university lecturer, as soon as I became a "student" of education, I started to behave like a student: concentrating on what was to be assessed and putting off tasks until just before the deadline. There may be a few self disciplined people who can do it all on their own, but I suggest the average person will needs a push along.

For my graduate certificate final assignment I am looking at integrating an e-portfolio into higher degree programs. Alongside their courses and/or research, students would do an on-line course top teach them how to compose an e-portfolio to present evidence of their skills. Students would then fill out either a generic graduate skills template, or one or more specific templates, such as for membership of a professional body (such as the Australian Computer Society or CMALT). The software used to do this is not very important, Mahara and Moodle would do (that is what I have used on my courses). The important point is to offer the student a framework to help them along.

Core areas of work

1 Operational issues. Candidates should demonstrate both their understanding and use of learning technology. ‘Use’ might include the development, adaptation or application of technology within teaching, training or the support of learning more generally. This should include evidence of:

a) an understanding of the constraints and benefits of different technology;
b) technical knowledge and ability in the use of learning technology;
c) supporting the deployment of learning technologies.

2 Teaching, learning and/or assessment processes. Candidates should demonstrate their understanding of and engagement with teaching, learning and assessment processes. ‘Engagement’ may include using understanding to inform the development,
adaptation or application of technology. This should include evidence of:

a) an understanding of teaching, learning and/or assessment processes;
b) an understanding of your target learners.

3     The wider context. Candidates should demonstrate their awareness of and engagement with wider issues that inform their practice. This should include evidence of:

a) understanding and engaging with legislation, policies and standards.

4     Communication. Candidates should demonstrate their knowledge and skills in communication either through working with others or through interface design.
This should include evidence of either (a) or (b).

a) Working with others.
b) Interface between human and technical systems.

Specialist option(s)

As well as the core areas, candidates are required to demonstrate evidence of independent practice in one or more specialist options. Here is an indicative list of
specialist options:
  • producing learning materials/content/courseware;
  • project management, including resource management;
  • training, mentoring and developing others;
  • evaluating projects;
  • research;
  • designing tools and systems;
  • institutional development/strategic work;
  • knowledge and application of standards and specifications for learning technology;
  • assistive technologies;
  • VLE administration and maintenance;
  • interface design;
  • managing and sourcing content;
  • copyright. ...
From: CMALT Prospectus, Association for Learning Technology, 2012.



Wednesday, November 28, 2012

Online Distance Education for the Mature Student

I just attended a USQ focus group to get the views of students on technology used by the university (I was a USQ education student for two semesters). The focus group was conducted online via Blackboard Collaborate and worked well. It appears that I am a typical mature student who does not want mobile apps, twitter or Facebook, just ordinary old fashioned Moodle, email, lecture recordings and video conferences. ePortfolios appear to be popular and MOOCs may be appealing as a supplement to normal courses. I urged USQ to keep producing well designed online courses, delivered by well trained staff and not get distracted by e-fads.

Friday, November 16, 2012

e-Learning at ANU

ANU Sciences Teaching Building
ANU Sciences Teaching Building
Greetings from the new new Sciences Teaching Building at the Australian National University in Canberra, where I am attending a Science Teaching and Learning Colloquium on Research Led Education. The event is being held in one of the 150 seat flexible learning spaces. 
The keynote is from Associate Professor Adam Bridgeman, University of Sydney, on the ‘Sydney Scientist’ project.
The ‘Sydney Scientist’ project involves a collaboration between the Faculty of Science, the Library and the Learning Centre at The University of Sydney. The project seeks to renew the BSc curriculum through the embedding of graduate attributes and academic skills across first year units. The project simultaneously aims to enhance the transition of students into the culture of the Faculty through the ‘First Year Science eCommunity’.
Professor Bridgeman described how the sciences program was modified to remove "core" units and  make use of online systems for carefully designing units and ensuring each student gets the required skills. The students document their work with an eportfolio.
Coincidentally, yesterday I visited the Canberra Institute of Technology (CIT) to have my teaching experience assessed for Recognition of Prior Learning (RPL)  in a Graduate Certificate iV in Teaching and Assessment. The process described by Professor Bridgeman for University of Sydney is very much like the systematic process which CIT and the vocational sector in Australia has been using for decades.

Previously I have proposed using such a system at ANU, but this was seen by many of my colleagues as trivializing education with a vocational model, not suited to a leading research university. So since last November I have been looking at the educational theory behind such an approach. This would seem to be the right time to propose: "On-line Professional Education For Australian Research-Intensive Universities in the Asian Century".

Thursday, November 08, 2012

On-line Professional Education For Australian Research-Intensive Universities in the Asian Century

"On-line Professional Education For Australian Research-Intensive Universities in the Asian Century" is an early version of work for the ANU Graduate Certificate In Higher Education. The aim is to allow higher degree students to obtain skills certificates, by completing a template in their e-portfolio, alongside their coursework and research. This will allow universities to meet skills and quality standards and offer e-learning as an option, while retaining traditional courses and flexible research degrees. I would welcome comments.

As an example I what I have in mind, it happens I have been asked if I can do some vocational teaching at an RTO. This requires a Certificate IV in Training and Assessment. I should be able to meet much of the requirements for the certificate by Recognition of Prior Learning, based on my studies for the Graduate Certificate in Higher Education. This requires filling in a form from a RTO, attaching evidence of skills and experience and having this assessed. That process would have been much easier, if I had the form at the start of my Graduate Certificate and I could have filled it in with evidence as I went along.

PS: As the Prime Minister recently released the  Australia in the Asian Century White Paper and I am just on my way back from talking on online education in Indonesia, I appended “Asian Century” to the previous title of the paper. ;-)

Thursday, September 27, 2012

Knowledge and the real world

A shortened version of my post "Employability of Higher Degree Research Graduates", without the references, appeared in The Australian Newspaper's Higher Education section, 19 September 2012, with the title "Knowledge and the 'real world'":
EVER since Plato set up The Academy in an olive grove 2000 years ago, employers have complained that academia is not producing graduates suitable for work in the real world. Some university courses are vocational, but that is not the primary purpose of a university. If employers want staff with vocational skills then they need to select those applicants who have the right qualifications and then train them on-the-job. 
Do not be fooled by claims from some educational institutions of generic skills and graduate attributes. 
Ask to see where the skills you want are in the curriculum and how they are assessed. If the skills are not taught and tested, they probably don't exist, except in the minds of the marketing department. 
At the highest levels, university is about research to create new knowledge. There are two other types of masters degrees that can include professional practice: the coursework masters and the extended masters. A doctoral degree is about new knowledge, which can include professional practice, but not all do. If you want a researcher then hire anyone with a masters or PhD in research, but otherwise look for graduates with vocational qualifications and work-relevant research.
From: Knowledge and the 'real world', Torn Worthington, ANU, The Australian, Higher Education section, 19 September 2012

Monday, August 20, 2012

Employability of Higher Degree Research Graduates

Ever since Plato set up The Academy in an olive grove outside Athens two thousand years ago, employers have complained that academia is not producing graduates suitable for work in the real world. Some university courses are vocational, but that is not the primary purpose of a university. If employers want staff with vocational skills, then they need to select those applicants who have vocational qualifications and and then train them on the job.

Universities aim to turn out graduates with a broad education. Some universities take the initiative, with students doing vocational training in parallel with their university studies. But all graduates will need further training in the specifics of a job. Employers should expect to invest a considerable amount in the initial and ongoing training of their graduates. Check what vocational/industry qualifications applicants already have and that they are willing to undergo further training for a career in industry.

Employers should not be fooled by claims from some educational institutions of "generic skills" and "graduate attributes". Ask to see where the skills you want are in the curriculum and how were are assessed. If the skills are not taught and tested, then they probably don't exist, except in the minds of the marketing department. If the student claims to have done teamwork and leadership exercises, then ask to see documentary evidence of this in their e-portfolio.

At the highest levels, university is about research to create new knowledge. A Research Masters, as defined in the Australian Qualifications Framework is about research and is not intended to teach vocational skills. There two other types of Masters degrees in Australia, which can include professional practice: the Coursework Masters and the Extended Masters. A Doctoral Degree is about "new knowledge", which can include professional practice, but not all do. Employers should not accept all higher degrees as being the same and look for coursework, professional practice and work relevant research topics.

In short, if you want a researcher, then hire anyone with a Masters or PHD in research, but otherwise look for graduates with vocational qualifications and work relevant research.

An Innovation in Education Showcase will be held at the ANU in Canberra, 17 to 23 September 2012. As part of this I will presenting on "A Green Computing Professional Education Course Online using eBooks", 12:30pm, 19 September 2012, in the Ethel Tory Centre."

Research Graduate Skills Project

The Australian Learning and Teaching Council sponsored a Research Graduate Skills Project which reported in 2009. This addressed the timely completion of research and work skills.

The authors reported eight key findings:

  1. The nature and extent of the ‘skills agenda’ in higher education that has been operating in Australia and the UK for more than a decade.
  2. The conventional skill categories at the HDR level, namely, those pertaining to academic and employability skills.
  3. The importance of acknowledging the skills and attributes that candidates are able to demonstrate on commencement.
  4. An analysis of conceptual models developed to explain skill development, which have been concerned primarily with undergraduate education.
  5. A view to providing a more integrated and holistic approach to skills development, in which seven dimensions of capability are formulated.
  6. Employing diagrammatic representation, three dominant approaches to capability development, namely, ‘structured’, ‘semi-structured’ and ‘unstructured’.
  7. A concept that extends existing research by advancing the notion of ‘contextualised performance’. This is designed to represent the enactment of skills in particular settings, for example, where a candidate is operating in unfamiliar or especially challenging circumstances.
  8. A number of parallel themes emerged from the case study, namely diversity, flexibility, quality and engagement.

Unfortunately some of these are not actually findings. As an example the first "finding" is the "... nature and extent of the ‘skills agenda’ in higher education ...", but the authors do not express any opinion about this agenda. The executive summary goes on to provide a useful summary of the skills agenda issue, but likewise does not come to any conclusions and does not make any recommendations.

The report proposes ‘dimensions of research graduate capability’: inquiring, analyzing, producing, communicating, teaching, managing, thinking and interacting. These are depicted as inter-related and inter-dependent. While that might be of use in a theoretical study, it is too complex for use in a real world definition of skills.

Research Graduate Skills Project Website

The Research Graduate Skills Project Website is a byproduct of the study discussed above, providing additional materials associated with the project.

The slides from a presentation to the 2009 HERDSA Conference have a useful summary of the work (more useful than the executive summary in the report).

The authors argue that the more diverse background of the candidates and demands of timely completion of higher degrees are being addressed with more structured programs. They criticize existing theoretical models as being based on undergraduate, not postgraduate courses. However, if as the report suggests, industry is asking for graduates with work relevant skills, then education based on coursework, not research, would be appropriate.

The authors suggest two skill categories: academic and employability. However, I suggest the basic dichotomy for graduate degrees is: coursework versus research. The essential issue to be addressed is if having students conduct research is a useful way to teach workplace skills.

The website also provides a database of skill development activities in higher education institution. However, it does not appear to provide a usable ontology of graduate skills.

This research is a very long way from providing practical assistance with graduate skills. An example of such practical help is the "eCurriculum for Higher Education", a software tool to assist for mapping between high level attributes, course objectives and assessment.

What are generic skills for research higher degrees?

Gilbert, Balatti, Turner and Whitehouse (2004) provide a useful overview of the issues with generic skills in research higher degrees. The authors put it very clearly:

"Given that the chief goal of doctoral and masters' research degrees is for students to make an original contribution to knowledge, it seems potentially contradictory that at the same time students should be developing a set of skills common to them all."

The authors go on to list some commonly cited skills: Leadership and communication, Project management, Collaboration and teamwork. They make the point that even academic employers seek such skills.

Gilbert, Balatti, Turner and Whitehouse go on to discuss the difficulties with agreeing a set of generic skills. However, they do not appear to address the central point that research may not be a useful way to teach these skills, nor if thesis examination an effective way to test for the skills.

What Are Generic Skills?

Hager, Holland, and Beckett (2002) describe generic skills as qualities and capacities, such as logical and analytical reasoning, problem solving
and intellectual curiosity, effective
communication skills, teamwork skills. The authors point out that some of the "skills", such as integrity and tolerance, are more attitudes than skills.

Apart from demands from employers, Hager, Holland, and Beckett point out that some of these these generic skills are also attributes looked for in adult learning and so can aid the learning. The authors also point out that some skills are interdependent, such as teamwork and communication.

Hager, Holland, and Beckett refer to federal government policy which has encouraged universities to address generic skills, most universities having responded with statements of graduate attributes by 2002.

Hager, Holland, and Beckett point to RMIT University, QUT, UTS, UNISA and CUT, making up the Australian Technology Network (ATN), as having worked on "qualitative differences in the attainment of a generic capability". I suggest this may come from the vocational and technical background of these universities, where observed measurement of skills is the norm. However, the authors don't point out the apparent contradiction in measuring supposed "generic" skills, such as team-work, in a specific context. If the skill is assessed in a specific context then they cease to be a "generic".

The ATN skills appear to be very generic, such as "a commitment to learning from every new situation they encounter and the ability to fulfil that commitment". Such a skill appears so generic as to be a of no practical value. There would be no way that a university could test for such a skill and therefore no way to attest that a student has acquired the skill.

Hager, Holland, and Beckett go on to briefly mention forms of work-based learning. Given the obvious value of this to employers, it is surprising the topic is not covered in more detail.

How Can Generic Skills be Assessed?

Kiley (2006) points out that Australian postgraduate research students are normally assessed only through a written thesis and asks how generic skills might be assessed. Unfortunately Kiley appears to accept that Australian universities do not directly assess such skills and instead opts for self assessment by the student. It seems unlikely that employers would accept self-assessment as a valid form of verification of a graduate's skills.

Student Portfolios for Graduate Attributes

Manathunga (2004) describes a process called "Research Student Virtual Portfolio" (RSVP) using student portfolios for developing and demonstrating graduate attributes.

Manathunga points to the limited use of formal pedagogical theory for doctoral education and lack of a "curriculum". In an attempt to provide some structure (without limiting research freedom), the RSVP process has the student and supervisor tailor a custom developmental plan for each student. The student can then collect evidence in their portfolio to indicate progress on the developmental areas. This include a reflective exercise by the student.

This e-portfolio approach would seem to answer many of the challenges of generic skills for research students. It provides a way for the student to plan and chart their progress, without the need for a narrow coursework structure. However, this assumes the student, and the supervisor, have the skills to undertake this developmental process. Some formal coursework is likely to be required to bootstrap the student, and the supervisor, so they have sufficient skills to undertake a self directed process.

The claims made for RSVP need to be treated with some caution, as the university where Manathunga developed the concept is seeking to commercially exploit it, with RSVP registered as a trademark.

Generic Skills in the ICT Profession

The Australian Computer Society (ACS), along with some other nation's ICT professional bodies use the Skills Framework for the Information Age (SFIA) mapping of professional skills. In 2011 the topic of generic skills was discussed at the ACS Education Faculty Board meeting. SFIA has a seven levels of responsibility and about eighty skills descriptions.

The ACS designs courses and assessment procedures which address a package of SFIA skills at one or two levels. Course and harassment design is required to allow the tracking of skills from SFIA definitions, through learning objectives, to individual assessment items. As an example of this, I designed the course "ICT Sustainability" with two learning objectives which correspond to two SFIA skills, assessed with two assignments.

The ACS also conducts a Skills Recognition process for the Australian Government to assess prospective migrants. In preparing the sustainability assessments for this process I was required to map each question asked of the applicant to a skill in SFIA.

In addition SFIA has "generic skills" defined at each revel of responsibility. Here are SFIA generic skills for enterprise architecture at Level 5:

  • Challenge range and variety of complex technical or professional work activities;
  • Influences organization, customers, suppliers, and peers within industry on contribution of specialization;
  • Work requires application of fundamental principles in a wide and often unpredictable range of contexts;
  • Maintains awareness of developments in the industry;

From: Enterprise Architecture (Elective Subject), ACS Education, 2011

These generic skills use similar terminology to those for university graduate programs. Some of these skills are specifically addressed in courses on "Business, Legal and Ethical Issues", "Business, Strategy and IT" and "New Technology Alignment". More generally a Professional Practice reflective diary, recorded in an e-portfolio, is used by the student to document their learning experience.

New Route PhD

The "New Route PhD", is a structured program for graduate students, developed by a consortium of UK universities (mostly vocationally oriented ones). The program also offers Diploma, Certificate, Masters and professional qualifications, along the way to a PHD. The program addresses the popular"generic" skills, such as communication and teamwork. But I could not see any of the details of the actual courses offered. Also this appears to be a consortium approach, like Open Universities Australia, where the individual institutions involved come together for marketing purposes, but their courses are not integrated.

Generic Graduate Attributes for Research Students an Oxymoron?

After a brief look at some of the literature on generic graduate attributes for research students, I am unable to shake off the sense that Australian universities are creating complex contradictory structures in order to avoid an obvious truth: research degrees are not a suitable form of education for most employees. A research degree provides an education in how to carry out research in a narrow specialization. The research skills may be transferable to other areas of research and some of the background to the specialization may be useful in employment. But apart from this, such an education will not be useful, outside a few research occupations. It should be noted that, a research degree would not be suitable preparation for lecturing at a university, as universities are tending to require teaching qualifications.

Rather than address employer's requirements by designing vocational coursework programs at the graduate level, some universities appear to be using marketing dressed up as research, to make research programs appear vocationally relevant, with impressive sounding "skills".

I suggest that rather than asking what generic student attributes students might obtain as a byproduct of their studies, universities need to put these at the core of programs. Teaching and testing these skills will, as some of the literature suggests, also aid student learning and research skills.

e-Portfolios to Demonstrate Generic Skills

If "generic" skills are an important part of higher degrees, then universities need to specifically train and test these skills. This does not appear a problem for coursework students, where the skills can be part of compulsory courses. However, universities appear reluctant to have any coursework, or compulsory content, in research degrees. In theory that should not be a problem, as these degrees are not intended to provide vocational skills. However, employers do not understand the distinction between coursework and research degrees and, for marketing reasons, universities do not want to educate the employers about this distinction.

The use of techniques developed for adult vocational education appear to offer a way to provide generic skills for research students, without requiring compulsory courses. With this approach, the student has a portfolio, where they place evidence of having acquired skills. Templates with standard skill sets can be provided and courses to help the students acquire the skills. At the end of their program, if these skills are mandatory, the portfolio can be submitted as part of the thesis and assessed. The employer can then examine this material when selecting employees to see which have useful skills.

However, use of ePortfolios will require staff trained in their use to help the students. Research supervisors will require extensive training and testing before they could carry out this function and they may not be the most suitable people for the task.

ps: Others Write on Research & Employability

A search of The Australian Higher Education Supplement Letters, for "research & employability" found only two documents:

  1. "Doctoral skills" by Jim Cumming from the Centre for Educational Development and Academic Methods, ANU (12 March 2008) points to the value of work integrated learning and the role for industry in education.

  2. Business ideas have great value, Alec Cameron, Jill McKeough, Cameron Glesson, Lynne Hunt, 6 April 2011

References:

Gilbert, R., Balatti, J., Turner, P., & Whitehouse, H. (2004). The generic skills debate in research higher degrees. Higher Education Research and Development, 23(4), 375-388. Retried from: http://www.tandfonline.com.virtual.anu.edu.au/doi/full/10.1080/0729436042000235454

Hager, P., Holland, S., & Beckett, D. (2002) Enhancing the learning and employability of graduates: The role of generic skills. Melbourne: Business/Higher Education Round Table. Retrieved From: http://www.bhert.com/publications/position-papers/B-HERTPositionPaper09.pdf

Kiley, M. (2006). Can we improve doctoral student learning through assessing generic and employability skills? In C. Rust (Ed.), Improving student learning through assessment (pp. 116-124). London: OCSLD. Retrieved from: http://wattlecourses.anu.edu.au/pluginfile.php/40975/mod_resource/content/0/Kiley_2006.pdf

Manathunga, C. (2004) Developing research students' graduate attributes. In M. Kiley & G. Mullins (Eds.) Quality in postgraduate research: Re-imagining research education. Proceedings of the 2004 International Quality in Postgraduate Research Conference, Adelaide. Retrieved from: http://www.tandfonline.com/doi/full/10.1080/01580370601146270

Tuesday, March 29, 2011

Australian E-portfolios Trials

Australian Flexible Learning Framework (Framework) has announced the results of three E-portfolio Implementation Trials (EIT2010):

e-Pathways – Centre for Adult Education (CAE), Victoria:

Disengaged and at-risk young people used Mahra e-portfolios for personal and academic goals:

Regional RPL – Polytechnic West, Western Australia:

RPL (recognition of prior learning) tool for regional and remote laboratory technicians undertaking a Certificate IV in Laboratory Techniques for the AQTF (Australian Quality Training Framework) standards:

E-portfolios for nursing – Royal District Nursing Service, South Australia

In this trial, Diploma of Nursing students used the PebblePad e-portfolio system to compile and present evidence to support a range of course and professional competencies, including those required by the Australian Nursing and Midwifery Council.

The use of an e-portfolio system helped to overcome the complexity in integrating, applying and translating evidence of competencies required under both course and professional frameworks and to meet increased regulatory requirements around learning evidence.

Learners, many of whom are following study pathways to university, completed activities that required them to reflect on their work placements, in a bid to facilitate a smooth transition between learning and work.

2010 E-portfolios Implementation Trials - General Observations and other resources

A mid-way report and some key general observations about these trials at September 2010 can be found on the E-portfolios blog.

A recording of the Trial Project Leaders’ presentations about their 2010 EITs for the VET E-portfolios Community of Practice Online Event, on 29 November 2010, is available available.


Tuesday, September 28, 2010

E-portfolios 2.0

The Australian Flexible Learning Framework has arranged for Dr Keith Pratt, (Fielding Graduate University, USA) to present on "Reflection and Projection for E-portfolios 2.0", in a free online event, 11am, 30 September 2010:
Group Facilitator, Carole McCulloch has set an e-portfolios challenge for you before the meeting-

Saturday, September 25, 2010

Digital Education Revolution Skills

Professor SV Raghavan and Senator Conroy both talked on the benefits of broadband for education at the World Computer Congress 2010 in Brisbane this week. But will teachers know what to do with broadband?

More work is needed on tools and skills for teachers to use the fibre. I can say this sort of thing now I am an award winning online educator. ;-)

While the federal government has done good work on educating teachers with projects such as Edna and the Australian Flexible Learning Framework, the investment is relatively small compared to that being spent on computer hardware and networking.

Recently I have been taking part in an online discussion in the LinkedIn Group: Higher Education Teaching and Learning, of how to present materials to students. What was worrying was that many teachers were replicating poor paper based education in the digital domain. Faced with the problem of students not reading long wordy documents on paper, they put them online, producing long wordy PDF documents. When the students did not read those, the teachers gave the students to hour long lectures on what was in the documents which the students (sensibly) had not read.

This week during the World Computer Congress in Brisbane I talked to a university professor who was having problems with email. They were keeping copies of all messages from students and book collaborators in the university mail system. As a result their mail box was clogged with copies of draft papers and books.

Universities provide tools for efficiently handling documents in learning management systems and e-portfolios. However, the system administrators may be too quick to remove all data from the system at the end of a course. This then requires the teachers and students to manually store duplicate copies of materials elsewhere. Multiplied thousands of times across schools, TAFEs and universities, this is a waste of teacher and student effort. Also the students will be learning poor e-literacy skills which they will then take with them into the workforce. I will be discussing some of this at the Canberra MoodlePosium, 7-8 October 2010.

The ANU asked me to prepare a 6 week e-learning course on electronic document management to be offered from early next year. This would incorporate material on electronic document management and web design courses I previously presented in ANU face to face courses.

One problem I had with this was making it interesting. When this material is part of a larger course the student has to do it, to complete the course. A standalone EDM course might appeal to a few records managers and librarians, but then they are more likely to want to do specialist courses designed just for them. What I might do is call the course "Working in the Cloud" and present it for all information professionals (including educators) needing to support efficient online work practices. That would explore efficiency both from the point of view of getting the work done and efficient technical use of the online resources.

Wednesday, August 04, 2010

Reflections of an Online Student, Part 6: Past and Future

Reflecting on what my online tutor had to say, perhaps teaching a class of 200 students online needs different techniques and tools. My past experience as an online facilitator has mostly in developing public policy on IT, starting in the the mid 1990s. Internet based forums were used for this and part of the process was to try to develop a consensus view on difficult issues, such as Internet censorship.

My experience of acting as a educational tutor online is confined to one course "Green ICT Strategies", designed for mentored and collaborative e-learning. Having not been impressed tutors who talked too much in class, I decided to take a low key role by first setting some readings and questions, then leaving it to the students to discuss. Only if there is a problem do I take part in the discussion. During a 12 week course, I would typically need to take part in the discussion only two or three times. Instead I would provide individual mentoring of students.

The greatest challenge I see in the future is to have enough resources to be able to carry out the facilitation role in courses. In small courses of up to 25 students, which I have been tutoring, it is relatively easy to get to know the students and they each other. Peer pressure and individual mentoring can then keep the discussion on track. But if there are 200 students (because the educational institution wants to lower costs), can normal group dynamics work and can there be time for the tutor to provide individual mentoring?

It may be possible to have larger groups by using social networking techniques, as applied to business by services such as LinkedIn. As Franklin and van Harmelen point out:

"LinkedIn acts, at a professional level, as a model of educational use in the way in which it can be used to disseminate questions across the community for users seeking particular information."

From: Web 2.0 for Content for Learning and Teaching in Higher Education, Tom Franklin and Mark van Harmelen, JICS Repository, 2007

Such systems automate some of the work the tutor normally has to do manually. This then makes it possible to create and maintain a sense of group purpose in a much larger group. Some of those tools are already built into e-portfolio tools such as Mahara.

However, I suspect the larger part of the challenge will be to educate university administrators on why there is still a need for tutors to have the time for interaction with students, even when that interaction is online.

Tuesday, April 27, 2010

ePortfolios Australia Conference 2010 ePortfolios Australia Conference 2010

The ePortfolios Australia Conference 2010 (Melbourne, 3 to 4 November 2010), has issued a call for papers on the use of electronic portfolios in the vocational education and training (VET), higher education (HE) and adult and community education (ACE) sectors. Abstracts for Full papers, Works in Progress reports, Case Studies and Posters are due 4 June 2010

ePortfolios Australia Conference 2010

Submission for proposals

The theme of the ePortfolios Australia Conference 2010 is Widening participation - engaging the learner (see: http://www.flexiblelearning.net.au/e-portfolios-australia).

Submission of proposal:

The ePortfolios Australia Conference 2010 Organising Committee invites the submission of proposals for:

  • Full papers or Works in progress reports (peer-reviewed); full papers or works in progress reports of research findings and progress;
  • Case studies (abstract only); discussions of key directions and findings of action research or current practice and ;
  • Posters (abstract only): highly visual media communicating information about an innovation, tool, process or development.

Session duration:

  • Paper presentations and Case studies: 25 minutes
  • Posters: Posters will be displayed for the duration of the conference. There will be an hour allocated in the programme when poster presenters will be available near their posters to interact with conference participants.

Proposal themes:

Papers, reports, case studies and posters should relate to one or more of the following sub-themes:

  • Key government educational initiatives:
    • Quality outcomes and standards;
    • Learner mobility and transitions between educational sectors; and
    • Supporting learners accessing the Compact for Young Australians and Retrenched Workers initiatives;
    • Learner study experiences, retention and course completions.
  • Responsive learning and assessment practices:
    • Learning outcomes and reflective skills;
    • Recognition of prior learning (RPL), workplace learning and assessment processes;
    • Assessing graduate attributes and employability skills;
    • Discipline-specific initiatives;
    • Work-integrated learning, fieldwork and practicum experiences.
  • Career pathways and lifelong learning:
    • Continuing professional development (CPD) leading to professional standards, reaccreditation and/or workforce development;
    • Gaining employment
    • Supporting non-traditional learners
    • Improved partnerships with industry;
  • Implementing e-portfolios - successes and sustainability:
    • E-portfolios in the Web 2.0 environment
    • Technical standards supporting e-portfolios
    • Challenges and opportunities in e-portfolio implementation
    • Accessibility and e-portfolios
    • Sustainability and e-portfolios
    • Communities of practice

Papers, reports, case studies and posters not falling under these sub-themes may also be submitted for consideration, but should justify how the proposal complements the 'Widening Participation' conference theme.

Guidelines for Proposals:

Full Papers and Work in Progress reports are proposed by submission of an abstract (up to 400 words), and the full text of the paper which must be no more than 4,000 words including, appendices and references. As a general guide, a full paper should include an introduction, literature review and methodology, results, discussion and conclusions. Full papers are subject to double blind peer-review as required by DEEWR. Authors of successful submissions will be able to make minor corrections to the paper before final submission.

Case Studies are proposed by submission of an abstract (up to 400 words). Abstracts are subject to review by the ePortfolios Australia Conference 2010 Organising Committee.

Poster Presentations are proposed through submission of an abstract (up to 400 words). Posters are subject to review by the ePortfolios Australia Conference 2010 Organising Committee. Display versions should be sized between A3 -minimum and AO - maximum. You are not required to submit your 'Display' version; simply bring it with you to the Conference. Presenters are required to be in attendance with their poster during the allocated formal presentation period, to explain, discuss and to answer viewers' questions. While every effort will be made to ensure the safe handling of posters, the conference committee takes no responsibility for loss or damage of posters.

Paper submission process:

Please submit papers and abstracts to studenteportfolio@qut.edu.au by the due date as detailed below.

Due dates:

Abstracts (for Full papers and Works in Progress reports, Case Studies and Posters) - 4 June 2010

Author notification of acceptance - 2 July 2010

Full papers (final version) due - 2 August 2010

Review feedback notification - 6 September 2010

Final submission - 4 October 2010

Paper submission enquiries:

Please forward all enquires about the submission process to: studenteportfolio@qut.edu.au



From: Call for Papers, for ePortfolios Australia Conference 2010

Thursday, February 04, 2010

Some suggestions for ACS in 2010

The first meeting of the Canberra Branch of the Australian Computer Society for 2010 was devoted to hearing suggestions from the members. Here are some suggestions I made:
  • Make web site mobile okay: Currently the ACS home page scores less than zero out of 100 on the W3C mobileOK Checker: "This page is not mobile-friendly!". I suggest aiming for a score of 80/100 on the mobile tests for the ACS web pages. This would be a way to curb the web designers enthusiasm for putting too much stuff on the pages. It would also make the ACS look trendy, by having a web site which works on iPhones and the like. Obviously the ACS should also fix the minor accessibility problems, as indicated by an automated TAW Test. Designing web pages which work on smart phones and which meet accessibility standards, so as to comply with Australian law, is not too difficult and I teach it to the ANU students. To be fair, other IT professional bodies do not rate much better. The ACM home page scores only 1/100 on the mobile tests and only slightly better than ACS on accessibility.
  • Social networking for professionals: The ACS is using social networking for teaching online courses. This could be extended to all members, with online forums and activities. ACS should divert a significant amount of resources to this. At the national level I suggest diverting 75% of what is currently spent on publications, meetings and marketing to online interaction. There is little point in spending effort on meetings and bits of paper which few people attend or take notice of. The ACS could use a mix of the software which it already has installed for education (Mahara ) and external sites, particularly Linkedin.
  • Support for meetings: Using the online tools discussed above, I suggest we should have an online component to all meetings. When there is a branch meeting, members should be invited to discuss the topic online, before, during and after. This can also allow for more fluid and more far reaching meetings. Last year I helped Senator develop her "Public Sphere" format for events. On a smaller scale the first Bar Camp Canberra is on at ANU this Saturday. This is a sort of make it up as you go along conference, using of online resources.
  • Digital CVs: ACS education is providing "e-portfolios" for students, as do some other education providers. I suggest ACS provide certified e-portfolios for members. This would be a web page about the member's qualifications and experience, testified to by ACS. This could then be used when they apply for a job or course. The ACS is already checks and records the member's credentials.