Showing posts with label ALTC. Show all posts
Showing posts with label ALTC. Show all posts

Tuesday, December 11, 2012

Evaluating Education Projects

One of the resources for my current education studies is "Evaluating Projects (Chesterton)". This provides guidance in preparing applications for Office for Learning and Teaching (OLT) grants. Unfortunately the link for the evaluation document changed when the OLT was created to replace the Australian Learning and Teaching Council (ALTC). The document "ALTC Grants Scheme - Evaluating Projects" is available on the new OLT website. A PDF version titled "ALTC PROJECT EVALUATION RESOURCE" also available. It is not clear why the web and PDF versions of the document have different titles.
 
The document was developed by Paul Chesterton (ACU) and Rick Cummings (Murdoch University) for the ALTC. The document is dated 2001 and no changes appear to have been made since the creation of the OLT.

ALTC Grants Scheme - Evaluating Projects

Purpose of the Resource

This resource is designed to provide guidance and assistance on project and program evaluation to individuals and groups submitting proposals for funding under the ALTC’s Grants and Fellowships Programs. The guidance is in the nature of background information on what project evaluation is and what constitutes good practice in the evaluation of learning and teaching projects.
Assistance is provided in the form of templates for key elements of a project evaluation. The resource also links to resources that help you and/or the evaluation team to carry out the evaluation — from design to data collection, analysis and management to reporting the findings. This resource is designed around the development of an evaluation plan, and it is intended that every project proposal will show evidence of formal evaluation planning that focuses on questions such as those outlined in this resource.
Depending on the expertise and experience of the user, the resource might be used for a variety of purposes, including as a guide for an evaluation plan, a checklist to assess a draft plan, a resource to inform stakeholders of good practice in evaluation, or to review a completed evaluation study and report....
From:  "ALTC Grants Scheme - Evaluating Projects", OLT (ALTC), 2011

Friday, October 28, 2011

Modular Portable Classroom Design

The University of Melbourne's Design School is running a federal government sponsored competition for a relocatable classroom design, called "Future Proofing Schools". I started preparing a submission, but realized that while I had a concept, I could not prepare the architectural renderings required. So I decided to release what I had done, the "Future Proof Classroom" (FPC). There is the statement and two for the competition, along with two renderings:

Future Proofing Schools Submission: Statement

Future Proof Classroom (FPC)

Tom Worthington, 28 October 2011

Schools are not just buildings

Modular Portable Classroom Design: Perspective ViewSchools are a resource for the whole community. Design needs to start with community consultation and to consider use of the school by the whole community. School buildings are valuable and need to be able to be reconfigured for different uses at different times of the day, night and weekends, by students, adult learners and the whole community. Schools are at the centre of the community in bad times as well as good. So schools need to be designed to not only survive a natural disaster, but be ready to function an an emergency relief centre for the community, with their own water and power supplies.

Building the community in the School

  1. Online consultation system: Consultation needs to happen from the start, so the first component of the FPC is a web site for consulting the community. The system provides for all phases of school development, from pre-planning, design, building, operation, maintenance, modification and relocation. The system allows the community to be consulted directly online and the text and video minutes of face to face town hall style meetings to be kept. The system will also hold all planning documents, in a legally certified e-records, to allow for audit of the process.

  2. Planner: Planner is an online application which allows anyone to design a school, using pre-prepared modules and test how it will look and work.

  3. Educator: Educator is an online extension of the school building, which provides an interface from computer screens in the building. But even before the building has been designed, educator takes care of the pedagogy (teaching to children), androgyny (teaching to adults), and heutagogy (self directed learning). The system provides a web site for e new facility and links this to other facilities on the campus, surrounding schools, community facilities and resources nationally and globally.

  4. Tech Modules: The physical school is built from one or more tech modules. These are 20 foot ISO shipping container sized units holding the pre-installed mechanical, electrical, water, waste and ICT systems. The tech modules also provide the basic structure the building is assembled around. The modules are filled with equipment, such as computers, solar panels, and water treatment systems, which is progressively unpacked as the building unfolds around the modules. Before lock-up stage, the models provide secure storage for the equipment and can be linked to a wireless security system.

  5. Flex Panels: The tech modules are only large enough to hold the mechanical systems for the school, there is no room in them for classrooms (and no one likes sitting in a shipping container anyway). The floor, wall and roof panels of the building are delivered folded in 40 foot ISO container sized cradles. The floor panels are unfolded onto the foundations and then the wall, ceiling and roof panels added. The cradles the panels were delivered on also form part of the structure of the building. The "twist-lock" connectors built into the standard shipping containers are used to secure the to the structure of the building to meet the highest Australian cyclone and earthquake codes. All windows are fitted with steel mesh for security and bushfire protection.

The school provides flexibility by using compact movable furniture (delivered packed in the in the containers). Areas of the building can also be changed subtly by adjusting the colour and intensity of the low energy LED lighting and by the use of sound reinforcement. This allows the open space to be reconfigured for small groups, classes, learning commons, community library or public meeting. The building can be relocated by folding the panels back into the shipping cradles they arrived in. The components can be reassembled into two smaller buildings or several kits used to make one larger building.

Design Process

Modular Portable Classroom Design: Plan View

The brief called for up to 60 students to be accommodated, with per student 3.5 m2 for teaching (total 210 m2) and 9.75 m2 per student overall (585 m2 total). An initial design is for a building with a footprint the size of 40 ISO shipping containers, arranged in a grid of 4 x 10, to make a 24.232m by 24.3m building.

The building is delivered as eight ISO containers: two 20 foot containers (ICT/Power Module and the Toilet/kitchen/water module) and three 40 foot panel cradles. The building can be transported as four trailer truck loads or four loads of the RAAF's C-17 cargo aircraft.

The building has no internal walls, apart from those of the tech modules and so the layout can be arranged as required. There is a screened veranda around all sides, to provide covered outdoor space. The roof can be changed from a low pitch for a contemporary look in inner city areas, to a suburban pitch, as required. The cladding is painted steel for durability and low cost and can have a full colour digital image applied with an industrial ink jet printer at the factory, to simulate any building material, architectural style or decorative effect required.

Sunday, August 28, 2011

Portable Classroom Design Competition

The University of Melbourne's Design School is running a federal government sponsored competition for a relocatable classroom design, called "Future Proofing Schools". The competition is open to anyone, but primarily aimed at professionals and tertiary students including Architects, Landscape Architects, Urban Designers, Planners and Industrial Designers. There is also a special web site for Year 10 to 12 school students.

Available are:
  1. Brief and Guidelines
  2. Frequently Asked Questions
  3. 21st Century Learning
  4. Sustainable School Environments
  5. Landscape Integration and Connections
  6. Prefabrication
Three-step challenge

The competition has three steps:
  1. Propose design ideas for next-generation
    relocatable classroom space [s] that:
    • suit a core cluster of up to 50 - 60 students*
      * based on teaching space of 3,5sqm per student + amenity spaces such as teacher preparation areas, wet areas and lockers + core spaces such as toilets
      Note: Australia’s Federal Guidelines suggest 9.75sqm per student for an entire school.
    • can be scaled to suit larger or smaller student populations
    • can adapt sustainably and economically to a range of physical and cultural contexts [climates, topographies, amounts of land available]
    • provide delightful spaces within, between and adjacent in which to teach, learn and play can be installed rapidly
  2. Show us how your design idea from step 1 works
    by applying it to a school site, either real
    or hypothetical:
    How will your design idea:
    • address variations in climate, topography and amounts of land available at different schools?
    • address connections to the outside, and existing buildings?
    • allow for clustering to create connected learning communities?
    • convey a sense of permanence, even though it is relocatable?
    You are free to tailor your design ideas to physical contexts of your own choice. ...

  3. Show us how your tailored design idea from
    step 2 can be re-located and re-adapted to
    a new school site with different physical
    parameters, either real or hypothetical:
    • How will your design idea adapt to this new set of parameters?
    • What building elements might change?
    • What building elements might stay the same?
    Consider that your tailored design idea may be relocated after one year, three years or even more at its first school site.
An ABC Radio "By Design" Podcast about the design of demountable school buildings with James Timberlake (Kieran Timberlak) and Arie van der Neut (HVDN) is available: "Reimagining 'relocatables' as 21st century learning spaces".

The competition is funded as Australian Research Council Linkage Grant project "Future Proofing Schools: using smart green integrated design approaches to prefabricated learning environments" (LP0991146, by CL Newton; T Kvan; D Hes; K Fisher; MJ Grose; S Wilks).

Schools in the Community Context

While the competition guidelines do a good job of setting the learning and environmental context, they do not appear to take into account the school in its social environment. Treating a school is a resource for the community and should be planned to be available for use by the community. A school building can be used by students of other schools in the area and as a community facility when not needed by students. At the same time the cost of the school building and its facilities can be reduced by drawing on community resources.

As discussed in my submission to the parliamentary inquiry into the NBN, governments are paying for unnecessary duplication across education sectors in both online learning and physical infrastructure. Substantial savings could be obtained through the creation of an ‘Australian Learning Commons’ consisting of multi-use school buildings and free sharing of teaching materials throughout Australia.

Rather than have a single purpose relocatable school building which, has to be dismantled and moved on a truck every few years to re-purpose it, this can be done by changing the use of the classrooms from daytime school student use to nighttime adult education class, to weekend community class. Instead of having to move walls to reconfigure the classroom, which could take minutes or hours, the software running on the computers in the classroom could be changed in seconds.

Friday, July 30, 2010

Using Video to Relate Research to Service Teaching

Professor Les Kirkup (UTS) talked on "New Perspectives on Service Teaching" at the Australian National University in Canberra today. He related his work on how to make service teaching of physics to life sciences students. His work with video I found very useful, but the remainder of the presentation seemed to be stating the obvious: courses should be designed around to what the student is learning to do.

As an ALTC Fellow, Professor Kirkup observed what actually happened in the classroom, rather than just reading the course description. The aim was to see how service teaching courses could fit with the degree program the student was studying at UTS.

Labs were also identified as an issue. A framework was developed for creating a laboratory program. This first trialled experiments, had a review by independent experts, trial by demonstrators and finally try with students.

I had difficulty understanding how much of what Professor Kirkup was describing was an area for research, was new or novel. When I am asked to design a course I am required to start from the requirements of the discipline it is for, usually based on a formal document issued by the relevant professional body. I then have to look at typical tasks the professional carries out in practice and then design learning materials based on these. There then has to be assessment which demonstrates the link between the learning materials and the skills the professional is required to have. I find it hard to believe that course designers would not be required to do this in credible educational institutions. But perhaps if Professor Kirkup needs to explain the process in such detail it is not as common as I had assumed.

Professor Kirkup described a process of designing experiments relevant to the student's future work. This also seemed to me to be stating the obvious. The course designer would obviously work top-down, stating from what the professional is being trained to do and turning that into something suitable for a student at the level they at. If teaching aeronautical engineers, the experiments would then relate to aeronautics, if teaching medical students, the experiments would relate to medicine. To do anything else would seem to be a waste of resources and be unlikely to pass the course design review process.

One aspect of the presentation which was useful was the idea of inspiring undergraduates with research. teaching research nexus One idea is to use "personal response" by using professionally prepared interviews with researchers. A two step process was used, with an audio interview first. This was used to gauge the value of the interview and also train the researcher in how to give an interview. A five minute video interview was then conducted. To encourage researchers to participate, versions of the interviews are made public to promote the research. This sounds a good approach: audio is much cheaper and easier to make than video. The videos are not simply entertainment for the students, they are given assessable questions to answer based on the video.

One issue is that video is expensive to make (about $1,000 per minute). The solution to this might be to have the video funded by the university marketing department, but have the content designed to suit education.

Friday, July 23, 2010

New Perspectives on Service Teaching

Professor Les Kirkup (UTS) will speak on "New Perspectives on Service Teaching" at the Australian National University, Canberra, 30 July 2010:
A TEACHING FORUM PRESENTATION
NEW PERSPECTIVES ON SERVICE TEACHING: TAPPING INTO THE STUDENT EXPERIENCE
A/PROF LES KIRKUP, DEPARTMENT OF PHYSICS AND ADVANCED MATERIALS,UNIVERSITY OF TECHNOLOGY, SYDNEY
FRIDAY 30TH JULY, 12:30-2:00, FORESTRY ROOM 102, BUILDING 48, the Australian National University

What are the characteristics of a good service subject and how do you design one?

Les Kirkup describes his experiences of identifying and addressing issues of student
fundedengagement in physics service subjects, drawing on insights gained through an ALTC project and Fellowship. He will discuss the design of laboratory experiences for students enrolled in first year physics service subjects as well as the benefits that accrue from enhancing the connection between teaching and discipline-based research for these students.

One measure of the success of a project or innovation is the influence it has on the practices of others. Les will describe the approaches being adopted to the dissemination of the ALTC project and Fellowship, and the outcomes of that dissemination to date.
Les Kirkup has 30 years experience working in tertiary education institutions. He held
academic positions in England and Scotland before moving to Australia in 1990. He is an
Associate Professor the Department of Physics and Advanced Materials at UTS. His national contributions to teaching and learning were recognised in 2007 with a Carrick/ALTC Associate Fellowship. He has written, or co-written, 4 books and over 50 peer-reviewed papers covering educational issues in physics as well as discipline-based research. He recently co-led an ALTC funded project Forging New Direction in Physics Education which concentrated on several issues including the provision of physics service teaching. In his discipline-based research he has worked in close collaboration with academics from a diversity of disciplines including physiology, psychology, chemistry, journalism and metrology (as well as, from time to time, fellow physicists).

LIGHT LUNCH PROVIDED – RSVP TO ANNA.WILSON@ANU.EDU.AU

Thursday, April 08, 2010

Engagement to Improve Learning and Teaching Techniques

I am part of a team applying for an ALTC grant to work on techniques for teaching Green ICT and applying it in universities. Essentially the idea is to take the Green ICT course I designed and use it as the basis of standards in the area and demonstrate its use in a green electronic classrooms. An interesting part of this is considering how to disseminate the results of the work. For a normal research grant the researchers would write some papers and talk at some conferences. But the ALTC requires more than just some papers and talks, as they want to see the results actually used.

ALTC produced two reports:
The project proposals are required to include "formative" evaluation o provide feedback as it goes along. Large projects (over $150,000 currently) also require formal external "summative" evaluation at the end (the cost of this evaluation can be part of the grant).

ALTC have a ten step process for evaluation:
  1. Project Clarification: What is the nature of the project?
  2. What is the purpose and scope of the evaluation?
  3. Who are the stakeholders for the project and the audiences for the evaluation information?
  4. What are the key evaluation questions which the evaluation will address?
  5. How will the information be collected and analysed?
  6. What are the criteria for making judgements about the findings of the evaluation?
  7. What resources and skills are required to conduct the evaluation?
  8. How will the evaluation findings be disseminated?
  9. What is the timeline for the evaluation activities?
  10. Is the evaluation plan internally coherent and of high quality?
For a green project some ways this might be done is to provide online forums to help get green educators together and provide them with resources. Also in person they would try out the green electronic classroom. Rather than having a two phase approach where part of the project is to do the research and then separately disseminate it, we would build tools and facilities which would be used for dissemination as well.

One of the difficulties is to find interested participants in the ALTC project. These need not be limited to university and can be companies or other organisations. It occurs to me that some of my former Green ICT students may wish to appreciate, as they work in the field in government agencies, multinational companies, Australian and North American universities. Also an obvious partner is the Australian Computer Society's educational arm, which originally commissioned the Green ICT course.

The traditional way to find partners is to quietly sound out people. However, I thought it useful to make a public blog posting and invite people to express interest.

ps: ALTC do not appear to have practice what the preach, having produced their recommendations on dissemination as large hard to download, hard to read, PDF documents. So I have extracted the summary of one, to make it easier to read:
Unravelling the complex relationship between ideas and innovations, their dissemination and their recontextualisation within and between the different levels of society, government or the higher education system as a whole, individual universities, and the students and teachers in universities has been a central task of this project in order to identify and devise strategies to engage these multiple levels in systematic and strategic change. Ideas about educational policy and reforms and innovations supporting educational change
are received and interpreted differently within and between each of the levels and the various contexts in which institutions operate (Ball, 1998). Most current models of dissemination of good teaching practice and innovations focus on sponsored workshops, seminars and courses, upgrading infrastructure, showcases of good practice and some form of ‘teaching excellence’ awards.

While these are useful and constitute a degree of dissemination, they are not sufficient to lead widespread changes in practice or implementation across an
institution or discipline.

The question faced by the Carrick Institute for Learning and Teaching in Higher Education as it considers developing a grant scheme is ‘How can large-scale educational reform in Australian universities be developed and sustained by grant schemes and other centrally funded projects?’

The aim of this project was to systematically investigate Australian and international learning and teaching grant schemes and their outcomes to determine strategies the Carrick Institute might employ to maximise the
likelihood of achieving large-scale change in teaching and learning across the Australian higher education sector, especially through its grants program. The project has identifi ed a number of conditions that have been shown to be effective in achieving dissemination of project outcomes and that engage the multiple levels of the higher education sector. It has recommended strategies for the Carrick Institute and leaders of institutions to manage multiple innovative strategies that impact on the culture and practices of universities and their departments as well as on the practices of individual academics. ...

From: Strategies for effective dissemination of project outcomes, Deborah Southwell, Deanne Gannaway, Janice Orrell, Denise Chalmers, Catherine Abraham, 2005