Tag Archives: students

Tips for preparing and presenting online learning

Uncategorized, , , , , , , , ,

This week we had a group of library staff contribute to a roundtable discussion about online training. We were lucky to have visiting Australian Tom Worthington* talk to the group. These are some notes from the wide-ranging discussion.

Online approaches

In face-to-face teaching, a unit in philosophy taught over a semester is very different to a single training session in how to find something in a library catalogue. However in practice in the online world they are the same.

Tom noted that five years ago he decided to stop giving lectures and only deliver courses online. It has taken that time for him to feel comfortable with the online delivery.

The electronic equivalent of the traditional lecture is you prepare a reading block, mail it to the students, give them exercises to do, they write it down and you give them comments. But there is an opportunity to do much more. An example is the book “ICT Sustainability: Assessment and Strategies for a Low Carbon Future“, used for an ANU course.

The ‘flipped classroom’ is an approach where the online component is first. However unless you give them a task they will come to the first day full of excuses. The convenor can give students blocks of exercises. At the face to face section you can have the informal discussion and help them with problems. That works well.

Text based courses can use video that someone else has recorded on the topic. The process is the students:

  • Read the summary of the course
  • Do the readings
  • Do the test
  • Then have a discussion online or in person together.

Asynchronous courses ask students to contribute to an online text based forum. As an example, the questions for week one of “ICT Sustainability”.  The students might be asked to answer questions – find a paper or video on the topic, say why it is relevant. They should post to the forum by the middle of the week, must reply to two other posts by two students by Friday. Then use peer assessment to mark each other’s work. It is good if their contribution is used in some way. Usually allocate 10-20% of the marks to their contribution to the marking of each other’s work. Students will go to remarkable lengths to get small number of marks. Needs to make sense to the long term goal of the student.

One way of presenting a course is to provide small ‘units’ of information which are not timed. At the end of a unit the student does a test and when they pass they move onto the next section.

Using traditional eLearning you would have at most 24 people in each group – you usually still have ‘loud’ people you have to tell to stop writing/talking.

Course structures

There are standards for learning materials. The University provides considerable resources for Learning Aims and Outcomes.

It helps to have rigid statements about what the course is about. These should include learning objectives, how the course is broken up eg: two components and three sub components. See the introduction to “ICT Sustainability”.  Without this structure the student does not know where they are up to. You need to show participants there is a plan.

Tom noted it is important to tell participants why the course will be useful to them and how it will be useful to them. It is very important to provide markers throughout the course. Where are we up to and what is this for? Eg: this will increase your chances of getting a paper published.

It is all in the preparation

Academic bravado is ‘I have a lecture in 5 minutes, I had better get something together’. With eLearning you have to design all the materials and exercises in advance before they start. Gather the materials together – but you always need to consider licenses. A repository – equivalent of an electronic book, videos and quizzes.

Don’t add things on the fly. Once it starts you need to keep things stable. You can take online material and deliver it in person easily. It is much harder to do it the other way.

Preparing online courses is very labour intensive and traditional universities do not provide for the preparation time. However the delivery is much quicker. If you are at the distance education university this is built into the system. But in a traditional university you only get paid for delivery. So first time you run a course, it is at a ‘loss’ but each time after that it is easier. So try to minimise the material beforehand.

The question about the inability to get feedback from people was raised. With online fixed courses you don’t have a way to improve the content for your students. Tom suggested observing the test results helps. The dropout rate is an indicator (and you can always ask people why they dropped out). You can look at what they have been accessing. There is considerable research on ‘Learning Analytics’ and products for extracting the data from Moodle.  There may be things they have not been looking at – it might be the link has broken. The flipped classroom will give people the chance to fix things.

Some concern was raised about reusing information. One person noted that ‘internalising the material requires creating it myself’. The group agreed it was important to ensure the information is stitched together well so there is a real narrative. Tom noted we do have standardised educational materials – they are called text books. You can still use text books in an online course. If we have standard published sources then we should use them.

Preventing cheating

If you just give students reading materials online then they will not read it. You need to give them tasks to do and monitor the results. Give them multiple choice using immediately marked systems. Them knowing there is a test at the end increases their education (even if they get all the answers wrong). Even if the test is not for credit, students will still cheat.

Ways to prevent people cheating at online tests:

  • Limited number of attempts
  • Questions are selected from a bank at random
  • Positions of the multiple-choice answers are randomised
  • If numeric answers, the system generates a random set of values so each student gets a different question

Note that young digital natives are still academically illiterate – they do not naturally know how to write things with proper referencing. They write assignments with broken jargon, not proper referencing and will copy things from Wikipedia. Tom said that he doesn’t call it ‘plagiarism’ in the first few weeks, they call it ‘poor referencing’.

Encouraging attendance

The conversation moved to the library training environment, where we often have an opportunity to see people only once face to face. Students need to get feedback on the quizzes – there might not be anything after that.

There is nothing telling the students they have to go to these sessions apart from them thinking it might be helpful. So how do we leverage off a one off teaching slot? In that one off session – eg: ‘How can you become an expert in 10 minutes’ – can we replicate that type of activity online in the same sort of way?

Suggestions for encouraging attendance included:

  • Doing this as part of something for someone they respect.
  • Provide students the materials in the live sessions eg: worksheets and reading and exercises, then collect them into a coherent ebook, step by step.
  • Give them a certificate at the end – shake their hands and give it to them.

Getting university buy-in

Tom suggested that it is a good idea to tap into the national standard for what a student needs to do in a particular area. Each department will have their own way of doing it.

He suggested going to the international standardised skills framework, finding the skill that is relevant, and using the text describing this to be part of the course outline. Accrediting bodies in some areas will be useful for this (for example Engineering). You can use the description from this body. Doing this makes it easier to get a course approved. The Executive of institutions will support that kind of course.

Examples include the Skills Framework for the Information Age (SFIA), which  is a computer science based set, and there is the Seoul Accord.

Online course technologies

Cambridge University uses the Moodle Virtual Learning Environment, which Tom noted is the equivalent of buying a Vauxhall – can buy lots of parts and find lots of people to fix it. It is not very exciting. But it is fine.

Moodle is not really built for creating an ePortfolio which shows evidence the students know how to use something. They collect material into your e-portfolio and then you present it. Use simple social media where you say “please work on this and discuss it”. This can shows evidence the student knows how to use something. One tool is the Mahara open source ePortfolio program.

Recording technology

Recording lectures is a challenge at Cambridge where there are not universal recording facilities in lecture theatres. But Tom noted that while sometimes having good technology can be useful – a document camera can show students how equations are done for example – using simple tools can work.

If you are giving a presentation, simply set a recording device on the desk. Students really like the recordings of a presentation. Tom noted that when recording something to go online is it much easier to give a presentation to a live audience rather than to an empty room. Note it is important to consider the legal issues of recording people – when they approach you to speak privately about something you need to turn the microphone off. It is also important to remember to repeat questions asked by the audience into the microphone.

Recording helps international students. They listen to the recording a minimum of six times. If use echo360 active learning program you can see how many views each part of the course is being looked at.

People are prepared to listen for 6-20 minutes. When putting recordings online you can have a talking head or show the powerpoint slides. A good way of presenting a video recording is to show a talking head for the first few seconds to see a human, then flip to powerpoint slides then have the human again at the end. An alternative is to just use a static photograph. People will treat a smiley face as a person.

Tom noted that he has never been to a webinar session at university that worked properly. You spend half the time trying to get the technology to work. It is necessary to train people in the technology. Unless there is a need for a live session don’t do it. Digital native young people still have trouble with the technology.

Examples of good online teaching

Universities UK have Open Learn and the Australian equivalent is Open 2 Study. The way these are set up – you do a short course for free then you can enrol in the longer one for a cost. The courses all started at 12 weeks, and they are now four weeks. MIT have created Open EdX.

Other useful links:

* About the speaker

Tom Worthington, is an independent computer consultant and educator. He is an Adjunct lecturer in the Research School of Computer Science at the Australian National University and a member of the ANU Climate Change and Energy Change Institutes. Also Tom designs and teaches on-line courses for the the Australian Computer Society (ACS) Virtual College. He was previously an IT policy advisor at the Australian Department of Defence. Tom is a Past President, Honorary Life Member and Fellow of the ACS, as well as a voting member of the Association for Computing Machinery and a member of the Institute of Electrical and Electronics Engineers.

Published 23 July 2015
Written by Dr Danny Kingsley
Creative Commons License

Evolution of Library Ethnography Studies – notes from talk

Uncategorized, , , , , , , ,

Today Susan Gibbons, the University Librarian & Deputy Provost at Yale University came to speak to the Cambridge Library community about her work for more than a decade on the ethnography of library users.

The premise of the work Susan has done in collaboration with anthropologist Nancy Fried Foster is that libraries should get to know their users better rather than assume that ‘we know what they need’. They recognised that often we base our assumptions of what students experience and need on our own experiences as students which are clearly dated.

The reality of a rapidly changing world is that we need to adapt to the changing needs of the students. It is easier for the library to change than to expect our users to change.

I should note that I have followed Susan and Nancy Fried Foster’s work for many years. I based the design of my empirical work for my PhD “The effect of scholarly communication practices on open access: an Australian study of three disciplines” on their early studies. I am a bit of a fan.

Ethnographic research

Their work began on 2002 and 2003 with analyses of ‘faculty’ (academics’) work practices, before moving to undergraduates, graduate students, analysing how people search for information, asking what is the point of science library buildings in the electronic age, before most recently returning to the undergraduate student body.

There is a circularity in this type of  ethnographic research:

  • Start with a basic question – such as what are the barriers to completion of a PhD, or why do people still use the buildings in science when the content is all online
  • Methods – These can vary wildly from photos to observations, and analysis of academics diaries
  • Data Gathering – these first three constitute the ethnography
  • Findings – which is getting into user design. Analyse the data to start looking for patterns.
  • Change – you can only do this process once maybe twice, and if you do not make a change that is visible to the patrons then they won’t engage. There is a huge investment of time and trust in the process. This needs a commitment from the top down not just the bottom up to have the changes.

At the end of the process, there needs to be an analysis of whether the change has worked and if not, start again. Susan noted that they do not presume to know what the answers were when beginning the process. The area is so unknown they would not even be able to create a survey to ask A, B or C.

We need to embrace experimentation. Libraries have to have a tolerance for failure and change – otherwise the whole process will not work.  We need to have R&D thinking – try it and see if it works. We should not worry about every contingency because then we have lost the opportunity because someone has stepped in and started something. Don’t worry about scale until you find it is an appropriate method.

Changing role of the library

Once of the big messages from the talk was that increasingly the literature and the technology re intertwined. As librarians it is not just good enough to know the literature. If supporting social sciences then you need to know statistical packages and data visualisation. If the librarian can’t help with that then there is a break in the service. There needs to be a fluency with the digital tools as well in the library staff. Libraries are defined by their services but not by their collections. If we don’t have the services to support those collections then we may as well not have them.

This observation raised the question from the floor – do we employ specialists or employ librarians and train them up? Susan responded by saying increasingly Yale University was employing more people who have a PhD in the specific area. That way there is no expectation that everyone is an expert in every tool but there can be a go-to person.

However there has been a push to training people up in the library to be ‘librarians as teachers’. There is an emerging program to teach librarians on how to be teachers – very focused on professional development.

Increasingly the university is asking librarians to have outreach as part of their role. Professional assessments ask if they have created any subject guides, how many classes they have taught. Outreach is valued in the evaluation process. For some existing staff this was not comfortable – they wanted to be curators. The feeling for these people was they ‘changed the rules on me’ – so the university helps them make the transition. Some have come along the outreach path, others have moved somewhere else – and the university helps them with that move.

Studies at Rochester and Yale Universities

Susan did describe two examples  – one from her current institution Yale University and one from her former, the University of Rochester. She prefaced these descriptions with the disclaimer that all institutions are different – these findings are not translatable. That is why ethnography is so important – it is very locally focused. The questions that can affect the outcomes include whether students live on campus or off campus.Are students full or part time? Is it an engineering based institution. In addition weather and climate impacts behaviour.

The question behind the undergraduate student study was: “How can we improve the experience for the students?” That behind the graduate student study was “What are the barriers to the completion of a dissertation?”

Despite her findings being fascinating I won’t go into detail here partly because of the specificity of the findings to her institutions. Susan did note this was not a talk where we should take her group’s solutions and adopt them, rather we need to undertake our own research to determine what we need to do. However for those who are interested there is a considerable body of publications about the various projects:

However the methods are instructive and some of what emerged from the work is universal.

Findings

With the undergraduate students they undertook a ‘retrospective study’ of students who were responsible for writing a big paper. They ‘followed’ the students by contacting them one a week or fortnight and asking basic questions on how they were going. Then the day they handed the paper in they interviewed the students. This produced two outputs – a transcript of the interview but also during the interview the students were asked to draw the process out as they were explaining their experience.

The graduate students were asked to do an in-situ interview – in the place they do most of their work. Sometimes a lab, a coffee shop, where they lived. Then they were asked all sorts of information like showing us when they decided to print out an article and how did they keep track of them, about the books on the shelves – how they decide whether to buy one or take it our of the library and how are things filed on their computer. Other questions included the tricks of the trade of how they got through the writing process, what software they were using and the time of day and when they work.

Findings that spanned both studies included what Susan described as ‘the magical summer’. This is the time between finishing their bachelor degree and start the graduate school. The researchers asked professors what they thought the abilities were of those that leave as bachelors, and what the expectations were of new graduates, which was much higher. Hence the magic of the three month summer – how did the students manage this raised expectation? They knew they could not change those expectation of the professors. But we could help the students reach their expectations and help them through the process. This was a good time for the library to say ‘we are safe, work with us and we can help you’.

Another question is what is the best time to introduce research tools? People working on a thesis will need to use some sort of research tools – but when do you introduce that into their toolkit. The group found that once the student’s dissertation prospectus was approved their toolbox was locked – they were not able to ‘take a risk’ at that stage. So the introduction of tools has to be early in the process. The library had to ensure that professors were encouraging students to use the library services when they were writing their shorter papers.

They also found the importance of the human network – learning from other students, following other researchers – people texting information or attending a conference and seeing a book that is perfect for a colleague so they take a picture and send to their friend. So the question is how do you get the relevant librarian into that social network so they see the librarian as another resource?

Summary

Susan summarised the talk by saying there are so many things that drive the students away including physical and other barriers. Barriers can include use of acronyms, the scattering of collections and not knowing  how to get access to them. The Library needs to ask of itself is this barrier still necessary? If not change it. Some things are necessary but if we can’t change it we should explain it.

There is a continued importance of libraries as physical spaces – when the students want a place to go to get their work done they go to the library because it is a place of intellectual gravity. There are important symbolic aspects of libraries. They had asked students to circle a map of the university where you don’t feel welcome. Students answered ‘I’m not an athlete and that’s a gym’ for example. But the Library is a place where we all feel welcome. There is neutrality there.

Published 18 March 2015
Written by Dr Danny Kingsley
Creative Commons License