Tips for preparing and presenting online learning

Uncategorized, , , , , , , , ,

This week we had a group of library staff contribute to a roundtable discussion about online training. We were lucky to have visiting Australian Tom Worthington* talk to the group. These are some notes from the wide-ranging discussion.

Online approaches

In face-to-face teaching, a unit in philosophy taught over a semester is very different to a single training session in how to find something in a library catalogue. However in practice in the online world they are the same.

Tom noted that five years ago he decided to stop giving lectures and only deliver courses online. It has taken that time for him to feel comfortable with the online delivery.

The electronic equivalent of the traditional lecture is you prepare a reading block, mail it to the students, give them exercises to do, they write it down and you give them comments. But there is an opportunity to do much more. An example is the book “ICT Sustainability: Assessment and Strategies for a Low Carbon Future“, used for an ANU course.

The ‘flipped classroom’ is an approach where the online component is first. However unless you give them a task they will come to the first day full of excuses. The convenor can give students blocks of exercises. At the face to face section you can have the informal discussion and help them with problems. That works well.

Text based courses can use video that someone else has recorded on the topic. The process is the students:

  • Read the summary of the course
  • Do the readings
  • Do the test
  • Then have a discussion online or in person together.

Asynchronous courses ask students to contribute to an online text based forum. As an example, the questions for week one of “ICT Sustainability”.  The students might be asked to answer questions – find a paper or video on the topic, say why it is relevant. They should post to the forum by the middle of the week, must reply to two other posts by two students by Friday. Then use peer assessment to mark each other’s work. It is good if their contribution is used in some way. Usually allocate 10-20% of the marks to their contribution to the marking of each other’s work. Students will go to remarkable lengths to get small number of marks. Needs to make sense to the long term goal of the student.

One way of presenting a course is to provide small ‘units’ of information which are not timed. At the end of a unit the student does a test and when they pass they move onto the next section.

Using traditional eLearning you would have at most 24 people in each group – you usually still have ‘loud’ people you have to tell to stop writing/talking.

Course structures

There are standards for learning materials. The University provides considerable resources for Learning Aims and Outcomes.

It helps to have rigid statements about what the course is about. These should include learning objectives, how the course is broken up eg: two components and three sub components. See the introduction to “ICT Sustainability”.  Without this structure the student does not know where they are up to. You need to show participants there is a plan.

Tom noted it is important to tell participants why the course will be useful to them and how it will be useful to them. It is very important to provide markers throughout the course. Where are we up to and what is this for? Eg: this will increase your chances of getting a paper published.

It is all in the preparation

Academic bravado is ‘I have a lecture in 5 minutes, I had better get something together’. With eLearning you have to design all the materials and exercises in advance before they start. Gather the materials together – but you always need to consider licenses. A repository – equivalent of an electronic book, videos and quizzes.

Don’t add things on the fly. Once it starts you need to keep things stable. You can take online material and deliver it in person easily. It is much harder to do it the other way.

Preparing online courses is very labour intensive and traditional universities do not provide for the preparation time. However the delivery is much quicker. If you are at the distance education university this is built into the system. But in a traditional university you only get paid for delivery. So first time you run a course, it is at a ‘loss’ but each time after that it is easier. So try to minimise the material beforehand.

The question about the inability to get feedback from people was raised. With online fixed courses you don’t have a way to improve the content for your students. Tom suggested observing the test results helps. The dropout rate is an indicator (and you can always ask people why they dropped out). You can look at what they have been accessing. There is considerable research on ‘Learning Analytics’ and products for extracting the data from Moodle.  There may be things they have not been looking at – it might be the link has broken. The flipped classroom will give people the chance to fix things.

Some concern was raised about reusing information. One person noted that ‘internalising the material requires creating it myself’. The group agreed it was important to ensure the information is stitched together well so there is a real narrative. Tom noted we do have standardised educational materials – they are called text books. You can still use text books in an online course. If we have standard published sources then we should use them.

Preventing cheating

If you just give students reading materials online then they will not read it. You need to give them tasks to do and monitor the results. Give them multiple choice using immediately marked systems. Them knowing there is a test at the end increases their education (even if they get all the answers wrong). Even if the test is not for credit, students will still cheat.

Ways to prevent people cheating at online tests:

  • Limited number of attempts
  • Questions are selected from a bank at random
  • Positions of the multiple-choice answers are randomised
  • If numeric answers, the system generates a random set of values so each student gets a different question

Note that young digital natives are still academically illiterate – they do not naturally know how to write things with proper referencing. They write assignments with broken jargon, not proper referencing and will copy things from Wikipedia. Tom said that he doesn’t call it ‘plagiarism’ in the first few weeks, they call it ‘poor referencing’.

Encouraging attendance

The conversation moved to the library training environment, where we often have an opportunity to see people only once face to face. Students need to get feedback on the quizzes – there might not be anything after that.

There is nothing telling the students they have to go to these sessions apart from them thinking it might be helpful. So how do we leverage off a one off teaching slot? In that one off session – eg: ‘How can you become an expert in 10 minutes’ – can we replicate that type of activity online in the same sort of way?

Suggestions for encouraging attendance included:

  • Doing this as part of something for someone they respect.
  • Provide students the materials in the live sessions eg: worksheets and reading and exercises, then collect them into a coherent ebook, step by step.
  • Give them a certificate at the end – shake their hands and give it to them.

Getting university buy-in

Tom suggested that it is a good idea to tap into the national standard for what a student needs to do in a particular area. Each department will have their own way of doing it.

He suggested going to the international standardised skills framework, finding the skill that is relevant, and using the text describing this to be part of the course outline. Accrediting bodies in some areas will be useful for this (for example Engineering). You can use the description from this body. Doing this makes it easier to get a course approved. The Executive of institutions will support that kind of course.

Examples include the Skills Framework for the Information Age (SFIA), which  is a computer science based set, and there is the Seoul Accord.

Online course technologies

Cambridge University uses the Moodle Virtual Learning Environment, which Tom noted is the equivalent of buying a Vauxhall – can buy lots of parts and find lots of people to fix it. It is not very exciting. But it is fine.

Moodle is not really built for creating an ePortfolio which shows evidence the students know how to use something. They collect material into your e-portfolio and then you present it. Use simple social media where you say “please work on this and discuss it”. This can shows evidence the student knows how to use something. One tool is the Mahara open source ePortfolio program.

Recording technology

Recording lectures is a challenge at Cambridge where there are not universal recording facilities in lecture theatres. But Tom noted that while sometimes having good technology can be useful – a document camera can show students how equations are done for example – using simple tools can work.

If you are giving a presentation, simply set a recording device on the desk. Students really like the recordings of a presentation. Tom noted that when recording something to go online is it much easier to give a presentation to a live audience rather than to an empty room. Note it is important to consider the legal issues of recording people – when they approach you to speak privately about something you need to turn the microphone off. It is also important to remember to repeat questions asked by the audience into the microphone.

Recording helps international students. They listen to the recording a minimum of six times. If use echo360 active learning program you can see how many views each part of the course is being looked at.

People are prepared to listen for 6-20 minutes. When putting recordings online you can have a talking head or show the powerpoint slides. A good way of presenting a video recording is to show a talking head for the first few seconds to see a human, then flip to powerpoint slides then have the human again at the end. An alternative is to just use a static photograph. People will treat a smiley face as a person.

Tom noted that he has never been to a webinar session at university that worked properly. You spend half the time trying to get the technology to work. It is necessary to train people in the technology. Unless there is a need for a live session don’t do it. Digital native young people still have trouble with the technology.

Examples of good online teaching

Universities UK have Open Learn and the Australian equivalent is Open 2 Study. The way these are set up – you do a short course for free then you can enrol in the longer one for a cost. The courses all started at 12 weeks, and they are now four weeks. MIT have created Open EdX.

Other useful links:

* About the speaker

Tom Worthington, is an independent computer consultant and educator. He is an Adjunct lecturer in the Research School of Computer Science at the Australian National University and a member of the ANU Climate Change and Energy Change Institutes. Also Tom designs and teaches on-line courses for the the Australian Computer Society (ACS) Virtual College. He was previously an IT policy advisor at the Australian Department of Defence. Tom is a Past President, Honorary Life Member and Fellow of the ACS, as well as a voting member of the Association for Computing Machinery and a member of the Institute of Electrical and Electronics Engineers.

Published 23 July 2015
Written by Dr Danny Kingsley
Creative Commons License

Dutch boycott of Elsevier – a game changer?

Uncategorized, , , , , , , , , , ,

A long running dispute between Dutch universities and Elsevier has taken an interesting turn. Yesterday Koen Becking, chairman of the Executive Board of Tilburg University who has been negotiating with scientific publishers about an open access policy on behalf of Dutch universities with his colleague Gerard Meijer, announced a plan to start boycotting Elsevier.

As a first step in boycotting the publisher, the Association of Universities in the Netherlands (VSNU) has asked all scientists that are editor in chief of a journal published by Elsevier to give up their post. If this way of putting pressure on the publishers does not work, the next step would be to ask reviewers to stop working for Elsevier. After that, scientists could be asked to stop publishing in Elsevier journals.

The Netherlands has a clear position on Open Access. Sander Dekker, the State Secretary  of Education has taken a strong position on Open Access, stating at the opening of the 2014 academic year in Leiden that ‘Science is not a goal in itself. Just as art is only art once it is seen, knowledge only becomes knowledge once it is shared.’

Dekker has set two Open Access targets: 40% of scientific publications should be made available through Open Access by 2016, and 100% by 2024. The preferred route is through gold Open Access – where the work is ‘born Open Access’. This means there is no cost for readers – and no subscriptions.

However Gerard Meijer, who handles the negotiations with Elsevier, says that the parties have not been able to come close to an agreement.

Why is this boycott different?

It is true that boycotts have had different levels of success. In 2001, the Public Library of Science started as a non-profit organization of scientists ‘committed to making the world’s scientific and medical literature freely accessible to both scientists and to the public’. In 2001 PLoS (as it was then) published an open letter asking signatories to pledge to boycott toll-access publishers unless they become open-access publishers. The links to that original pledge are no longer available. Over 30,000 people signed , but did not act on their pledge. In response, PLOS became an open access publisher themselves, launching PLOS Biology in October 2003.

In 2012 a Cambridge academic Tim Gowers started the Cost of Knowledge boycott of Elsevier which now has over 15,000 signatures of researchers agreeing not to write for, review for, or edit for Elsevier. In 2014 Gowers used a series of Freedom of Information requests to find out how much Elsevier is charging different universities for licence subscriptions. Usually this information is a tightly held secret, as individual universities pay considerably different amounts for access to the same material.

The 2015 Dutch boycott is significant. Typically negotiations with publishers occur at an institutional level and with representatives from the university libraries. This makes sense as libraries have long standing relationships with publishers and understand the minutiae of the licencing processes . However the Dutch negotiations have been led by the Vice Chancellors of the universities.  It is a country-wide negotiation at the highest level. And Vice Chancellors have the ability to request behaviour change of their research communities.

This boycott has the potential to be a significant game changer in the relationship between the research community and the world’s largest academic publisher. The remainder of this blog looks at some of the facts and figures relating to expenditure on Open Access in the UK. It underlines the importance of the Dutch position.

UK Open Access policies mean MORE publisher profit

There have also been difficulties in the UK in relation to negotiations over payment for Open Access. Elsevier has consistently resisted efforts by Jisc to negotiate an offsetting deal  – where a publisher provides some sort of concession for the fact that universities in the UK are paying unprecedented amounts in Article Processing Charges on top of their subscriptions because of the RCUK open access policy.

Elsevier is the world’s largest academic publisher. According to their Annual Report the 2014 STM revenue was £2,048 million, with an operating profit of £762 million. This is a profit margin of 37%. That means if we pay an Article Processing Charge of $3000 then $1,170 of that (taxpayers’) money goes directly to the shareholders of Elsevier.

The numbers involved in this space are staggering. The Wellcome Trust stated in their report on 3 March 2015 The Reckoning: An Analysis of Wellcome Trust Open Access Spend 2013 – 14: ‘The two traditional, subscription-based publishers (Elsevier and Wiley) represent some 40% of our total APC spend’.

And the RCUK has had similar results, as described in a Times Higher Education article on 16 April 2015 Publishers share £10m in APC payments: “Publishers Elsevier and Wiley have each received about £2 million in article processing charges from 55 institutions as a result of RCUK’s open access policy”.

Hybrid open access – more expensive and often not compliant

Another factor is the considerably higher cost of  Article Processing Charges for making an individual article Open Access within an otherwise subscription journal (called ‘hybrid’ publishing) compared to the Article Processing Charges for articles in fully Open Access journals.

In The Reckoning: An Analysis of Wellcome Trust Open Access Spend 2013 – 14, the conclusion was that the average Article Processing Charge levied by hybrid journals is 64% higher than the average Article Processing Charge of a fully Open Access title. The March 2015 Review of the implementation of the RCUK Policy on Open Access concluded the Article Processing Charges for hybrid Open Access were ‘significantly more expensive’ than fully OA journals, ‘despite the fact that hybrid journals still enjoyed a revenue stream through subscriptions’.

Elsevier has stated that in 2013 they published 330,000 subscription articles and 6,000 author paid articles. There is no breakdown of how many of those 6,000 were in fully open access journals and how many were hybrid. However in 2014 Elsevier had 1600 journals offering their hybrid option, and 100 journals that were fully open access (6%). Note that the RCUK open access policy came into force in April 2013. It would be interesting to compare these figures with  the 2014 ones, however I have been unable to find them.

While the higher cost for hybrid Article Processing Charges is in itself is an issue, there is a further problem. Articles in hybrid journals for which an Article Processing Charge has been paid are not always made available at all, or are available but not under the correct licence as required by the fund paying the fee. Here at Cambridge, the five most problematic publishers with whom we have paid more than 10 Article Processing Charges have a non compliance rate from 11-25%. With this group of publishers we are having to chase up between three and 31 articles per publisher. This takes considerable time and significantly adds to the cost of compliance with the RCUK and COAF policies.

According to the March 2015 Review of the implementation of the RCUK Policy on Open Access, ‘Elsevier stated that around 40% of the articles from RCUK funding that they had published gold were not under the CC-BY licence and are therefore not compliant with the policy’ (p19).

We support our Dutch colleagues

In summary, the work happening in The Netherlands to break the stranglehold Elsevier have on the research community is important. We need to stand by and support our Dutch colleagues.

NOTE: This blog was subsequently reblogged on the London School of Economics Impact Blog and later listed as one of the Top Ten Posts for 2015: Open Access. It was also listed as one of the blogs that had an average minute per page measurement of over 6 minutes and 30 seconds.

Published 3 July 2015, added to on 22 January 2016
Written by Dr Danny Kingsley
Creative Commons License

Libraries of the future – insights from a talk by Lorcan Dempsey

Uncategorized, , , , , , , , , , , , , ,

There is no argument even from traditionalists that the library role is changing. But there is a great deal of confusion and sometimes fear about what that means, and what the future might look like.

On 3 June, Lorcan Demsey*  came to speak to staff at Cambridge University Library about how the role and purpose of libraries are changing. The slides from his talk are available on Slideshare.

The one sentence headline from the talk was that research libraries are moving from licensing published content to managing workflow and research outputs – which means the print collection needs to be managed down to free up resources for the new roles. The subhead is – if we don’t do this, the publishers are waiting in the wings to take over.

Modern libraries in research environments

The Library role is distilling from owned materials to facilitating access to many things. Changing focus to ‘discovery’ in the collection means there must be a loss of some of the items.

Lorcan noted that his sense is that there is still a low uptake of this concept. As someone who has been working in scholarly communications for over a decade. I agree.

The collection as a means to an end rather than an end it itself – in some ways this is obvious but in others it is a huge psychological shift. 

  • In a print world, researchers and learners organised their workflow around the library. The library had a limited interaction with the full process.
  • In a digital world the Library needs to organise itself around the workflows of research and learners. Workflows generate and consume information resources.

In libraries there is a separation of the discovery and the collection – library users are on the global level. The library will make some available and own some of those.

Change of focus

The research endeavour has moved from a focus on outcomes to begin to think about a range of activities around the process and the aftermath.

The traditional role of a library – outside of special collections and manuscripts – deals with outcomes like the books and journals. In this model students and researchers interact with the books and journals and then turn it into classically published works that come back into the library.

But we live now in an online world and the Library is interacting with the content in many different ways. There is interest in the process of research –methods, evidence and research data. There is also interest in the discussion around research through pre-prints, working papers and a variety of prepublication activity. This involves revision, derivative works and reuse. Copyright is important in these cases to let people know how things will be used.

This means that ‘collections’ from a library perspective now include the process, methods, discussions and outputs as well as books and journals.

From curation to creation

Mediated access to licensed material is becoming more streamlined, and other items becoming more available. Libraries are supporting creation, not just consumption.

Libraries need to be seen as a source for collaboration. There needs to be a partnership between the Library and the Faculty. The library is a partner in terms of the creation activity. The mediating role will continue.

Managing this transition is often done opportunistically – when people retire they are replaced with new skill sets.

The repository was seen by the Libraries initially as something in relation to artefacts but now it is seen as part of the workflow of the research lifecycle. There is less attention on what is coming in and more focus on sharing material back out.

Show me the money

There is a question around how much of this activity will be supported by the institution? And how is the resource shifting occurring in the libraries?

Lorcan said that while libraries talk about a growing interest in special collections and archives, there is no evidence from a budget perspective that this is being supported.

Publishers are trying to muscle in

Managing online identities

There is considerable interest amongst researchers in having a carefully tended online presence. This is time consuming, and would appear to be important to the researchers. This process is becoming intimately tied to publication – it is where people are announcing their publication.

Lorcan mentioned a study in Nature which was a survey of 3,000 scientists and engineers. They found 6% used Google Scholar, but more than half were using ResearchGate more regularly than LinkedIn. Not surprisingly this behaviour can be broken down by discipline. The social sciences tend to use Google Scholar, and academic.edu has low use by engineering and sciences. There are many solutions to the workflow to help researchers. Many of these will go away, but some are quite heavily used.

Thinking historically, a catalogue covers the material a library owns. The library has a discovery layer and a license. However this activity will have to shift to support creation. We have repositories, Google Scholar, ResearchGate etc. The incentive to use the repository is very low compared with these services.

A gap in the market?

Workflow is the new content – managing identity is where a lot of the focus is. Publishers are trying to position themselves as the service provider in this space.

Many libraries do not see their role as managing evolving scholarly records – the research and learning material. The curation of identity for researcher profiles is a big interest. This is often currently managed by research offices.

However this is a space into which publishers are moving. Several big publishers are now trying to be part of the full cycle for researchers.

For example Elsevier has two products – Pure is a content management system for research reporting and Mendeley is an academic social network. It is no coincidence that the word ‘solution’ is in the url thread. Similarly, Macmillian (publishers of Nature) recently bought Digital Science the company that created the equivalent products Symplectic and figshare. Digital Science was not included in the Macmillan Springer merger, possibly because they still need substantial investment. Lorcan noted that people see them as ‘plucky start-ups’ but they are owned by big publishers. There has been a big take-up of these services.

Lorcan showed a quote from Annette Thomas, CEO of Macmillian Publishers about ‘A publisher’s new job description’.

Her view is that publishers are here to make the scientific research process more effective by helping them keep up to date, find colleagues, plan experiments, and then share their results. After they have published, the process continues with gaining a reputation, obtaining funds, finding collaborators, and even finding a new job. What can we as publishers do to address some of the scientists’ pain points? 

As Lorcan observed – you can take out the word ‘publisher’ and replace with the word ‘library’.

Managing down collections

Libraries are increasingly wanting to organise their space around the student experience not around collections. Lorcan used a grid to illustrate the changing focus. The two distinctions were:

  • Whether items are in many collections or are rare or unique.
  • Whether items require stewardship. Items that are high stewardship items are looked after and resources are spent on them. Items that are low stewardship don’t get looked after in Libraries.

At one extreme is licensed materials which are high stewardship/many collections. The opposite corner is research materials which are only available in a few collections and are low stewardship.

Lorcan said he thinks in the future there will be a focus on distinctive collections. There needs to be a lot more money to do this. So licensed purchased material will be more streamlined. Management attention 15 years ago was on highly managed, licensed items, but now the focus has shifted to items of low stewardship.

Inside out library

Market materials: licensed/purchased stuff. Library as broker and telling users that these things are available in a special way.

Distinctive collections: Library is provider and want to maximise discoverability. Want other people to know about faculty expertise, and research data. Putting into own discovery layer doesn’t help there. Think about metadata and which aggregators are important. Been slow to realise that discoverability is vital.

These have very different dynamics. We want to share material held within the library with the rest of the world. The licensed stuff is external and libraries bring it in to share internally. This is inside out.

Traditionally libraries deal with published, purchased material (including special collections). However there is a shift away from acquisitions to demand. This means that libraries need to redirect their resources towards research support. One way of doing this is to manage down the print collection.

There was an explosion of publishing after the Second World War. In the same way that baby boomers are all retiring at the same time, we are now faced with the challenge of managing these collections down.

Challenges for identity

The managing down of print collections coincides with the push to repurpose space in libraries. There are many discussions with architects – managing down print means there must be refurbishment.

One of the issues emerging for libraries is: Without the books, does the campus see this as the Library? Is the space needed for the Library – could they be replaced by learning commons or the student union?

We can see the identity discussion about libraries emerging now. If we are managing down collections, what is the space for? What are the new services we offer? Lorcan mentioned media stories where librarians are being attacked by historians who see this as managerial, technocratic activity.

Lorcan described some of the shared collection activities happening in the USA.

Conclusion

We used to think of the Library as a collection. Now we need to think of the Library in terms of the user and their workflows.

We must move to more facilitated access to items, also move to the management and disclosure of curated materials. The print and digital scholarly record needs curation and co-ordination at a conscious national level.

The job is about restructuring the means but we need to make decisions about moving resources or bets on the future. Libraries must shift from an organisation where the end was known to one where we must take some risk.

Published 6 June 2015
Written by Dr Danny Kingsley
Creative Commons License

* Lorcan coordinates strategic planning and oversees Research, Membership and Community Relations at OCLC. He has worked for library and educational organizations in Ireland, the UK and the US. His influence on national policy and library directions is widely recognized. He is on Twitter – @LorcanID