Tag Archives: professional development

Plans for scholarly communication professional development

Uncategorized, , , , ,

Well now there is a plan. The second meeting of the Scholarly Communication Professional Development Group was held on 9 October in the Jisc offices in London. This followed on from the first meeting in June about which there is a blog. The attendance list is again at the end of this blog.

The group has agreed we need to look at four main areas:

  • Addressing the need for inclusion of scholarly communication in academic library degree courses
  • Mapping scholarly communication competencies against training provision options
  • Creating a self assessment tool to help individuals decide if scholarly communication is for them
  • Costing out ‘on the job training’ as an option

What are the competencies in scholarly communication?

The group discussed the types of people in scholarly communication, noting that scholarly communication is not a traditional research support role either within research administration or in libraries. Working in scholarly communication requires the ability to present ideas and policies that are not always accepted or embraced by the research community.

The group agreed it would be helpful to identify what a successful scholarly communication person looks like – identifying the nature of the role, the types of skill sets and what the successful attributes are. The group has identified several examples of sets of competencies in the broad area of ‘scholarly communication’:

The group agreed it would be useful to review the NASIG Competencies and see if they map to the UK situation and to ask NASIG about how they are rolling it out across the US.

The end game that we are trying to get to is a suite of training products at various levels that as a community is going to make a difference to the roles we are recruiting.  We agreed it would be useful to explore how these frameworks relate to the various existing professional frameworks, such as CILIP, ARMA and Vitae. 

The approach is asking people: ‘Do you have a skills gap?’ rather than: ‘Do you (or your staff) need training?’. It would be helpful then, to develop a self assessment tool to allow people to judge their own competencies against the NASIG or COAR set (or an adaptation of these). The plan is to map the competencies against training provision options. 

Audiences

We have two audiences in terms of professional training in scholarly communication:

  1. New people coming into the profession – the initial training that occurs in library schools.
  2. Those people already in a research support environment who are taking on scholarly communication roles. 

The group also discussed scope. It would be helpful to consider how many people across the UK are affected by the need for support and training.

Another issue is qualifications over skills – there are people who are working in administrative roles who have expanded their skills but don’t necessarily have a qualification. Some libraries are looking at weighting past experience higher over qualifications. 

There needs to be a sense of equity if we were to introduce new requirements. While large research intensive institutions can afford professional development, in some places there is one person who has to do the scholarly communication functions as only part of their job – they are isolated and they don’t have funds for training. An option could be that if a training provision is to be ‘compliant’ with this group then it must allow some kind of free online training.

Initial training in library schools

As was discussed the previous time the group met, there is a problem in that library schools do not seem to be preparing graduates adequately for work in scholarly communication. Even the small number of graduates who have had some teaching in this area are not necessarily ready to hit the ground running and still need further development. The group agreed the sector needs to define how we skill library graduates for this detailed and complex area.

One idea that arose in the discussion was the suggestion we engage with library schools at their own conferences, perhaps asking to have a debate to ask them what they think they are doing to meet this need. 

The next conference of the library schools Association of Library and Information Science Educators is 6-9 February 2018 in Denver. Closer to home, iConference 2018 will be 25-28 March and will be jointly hosted by the UK’s University of Sheffield’s Information School and the iSchool at Northumbria. However, when we considered the conference options it became clear that this would not necessarily work, the focus of these conferences is academic focus, not practitioner or case studies. This might point to the source of some of the challenges we see in this space.

One of the questions was: what is really different now to the way it was 10-20 years ago? We need to survey people who are one or two years out from their qualifications.

Suggestions to address this issue included:

  • Identify which library schools are running a strand on academic librarianship and what their curriculum is
  • We work with those library schools which are trying to address this area, such as Sheffield, Strathclyde and UCL to try and identify examples of good practice of producing graduates who have the competencies we need
  • Integrate their students into ‘real life’, taking students in for a piece of work so they have experience

Professional Development option 1 – Institutional-based training

In the environment where there is little in the way of training options, ‘on the job’ training becomes the default. But is there a perception that on the job training comes without cost While the amount of training that happens in this environment is seen as cost neutral, it could be that sending someone on a paid for course could be more effective.

How much does it cost for us to get someone fully skilled using on the job training? There are time costs of both the new recruit and the loss of work time for the staff member doing the training. There is also the cost of the large amount of time spent recruiting staff because we cannot get people who are anywhere near up to speed. 

One action is to gain an understanding of how much it does actually cost to train a staff member up. 

Professional Development option 2 – Mentoring

There is an issue in scholarly communication with new people coming through continuously who need to be brought up to speed. One way of addressing this issue could be by linking people together. UKCORR are interested in creating some kind of mentoring system. ARMA also has a mentoring network which they are looking to relaunch shortly.

 The group discussed whether mentoring was something that can be brokered by an external group, creating an arrangement where if someone is new they can go and spend some time with someone else who is doing the same job. However, to do this we would need a better way of connecting with people. 

This idea ties into the work on institutional based training and the cost associated with it. We are aware there is a lot of cost in sharing and receiving info done by goodwill at present.

Professional Development option 3 – Community peer support events

Another way of getting people together is community and peer support, which is already part of this environment and could be very valuable. Between members of the group there are several events being held throughout the year. These range from free community events to paid for conferences. For example, Jisc is looking at running two to three community events each year. They recently trialled a webinar format to see if it is an opportunity to get online discussions going.

The group discussed whether we need more events, and what is the best way of supporting each other and what kind of remote methods could be used. There is a need to try and document this activity systematically.

Professional Development option 4 – Courses we can run now

The group agreed that while it might be too early for us to look at presenting courses, it would be useful to have an idea of who is offering what amongst the member organisations of the group and that we can start to glean a picture of what is covered. If we were to then map this to the competencies it helps decision making.

For example, UKSG have webinars on every month that are free which fulfils a need. Is there a topic we can put on for an hour?

 UKSG is planning a course towards the end of next year – a paid seminar face to face, outlining the publication process, particularly from the open access environment. This could be useful to publishers as well. It explains what needs to happen in a sequence of events – why it is important to track submission and acceptance dates. Pitching it to people who are new in the role and at senior managers who are responsible for staffing.

Professional Development option 5 – Private providers

Given the pull on resources for many in this sector we need to consider promoting and creating accessible training for all. So in that context the discussion moved to whether we were prepared to promote private training providers. This is a tricky area because there is such a range under the banner ‘private’ – from freelance trainers, to organisations who train as their primary activity to organisations who offer training as part of their wider suite of activities. Any training provision needs to look at sustainability, it isn’t always possible to rely on the goodwill of volunteers to deliver staff development and training.

For example, UKSG as an organisation is not profit-making — it is a charity and events are run on a non-profit basis. Jisc is looking at revenue on a non-profit basis to feed into Jisc’s support for the sector. ARMA work on a cost recovery basis – ARMA events are always restricted to members. Many of the member groups engage with private providers and pay them to come along and speak for the day.

We agreed that when we look at developing the competencies framework and identify how someone can achieve these skills we should be linking to all training provision, either through a paid course, online webinar or mentoring.  The group agreed we are not excluding private providers from the discussion. We are looking to get the best provision for the sector.

However, the topic came up about our own expertise. Experts working in the field already give talks at many events on work time, which is being paid for by their employer — who are in effect subsidising the cost of running the training or event. Can we use our own knowledge base to share this information amongst the community? Perhaps it is not about what you pay, it is what you provide into the community. 

Opening up the discussion

The group talked about tapping into existing conferences held by member organisations of the group to specifically look at this issue ‘branded’ under the umbrella of the group.  To ensure inclusion it would be good to have a webinar as part of the discussion at each of these conference so people who are not there can attend and contribute. Identified conferences were:

We also need to address other groups involved in the scholarly communication process within institutions, such as research managers, researcher developers and researchers themselves.

Next steps

  • Engaging with library schools to discuss the need for inclusion of scholarly communication in their academic library degree courses, possibly looking at examples of good practice
  • Discussion with NASIG about rolling out their scholarly communication competencies
  • Mapping scholarly communication competencies against current training provision options
  • Creating a self assessment tool to help individuals decide if scholarly communication is for them
  • Costing out ‘on the job training’ to evaluate the impact of this on the existing team

Attendees

  • Helen Blanchett – Jisc
  • Fiona Bradley – RLUK 
  • Sarah Bull – UKSG 
  • Helen Dobson – Manchester University 
  • Anna Grigson representing UKSG
  • Danny Kingsley – Cambridge University
  • Valerie McCutcheon – representing ARMA
  • Ann Rossiter – SCONUL
  • Claire Sewell – Cambridge University
  • Nick Shepherd – representing UKCoRR

 Published 27 November 2017
Written by Dr Danny Kingsley
Creative Commons License

Benchmarking RDM Training

Uncategorized, , ,

This blog reports on the progress of the international project to benchmark Research Data Management training across institutions. It is a collaboration of Cambridge Research Data Facility staff with international colleagues – a full list is at the bottom of the post. This is a reblog, the original appeared on 6 October 2017. 

How effective is your RDM training?

When developing new training programmes, one often asks oneself a question about the quality of training. Is it good? How good is it? Trainers often develop feedback questionnaires and ask participants to evaluate their training. However, feedback gathered from participants attending courses does not answer the question how good was this training compared with other training on similar topics available elsewhere. As a result, improvement and innovation becomes difficult. So how to objectively assess the quality of training?

In this blog post we describe how, by working collaboratively, we created tools for objective assessment of RDM training quality.

Crowdsourcing

In order to objectively assess something, objective measures need to exist. Being unaware of any objective measures for benchmarking of a training programme, we asked Jisc’s Research Data Management mailing list for help. It turned out that a lot of resources with useful advice and guidance on creation of informative feedback forms was readily available, and we gathered all information received in a single document. However, none of the answers received provided us with the information we were looking for. To the contrary, several people said they would be interested in such metrics. This meant that objective metrics to address the quality of RDM training either did not exist, or the community was not aware of them. Therefore, we decided to create RDM training evaluation metrics.

Cross-institutional and cross-national collaboration

For metrics to be objective, and to allow benchmarking and comparisons of various RDM courses, they need to be developed collaboratively by a community who would be willing to use them. Therefore, the next question we asked Jisc’s Research Data Management mailing list was whether people would be willing to work together to develop and agree on a joint set of RDM training assessment metrics and a system, which would allow cross-comparisons and training improvements. Thankfully, the RDM community tends to be very collaborative, which was the case also this time – more than 40 people were willing to take part in this exercise and a dedicated mailing list was created to facilitate collaborative working.

Agreeing on the objectives

To ensure effective working, we first needed to agree on common goals and objectives. We agreed that the purpose of creating the minimal set of questions for benchmarking is to identify what works best for RDM training. We worked with the idea that this was for ‘basic’ face-to-face RDM training for researchers or support staff but it can be extended to other types and formats of training session. We reasoned that same set of questions used in feedback forms across institutions, combined with sharing of training materials and contextual information about sessions, should facilitate exchange of good practice and ideas. As an end result, this should allow constant improvement and innovation in RDM training. We therefore had joint objectives, but how to achieve this in practice?

Methodology

Deciding on common questions to be asked in RDM training feedback forms

In order to establish joint metrics, we first had to decide on a joint set of questions that we would all agree to use in our participant feedback forms. To do this we organised a joint catch up call during which we discussed the various questions we were asking in our feedback forms and why we thought these were important and should be mandatory in the agreed metrics. There was lots of good ideas and valuable suggestions. However, by the end of the call and after eliminating all the non-mandatory questions, we ended up with a list of thirteen questions, which we thought were all important. These however were too many to be asked of participants to fill in, especially as many institutions would need to add their own institution-specific feedback questions.

In order to bring down the number of questions which should be made mandatory in feedback forms, a short survey was created and sent to all collaborators, asking respondents to judge how important each question was (scale 1-5, 1 being ‘not important at all that this question is mandatory’ and 5 being ‘this should definitely be mandatory’.). Twenty people participated in the survey. The total score received from all respondents for each question were calculated. Subsequently, top six questions with the highest scores were selected to be made mandatory.

Ways of sharing responses and training materials

We next had to decide on the way in which we would share feedback responses from our courses and training materials themselves . We unanimously decided that Open Science Framework (OSF) supports the goals of openness, transparency and sharing, allows collaborative working and therefore is a good place to go. We therefore created a dedicated space for the project on the OSF, with separate components with the joint resources developed, a component for sharing training materials and a component for sharing anonymised feedback responses.

Next steps

With the benchmarking questions agreed and with the space created for sharing anonymised feedback and training materials, we were ready to start collecting first feedback for the collective training assessment. We also thought that this was also a good opportunity to re-iterate our short-, mid- and long-term goals.

Short-term goals

Our short-term goal is to revise our existing training materials to incorporate the agreed feedback questions into RDM training courses starting in the Autumn 2017. This would allow us to obtain the first comparative metrics at the beginning of 2018 and would allow us to evaluate if our designed methodology and tools are working and if they are fit for purpose. This would also allow us to iterate over our materials and methods as needed.

Mid-term goals

Our mid-term goal is to see if the metrics, combined with shared training materials, could allow us to identify parts of RDM training that work best and to collectively improve the quality of our training as a whole. This should be possible in mid/late-2018, allowing time to adapt training materials as result of comparative feedback gathered at the beginning of 2018 and assessing whether training adaptation resulted in better participant feedback.

Long-term goals

Our long-term goal is to collaboratively investigate and develop metrics which could allow us to measure and monitor long-term effects of our training. Feedback forms and satisfaction surveys immediately after training are useful and help to assess the overall quality of sessions delivered. However, the ultimate goal of any RDM training should be the improvement of researchers’ day to day RDM practice. Is our training really having any effects on this? In order to assess this, different kinds of metrics are needed, which would need to be coupled with long-term follow up with participants. We decided that any ideas developed on how to best address this will be also gathered in the OSF and we have created a dedicated space for the work in progress.

Reflections

When reflecting on the work we did together, we all agreed that we were quite efficient. We started in June 2017, and it took us two joint catch up calls and a couple of email exchanges to develop and agree on joint metrics for assessment of RDM training. Time will show whether the resources we create will help us meet our goals, but we all thought that during the process we have already learned a lot from each other by sharing good practice and experience. Collaboration turned out to be an excellent solution for us. Likewise, our discussions are open to everyone to join, so if you are reading this blog post and would like to collaborate with us (or to follow our conversations), simply sign up to the mailing list.

Resources

Published 9 October 2017
Written by: (in alphabetical order by surname): Cadwallader Lauren, Higman Rosie, Lawler Heather, Neish Peter, Peters Wayne, Schwamm Hardy, Teperek Marta, Verbakel Ellen, Williamson, Laurian, Busse-Wicher Marta
Creative Commons License

Planning scholarly communication training in the UK

Uncategorized, , , , , ,

In June 2017 a group of people (see end for attendees) met in London to discuss the issues around scholarly communication training delivery in the UK. Representatives from RLUK, UKSG, SCONUL, UKCoRR, Vitae, Jisc and some universities had a workshop to nut through the problem. Possibly because of the nature of the attendees of the group, the discussion was very library-centric, but this does not preclude the need for training outside the library sector. This blog is a summary of the discussion from that day.

Background

The decision to hold a meeting like this came out of the a library skills workshop run at UKSG recently. In ensuing discussions, it was agreed that it would be a good idea to get stakeholders together for a symposium of some description to try and nut out how we could collaborate and provide training solutions for scholarly communication across the sector. There is plenty of space in this area for multiple offerings but we do want to make sure we are covering the range of areas and the types of delivery modes and levels required. In preparation for the discussion the group created a document listing scholarly communication training on offer currently.

What is scholarly communication?

An informal survey of research libraries in the UK earlier this year showed that while all respondents had some kind of service that supports aspects of scholarly communication, only half actually used the term ‘scholarly communication’ to describe those services.

A discussion around the table concluded that the term scholarly communication encompasses a wide range of definitions. Some libraries take the boundary that it refers to post-publication. Others address the pre-publication aspect and meet the need of Early Career Researchers for advice on publishing. Services can focus on the academic’s profile of themselves and their research, or the research lifecycle. In some cases there is a question about whether research data management is part of the equation.

The failure of library schools to deliver

It is fairly universally acknowledged that it is a challenge to engage with library schools on the issue of scholarly communication, despite repositories being a staple part of research library infrastructure for well over a decade. There are a few exceptions but generally open access or other aspects of scholarly communication are completely absent from the curricula. (Note: any library school that wishes to challenge this statement, or provide information about upcoming plans are welcome to send these through to info@osc.cam.ac.uk)

This raises the question – if library schools are not providing, how do we recruit and train the staff we need? Indeed, who are we actually recruiting? Is it essential for staff to have a library degree, or experience in an academic library? Or are our requirements more functional such as the ability to manipulate large data sets, or experience working with academics, or an understanding of the Higher Education environment?

While libraries are starting to employ post-graduate researchers because they can lend skills to the library, library culture is a consideration. Employing researchers who are not librarians has the benefit of bringing in expertise from outside, but there are challenges to integrate their work into the library culture. We need to look at competencies in terms of the structure and size of the organisation, both for current staff and staff of the future.

In the absence of scholarly communication instruction within the basic qualification, skills training in this space would appear to need to be addressed at the profession level.

One possible route to prepare the next generation is offering some modular approach of on the job learning with very practical experience. An option could be to work with people who have come from outside the library space. Given libraries seem to be starting to bring skill sets in, we need to consider how this sits with the existing profession.

Audiences and their training needs

The goal of the meeting was to resolve what kinds of training the sector needs, for whom and how it is delivered. For example, with many general library staff there is a basic need to understand the issues with scholarly communication. The number one question is ‘what is scholarly communication’? The possibly it is enough for these people to just be familiar with the terminology.

It is possible we need lots of short courses on the general topic of: this is what OA is, basics of RDM etc (that could potentially be delivered online), but probably fewer more complex courses on issues like analysing publisher and funder policies. There are also debates and higher order areas which require face to face debate.

  • Front facing staff
    • Need an overview so the language is familiar and they can refer queries on
  • People working in scholarly communication
    • Day to day practicalities of funder open access compliance
  • Specialist roles in scholarly communication
    • Specific areas
  • Senior managers
    • Very much need a refresher so they can help their staff.
    • Similar overview training, leadership is around the advocacy
    • Need conceptual framework for scholarly communication – how do the technical parts sit together for the infrastructure and governance of institutions
    • Stakeholder management skills.

Skill sets in scholarly communication

It was agreed that budgetary, presentation and negotiation skills are needed in this area as general skills. When it comes to specialist skills these include:

  • Research Integrity
  • Bibliometrics
    • Involved in providing specialist advice on metrics within a school discussion
    • Providing advice on impact
  • Pushing the open research agenda
  • Academic reward structure
  • Technical and infrastructure eg: integrating ORCIDS etc

Considerations – Lack of perceived need?

There appears to be a problem with a lack of perceived need for training in this space. We are encountering issues where people in libraries are saying ‘I don’t think this is our job’. This points to what should we be presenting librarianship as – what kind of people do we want in the profession? A ‘traditional librarian’ of 20 years ago is not the same job now, the skills are different. Today much of an academic librarian’s job is about winning over people who don’t want to hear the message. It is possible there does need to be a different sort of person who is pushing an open access agenda.

There have been other innovations in library work that required engaging different behaviours and tasks in the past. For example, is this move towards a scholarly communication future different from when the discovery search was introduced? The eResources experience is similar in terms of new competencies required in the profession. However the difference in the scholarly communication environment is there is an external driver – we need to understand the politics of how open access can move forward in the UK.

Considerations – budgets

There is a mismatch between what people would love to have, what can be designed and what people can afford. Anecdotally the group heard that training budgets are really squeezed so priority and focus might be heavily influenced by this, with geography and travelling costs being central to decisions.

The group discussed the need to make training accessible to all. Even free events can be prohibitive in terms of travel, and hosting them in off-peak periods can be helpful with costs. The blockage is not just money, it includes time – in terms of loss of a team member while they are away. This is particularly problematic if scholarly communication is only a part of their job. Most of the need comes from really small institutions where the work is part of a bigger role, however that is where there is little money. This also raises challenges for the time available for those people to self educate.

UKSG run events in London which is expensive for organisations north of London to attend. To increase participation UKSG are now trying to put regional events on, and have shifted their training to a webinar programme rather than face to face.

SCONUL has done basic copyright training and this has thrown up price sensitivity. One solution is trying to keep it local, and members can volunteer staff in kind.

One option could be online training where participants log on at a certain time once a week for 10 weeks. Many of the people in scholarly communication work in universities, and have distance education software available to them. An alternative is having courses done in house – that could part of a modular package (but how do you link this?). The course content needs to be agnostic enough to be useful (not discussing DSpace or PURE for example) before delving into institutional specifics. Make it modular with core principles and then have options.

There was a suggestion that we create a nonprofit making shared collaborative service. The costs to developing this type of deliverable include the development of the training materials, infrastructure costs, room hire, catering etc. Can we make it all online and available? This could work if it were modular.

Next steps

We have not yet bottomed out the need yet – perception of needs at the practitioner level and senior management might be different. Cost is an issue here. Universities need to work out how much it costs to do in-house training – what is the opportunity cost to employ a staff member without experience or training and then get them up to speed?

It would be useful to have an understanding of what training is happening within institutions. What subjects/topics are being taught, who is doing it, what language is being used, is there a dedicated staff member. Where else do people get information and support?

The general plan is to reconvene in September.

Useful Resources

Skill sets analyses

Here are links to work that has already been done on the required skill sets:

Organisations providing or coordinating training

Organisations are running similar events and then participants have to choose what to focus on. If we divvy it up across the sector it might help the situation.

The Society for College, National and University Libraries (SCONUL) does basic copyright training. There is more focus on the leadership end of the equation. The Collaboration Strategy Group is considering a shared service. People come from non traditional groups and this reflects a broader skills sets required in libraries than traditional library courses give you. SCONUL are about to scope out where those services might be and try to identify needs into the future. There are challenges are in recruiting people given the slightly moralistic nature of library culture and whether they are welcoming of people from different background. How do we promote, retain and incentivise people who may not come from this area?

Research Libraries UK (RLUK) don’t do direct training, but they do have programmes of works and networks around these issues. The RLUK board recently had a meeting to look at a new strategy – updating the existing 2014-2017 RLUK Strategy. They are looking at the bigger picture for scholarly communication – the infrastructure challenges, the bigger picture related to licensing and costs and how to leverage members in the consortia. Their role is very much supporting and helping out.

UK Serials Group (UKSG) runs a conference programme. One day events are a mix of standing repeated courses and one off sessions. In conferences often the breakout sessions are the things that people find really valuable. These include soft skills like mindfulness in leadership. The audience tends to be practitioners, people in their mid-career. Traditional areas such as library have been focused around collection management because that is where publishers are. But it is not just about traditional publishing. They are our members and that is moving our agenda to meet those needs. UKSG cannot get anywhere in contributing to university publishing courses. Libraries are starting to employ people who have publishing backgrounds.

The Association of Research Managers and Administrators (ARMA) has special interest groups in open access. (Note: ARMA were invited to this meeting but unfortunately couldn’t attend.)

The Chartered Institute for Library and Information Professionals (CILIP) conducts training at a local level. It was agreed we can’t have the conversation without having CILIP in the room – they are wanting to offer more support for academic libraries and seem to be recognising that the library schools program for CILIP is not the be-all and end-all any more. This is partly why they have developed a recognised trainer programme. (Note: CILIP were invited to this meeting but unfortunately couldn’t attend.)

Representatives attending the discussion

  • Helen Dobson – Manchester University
  • Danny Kingsley – Cambridge University
  • Claire Sewell – Cambridge University
  • Anna Grigson representing UKSG
  • Fiona Bradley – RLUK
  • Ann Rossiter – SCONUL
  • Katie Wheat – Vitae
  • Sarah Bull – UKSG
  • Stephanie Meece -UKCoRR
  • Frank Manista – Jisc
  • Helen Blanchett – Jisc (a member of the group coordinating the meeting, but was unable to attend on the day)

ARMA and CILIP were also invited but were not able to send a representative.

Published 15 August 2017
Written by Dr Danny Kingsley