Tag Archives: open access

Whose money is it anyway? Managing offset agreements

Uncategorized, , , , , ,

Sometimes an innocent question can blow up a huge discussion, and this is what happened recently at an RCUK OA Practitioner’s Group meeting when I asked what was appropriate for institutions to do when managing money they receive as refunds from publishers through offsetting arrangements.

When an institution pays for an article processing charge (APC) in a hybrid journal, it is doing so in addition to the existing subscription. This is generally referred to as ‘double dipping’.  I have written extensively about the issues with hybrid in the past, but here, I’d like to discuss the management of offset agreements.

Offset agreements are a compensation by a publisher to an institution for the extra money they are putting into the system through payment of APCs. Most large publishers have some sort of offset agreement for institutions in the UK which are negotiated by Jisc, based on the principles for offset agreements. (There is one significant publisher which is an exception because it insists there is no need for an offset agreement because it does not double dip.)

Offset agreements are not equal

While offset agreements are negotiated nationally, there is no obligation for any institution  to sign up to them. Cambridge makes the decision to sign up to an offset agreement or not through a standard calculation. If we are spending RCUK and COAF funds on the offset it must show benefit to the funds first. If the numbers demonstrate that by signing up to (and sometimes investing in) the agreement, the funds will be better off at the end of the year then we sign. The fact this agreement may have a broader benefit to the wider University is a secondary consideration. The OSC has a publisher and agreements webpage listing the agreements Cambridge is signed up to.

In a fit of spectacular inefficiency, all offsets work slightly differently. Here’s a run down of different types:

  • In some instances we have a melding of the costs into one payment and there are no transactions for open access. The Springer Compact is an example of this. At Cambridge we have split the cost of this deal between the subscription spend the previous year with the top up being made by our funds from RCUK and COAF in proportion to the amount we publish between these two funders with Springer.
  • Other offsets are internal – where the money does not leave the publisher’s system. The Wiley OA Agreement is this type. By signing up we receive a 25% discount on each APC that is managed through their dashboard. We also receive a 50% discount in a given year based on the number of APCs we bought the previous year. This money is calculated at the beginning of the year and the ‘money’ is put into a ‘fund’ held by Wiley. The APC payments for future articles can be made out of this credit. It is is bit like a betting app – you can’t get the money out without some difficulty, you can only ‘reinvest’ it
  • There is a different kind of internal offset where the calculation is made up front based on how much you spent the previous year on APCs. These manifest as a discount on each APC paid. Taylor and Francis’ offset works this way which is a bit of a hassle because you still have to process each APC regardless of whether you spend $2000 or $200 on it. But again there is no extra money anywhere in this equation because the discount is applied before the invoice is issued. 
  • A different kind of arrangement relates more to fully open access journals. These include a membership where you get a discount on APCs for being a member. Sometimes there is a payment associated with this (BMC for example, which for an upfront membership you can get 15% discount), and others where there is no payment (MDPI – 10% discount for now). Alternatively you can ‘buy’ membership for researchers in exchange for the right to publish for free (PeerJ).
  • The last type of offset is the most straightforward – where the institution gets a cheque back based on the extra spend on APCs over the subscription. Currently IoP is the only publisher with whom Cambridge has this type of agreement.

Managing offset refunds

When Cambridge received its first IoP cheque in 2015 there were questions about what we could or could not do with it. The Open Access Project Board discussed the issue and decided that the money needed to remain within the context of open access. Suggestions included paying our Platinum membership of arXiv.org with it, because this would be supporting open access.

The minutes from the meeting on 31 March 2015 noted: “Any funds returned from publishers as part of deals to offset the cost of article processing charges should be retained for the payment of open access costs, but ring-fenced from the block grants and kept available for emergency uses under the supervision of the Project Board.” We have since twice used this money to pay for fully open access journal APCs when our block grant funds were low. 

Whose money is it anyway?

When the issue of offset refunds and what institutions were doing with it was raised at a recent RCUK OA Practitioners Group meeting it became clear that practices vary considerably from institution to institution. One of the points of discussion was whether it would be appropriate to use this money to support subscriptions. The general (strong) sentiment from RCUK was that this would not be within the spirit, and indeed against the principles, of the RCUK policy.

I subsequently sent a request out to a repository discussion list to ask colleagues across the UK what they were doing with this money. To date there have only been a handful of responses.

In one instance with a medium-sized university the IoP money is placed into a small Library fund that is ring-fenced to pay for Open Access in fully Open Access journals only. This fund has the strategic aim to enable a transition to Open Access by supporting new business models and contributing to initiatives such as Knowledge Unlatched, hosting Open Journal Systems, as well as supporting authors to publish in Open Access venues when they have no other source of funding.

A large research institution responded to say they had a specific account set up into which the money was deposited, noting, as did the other respondents, that the financial arrangements of the University would mean that if it were deposited centrally it would never be seen again. This institution noted they were considering using the funds to offset the subscription to IoP in the upcoming year due to a low uptake of the deal.

Another large research institution said the IoP cheques were being ‘saved’ in the subscriptions budget.

Sussex University

In their recent paper “Bringing together the work of subscription and open access specialists: challenges and changes at the University of Sussex” there is a section on how they are managing the offset money. They note: “It seemed a missed opportunity to simply feed it back into the RCUK block grant, but equally inappropriate to use for journal subscriptions or general Library spending”.

The decision was to support APCs for postgraduate researchers (PGRs) who did not have any other access to money for gold open access, and could only be spent on fully open access journals. They noted that this was a welcome opportunity to be able to offer something tangible and helpful in their advocacy dealings with postgraduate researchers.

Only the start of the conversation

This discussion has raised questions about the decision making process for supporting access to the literature.

Subscriptions are paid for at Cambridge through a fund that is not owned by the Library – the fund consists of contributions from all the Schools plus central funds. Representatives of the Schools, Colleges and library staff sit on the Journal Coordination Scheme committee to decide on subscriptions. However decisions about open access memberships and offsets are made by the Office of Scholarly Communication. Given the increased entanglement of these two routes to access the literature, this situation is one the University is aware needs addressing. The Sussex University paper discusses the processes they went through to merge the two decision making bodies.

This is a rich area for investigation – as we move away from subscription-only spend and into joint decision-making between the subscription team and the Open Access team we need to understand what offsets offer and what they mean for the Library. This discussion is just the beginning.

Published 30 June 2017
Written by Dr Danny Kingsley 
Creative Commons License

Reflections on Open Research – a PI’s perspective

Uncategorized, ,

As part of the Open Research Pilot Project, Marta Teperek met with Dr David Savage and asked him several questions about his own views and motivations for Open Research. This led to a very inspiring conversation and great reflections on Open Research from the Principal Investigator’s perspective. The main points that came out of the discussion were:

  • Lack of reproducibility raises questions about scientific rigour, integrity and relevance of work in general
  • Being open is to work in a team and be collaborative
  • Open Research will benefit science as a whole, and not the careers of individuals
  • Peer review remains a critical aspect of the scientific process
  • Nowadays, global collaboration and information exchange is possible, making the data really robust
  • Funders should emphasise the importance of research integrity and scientific rigour

This conversation is reported below in the original interview format.

Motivations for doing Open Research

Marta: To start, could you tell me why you are keen on Open Research and why did you decide to get involved in the Open Research Pilot Project?

David: Sure, but before we start I wanted to stress that when I make comments about science, these are very general comments and they don’t apply to anyone in particular.

So my general feeling is that I am very concerned and disappointed about the lack of research reproducibility in science. Lack of reproducibility raises questions about scientific rigour, integrity and relevance of work in general. Therefore, I am really keen on exploring ways of addressing these failings of science and I want to make a contribution to solving these problems. Additionally, I am aware that I am not perfect either and I want to learn how I can improve my own practice.

Were there any particular experiences which made you realise the importance of Open Research?

This is just the general experience of reading and also reviewing far too many papers where I thought that the quality of underlying data was poor, or authors were exaggerating their claims without supporting evidence. There is too much hype around, and the general awareness about the number of papers published in high impact journals which cannot be reproduced makes the move to more transparent and open approaches necessary.

Do we need additional rewards for working openly?

How do you think Open Research could benefit academic careers?

I am not sure if Open Research could or should benefit academic careers – this should not be the goal of Open Research. The goal is to improve the quality of science and therefore the benefit of science to the public. Open Research will benefit science as a whole, and not the careers of individuals. Science has become very egotistical and badge –accumulating. We should be investigating things which we find interesting. We should not be motivated by the prize. We should be motivated by the questions.

In science we have far too many people who behave like bankers. Publishing seems to be the currency for them and thus they are sloppy and lack the necessary rigour just because they want to publish as fast as they can.

In my opinion it is the responsibility of every researcher to the profession to try to produce data which is robust. It is fine to make honest mistakes. But it is not acceptable to be sloppy or fraudulent, or not to read enough literature. These are simply not good enough excuses. I’m not claiming to be perfect. But I want to constantly improve myself and my research practice.

Barriers to greater openness in research

What obstacles may be preventing researchers from making their research openly available?

The obvious one is competition for funding, which creates the need to publish in high impact factor journals and consequently leads to the fear of being scooped. And that’s a difficult one to work around. That’s the reason why I do not make everything we do in my research group openly available. However, looking at this from society’s perspective, everything should be made openly available, and as soon as possible for the sake of greater benefit to mankind. So balance needs to be found.

Do you think that some researchers might want to make their research open, but might not know how to do it, or might not have the appropriate skills to do it?

Definitely. Researchers need to know about the best ways of making their research open. I am currently trying to work out how to make my own project’s website more open and accessible to others and what are the best ways of achieving this. So yes, awareness of tools and awareness of resources available is necessary, as well as training about working reproducibly and openly. In my opinion, Cambridge has a responsibility to be transparent and open about its processes.

Role of peer-review in improving the quality of research

What frustrates you most about the current scholarly communication systems?

Some people get frustrated with the business model of some of the major publishers. I do not have a problem with it, although I do support the idea of pre-print services, such as bioRxiv. Some researchers get frustrated about long peer-review process. I am used to the fact that peer-review is long, and I accept it because I do not want fraudulent papers to be published. However, flawed peer review, such as biased peer-review or lack of rigorous peer review, is not acceptable and it is a problem.

So how to improve the peer-review process?

I think that peer-reviewers need to have greater awareness of the need for greater rigour. I was recently asked to peer review an article. The journal had dedicated guidance for peer reviewers. However, the guidance did not contain any information about suitability to undertake the peer-reviewing work. Peer-reviewer guidance documents need to address questions like: Do you really know what the paper is about? Do you know the discipline well enough? Are there any conflicts of interest? Would you have the time to properly peer-review the work? Peer-review needs to be done properly.

What do you think about the idea of journals employing professional peer-reviewers, who could be experts in their respective fields and could perform unbiased, high quality peer-review?

This sounds very reasonable, as long as professional peer-reviewers stay up to date with science. Though this would of course cost money!

I suppose publishers have enough money to pay for this. Have you heard of open peer-review and what do you think about it?

I think it is fine, but it might be subject to cronyism. I suspect that most people will be more likely to agree for their reviews to be made open as long as they make a recommendation for the paper to be accepted.

I recently reviewed a paper of a senior person and I rejected it. But if I made my review open, it would pose a risk to me – what if the author of the paper I rejected was the reviewer of my future grant application? Would they still assess my grant application objectively? What if people start reviewing each other’s papers and start treating peer-review as a mechanism to exchange favours?

The future of Open Research is in your hands

Who or what inspires you and makes you optimistic about the future of Open Research?

In Cambridge and at the Wellcome Trust there are many researchers who care about the quality of science. These researchers inspire me. These are very clever people, who work hard and make important discoveries.

I am also inspired by teamwork and collaboration. In Big Data and in human genetics in particular, people are working collectively. Human genetics and epidemiology are excellent examples of disciplines where 10-20 years ago studies were too small to allow researchers to make significant and reproducible conclusions. Nowadays, global collaboration and information exchange is possible, making the data really robust. As a result, human genetics is delivering really important observations.

To me, part of being open is to work in a team and be collaborative.

If you had a magic wand and if you could get one thing changed to get more people share and open up their research, what would it be?

Not sure… I suppose I am still looking for it! Maybe I will find one during the Open Research Pilot Project. Seriously speaking, I do not believe that a single thing could make a difference. It is the little things that matter. For example, on my side I am trying to make my own lab and institute more aware of reproducibility issues and ensure that I can make a difference in my own environment.

So as a Group Leader, how do you ensure that researchers in your own group are rigorous in their approach?

First, I really make them aware of the importance of reproducible research and of scientific rigour. I am also making a lot of effort to ensure that my colleagues are up to date with literature. I ask them if they read important literature and if they are unable to answer I ask them to do their homework. I am also imposing rigorous standards for experiments. In my lab people repeat the key experiments, or those which are particularly surprising, in a blind fashion. It takes a lot of time and extra resources, but it is important not to be too quick and to validate findings before making claims.

I am also ensuring that my people are motivated. For example, even though everyone helps each other in my group, all PhD students have direct access to me and we have regular discussions about their work. It is important that your group is of a manageable size; otherwise, as a group leader, you will not know all your people and you will not be able to have regular discussions about their work.

How do you identify people who care about reproducible research when making hiring decisions?

I ask all prospective applicants to make a short presentation about their previous work. During their presentation I ask them to tell me exactly what their research question was and how confident they were about their discovery. I am looking for evidence of rigorous methodology, but also for honesty and for people who are not overselling their findings.

In addition, I ask about their career goals. If they tell me that their career goal is to publish in Nature, or have two papers in Science, I count this against them. Instead, I favour applicants who are question-driven, who want to make progress in understanding how things work.

Role of funding bodies in promoting Open Research

Do you think that funders could play a role in promoting Open Research?

Funders could definitely contribute to this. The Wellcome Trust is a particularly notable example of a funding body keen on Open Research. The Trust is currently looking into the best ways to make Open Research the norm. Through various projects such as the Open Research Pilot, the Trust helps researchers like myself to learn best practice on reproducible research,and also to understand the benefits of sharing expertise to improve skills across the research community.

Do you think funder policies to mandate more openness could help?

Potentially. However, policies on Open Access to publications are easy to mandate and relatively easy to interpret and implement. It is much more difficult for Open Research. What does Open Research mean exactly? The right scope and definitions would be key. What should be made open? How? The Wellcome Trust is already doing a lot of work on making important research results available, and human genomic data in particular. But making your proteomic and genomic data publicly available is slightly different from ensuring that your experiments are rigorous and your results honest. So in my opinion, funders should emphasise the importance of research integrity and scientific rigour.

To close our discussion, what do you hope to achieve through your participation in the Open Research Pilot Project?

I want to improve my own lab’s transparency. I want to make sure that we are rigorous and that our research is reproducible. So I want to learn. At the same time I wish to contribute to increased research integrity in science overall.

Acknowledgements

Marta Teperek would like to thank SPARC EUROPE and Dr Joyce Heckman for interviewing her for the Open Data Champions programme – many of the questions asked by Marta in the interview with Dr David Savage originate from inspiring, open questions prepared by SPARC EUROPE.

Published 22 June 2017
Written by Dr Marta Teperek

Creative Commons License

Cambridge RCUK Block Grant spend for 2016-2017

Uncategorized, , , ,

Much to our relief, last Friday we sent off our most recent report on our expenditure of the RCUK Block Grant fund. The report is available in our repository. Cambridge makes all of its information about spend on Open Access publicly available. This blog continues on from that describing our spend from 2009 – 2016, and from the blog on our open access spend in 2014.

Compliance

We are pleased to be able to report that we reached 80% compliance in this reporting period, up from 76% last year. The RCUK is expecting 75% compliance by the end of the transition period on 31 March 2018, so we are well over target.

According to our internal helpdesk system ZenDesk, our compliance is shared between 52% gold (publication in an Open Access journal or payment for hybrid Open Access), and 28% green (placement of the work into our institutional repository, Apollo). We do not have the breakdown of how many of the gold APC payments were for hybrid. In the past it we have had an overall 86.8% spend on hybrid.

Not only do we have an increase from 76% to 80% in our compliance rates overall, this is even more impressive when we consider that this is in the face of a 15% increase in the number of research outputs acknowledging RCUK funding. Web of Science indicated in a search for articles, reviews and proceedings papers that Cambridge published 2400 papers funded by RCUK in 2016. In 2015 Web of Science the same search counted 2080 RCUK funded research outputs.

Headline numbers

  • In total Cambridge spent £1.68 million of RCUK funds on APCs (this is up from £1.28 last year)
  • 1920 articles identified as being RCUK funded were submitted to the Open Access Service, of which 1248 required payment for RCUK*
  • The average article processing charge was £1850 – this is significantly less than the £2008 average last year, reflecting the value of the memberships we have (see below)

*Note these numbers will differ slightly from the report due to the difference in dates between the calendar and financial years (see below).

Non APC spend

In total Cambridge spent £1.94 million of RCUK funds in this reporting period, of which £1.68 million was on APCs.  Approximately 13% was spent on other costs,  primarily distributed between staffing, infrastructure and memberships.  The greatest proportion is staffing, with £95,000 spent on this cost. Memberships were the next largest category, mostly arrangements to reduce the cost of APCs, including:

  • £42,000 on the open access component of the Springer Compact
  • £22,000 on memberships to obtain discounts – there is a list of these on the OSC website
  • £18,000 on the University’s SCOAP3 subscription

The RCUK fund has also supported the infrastructure for Open Access at Cambridge, with £62,000 covering the cost of several upgrades of DSpace and general support for the repository. This has allowed us to implement new services such as the minting of DOIs and our hugely successful Request a Copy service which allows people to contact authors of embargoed material in the repository and ask them to send through the author’s accepted manuscript. This category also covers our license for our helpdesk system, ZenDesk, which helps the Open Access team manage the on-average  responses to 60 queries a day. We are also able to run most of our reporting out of ZenDesk.

There are some other smaller items in the non APC category, including £1500 on bank charges that for various reasons we have not been able to allocate to specific articles.

Are these deals good value?

Some are. The Springer Compact is shown as a single charge in the report with the articles listed individually. The RCUK Block Grant contributed £46,020 to the Springer Compact and 128 Cambridge papers were published by Springer that acknowledged RCUK funding. This gives us an average APC cost per paper to the RCUK fund* of £359.53 including VAT. This represents excellent value, given that the average APC for Springer is $3,000 (about £2,300).

*Note that in some instances the papers acknowledging RCUK may also have acknowledged COAF in which case the overall cost for the APC for those papers will be higher.

Cambridge has now completed a year having a prepayment arrangement with Wiley. Over this time we contributed £108,000 to the account and published 68 papers acknowledging RCUK. This works out that on average the Wiley APC cost was £1,588 per paper. Like Springer, the average APC is approximately £2,300 so this amount appears to be good value.

However the RCUK has contributed a higher proportion to the Wiley account than COAF because at the time the account was established we had run low on COAF funds. Because the University does not provide any of its own funds for Open Access, there was no option other than to use RCUK funds. We will need to do some calculations to ensure that the correct proportion of COAF and RCUK funds are supporting this account. It is a reflection of the challenges we are facing on a rolling basis when the dates are fluid (see below).

It appears we need to look very closely at our membership with Oxford University Press. We spent £44,000 of RCUK funds on this, and published 22 articles acknowledging RCUK funding. This works out to be an APC of £2000 per article, which is not dissimilar to an average OUP APC, and therefore does not represent any value at all. This is possibly because our allocation of the expense of the membership between COAF and RCUK might not reflect what has been published with OUP. We need to investigate further.

Caveat – the date problem

We manage Open Access funds that operate on different patterns. The COAF funds match the academic year, with the new grants starting on 1 October each year.  The RCUK works on a financial year, starting on 1 April each year. Many of our memberships and offset deals work on the calendar year.

To add to the confusion, the RCUK is behind in its payments, so for this current year which started on 1 April 2017, we will not receive our first part-payment until 1 June. That amount will not cover the commitments we had already made by the end of 2016, let alone those made between 1 April when this year started and the 1 June when the money is forthcoming. This means we will remain in the red. Cambridge is carrying half a million pounds in commitments at any given time. The situation makes it very difficult to balance the books.

Our recent RCUK report covers the period of 1 April 2016 – 31 March 2017 and refers only to invoices paid in this period. In the report the dates go beyond the 31 March 2017 because the reconciliation in the system sometimes takes longer, so items are logged as later dates even though the payment was made within the period. The publication dates for the articles these invoices relate to are wildly different, and many of these have not yet been published due to the delay between acceptance and publication which ranges from days to years.

This means working out averages is an inexact science. It is only possible to filter Web of Science by year, so we are only able to establish the number of papers published in a given calendar year. This set of papers is not the same set for which we have paid, but we can compare year on year and identify some trends that make sense.

Published 22 May 2017
Written by Dr Danny Kingsley

Creative Commons License