Open Access Week: Series of reports on OA

Éric Archambault eric.archambault at SCIENCE-METRIX.COM
Sat Oct 25 13:39:56 EDT 2014


David

I wouldn’t jump to the conclusion too fast that all Delayed OA is Dead on Arrival. In several fields, uptake is slow and shelf life is long so I’m afraid you are jumping to this conclusion too fast. If we wanted to give other meaning to the acronym DOA, which stands for Delayed OA, perhaps we could say BTN for Better than Nothing. However, BTN is far from an optimal model. The world over, governments, and hence the public, end up paying more than Billion $450 to support public research. The market for STM subscriptions is a tad over Billion $10. So this 45:1 ratio says the system is outrageously inefficient as most of the public and even small and medium enterprises do not have access to the scientific knowledge they fund – at the moment, scientific knowledge is created by the research community for the research community as only it is organized in such a way that it can subscribe to the material it produces. So DOA is better than nothing, highly inefficient, contrary to social interests, but not necessarily Dead on Arrival. More research is required, as I was mentioning, to establish the social cost of these inefficient, half-baked policies. I think people are confused on both sides: whatever the solution that will prevail, the public will pay editors (be them not for profit or for profit) to publish papers. Paying for universal access makes more sense than restricting access to the research community, and providing instant access also makes more sense. I am confident that in the long run common sense will prevail and subscription and delays will both disappear. DOA is only a stopgap measure, the result of fear, ignorance and lobbying.

Eric

From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of David Wojick
Sent: October-25-14 7:41 AM
To: SIGMETRICS at LISTSERV.UTK.EDU
Subject: Re: [SIGMETRICS] Open Access Week: Series of reports on OA

Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html
William,

Are you referring to the fact that DOA usually means Dead On Arrival? Given that the US Public Access program has opted for delayed access it is more like Dominant On Arrival, since the Feds fund a significant fraction of all published research. In that regard I notice that the definition of DOA does not mention government mandates, which it should. The US action may be decisive.

Also the references to hybrid are somewhat muddled. Hybrid is not a kind of article access at all, rather it is a kind of journal access. Perhaps we need a different set of definitions for articles and journals.

What does seem funny to me, as an observer, is that the publishers have basically said "Okay, if you insist on giving us money to publish your articles, then we will take it." Wiley, for example, is bringing out a bunch of new APC journals. At this point it looks like DOA and APC are the future of OA. Of course that may change given time.

David

David Wojick
http://insidepublicaccess.com/

On Oct 24, 2014, at 5:05 PM, William Gunn <william.gunn at MENDELEY.COM<mailto:william.gunn at MENDELEY.COM>> wrote:

DOA<https://en.wikipedia.org/wiki/Dead_on_arrival> as an acronym for "Delayed Open Access" does have a certain ring to it, now that I think about it...

Best,
--
William Gunn | Head of Academic Outreach, Mendeley | @mrgunn
http://www.mendeley.com/profiles/william-gunn | (650) 614-1749

On Thu, Oct 23, 2014 at 7:12 AM, Éric Archambault <eric.archambault at science-metrix.com<mailto:eric.archambault at science-metrix.com>> wrote:
Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html
Apologies for cross-posting

As part of Open Access Week 2014, a series of six reports on open access, produced for the European Commission (EC), were posted yesterday on the Science-Metrix website:

http://science-metrix.com/en/publications/reports

These reports were produced as part of the EC efforts to monitor the development of open access (OA) availability of peer-reviewed papers in addition to examining policies to promote OA data and scientific publications.

The core report in the series provides definitions for OA scientific papers to address some of the shortcomings of existing definitions which are far too incomplete to grasp the full spectrum of situations encountered while measuring OA availability.

The following definitions are suggested:

A: Access—can be open (free), restricted or paid; with unrestricted or restricted usage rights; quality controlled or not; pre-print (pre-referring), post-print (post-referring), or published version (with final copy editing and page layout); immediate or delayed; permanent or transient.

OA: Open Access—freely available online to all.

IOA: Ideal OA—free; quality controlled (peer-reviewed or editorially controlled); with unrestricted usage rights (e.g. CC BY); in final, published form; immediate; permanent.

RA: Restricted Access—access restricted to members of a group, club, or society.

PA: Paid Access—access restricted by a pay wall; includes subscription access, licensed access, and pay-to-view access.

Restricted OA—free but with download restrictions (e.g. registration required, restricted to manual download, HTML-only as opposed to self-contained format such as PDF) or re-use rights (e.g. CC NC).

Green OA—OA provided before or immediately after publication by author self-archiving.

Gold OA—immediate OA provided by a publisher, sometimes with paid for publication fee. Note that several Gold journals have right restriction: they are Gold ROA. For example, of the 38% of journals listed in the DOAJ that use a Creative Common licence, only 53% use the CC-BY licence that would allow them to qualify for the IOA definition above (Herb, 2014).
Gold OA Journal—journal offering immediate cover-to-cover access.
Gold OA Article—immediately accessible paper appearing in a Gold journal, or in a PA journal (the latter is also sometimes referred to as hybrid open access).

ROA: Robin Hood OA or Rogue OA—Available for free in spite of restrictions, usage rights, or copyrights (overriding RA, PA, Restricted OA). As the publishers' copyright policies and self-archiving rules are compiled by the University of Nottingham in the SHERPA/RoMEO database, Rogue OA is synonymous with Robin Hood OA.

DOA: Delayed OA—access after a delay period or embargo.
Delayed Green OA—free online access provided by the author after a delay (due to author's own delay to make available for free) or embargo period (typically imposed by publisher).
Delayed Gold OA—free online access provided by the publisher after a delay (e.g. change of policy that makes contents available for free) or embargo period.
Delayed Gold OA Journal—Journal offering cover-to-cover access after an embargo period or after a delay.
Delayed Gold OA Article—Paper appearing in a Gold journal or in a PA journal (the latter is also sometimes referred to as hybrid open access) which is available after an embargo period or after a delay.

TOA: Transient OA—free online access during a certain time.
Transient Green OA—free online access provided by the author for a certain time which then disappears. Note that a substantial part of Green OA could be Transient Green OA due to the unstable nature of the internet, websites, and institutional repositories, many of which are not updated or maintained after a period of time and are therefore susceptible to deletion in subsequent institutional website overhauls. There are also integrator repositories that can change access rules, for example after being acquired by a third party.
Transient Gold OA—free but temporary online access provided by the publisher, instead of permanent. Sometimes appears as part of promotion. Note that some Gold journals and articles sometimes become paid access after a certain time, because of revised strategies by a publisher or because they are sold to another publisher who instaures paid access.

Looking forward, we need to understand these various forms of OA availability. It was beyond the scope of this project to measure all these forms but it is an essential element to address. For example, Robin Hood OA has hardly been measured and is somewhat of a taboo subject. Transiency is another ill-understood subject that should be addressed by fundamental questions such as; What is the percentage of OA papers which are transient and why is this occurring?

Relative to these definitions, the report has shortcomings. In the present reports, the following operational definitions were used to perform measurement:

Green OA: refers to papers which are self-archived by authors and available on institutional repositories as listed in OpenDOAR and/or in ROAR. Listings in OpenDOAR and ROAR which correspond to known Gold OA Journals were set aside. Aggregator sites such as CiteSeerX were not considered here, since, even though they access article submissions, they do not constitute a repository in the classical sense. Likewise, articles in the main PubMed Central sites were not counted as Green as they have curtailed usage rights or limited download rights.[3] Because it is commonly difficult to determine whether a paper was self-archived before, at the same time or after publication and also how long it will be available on the internet, Green OA includes Green OA, Delayed Green and Transient Green. Note that some of these articles may not respect restrictions placed by journal publishers (many of whose rules can be found on SHERPA/ROMEO)[4] and therefore contain a certain number of Robin Hood OA papers. Finally, only articles which could be downloaded without user registrations were considered.

Gold Journals OA: refers to papers appearing in journals listed in the Directory of Open Access Journals (DOAJ)[5] and on the PubMed Central list of journals.[6] When a paper is published during the first year that a journal appears in the DOAJ, it is not counted. This is a conservative decision due to the fact that one cannot determine whether a journal started publishing Gold articles early or late during the year. For PubMed Central, only open access journals with full participation and immediate access were considered to be Gold, hence all journals with an embargo and in the 'NIH Portfolio' were not considered. Thus, this category covers articles appearing in Gold journals and excludes delayed Gold as well as piecemeal Gold (Gold articles in paid access journals, also called hybrid OA).

Other OA: refers to pretty much everything that could be found on the web by a determined researcher and downloaded for free and which was not part of the Green and Gold operational definitions above. This comprises articles appearing in journals with an embargo period (Delayed Gold OA); articles appearing on authors' webpages and elsewhere (both Green OA and Rogue OA); articles appearing on aggregator sites such as ResearchGate and CiteSeerX in addition to PubMed Central. The category comprises both transiently and permanently accessible items as there are no reliable ways to ascertain at measurement time whether an item will be permanently accessible or not.

Total OA: The mutually exclusive sum of Green OA, Gold Journal OA, and Other OA.

These definitions, though they made sense from an operational point-of-view, are inadequate for the future. They were used in response to comments received on last year’s series of reports. They were a stopgap measure and reflected what could be done on the project’s budget and with the tools available. More detailed work is required, preferably on a large scale such as was done in this study (sample larger than 1 million randomly selected articles).

An important aspect of the study which we hope will be followed by other metrology undertakings on OA availability is the use of: 1) large scale measurement to reduce statistical error; 2) use of calibration sample to determine adjustment by counting precisely recall and precision of the large scale measurement apparatus; 3) applying the calibration to the measured quantities. With hindsight, the application of the second part of the technique is a weak point of the study as the sample size was too small (500) and added an error of ± 4.5 percentage points. The manual calibration should be closer to 10,000 randomly selected papers to establish a gold standard to reduce additional error to about 1 percentage point (simplified discussion here, please see report D1.8 for a more elaborate discussion).

Discussion of the source of data’s characteristics is also essential. We need to have a more in-depth understanding of OA availability per country. I strongly suspect that countries that are not covered by WoS and Scopus are more likely to have a greater propensity to diffuse knowledge openly (and more so for the former, which partly explains why measuring OA with WoS provides lower scores). Combining WoS with no calibration for recall and precision can lead to a very serious underestimation of OA availability (missing more than 40% of the actual count of all peer-reviewed papers). It is likely that this study also underestimates OA availability because of the inadequate non-English language scientific literature in Scopus.

Another important contribution of the report is the examination of the scientific impact of OA vs. non-OA literature with three scores: 1) normalised impact of all literature (=1.0); 2) normalised impact of OA literature; 3) normalised impact of non-OA literature. Using a one-million article sample shows the deleterious effect, on average, of non-espousing an OA diffusion strategy. Data are also presented on broad fields of knowledge and show that green OA is king for impact yet even the younger (on average) gold journals are showing greater impact than the more-established (on average) subscription-based journals in several fields. Seriously designed studies are required to control for embargo to understand how DOA papers are disadvantaged in terms of scientific impact relative to immediate OA.

These results are presented at length in the report which can be downloaded from here:

http://science-metrix.com/en/publications/reports#/en/publications/reports/proportion-of-open-access-papers-published-in-peer-reviewed-journals-at-the

A review of OA policies for scientific publication can be found here:

http://science-metrix.com/en/publications/reports#/en/publications/reports/state-of-art-analysis-of-oa-strategies-to-peer-review-publications

A review of OA policies for scientific data can be found here:

http://science-metrix.com/en/publications/reports#/en/publications/reports/state-of-art-analysis-of-oa-strategies-to-scientific-data

A comparative analysis of OA policies for scientific publications and data can be found here:

http://science-metrix.com/en/publications/reports#/en/publications/reports/comparative-analysis-of-the-strengths-and-weaknesses-of-existing-open-access

A synthesis report on OA availability and policies can be found here:

http://science-metrix.com/en/publications/reports#/en/publications/reports/evolution-of-open-access-policies-and-availability-1996-2013-0

Finally, the short version of this synthesis can be found here:

http://science-metrix.com/en/publications/reports#/en/publications/reports/summary-report-evolution-of-open-access-policies-and-availability-1996-2013

Have a great Open Access Week and we hope you will appreciate these weekend readings.

Yours sincerely

Eric Archambault, Ph.D.
President and CEO | Président-directeur général
Science-Metrix
Brussels | Montréal | Washington
1335, Mont-Royal E
Montréal, QC  H2J 1Y6
Canada

T. 1.514.495.6505 x.111<tel:514.495.6505%20x.111>
F. 1.514.495.6523<tel:1.514.495.6523>
E-mail: eric.archambault at science-metrix.com<mailto:eric.archambault at science-metrix.com>
Web:    www.science-metrix.com<http://www.science-metrix.com>


________________________________

________________________________

[3] The PubMed Central site mentions 'You may NOT use any kind of automated process to download articles in bulk from the main PMC site. PMC will block the access of any user who is found to be violating this policy'. See http://www.ncbi.nlm.nih.gov/pmc/about/faq/#q12.

[4] http://www.sherpa.ac.uk/romeo/.

[5] https://doaj.org/about.

[6] http://www.ncbi.nlm.nih.gov/pmc/journals/.

________________________________
No virus found in this message.
Checked by AVG - www.avg.com<http://www.avg.com>
Version: 2014.0.4765 / Virus Database: 4040/8390 - Release Date: 10/14/14
Internal Virus Database is out of date.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.asis.org/pipermail/sigmetrics/attachments/20141025/f7078986/attachment.html>


More information about the SIGMETRICS mailing list