[Asis-l] DCC externally moderated reflective self-evaluation: Report Available

[Joy Davidson]

***Apologies for cross-posting***

DCC externally moderated reflective self-evaluation: Report Available

The DCC would like to thank everyone who took the time to contribute to our
recent DCC public survey. We would also like to congratulate Neil Fegen of
Heriot-Watt University who supplied the winning quote in the survey
competition to illustrate the importance of digital curation. His quote
"Digital curation is important for scholarship and science because it allows
the world to find, learn, evaluate and share" was deemed to be simple yet
effective by our panel of judges. Neil has won an iPod nano.

The results of the public survey have been incorporated as part of the DCC's
externally moderated reflective self-evaluation process. A final report on
the evaluation process has been authored by Professor Peter Brophy of
Manchester Metropolitan University and LIMC Ltd. and Dr Jeremy Frey,
University of Southampton. The report is available at
http://www.dcc.ac.uk/docs/DCC_Evaluation_Report_Final.pdf. An executive
summary is provided below.

Thanks again to everyone who contributed to the evaluation process.

Best regards,
Joy Davidson
DCC Training Coordinator and ERPANET British Editor
Humanities Advanced Technology and Information Institute (HATII)
George Service House, 11 University Gardens,
University of Glasgow
Glasgow G12 8QJ
Scotland
Tel: +44(0)141 330 8592
Fax: +44(0)141 330 3788
http://www.dcc.ac.uk
http://www.erpanet.org

********
DCC externally moderated reflective self-evaluation Report - Executive
Summary

This Report describes the evaluation of the first phase of activity of the
Digital Curation Centre (DCC), which was established in early 2004 with
funding, initially from the Higher Education Funding Councils’ Joint
Information Systems Committee (JISC) coupled from September 2004 with
funding from the Engineering and Physical Sciences Research Council (EPSRC).

The evaluation of this activity, carried out between February and August
2006, utilised a novel process of externally-moderated, reflective
self-evaluation. The emphasis in this process is on reflection by DCC staff
on their achievements to date and on the issues raised by operating the DCC,
but this is moderated by independent external advisers who are able to guide
the process, offer suggestions and draw together evidence – the report
itself was written by the two external evaluators.

In order to gather data on the achievements of the DCC, with emphasis on its
effectiveness and impact, a number of different data collection methods were
used. Heavy emphasis was placed on gathering the views of external
stakeholders as well as those of DCC staff, mainly through surveys and
interviews.

The general view from all of the groups surveyed during this exercise is
that the DCC is necessary to the well-being of UK research, enterprise and
culture, has established itself with high quality outputs and should be
encouraged to selectively expand its activities.

The Report is structured around the three key themes identified in the aims
agreed for the evaluation by the Steering Group, namely impact and
effectiveness; takeup; and, quality of services and resources. A further
section reports on suggestions made by survey respondents concerning
changes, which may be desirable in the DCC’s operations and opportunities
which should be considered for exploitation.

Under impact and effectiveness, the evidence shows that the DCC has been
effective in raising awareness of digital curation issues, but that to date
this has not spread as widely as is desirable, especially into the research
community. Nevertheless, the DCC’s activities are well-regarded by those who
are expert in the field, and its events in particular are highly thought of
as an important vehicle for bringing together both data creators and data
curators with experts.

The surveys showed considerable takeup of DCC services and resources;
software tools, however, remain largely at the development stage. Meantime
the DCC has pursued synergistic relationships with key players, gaining
recognition for its work and greater exposure in the broader community. It
is noted that by the end of 2005 over 1000 people had engaged directly with
the DCC either by joining the DCC Associates network, attending its
information days, conference and workshops, or by using the DCC Helpdesk.

The view of all stakeholders is that DCC outputs have been of high quality.
The Digital Curation Manual is regarded as highly important with major
potential to become the authoritative source of information on this subject.
A certification protocol is being pursued, in collaboration with others
internationally. Research outputs have been at a very high level of quality,
with many papers accepted by leading peer-reviewed journals. In addition,
DCC staff themselves are well-regarded and are seen as a valuable source of
high-quality information and advice.

The focus of community suggestions for changes has largely been on ways of
engaging more fully with the research community. The DCC is also seen as
well-placed to take on the key co-ordinating role which will enable
non-experts to navigate their way through the full range of curation
expertise and advice.

These suggestions are reflected in the final section of the report, which
summarises the DCC management’s reflections on the evidence gathered. It
thus encapsulates the self-reflective nature of the exercise. The further
development of links with the data curation community, and alternative ways
of segmenting that community so as to be effective in this regard, are
highlighted first. The importance of continuing to improve resources and
services is stressed. Internal organisational issues are addressed.

Appendices are provided to illustrate the range of organisations with which
the DCC has been collaborating with and to present the questions used in the
external community survey.

The report thus presents a largely positive view of the achievements of the
DCC to date; confirms expert opinion that it is needed in the longer term;
and highlights a number of ways in which it can become more effective and
have greater impact.