Research Outcomes Reporting: Guidelines for National Data Assets Projects
The ARDC’s National Data Assets portfolio aims to support the development of research data assets and infrastructure to produce reliable high quality research, improve efficiency through greater sharing of resources, catalyse data innovation through data science, and enhance research translation to produce benefits for communities beyond the research sector.
To ensure that these strategic goals are achieved, the ARDC requires all National Data Assets projects to plan, implement and report on research outcomes and impact from ARDC-invested activities. This document provides broad guidance on the requirements of research outcome and impact reporting, planning and implementation for outputs of all National Data Assets activities.
This page and associated document relate only to activities in the National Data Assets initiative.
Reporting Requirements for National Data Assets program
Research Outcomes Report
All National Data Asset projects are required to provide a Research Outcomes Report 12 and 24 months after project completion. The report should include any research outcome produced through the use of the ARDC-invested data asset or infrastructure. This may include, but is not limited to:
- publications (such as journals, conferences, books or book chapters)
- grants (domestic and international funders, including foundations)
- projects (especially projects with external partners, such as NCRIS projects, government, industry, NGOs or other community groups)
- reports (including any report for governments, NGOs or official national or international committees)
- usage (including where possible, usage by sectors such as higher education, public sector, industry)
- citations (from journal publications or official reports)
- user satisfaction
- training delivered
Research Impact Report
All National Data Asset projects are required to provide a Broader Impact Report 12 and 24 months after project completion. The report should outline any broader impact/benefits produced through the use of the ARDC-invested data asset or infrastructure. These may include any demonstrated social, economic, environmental, cultural and health benefits produced by research utilising the ARDC-invested data asset or infrastructure. The report should provide details relating to:
- who or what has benefitted from the results of the research (this should identify relevant research end-users, or beneficiaries from industry, the community, government, wider public)
- the nature or type of impact and how the research made a social, economic, cultural, environmental, and/or health impact
- the extent of the impact (with specific references to appropriate evidence, such as cost-benefit-analysis, quantity of those affected, reported benefits)
- the dates and time period in which the impact occurred.
The report may use a case study approach to report on impact. Sample case studies can be found at the NHMRC, ARC and CSIRO. CSIRO’s Impact Evaluation Guide provides a framework and reference to resources for conducting impact evaluation.
Planning Requirements for National Data Assets program
At Application stage: Research Outcomes and Broader Impact Statement
All National Data Assets project applications are required to submit a short statement giving a general outline of what research outcomes and broader impacts are expected from the infrastructure project. This statement will include steps to be taken during the project (such as requirements gathering from research groups) to ensure use of the infrastructure in research. The statement will be assessed as a part of the application selection process.
At Project Plan stage: Research Outcomes and Broader Impact Plan
Approved projects are required to develop a Research Outcomes and Impacts Plan prior to the commencement of work, addressing elements such as:
- establishment of monitoring framework
- inputs from research users in design of the infrastructure
- partnerships with research translation specialists
- establishment of policies, systems and workflows to track uptake.
The OECD’s Reference Framework for Assessing the Scientific and Socio-Economic Impact of Research Infrastructure provides a framework of 58 indicators for monitoring the outcomes and impact of research infrastructure. While not all 58 indicators are relevant to every project, projects are advised to develop their monitoring plans in accordance with at least some of these indicators. In addition, projects should also consider other additional indicators relevant to their projects.
Implementation Work Packages
All National Data Asset projects are eligible to receive up to 5 per cent extra of the overall project budget to implement changes within the project to their systems, workflows, policies, and broader research culture to support monitoring of research outcomes and impacts beyond the infrastructure project’s completion. Implementation work packages must include several of the following elements:
- automated and pervasive system integration of key persistent identifiers (ORCID, DOI, RAID, Grant ID, IGSN) that support tracking and monitoring of research outcomes and impact
- changes to data access workflows to register users, and capture information about projects, funding sources, intended uses
- tracking of the download of datasets using the COUNTER Code of Practice for Research Data in Repositories
- automated ongoing communications with end-users regarding their usage.
- other systems to track research publications, grants, projects, awards, industry funding, patents, etc enabled by the infrastructure
- collaboration with journal publishers so that they capture citations to data and acknowledgements to infrastructure (new policies and systems)
- collaboration with scholarly societies and funders to implement community policies for data citation and infrastructure acknowledgement (new policies and systems)
Successful projects who opt in to the supplementary 5 per cent investment will have two extra milestones:
- Impact/outcome monitoring systems work package description included in the project plan and acceptable to ARDC (invoicing milestone for the 5 per cent)
- Delivery of Impact/outcome monitoring systems work package.
Did you find this resource useful?
Receive tailored updates on latest digital research news, events, resources, career opportunities and more.