Measuring the impact of research has become increasingly important in helping to show the value of research to your institution and funding bodies, to identify areas of research strength and weakness, to identify top journals and identify emerging areas of research. Some metrics can be used to locate potential collaborators or competitors.
Metrics are used in rankings such as Times World University Rankings and QS rankings and by some panels in the REF so whatever your views on them it is worth finding out what is recorded about you.
There are a wide range of developing and established tools to evaluate research which you can explore using the Metrics Toolkit
The most established form of metrics is 'Bibliometrics' which is the analysis of research literature based on citations, however subject coverage does vary – arts and humanities has traditionally not been included in citation indices for example. It is important to note that citation databases have biases in coverage especially towards research written in English, and from Western countries.
When using Research Metrics, there are two golden rules;
- Always use both qualitative and quantitative input into your evaluations
- Use a combination of indicators and acknowledge their limitations to gain a more accurate picture.
Traditional Metrics and Altmetrics are measure of attention or engagement, not necessarily quality. There are limited methods to discover whether a citation or tweet about a work is positive or negative, so use of either or both should be contextualized where possible.
The Library Research Support Team supports the recommendations of HEFCE's Metric Tide Report. This includes the following recommendations to ensure responsible use of metrics:
Swansea University has endorsed the San Francisco Declaration on Research Assessment (DORA). Guidance for implementation of DORA principles by the Wellcome Trust has also has been released; Implementation Guidance
Web of Science / InCites - you will need a login
Scopus / SciVal - you will need a login
Google Scholar: - you will need to set up a profile.
These are the big three in terms of sources of citation data, Scopus and Web of Science are both used by various ranking organisations. Citation data from Scopus or Web of Science can also be used as supplementary material by select REF panels. Google Scholar is not used by these organisations due to the quality of the data.
Web of Science is the discovery tool - you can use it to search for articles and other research outputs. To access Web of Science off-campus you will need to login using your university username and password.
InCites is the analytics tool - where you can explore Journal Impact Factors, Citation Data, and other organisational data. To access InCites and Journal Citation Reports you need to register from a PC on Campus
Scopus is the discovery tool - you can use it to explore articles and other research outputs
SciVal is the Analytics tool - you can use it to explore a range of data including but not limited to citation data, field-weighted citation impact, and other organisational data
You do not need to register to use either of these services, but if you want to save reports, create alerts etc, it is a good idea to sign up using your university email address and a password.
Google Scholar is created without much human intervention, and the data is less reliable than Scopus & Web of Science, and is therefore not used in rankings or assessment like the REF. However, for subjects which aren't covered by Scopus or Web of Science it can give some insight into who is citing you, and can pick up citations to books and other non-journal material.
You will need to create a Google Scholar Profile like the one in the image, and see it to track citations. There is also a piece of free software called 'Publish or Perish' which can help analyse these citations
Inspec and Inspec Analytics from the Institution of Engineering and Technology, are highly specialised discovery and research intelligence tools that provide detailed insights into research trends and patterns across physics and engineering disciplines at both local and global levels.
The granularity of the Inspec index makes it easy to analyse research output by organisation and/or specific subjects, allowing you to monitor research output over time, compare output between organisations, stay up to date with emerging trends, find collaboration opportunities and identify the most relevant journals and conferences to publish work. Inspec Analytics is accessible via Inspec then click on the 'Go to Inspec Analytics' URL
To watch a video on how to access Inspec Analytics please follow the link; Inspec Analytics Video
Sources indexed in Inspec: https://www.theiet.org/media/6168/inspec-active-journals.pdf
More about Inspec’s subject classifications: https://www.theiet.org/publishing/inspec/inspec-content-coverage/inspec-classification/
Inspec Analytics user guide and videos: https://inspec-analytics.theiet.org/inspec-analytics-user-guide
We offer the following to colleges, departments, research groups, REF units of assessment and individual researchers:
Requests for any of these services should be sent to Libraryresearchsupport@swansea.ac.uk .
Altmetrics are metrics based on social media interactions and attention. They are more immediate than citations but also more open to "gaming". Providers of altmetrics suggest that they are best thought of as indicators of engagement and attention.
Reasons to consider altmetrics are to:
There are a number of commercial providers of Altmetrics but there is also a lot freely available:
This session explores the developing methods used in measuring research impact, including bibliometrics - which can include citation rates, publishing rates and institutional collaboration.
There …
This session explores the fundamentals of why you should share your research to a wide audience, what platform work best for academic work, as well as specific Academic Social Networking platforms. Co…
This session covers the basics of what the term ‘Open Access’ means and how it is and will affect your academic career and research output. This is designed to be an introduction to the principles beh…
This session explores the various ‘Read and Publish’ deals the library has available to researchers to help publish their research Open Access, and the various conditions which staff need to make use …