Summary + Slides for 2013 SSP Panel – Measure for Measure: The role of metrics in assessing research performance

Photo from @Editage

At the 2013 SSP (Society of Scholarly Publishers) Annual conference I was on a panel about research assessment and metrics. As part of my presentation I shared some findings from a large survey conducted by Elsevier’s Research and Academic Relations group (methodology in the slides).

One finding the Twitter back-channel picked up on was the surprising statistic that, from this random sample, only 1% of academics were familiar with altmetrics. I followed this up with a more optimistic statistic  showing that both researchers under 35 and also researchers from developing nations were more likely to view different types of potential altmetrics as useful. For this section of the talk, my primary point was that we need to focus on raising awareness among this demographic if altmetrics are to gain legitimacy in the researcher community.

Also discussed are DORA, Journal Metrics (SNIP, SJR), Snowball Metrics, and more. I summarized the primary take away points as follows:

  1. Choose methods + metrics appropriate to level and impact type being assessed (DORA)
  2. Don’t confuse level with type (alms ≠ altmetrics) – Tip: Embed free Scopus Cited-By counts at article-level
  3. Awareness of metrics correlates to acceptance, raising awareness matters
  4. APAC + younger researchers open to new metrics
  5. Don’t use just one metric, promote a variety of metrics – Tip: Embed free SNIP/SJR on journal pages
  6. Choose transparent and standard methods + metrics – Tip: Learn best practices from Snowball Metrics free ebook

Scopus March 2012 release overview: New Document Details Pages, Interoperability with Hub, Lipid Structures (beta), etc.

These slides and accompanying description outline the rationale and process for recently released updates to Scopus including Sciverse Hub integration and 2 new SciVerse Applications.

The below slides outline the updates to Scopus released last weekend. While most of these changes have already been announced on the SciVerse blog, this goes into a bit more detail on why the updates were made. It also mentions some of the smaller updates not yet announced and introduces some of what I feel to be the most interesting new SciVerse Applications for Scopus.

For two of the more interesting projects, I would like to go into more detail on the process and rationale behind the changes. One of the most noticeable changes is that the interface of the  main panel of the Document Details (Abstract) page has been completely overhauled.  The primary goal for this revamp was to improve the scanability and readability of the page.

We started with the user research already done for the Article of the Future and the new article page on ScienceDirect. From that foundation, our User-Centered Design group developed a prototype and conducted usability studies with researchers and librarians to determine which design elements transferred to  Scopus. As part of this research, we gathered information on which parts of the page users scan for first. The implemented design then focused on optimizing the visual hierarchy, so that the most used information is more prominent. Fonts were also optimized throughout to make reading of abstracts and other elements easier.

The other most noticeable change is the replacement of the tabs from the Document search results pages. When enabled, these tabs would run a users search on Web and Patent content from Scirus. The new links instead display the results in SciVerse Hub. While all existing functionality remains, Hub offers a lot of advantages to the tab structure. Most importantly, Hub offers improved relevancy rankings and additional refine options.  Hub also collapses multiple copies of the same document into a single record.

As part of this update, we now only display the links if results are available and display the results count in the link. Some readers may remember that this count used to be in the tabs, but was removed. Usage has since proven that display of this count is extremely important for users. The More tab has been replaced by a link to “Secondary documents” that works exactly the same as the tab. Our User-Centered Design group also developed a prototype and conducted usability studies to optimize these changes.

Hopefully the the above slides and description, help to give a full picture as to how the recent updates help improve the Scopus user experience.  Please feel free to leave feedback on these changes in the comments.

SNEAK PREVIEW Scopus Analyze Results: Overview and use case

In the next release of Scopus, we will be launching a new Analyze Results tool.  This is a sneak preview of what it will do and a couple examples of different use cases.  Feedback is welcome.