睡到自然醒blog

在上一篇日志中简要介绍了一下台湾财团法人高等教育评鉴中心基金会去年针对世界大学科学研究论文进行质量表现评比，首度研发推出「世界大学科研论文质量评比」排名系统 (HEEACT Ranking)，从「学术生产力」、「学术影响力」及「学术卓越性」三大评估面向，发布世界大学科研论文质量评比:2008世界科研论文排名，列出世界前五百大名单，以中英文分别公布于网站。

有些读者发信询问是否有英文原文或者什么PDF格式下载，看来大家对这个排名还是很感兴趣的。很简单，今天到「世界大学科研论文质量评比」系统官方网站HEEACT ranking进行查询。

ranking review in english

2008 Performance Ranking of Scientific Papers for World Universities 

Methodology

This project employs bibliometric methods to analyze and rank the scientific
papers performances of the top 500 universities in the world. The selection of
the 500 universities for inclusion in this project is primarily based on
information obtained from the Essential Science Indicators (ESI). Of the more
than 3,000 research institutions listed in ESI, this project selects the top 700
institutions sorted by the numbers of published journal articles. Exclusion of
non-university institutions from the primary list and the comparison to the
lists of universities included in the other ranking programs resulted in the 700
universities in this project. Data used to assess the performances of the
universities is drawn from ISI’s ESI, Web of Science (WOS), which includes SCI
and SSCI, and Journal Citation Reports (JCR).

The concept of authority control is employed to retrieve data indexed under
different forms of a university’s name in those resources – i.e., the official
name, the abbreviated and other possible forms of the names. This project also
considers the mergers and splitting of universities (or different campuses in a
university system) and includes publications by a university’s affiliated
institutions such as research centers and university hospitals. This effort
ensures the accuracy of each university’s number of published journal articles
and the subsequent statistics of their citations.
 
Indicators
The 2008 performance measures are composed of eight indicators. One indicator
used in the 2007 ranking (“number of subject fields where the university shows
excellence”) has been removed and the weightings of the 2008 indicators have
been adjusted accordingly. The indicators together represent three different
criteria of scientific papers performance: research productivity, research
impact, and research excellence. Table 1 lists the indicators and shows their
respective weightings for the indicators.
 
Table 1: The Criteria, Indicators, and Their Respective Weightings Used for the
Overall Performance Based Ranking
      Criteria2008 Overall Performance IndicatorsWeighting
      Research productivityNumber of articles of the last 11 years
      (1997-2007)1020
      Number of articles of the current year (2007)10
      Research impactNumber of citations of the last 11 years (1997-2007)1030
      Number of citations of the last 2 years (2006-2007)10
      Average number of citations of the last 11 years (1997-2007)10
      Research excellenceH-index of the last 2 years (2006-2007)2050
      Number of Highly Cited Papers (1997-2007)15
      Number of articles of the current year in high-impact journals (2007)15

 
Research Productivity:
 
The number of articles published in peer-reviewed academic journals is an
appropriate indicator of the productivity of a research institution. To fairly
represent a university’s on-going and current research productivity, this
project employs two indicators: the number of articles in the last eleven years
(1997-2007), and the number of articles in the current year (2007).

“Number of articles in the last 11 years” draws data from ESI, which include
1997-2007 statistics of articles published in journals indexed by SCI and SSCI.
“Number of articles in the current year” relies on the 2007 data obtained from
SCI and SSCI, which were searched between Jan 19 and Jan 31, 2008.
 
Research Impact:
 
The number of citations on a particular academic article within a specific time
frame is a commonly accepted indicator for that article’s impact. This project
considers both the long-term and short-term impacts of a particular research and
seeks to provide a fair representation of a university’s research impact
regardless of its size and faculty number.  Thus, this project measures research
impact by: the number of citations in the last eleven years, the number of
citations in the last two years, and the average number of citations in the last
eleven years.

“Number of citations in the last 11 years” draws 1997-2007 citation statistics
from ESI. “Number of citations in the last 2 years” draws 2006-2007 citation
statistics from SCI and SSCI at WOS, which include citation statistics updated
to the dates of retrieval. “Average number of citations in the last 11 years” is
the number of articles in the last eleven years divided by the number of
citations in the last eleven years.
 
Research Excellence:
 
 This project assesses each university’s research excellence by the following
indicators: the h-index of the last two years, the number of Highly Cited Papers
from ESI, and the number of articles in high-impact journals in the current year
(Hi-Impact journal articles). “H-index of the last 2 years” measures both the
quantity and quality of a university’s research via the use of the 2006-2007
data from SCI and SSCI. It is defined as “a university has index h if h of its
Np papers in the last two years have at least h citations each and the other (Np
– h) papers have ≦h citations each”.

“Number of Highly Cited Papers” utilizes data from ESI, which include statistics
of “Highly Cited Papers” from 1997 to 2007. ESI defines Highly Cited Papers as
SCI /SSCI-indexed papers that are cited most (in the top 1% of the total papers
indexed in the same year) within the last 11 years.

“Number of articles of the current years in high-impact journals” employs data
from JCR, which supplied the impact factor of each journal in its subject field.
The impact factor of a journal is the number of citations to the papers
published in that particular journal within the previous two years divided by
the number of that journal’s papers within the previous two years. A journal
with a higher impact factor means its articles are more frequently cited by
other journals, thus suggesting its higher scholarly value. This project defines
high-impact journals as journals whose impact factors are ranked as the top 5%
of the total journals within a specific subject category. With high-impact
journals lists derived from JCR, this project is able to count the numbers of
each university’s articles published in high-impact journals by subject.
 
Data Processing
 The procedures for data processing are as follow. First, the project staff
conducts authority control on the various forms of a university name and
analyzes all the SCI/SSCI bibliographic records in which the address field
contained one of the forms of the university name. An accurate number of the
total articles from a university are obtained after removing duplicate records
containing different forms of that university’s name. Second, using SCI/SSCI,
this project obtains the total number of citations by adding the number of
citations on each of the articles from that university from its inclusion in
SCI/SSCI to the date of retrieval for this research.

 Some university systems have several campuses. A few campuses within a
particular university system may have been commonly perceived as individual
institutions. However, they are indexed in ESI only by the university system
name. For example, University of Wisconsin-Madison and University of
Wisconsin-Milwaukee are not differentiated in ESI (they are both indexed under
“Univ Wisconsin”) though they are often perceived as two individual
universities. This project corrects the flaw by manually searching SCI/SSCI in
order to identify the actual number of articles and citations of these articles
produced by each individual campus. Likewise, this project employs the same
manual searching procedures to ensure the measurement of each university’s
Highly Cited Papers have fairly represented the research performance of each
individual university campus.
 
Score Calculation and Sorting
 Based on the measurement procedures, this project calculates a university’s
score for each of the eight indicators. For each indicator, the university with
the highest number receives the maximum points (100); the other universities’
numbers are subdivided by the highest number and are converted decimally into
their respective scores. For example, if University A has the highest number M
for Indicator X, it receives 100 for that indicator, while University B with a
number of N receives (N/M×100) for that particular indicator. Finally, the
project calculates the final score of each university by the indicator
weightings presented in Table 1 and sorts the universities by their final
scores. Universities with the same scores are sorted alphabetically. It should
be noted that many universities obtain similar scores, and the slight
differences of the final scores must be interpreted carefully. A university’s
slightly higher score than another university’s may not necessarily suggest its
superiority in scientific research because the two universities might be in very
close proximity in the ranking.
 
Copyright © 2007 Higher Education Evaluation and Accreditation Council of Taiwan