200 Chinese universities under the light of the Shanghai ranking

Transcription

1 Technical Report 03/ Chinese universities under the light of the Shanghai ranking Domingo Docampo Lawrence Cram January 22, Abstract The emergence of international academic rankings is one of the most interesting phenomena in the field of comparative analysis of higher education. The growing influence of the Shanghai ranking led its many critics to show strong reluctance in using it as a source of analysis and improvement, mainly because it was generally thought that its results were not reproducible. Once we have found a way to accurately replicate the results of the ranking, we are in a position to shed light into the performance of whole Higher Education systems. This technical report presents the results of 200 universities from inland China (excluding Hong Kong) in the 2013 edition of the Shanghai ranking. Keywords Academic rankings Shanghai arwu world class universities Chinese universities China Chinese Higher Education System 1 Introduction The Academic Ranking of World Universities (ARWU) a.k.a the Shanghai Ranking, evaluates the research performance of academic institutions on the basis of numerical measures related to individual outstanding achievements and institutional research throughput. The accessibility of the sources of the raw data and the fact that the hierarchy of universities generated by ARWU roughly aligns with perceptions of the historical and recent performance of elite research universities have contributed to its acceptance and success (Docampo and Cram, 2014). A first hand account of the Shanghai ranking indicators can be found in Liu and Cheng (2005), and is summarized in Section 2 following Docampo (2011). A reliable account of the ranking procedures can be found in Docampo and Cram (2014). For the sake of clarity, a summary of the procedure is also reproduced in section 3. This report analyzes the performance of Chinese Higher Education institutions on the indicators measured by the Shanghai ranking (2013 edition). To obtain the data for Chinese universities we have checked the electronic sources shown in Section 4. The Domingo Docampo Universidad de Vigo, Atlantic Research Center for Information and Communication Technologies; Campus Universitario, Vigo, Spain. Tel.: ddocampo@uvigo.es Lawrence Cram Australian National University, University House; 1 Balmain Crescent, Acton ACT 0200, Australia. Tel.: Lawrence.Cram@anu.edu.au

2 2 list of affiliation names and organizations-enhanced corresponding clues are shown in Section 5. Guidelines for the computation of scaled scores are provided in Section 6. Finally, in Section 7 we present the results of 200 Chinese universities on the Shanghai ranking indicators. 2 ARWU ranking ARWU ranks universities on six indicators of academic performance. Individual indicators Alumni Total number of graduates from an institution winning Nobel Prizes or Fields Medals in Mathematics. Award Total number of the staff working at an institution at the time of winning Nobel prizes in the sciences, or Fields Medals in Mathematics. HiCi Total number of highly cited researchers in broad subject categories found at the web site of the Institute of Scientific Information 1. Collective indicators N&S Total number of articles published in Science and Nature in the past five years. PUB Total number of articles indexed by Science Citation Index-Expanded and Social Science Citation Index in the previous year. PCP Total scores of the previous five indicators divided by the number of full-time equivalent academic staff. 3 ARWU ranking methodology ARWU ranks universities individually or into bands by sorting on the total score, i.e. the linearly weighted sum of 6 indicator scores derived from the corresponding raw data by transformations that have been calibrated and explained by Docampo (2013). To produce the annual Shanghai ranking report the following steps are required: 1. Assemble new raw data Scan the relevant data sources (see Section 4) for updated information on new Nobel prize winners (every year) and Fields medalists (every four years), new awardees (expected in 2014) and revised affiliations of the current list of HCR for Thompson ISI Highly Cited researchers, and the institutional details of Nature & Science publications and ISI indexed publications in the prior year. Do your best to obtain the institutional FTE (full-time equivalent) faculty numbers used in the calculation of the PCP (per-capita performance) indicator. 2. Assess and determine exceptions Once per decade, rescale indicators for historical Nobel prize winners and Fields medalists according to the decadal aging procedure. Allocate institutions specialized in the humanities and the social sciences to the class that uses special weights to exclude Nature & Science publications. Decide which entire countries and which special institutions will be excluded from the determination of PCP because the relevant values of FTE have not been found. 1

3 3 3. Combine raw data and apply scaling Sum and/or average raw data over the relevant time windows according to the published algorithms. For every indicator other than PCP, multiply each value of the processed raw data by a fixed scaling factor so that Harvard University has a scaled raw score of Calculate an intermediate quantity for PCP by dividing the weighted sum of the scaled raw scores by the FTE for the California Institute of Technology, and apply a scaling factor so that this intermediate quantity for CalTech is Compress the scaled raw data For each indicator, including PCP, compress the dynamic range of the scaled raw data by taking its square root to form the indicator score. 5. Calculate the total score and determine ranking/banding Combine the indicator scores using the relevant indicator weights, and linearly rescale so that the total score for Harvard University is 100. Rank institutions by total score, and determine for publication the ranking sequence, the membership of bands, and the excluded institutions. 4 Electronic sources Data were gathered from the following Electronic Sources: Nobel Prize Laureates available at Data on Field Medalists available at Medal Data on Highly Cited Authors available at Data on scientific production available at Preprint copies of our published articles are available at Cram/contributions/ Docampo/contributions/ 5 Affiliation names We have conducted electronic searches using the organizations enhanced (og) names feature of the Web of Knowledge. According to the last release notes (THOMSON- REUTERS, 2013), og names precisely identify research published from a specific organization using the Organization - Enhanced searching to quantify an organizations output including naming variants. The names used and the estimated Full Time Academic Staff figures are shown in Table 1. It is not unlikely that some disambiguation problems with affiliations may still persist, so we warmly invite comments on any apparent errors or uncertainties in the list of institutional name variants that comprise the WOK OG names. For Shanghai University we also added publications under og=shanghai university of science technology. The number of Full Time Equivalent Faculty appears to be linked to the number of full-time full and associate Professors. We have made a considerable effort through a number of reliable sources, including the own university information, to estimate the FTE Staff numbers of the institutions not included in the 2013 ARWU official list. We are sure that some mistakes have likely been made, so we would again warmly welcome any suggestion that could help in arriving at the appropriate FTE figure for each Chinese Higher Education institution.

4 4 Affiliation Name WOK og name FTE Agricultural University of Hebei agr univ hebei 750 Anhui Agricultural University anhui agricultural university 564 Anhui Medical University anhui medical university 1086 Anhui Normal University anhui normal university 550 Anhui University anhui university 800 Anhui University of Technology anhui university of technology 600 Beihang University beihang university 1307 Beijing Forestry University beijing forestry university 337 Beijing Institute of Technology beijing institute of technology 1277 Beijing Jiaotong University beijing jiaotong university 1028 Beijing Normal University beijing normal university 1305 Beijing University of Chemical Technology beijing university of chemical technology 764 Beijing University of Chinese Medicine beijing univ chinese med 745 Beijing University of Post and Telecommunications beijing university posts telecommunications 617 Beijing University of Technology beijing university of technology 1066 Bohai University bohai university 400 Capital Medical University capital medical university 994 Capital Normal University capital normal university 386 Central China Normal University central china normal university 1044 Central South University central south university 1807 Central University of Finance and Economics central university finance economics 556 Chang an University changan university 675 Changchun University of Science and Technology changchun university science technology 654 Changsha University of Science & Technology changsha univ sci technol 302 Changzhou University changzhou univ 410 Chengdu University of Technology chengdu university of technology 671 China Agricultural University china agricultural university 1211 China Jiliang University china jiliang university 519 China Medical University china medical university 895 China Pharmaceutical University china pharmaceutical university 212 China Three Gorges University china three gorges university 489 China University of Geosciences china university of geosciences 883 China University of Mining & Technology china university of mining technology 563 China University of Petroleum china university of petroleum 444 Chongqing Medical University chongqing medical university 1100 Chongqing Normal University chongqing normal univ 523 Chongqing University chongqing university 1700 Dalian Maritime University dalian maritime university 647 Dalian Medical University dalian medical university 1010 Dalian University of Technology dalian university of technology 1274 Donghua University donghua university 685 East China Institute of Technology east china institute of technology 750 East China Normal University east china normal university 1200 East China University of Science and Technology east china university of science technology 997 Fourth Military Medical University fourth military medical university 700 Fudan University fudan university 1544 Fujian Agriculture and Forestry University fujian agr forestry univ 761 Fujian Medical University fujian medical university 1159 Fujian Normal University fujian normal university 700 Fuzhou University fuzhou university 972 Guangdong Medical College guangdong med coll 209 Guangdong Pharmaceutical University guangdong pharmaceut univ 402 Guangdong University of Technology guangdong university of technology 1178 Guangxi Medical University guangxi med univ 834 Guangxi Normal University guangxi normal university 760 Guangxi University guangxi university 796 Guangzhou Medical University guangzhou medical university 545 Guangzhou University guangzhou university 894 Guilin University of Electronic Technology guilin univ elect technol 691 Guilin University of Technology guilin univ technol 745 Guizhou University guizhou university 1237 Hainan University hainan university 820 Hangzhou Dianzi University hangzhou dianzi university 655 Hangzhou Normal University hangzhou normal university 700 Harbin Engineering University harbin engineering university 978 Harbin Institute of Technology harbin institute of technology 2224

5 5 Affiliation Name WOK og name FTE Harbin Medical University harbin medical university 474 Harbin University of Science and Technology harbin university of science technology 816 Hebei Medical University hebei medical university 2186 Hebei Normal University hebei normal university 1335 Hebei University hebei university 800 Hebei University of Science and Technology hebei university of science technology 678 Hebei University of Technology hebei university of technology 790 Hefei University of Technology hefei university of technology 1026 Heilongjiang University heilongjiang university 1078 Henan Normal University henan normal university 500 Henan University henan university 850 Henan University of Science and Technology henan university of science technology 783 Hohai University hohai university 1340 Huaqiao University huaqiao university 450 Huazhong Agricultural University huazhong agricultural university 1048 Huazhong University of Science and Technology huazhong university of science technology 2185 Hubei University hubei university 665 Hunan Agricultural University hunan agr univ 749 Hunan Normal University hunan normal university 880 Hunan University hunan university 2128 Hunan University of Science and Technology hunan univ sci technol 876 Inner Mongolia Agricultural University inner mongolia agricultural university 658 Inner Mongolia University inner mongolia university 716 Jiangnan University jiangnan university 619 Jiangsu University jiangsu university 550 Jiangxi Normal University jiangxi normal university 577 Jilin Agricultural University jilin agr univ 776 Jilin Normal University jilin normal university 547 Jilin University jilin university 2972 Jinan University jinan university 1131 Kunming University of Science and Technology kunming university of science technology 1150 Lanzhou Jiaotong University lanzhou jiaotong university 489 Lanzhou University lanzhou university 954 Lanzhou University of Technology lanzhou university of technology 545 Leshan Normal University liaoning normal university 889 Liaocheng University liaocheng university 1034 Liaoning Normal University liaoning normal university 965 Liaoning University liaoning university 614 Ludong University ludong university 782 Nanchang Hangkong University nanchang hangkong univ 538 Nanchang University nanchang university 1213 Nanjing Agricultural University nanjing agricultural university 850 Nanjing Forestry University nanjing forestry university 573 Nanjing Medical University nanjing medical university 550 Nanjing Normal University nanjing normal university 669 Nanjing University nanjing university 1656 Nanjing Univ of Aeron. and Astron. nanjing university of aeronautics astronautics 1020 Nanjing University of nanjing university of Information Science & Technology information science technology 963 Nanjing Univ of Sci Technol nanjing university of science technology 850 Nanjing University of Technology nanjing university of technology 910 Nankai University nankai university 1510 Nantong University nantong university 743 National University of Defence Technology national university of defence technology china 750 Ningbo University ningbo university 768 Ningxia University ningxia university 578 North China Electric Power Univ north china electric power university 750 North University of China north university of china 692 Northeast Forestry University northeast forestry university china 600 Northeast Normal University northeast normal university china 783 Northeastern University of China northeastern university china 1060 Northwest Agriculture & Forestry University northwest a f university china 630 Northwest Normal University northwest normal university china 850 Northwest University northwest university xian 600 Northwestern Polytechnical University northwestern polytechnic university china 984 Ocean University of China ocean university of china 1200 chinese academy of medical sciences Peking Union Medical College peking union medical college 896 Peking University peking university 2488 Qingdao University qingdao university 1147

6 6 Qingdao University of Science and Technology qingdao university of science technology 736 Qufu Normal University qufu normal university 987 Renmin University of China renmin university of china 1189 Second Military Medical University second military medical university 850 Shaanxi Normal University shaanxi normal university 744 Shandong Agricultural University shandong agricultural university 657 Shandong Normal University shandong normal university 964 Shandong University shandong university 2475 Shandong University of Science and Technology shandong university of science technology 1334 Shanghai Jiao Tong University shanghai jiao tong university 2007 Shanghai Normal University shanghai normal university 768 Shanghai Ocean University shanghai ocean univ 200 Shanghai University shanghai university 1430 Shanghai University of Finance and Economics shanghai univ finance econ 523 Shantou University shantou university 350 Shanxi Medical University shanxi medical university 756 Shanxi Normal University shanxi normal university 744 Shanxi University shanxi university 1058 Shenyang Pharmaceutical University shenyang pharmaceutical university 182 Shenzhen University shenzhen university 1170 Shihezi University shihezi university 683 Sichuan Agricultural University sichuan agricultural university 550 Sichuan University sichuan university 2466 South China Agricultural University south china agricultural university 900 South China Normal University south china normal university 700 South China University of Technology south china university of technology 1449 Southeast University southeast university china 1621 Southern Medical University southern medical university china 700 Southwest Jiaotong University southwest jiaotong university 1200 Southwest University southwest university china 1088 Sun Yat-sen University sun yat sen university 2018 Suzhou University suzhou university 1633 Taiyuan University of Technology taiyuan university of technology 998 Third Military Medical University third military medical university 800 Tianjin Medical University tianjin medical university 850 Tianjin Normal University tianjin normal university 572 Tianjin Polytechnic University tianjin polytechnic university 700 Tianjin University tianjin university 1402 Tongji University tongji university 1974 Tsinghua University tsing hua university 2541 university of electronic University of Electronic Science & Technol science technology china 1080 University of Jinan university of jinan 760 University of Science and Technology of Beijing university of science technology beijing 602 University of Science and Technology of China university of science technology china 974 Wenzhou Medical College wenzhou medical college 451 Wenzhou University wenzhou university 627 Wuhan Institute of Technology wuhan institute of technology 530 Wuhan University wuhan university 2505 Wuhan University of Technology wuhan university of technology 1950 Xiamen University xiamen university 1627 Xian Jiao Tong University xian jiaotong university 1527 Xiangtan University xiangtan university 628 Xidian University xidian university 900 Xinjiang University xinjiang university 813 Yanbian University yanbian university 702 Yangzhou University yangzhou university 995 Yanshan University yanshan university 748 Yantai University yantai university 595 Yunnan Normal University yunnan normal university 457 Yunnan University yunnan university 631 Zhejiang Gongshang University zhejiang gongshang university 703 Zhejiang Normal University zhejiang normal university 910 Zhejiang University zhejiang university 2584 Zhejiang University of Science and Technology zhejiang university of science technology 850 Zhejiang University of Technology zhejiang university of technology 1270 Zhengzhou University zhengzhou university 1870 Table 1 Chinese Universities: affiliation name, Thomson Reuters organizations enhanced name, Full Time Academic Staff for the computation of the PCP indicator

7 7 6 Computation of the indicator scores Since final scores depend on the raw scores in relation with those of the best performer institution, the first step is to evaluate the raw scores for each institution on the five non composed indicators: Alumni, Award, HICI, S&N and PUB. For a complete account of the computation of raw scores the reader is referred to Docampo (2013). Now we need the raw scores of the best performer. Harvard University achieves the maximum score on the five non composed indicators in the 2013 edition of ARWU: its raw scores shown in Table 2. A caveat for those trying to replicate Harvard University results: when searching the Web of Knowledge, use oo=harvard univ, since Hospitals affiliated with Harvard also count when calling og=harvard university. Alumni Award HICI S&N PUB Table 2 Harvard University raw scores in 2013 Let us now summarize the precise operations with the raw scores described in steps 4 and 5 of Section 3. Let H be the number of points (raw score) of Harvard on any of the five indicators, and X the number of points achieved by any other institution. Estimated scores are computed through the same formula: X EST = 100 H Now, to get the PCP values we first compute the weighting sum of the squares of the estimated scores, evaluated through Equation 1, on the first five indicators; let s call that value WSS. WSS = 0.1Alumni (Award 2 + HICI 2 + N&S 2 + PUB 2 ) (2) Let s call WSSCT the value of the squared sums for Caltech, the university with the highest score in the indicator PCP. Let FTECT be the Full Time Equivalent Staff of Caltech (278 in 2013). To estimate the PCP indicator of the university X, with a Full Academic Staff of FTEX and weighted scores sum of WSSX, the following operation will be carried out: PCP = 100 WSSX FTEX WSSCT FTECT = 100 FTECT WSSCT WSSX FTEX To compute formula 3 we introduce the value of 278 for the Full Time Equivalent Academic Staff of Caltech. Since it follows from the 2013 ranking data that WSSCT = 29680, we have that FTECT W SSX = PCP = WSSCT F T EX (1) (3) (4)

8 8 7 Results We show in Table 3 the results corresponding to 200 Higher Education institutions from inland China (excluding Hong Kong) in the 2013 edition of ARWU. It is worth mentioning that the entrance score in the 500 universities (ARWU 2013) was close to 9.5. References Docampo D (2011) On using the Shanghai ranking to assess the research performance of university systems. Scientometrics, 86(1): Docampo D (2013) Reproducibility of the Shanghai academic ranking of world universities results. Scientometrics, 94(2), Docampo D, Cram L (2014) On the Internal Dynamics of the Shanghai ranking. Scientometrics, In Press DOI: /s Liu NC, Cheng Y (2005) Academic ranking of world universities: Methodologies and problems. Higher Education in Europe, 30(2), THOMSON-REUTERS (2013) Web of knowledge v5.9 release notes. URL

9 9 INSTITUTION Alu Awd HICI N&S PUB PCP score rk Tsinghua University Shanghai Jiao Tong University Peking University Fudan University Zhejiang University University of Science and Technology of China Nanjing University Sun Yat-sen University Jilin University Shandong University Sichuan University Huazhong University of Science and Technology Xian Jiao Tong University China Agricultural University Beijing Normal University Harbin Institute of Technology Beihang University Dalian University of Technology Xiamen University Nankai University Southeast University Tongji University Tianjin University Peking Union Medical College Central South University Lanzhou University Wuhan University South China University of Technology Suzhou University China University of Geosciences Chongqing University University of Electronic Sci & Technol East China University of Science and Technology East China Normal University Nanjing Medical University Capital Medical University Shanghai University Donghua University Second Military Medical University Zhengzhou University China Medical University Fourth Military Medical University Huazhong Agricultural University University of Science and Technology of Beijing Beijing Institute of Technology National University of Defence Technology Northwestern Polytechnical University Southwest University Jiangsu University Nanjing Agricultural University Nanjing Normal University Beijing University of Chemical Technology Northwest Agriculture & Forestry University Northwest University Southern Medical University China University of Petroleum Ocean University of China Jiangnan University Xidian University Hunan University Jinan University South China Normal University China Pharmaceutical University Harbin Medical University Nanjing University of Aeron. and Astron Northeast Normal University

10 10 INSTITUTION Alu Awd HICI N&S PUB PCP score rk Nanjing University of Science and Technology Northeastern University of China Third Military Medical University Yunnan University Capital Normal University Wuhan University of Technology Tianjin Medical University Beijing University of Post & Telecom China University of Mining & Technology Xiangtan University South China Agricultural University Central China Normal University Nanchang University Wenzhou Medical College Beijing Jiaotong University Zhejiang Normal University Zhejiang University of Technology Beijing University of Technology Chongqing Medical University Fuzhou University Nanjing University of Technology Yangzhou University Hangzhou Normal University Hohai University Shenzhen University Beijing Forestry University Nanjing University of Inf Sci & Technol Shenyang Pharmaceutical University North China Electric Power University Shaanxi Normal University Shantou University Hefei University of Technology Renmin University of China Shanxi University Southwest Jiaotong University Guangxi University Ningbo University Harbin Engineering University Liaocheng University Yanshan University Anhui Medical University Anhui University Hebei Medical University Henan Normal University Henan University Northeast Forestry University Guangzhou Medical University Kunming University of Science and Technology Qingdao University Shandong Agricultural University Sichuan Agricultural University University of Jinan Shanghai Normal University Taiyuan University of Technology China Jiliang University Hebei University Nantong University Hunan Normal University Qingdao University of Science and Technology

11 11 Inner Mongolia University Northwest Normal University Guangdong Medical College Shanghai Ocean University Tianjin Polytechnic University Wenzhou University Zhejiang University of Science and Technology Changzhou University Guangdong University of Technology Henan University of Science and Technology Hubei University Anhui Normal University Fujian Medical University Fujian Normal University Jiangxi Normal University Xinjiang University Huaqiao University Leshan Normal University Shandong Normal University Changsha University of Science & Technology Hebei Normal University Liaoning Normal University Nanjing Forestry University Yantai University Dalian Medical University Guangxi Medical University Guangxi Normal University Heilongjiang University Hunan Agricultural University Qufu Normal University Guizhou University Hangzhou Dianzi University North University of China Zhejiang Gongshang University Anhui University of Technology Chang an University Changchun University of Science and Technology Hebei University of Technology Lanzhou University of Technology Nanchang Hangkong University Yanbian University Chongqing Normal University Dalian Maritime University Fujian Agriculture and Forestry University Shanghai University of Finance and Economics Tianjin Normal University Chengdu University of Technology Guangzhou University Guilin University of Technology Hainan University Yunnan Normal University Beijing University of Chinese Medicine Bohai University Central University of Finance and Economics China Three Gorges University Hunan University of Science and Technology Lanzhou Jiaotong University Shihezi University Anhui Agricultural University Guilin University of Electronic Technology Harbin University of Science and Technology Jilin Agricultural University Liaoning University Ludong University Shandong University of Science and Technology Wuhan Institute of Technology Guangdong Pharmaceutical University Hebei University of Science and Technology Shanxi Medical University East China Institute of Technology Agricultural University of Hebei Inner Mongolia Agricultural University Jilin Normal University Shanxi Normal University Ningxia University Table 3 ARWU scores: Chinese universities ranked following ARWU 2013 criteria