Journals Evaluation and the Application Based on Entropy-TOPSIS

Transcription

1 Engneerng Management Research; Vol. 4, No. 1; 2015 ISSN E-ISSN Publshed by Canadan Center of Scence and Educaton Journals Evaluaton and the Applcaton Based on Entropy-TOPSIS Wen-Tao Duan 1, Yuan-Bao Zhang 2,3 & He Ne 1 1 Electrcal and Informaton School, Jnan Unversty, Zhuha, Chna 2 Packagng Engneerng Insttute, Jnan Unversty, Zhuha, Chna 3 Key Laboratory of Product Packagng and Logstcs of Guangdong Hgher Educaton Insttutes, Jnan Unversty, Zhuha, Chna Correspondence: Yuan-Bao Zhang, Packagng Engneerng Insttute, Jnan Unversty, Zhuha, , Chna. E-mal: zybt@jnu.edu.cn Receved: December 2, 2014 Accepted: January 2, 2015 Onlne Publshed: Aprl 27, 2015 do: /emr.v4n1p30 URL: Abstract Ths paper presented the objectve evaluaton method of Journals analyzed by the TOPSIS based on entropy weght and compared t wth the tradtonal sngle valuaton way. Based on the evaluaton ndex, the objectve weght of the ndex was calculated wth the entropy method, the journals selected analyzed by TOPSIS. Wth the weghts from normalzed entropy, ths paper calculated the dstance from each journal to the best and the worst and worked out the rankngs of the journal accordng to the proxmty. Then the results from Prncpal Component Analyss and Sngle Evaluaton Method were compared and analyzed, makng the result of evaluatng more objectve and accurate. Keywords: entropy coeffcent, TOPSIS, comprehensve evaluaton, journals, Prncpal Component Analyss (PCA) 1. Introducton Wth the development of scence, more and more dfferent perodcals are publshed provdng readers a wealth of nformaton and resource. Whle provdng numerous documents, a scentfc evaluaton system s needed to recommend and choose all the types of perodcals. In recent years studes on the evaluaton method and system of the scentfc and technologcal perodcal appears constantly, comprehensve evaluaton of ndex weght has become a hot spot, manly ncludng objectve weghtng methods, subjectve weghtng methods and combnaton gvng-weght-value. Zhong et al. (1999) made use of the factor analyss approach to flter and establsh the evaluaton system; Zhou et al. (2006) evaluated the man Journals of Mathematcs n Chna by the factor analyss approach; Guan et al. (2004) utlzed the prncpal component analyss to do the comment rankng for the core foregn journals; Wang et al. (2003) conducted the applcaton of WRSR methods ncomprehensve evaluaton of the medcal journals. TOPSIS et al. (2008) based on entropy Method s an evaluaton system whch can reflect the actual workng condton objectvely, t has a huge applcaton value n the practce. The score s determned by calculatng the entropy value, the weght of the ndex and the correspondng best and worst value. PCA et al. (2011) however doesn t use the Weghtng coeffcent, whch mproves the objectvty and qualty of the comments. As one of the multvarate analyss methods n mathematcal statstcs, t can avod the shortcomng of human subjectvty. In determnng the ndex weght and make the result more objectve. Ths paper conducted the academc evaluaton on the selected journals based on the TOPSIS and compared t wth the tradtonal way, that s usng the expandng the mpact factors as the sngle evaluaton ndex. 2. The Academc Level of Journals Evaluaton Model upon TOPSIS Based on Entropy Method Consderng the nfluence dfferent ndex have on the academc level, ths paper made a comprehensve evaluaton on the selected journals on the base of TOPSIS. Nne mpact ndexes on journals were selected and the objectve weght of each ndex calculated by entropy method, wth ths, we elmnated the effects from subjectve factors and made t more objectve. Based on the data from the objectve weght, the comprehensve evaluaton was conducted wth TOPSIS, fnally stated and verfed by PCA, thus we got the way to mprove the evaluaton of sngle ndex. 30

2 2.1 Evaluaton Indcators of Journals Accordng to the data from documents, there are a few ndex that may affect the academc level and they are as followed: (1) Extended total cted verson number; (2) Extended nfluence factor; (3) Extended mmedacy ndex; (4) Extended cted rate; (5) Extended number of ctng sc-tech journals; (6) Extended dscplnes mpact ndcators; (7) Extended dscplne dffuson ndex; (8) Extend cted half-lfe; (9) Extended h ndex. The tradtonal evaluaton of sngle ndex manly refers to make the evaluaton accordng to the two unversal evaluaton ndexes of extended nfluence and extended total cted verson number. That s we can get the poston of the journal n the same category by comparng and orderng extended nfluence and extended total cted verson number, thus valung and evaluatng ts academc nfluence and poston. But wth t as the only measure to evaluate journals, there are shortcomngs the nfluences from other factors are overlooked. Due to smplfyng too much, the objectvty and relablty of the method are under suspcon, especally n these sc-tech journals wth great nfluence but low level of extended nfluence factor et al. (2007). 2.2 TOPSIS Based on Entropy Weght Method Entropy-weghtng TOPSIS et al. (2011) s a common method n mult-objectve decson nukng method wth fnte alternatves. It s based on the normalzed orgnal data matrx, an objectve weght determnaton from the change of metrc. Then we can get the optmal value and the worst, calculate the dstance from certan scheme to the best and the worst and worked out the rankngs of the journal accordng to the proxmty. Concrete steps of Entropy-weghtng TOPSIS method are as follows: (1) Establsh the evaluated matrx wth all postve number, supposng t has n samples and each sample has pndcators. So the orgnal matrx s as follow x= x ( 1, 2,, n, j 1, 2,, p) n p Then we standardze the evaluated data of the journals ndcators. Concernng the trends and dmenson of the ndcators, we transform the negatve ndcators nto the postve ndcators so that all ndcators can be compared homodromously. Here we use the Z score method to standardze the data, as follow: X ' X X S j j ' X are the standardzed data,as follow: (2) Calculate the entropy of the ndcator j m X x x 1 m 1 e X ln X (1 j n) j ln m 1 31

3 (3) Calculate the weght of the 9 ndcators g 1 e (1 j n) j j n w g g (1 jn) j 1 (4) Weghtng the standardzed data We suppose that s the j-th value n th ndcator of weghtng value of the standardzed data. Accordng to the weghtng rule of the standardzed data, we can get the results as follow : X X w ' j (5) Suppose the j-thattrbute value of postve deal soluton s, and the j-thattrbute value of negatve deal soluton s. So, postve deal soluton s denoted by: negatve deal soluton s: z mn{ z }, 1,2,..., m; j 1, 2,..., n z max{ z }, 1,2,..., m; j 1,2,..., n (6) Calculate the dstance between the j-the valuaton object and deal soluton. s the dstancebetween thej-thevaluaton objectand postve deal soluton. s the dstance between the j- the valuaton object and negatve deal soluton : 4 2 ( j), 1,2,..., j1 d z z m s the dstance between the j-the valuaton object and negatve deal soluton z : 4 2 ( j), 1,2,..., j1 d z z m (7) Calculate relatve comprehensve evaluaton degree of each object and rank them. Comprehensve evaluaton value for each evaluaton object s: d C, 1,2, m d d Closeness between the evaluaton object and the deal soluton can be obtaned. Then we rank them accordng to. If the value s bgger, ndcatng that the correspondng evaluaton object closer to the optmal level; conversely, the value s closer to 0, the evaluaton object represents the worst level. 2.3 Prncpal Component Analyss Ths study determnes the extensons accordng to the total contrbuton of the prncple components, the weght from the varance of the prncple components. It can elmnate the devaton from the relatvty between the ndex and reduce the calculatng dmenson, whch makes t easer to choose the ndex and mprove the credt of the valuaton. Wth ths method, we can avod ndetermnaton and ensure to decde correctly and objectvely. To reduce the number of the selected ndex and dmenson cuttng down the calculaton quantty, ths paper determned the prncple components when the cumulatve percent of the varance s over 90% for they contaned 32

4 most nformaton. Then we calculated the evaluaton of the selected journals and the score wth the cumulatve percent of the varance as the weght of the component then fnally reached the comprehensve value. 3. Instance Analyss Ths paper uses data and evaluaton ndex n references (He et al. 2013) and calculates for the for economc journals wth matlab and SPSS19 et al. (2012). Then we utlze entropy-topsis method to evaluate these journals. 3.1 The Academc Level of Economc Journals Evaluaton Model upon TOPSIS Based on Entropy Method We evaluate the 20 economc journals(let B1, B2, B3, B4, B5, B6, B8, B9, respectvely stand for: Extended total cted verson number, extended nfluence factor, extended mmedacy ndex, extended cted rate, extended number of ctng sc-tech journals, extended dscplnes mpact ndcators, extended dscplne dffuson ndex, extend cted half-lfe, extended H Index), as shown n table. Table 1. Evaluaton data of Economc journals Journal Name B1 B2 B3 B4 B5 B6 B7 B8 B9 Sc-Tech and Industry A&E Research South Chna. J of Economcs Shangqng Commercal Research Productvty Research The J of World Economc World Economy Study Specal Zone Economy Contemporary Eco of Japan Asa-Pacfc Econ Revew Zhejang Economy Chna D. Observaton Economc Issues n Chna Resource&Industry QuanquK.JLaowang TanfuXnlun Modern Economcs(PM) Modern Econ Informaton Nanka Economc Studes Due to the 9 ndcators of ths paper are all very large ndcators, t need not be processed for common trends. SPSS wll analyze the orgnal data automatcally. After standardzng the data n table1, generate the data as shown n table 2. 33

5 Table 2. The standardzed evaluaton data of Economc journals Journal Name B1 B2 B3 B4 B5 B6 B7 B8 B9 Sc-Tech and Industry A&E Research South Chna. J of Economcs Shangqng Commercal Research Productvty Research The J of World Economc World Economy Study Specal Zone Economy Contemporary Eco of Japan Asa-Pacfc Econ Revew Zhejang Economy Chna D. Observaton Economc Issues n Chna Resource&Industry Quanqu K. JLaowang TanfuXnlun Modern Economcs(PM) Modern Econ Informaton Nanka Economc Studes We use the entropy-topsis method to evaluate the journals n table1 by matlab. Accordng to the entropy weght, we conduct the weghts of the 9 ndcators: 0.109, 0.109, 0.109, 0.117, 0.110, 0.112, 0.11, 0.113, Then fgure out the comprehensve values and ther ranks, as shown n table 3. Table 3. Evaluaton results of the Economc journals Journal Name TOPSIS rank Journal Name TOPSIS rank Sc-Tech and Industry Asa-Pacfc Econ Revew A&E Research Zhejang Economy South Chna. J of Economcs Chna D. Observaton Shangqng Economc Issues n Chna Commercal Research Resource&Industry Productvty Research Quanqu K.JLaowang The J of World Economc TanfuXnlun World Economy Study Modern Economcs(PM) Specal Zone Economy Modern Econ Informaton Contemporary Eco of Japan Nanka Economc Studes

6 3.2 The Academc Level of Economc Journals Evaluaton Model Based on PCA After standardzng the data, we obtan correlaton matrx of the data and ts characterstc root and the accumulatve contrbuton whch choose 90% as advance accumulatve contrbuton. Accordng to the contrbuton of each prncpal component, the comprehensve evaluated modell s as follow: Z= Z Z Z Result and Analyze Compared entropy-topsis method wth PCA and conventonal evaluated method, the rankng s as shown n table 4: Table 4. Comprehensve rankng Journal Name Entropy-TOPSIS PCA Smple Method 1 Sc-Tech and Industry A&E Research South Chna. J of Economcs Shangqng Commercal Research Productvty Research The J of World Economc World Economy Study Specal Zone Economy Contemporary Eco of Japan Asa-Pacfc Econ Revew Zhejang Economy Chna D. Observaton Economc Issues n Chna Resource&Industry Quanqu K.J Laowang TanfuXnlun Modern Economcs(PM) Modern Econ Informaton Nanka Economc Studes The top 5 journals by entropy-topsis method are The Journal of World Economc, Commercal Research, Nanka Economc Studes and South Chna Journal of Economcs Productvty Research whle the top 5 journals by PCA are The Journal of World Economc, Nanka Economc Studes, Commercal Research, World Economy Study and South Chna Journal of Economcs. The two results are not completely dfferent but very close. For example, The Journal of World Economc, one of the best economc journals n Chna, ranks frst n extended nfluence factor. In the frst three evaluated results of journals, The Journal of World Economc ranks frst n extended nfluence factor extended dscplnes mpact ndcators and extended dscplnes mpact ndcators. Nanka Economc Studes ranks frst n extended mmedacy ndex and extended cted rate when Commercal Research ranks as the top of Extended total cted verson number extended number of ctng sc-tech journals and extended dscplne dffuson ndex. They occupy the top of all the ndcators, whch are related a lot to ther ranks. So t llustrates that the TOPSIS based on entropy can evaluate objectvely the academc levels of these journals. Compared wth the smple evaluated method, the new method mprove a to some extent because t can take more factors nto consderaton such longer tme and other objectve factors. 35

7 4. Concluson The paper uses TOPSIS based on entropy weght to evaluate the 9 ndcators of the 20 economc journals. We exclude subjectve factors wth method of determnng the objectve weght and calculate the TOPSIS value after weghtng the data. At frst standardzng the journals data and calculatng the weghts of all the ndcators accordng to entropy. After weghng the data, we can calculate and obtan the score of TOPSIS. Relatve proxmty s between 0 and 1. If the value s closer to 1, ndcatng that the correspondng evaluaton object closer to the optmal level. Whereas t s closer to the worst level. At the same tme, PCA can prove ts reasonablty that t can mpact on readers and cters to some extent. The analyss procedure of TOPSIS based on s smple, t can reflect the evaluaton date of each ndex drectly, startng from the objectve weght and based on the objectve data, elmnatng the nterrupton from the subjectve factors. It can also adequately mne the ntrnsc lnk of data and show the objectvty of the model. Other objectve methods can obtan the evaluated results such as PCA and RSR but ther processes are more complex. If we got the ndex weght totally from experts advce, then t lacks scence and objectvty. However, extended nfluence factor only ncludes the ctes n 2 years. It s partal to evaluate the journals accordng to extended nfluence factor so comprehensve method s more persuasve. The evaluaton system s not a sngle evaluaton system, we also need to consder the condtons when applyng and the accuracy. Although TOPSIS based on the entropy can avod subjectve factors, ths weght result may not stand for the real stuaton. A better way to do ths s to combne the objectve weght method and the advce from experts to do an orented research, wth ths we can optmze the model n evaluatng the academc level of journals, a further study need to conduct to apply the subjectve factors. Acknowledgements The project of the college students nnovaton and entrepreneurshp tranng plan s n Jnan unversty (natonal level) (No ). References Guan, J., Chen, W. K., & L, Z. F. (2004). Comprehensve Evaluaton of Foregn Core Journals-the Applcaton of PCA. Journal of medcal ntellgence, 1, Retreved form He, D. F. et al. (2013). Chna s scence and technology journal ctaton reports (KuoKan verson). BeJng: Scence and technology lterature press. L, G. C., Guo, T. Ch, & Yan, Q. (2011). Evaluaton Model and Emprcal Study of Human All-Round Development Based on Entropy Weght and TOPSIS. Journal of Systems Engneerng, 26(3), L, J. H., Wang, Zh. K., Sun, M. J., & Su, H. Y. (2007). Rerecognzaton of the Impact Factor of the Sctech Perodcals of Chna. Chn J Med LbrInfSc, 16(1), 6-9. Sh, L. W. (2012). SPSS19.0 Statstcal Analyss from Entry to the Master (Vol 1). Tsnghua Unversty Press. Wang, J. N. (2011). Improved TOPSIS Model Base on Entropy Weght Research. Publc Communcaton of Scence &Technology, 2, Wang, J., & Xu, T. H. (2013). The RSR n the Applcaton of the Medcal Academc Journals of Sc-tech Qualty. Comprehensve Evaluaton Journal of Mathatcal Medcne, 16(3), Retreved form Zha, Z. H. (1999). Research on Evaluaton of Scentfc Research Standard of Scentfc and Techncal Personnel. Systems Engneerng-Theory & Practce, 11, Retreved form Zhang, H., Zhao, H. X., Lu, Y. P., & Tao, W. W. (2008). The Evaluaton Method of Sc-tech Journals Base on PCA. ActaEdtologca, 20(1), Zhou, L., & Zhang, L. L. (2006). The Evaluatng to Some Major Mathematcs Journals n Chna by Factor Analyss Method. Journal Of Huabe Cool Industry Teachers College, 127(2). Retreved form 36

8 Copyrghts Copyrght for ths artcles retaned by the author(s), wth frst publcaton rghts granted to the journal. Ths s an open-access artcle dstrbuted under the terms and condtons of the Creatve Commons Attrbuton lcense ( 37