12/18/18. The Dark Side of PubMed: Predatory Publishing. Disclosure. Learning Objectives. General References. Course outline

Transcription

1 2019 American Physical Therapy Association. All rights reserved American Physical Therapy Association. All rights reserved. The Dark Side of PubMed: Predatory Publishing Federico Pozzi, PT, PhD Chad Cook, PT, PhD, MBA, FAAOMPT Julie Tillson, PT, DPT, MS, NCS Disclosure FEDERICO POZZI: no relevant financial relationship exists Learning Objectives Identify the characteristics of a predatory journal and understand the impact of predatory journals on the profession American Physical Therapy Association. All rights reserved. CHAD COOK: no relevant financial relationship exists JULIE TILLSON: no relevant financial relationship exists 2019 American Physical Therapy Association. All rights reserved. Describe, from an author s perspective, the problems and dangers of publishing in a predatory journal. Recognize the impact of predatory journals on academic institutions as well as promotion and tenure evaluations. Explain the risks associated with basing patient care on research that has not been sufficiently peer reviewed. Course outline General References 2019 American Physical Therapy Association. All rights reserved. FEDERICO POZZI CHAD COOK JULIE TILLSON THE EPIDEMIC SPREAD OF PREDATORY PUBLISHING History of predatory publishing How to recognize predatory publishing PREDATORY PEER REVIEW PUBLISHING Should I publish in a predatory journal? Impact on promotion and tenure SOLUTIONS FOR CLINICIANS Bias & threat Risks for patients care 2019 American Physical Therapy Association. All rights reserved. Beall J. Predatory publishers are corrupting open access. Nature. 489(7415):179, 2012 Sorokowski P, Kulczycki E, Sorokowska A, Pisanski K. Predatory journals recruit fake editor. Nature. 543: , 2017 Ferris LE, Winker MA. Ethical issues in publishing in predatory journals. Biochemia Medica. 27(2):279-84, 2017 Clark J, Smith R. Firm action needed on predatory journals. BMJ. doi: /bmj.h Beall J. Predatory Journals Threaten the Quality of Published Medical Research. Journal of Orthopaedic and Sports Physical Therapy. 47(1): 3-5,

2 THE EPIDEMIC SPREAD OF PREDATORY PUBLISHING Federico Pozzi, PT, PhD DISCLOSURE No relevant financial relationships Editorial board member (2019 present) Arthritis Care & Research Ad hoc-reviewer (2013 present) 16 peer-reviewed scientific journals 13 subscription based journals 3 open access journals SESSION LEARNING OBJECTIVES Rationale for the session Identify the characteristics of a predatory journal and understand the impact of predatory journals on the profession. Describe, from an author s perspective, the problems and dangers of publishing in a predatory journal. Recognize the impact of predatory journals on academic institutions as well as promotion and tenure evaluations. Erode public trust on research Explain the risks associated with basing patient care on research that has not been sufficiently peer reviewed PREDATORY PUBLISHING EPIDEMIC Predisposing factors Scientific publishing Scientific publishing The rise of evidence based-practice World wide web The introduction of open access journals PREDATORY PUBLISHING EPIDEMIC Expert-based editorial board Expert-based peer-reviewed process Archive 1

3 Rise of evidence based-practice World wide web Awareness RESEARCHERS CLINICAL DECISION MAKING PATIENTS Access to evidence Clinician: $$$ impacting access to research Patients: my $$$ (taxes) fund most of the research Introduction of open access publishing Publishing revenue Public Library of Science Expert-based editorial board Expert-based peer-reviewed process Archive Digital repository Public full-text scholarly articles Journals: 2,500 Annual output: 430,000 Annual downloads: >900M Archives: 13M documents Journals: 7 Annual output: 27,000 Annual downloads: 24M Archives: 195,000 documents 2017 revenue 2.48 billion Profit margin ~37% 2017 revenue $36.8 million Potential financial gain PREDATORY PUBLISHING BUSINESS MODEL 2

4 PREDATORY PUBLISHING BUSINESS MODEL HOW BIG IS THIS EPIDEMIC? Expert-based editorial board Expert-based peer-reviewed process Archive 1,155 OPEN ACCESS STANDARD 18 PREDATORY SOME EXAMPLES First line of defense International Journal of Advanced Computer Technology (IJACT) Identify characteristics of predatory journals Identify characteristics of predatory journals Website Target author Spelling & grammar errors Promise rapid publication Low processing fee (<$150) Editorial staff No journal editor No affiliation for the editor No academic expertise Business management Lack of transparency Large number of new journals Lack of archival policies 3

5 Journal evaluation tool Journal evaluation tool scores GOOD FAIR POOR Within this range the journal meets many of the Open Access Journal Evaluation criteria defined for credibility. At the higher end of the range the journal would be described as recommended. Within this range the journal meets some of the Open Access Journal Evaluation criteria defined for credibility. The author would need to decide whether or not to publish in the journal. Within this range the journal meets the fewest of the Open Access Journal Evaluation criteria defined for credibility. This journal would not be described as recommended. PUBMED CONUNDRUM PUBLISHERS PREDATORY PUBLISHERS 4

6 Predatory Peer Review Publishing Chad Cook PT, PhD, MBA, FAAOMPT Professor and Program Director Division of Physical Therapy Duke University Duke Clinical Research Institute Annoyance Friday, 3:12 AM to 11:47 AM Daily, I receive 20 to 25 requests DHTS has said that my Filter system has maxed out Predatory Publishers In academic publishing, predatory open access publishing is an exploitative openaccess publishing business model that involves charging publication fees to authors without providing the editorial and publishing services associated with legitimate journals (open access or not). Growth in illegitimate journals continues (nearly 1,100 at the writing of this PP) 1

7 Predatory Publishers In 2011 there were 18 In 2017 there were 1,155 Fake but Real Sounding The Scientific Pages of Pancreatic Cancer The Scientific Pages of Pediatrics The Scientific Pages of Pediatric Neurology The Scientific Pages of Physical Medicine The Scientific Pages of Plant Pathology The Scientific Pages of Psychiatry The Scientific Pages of Pulmonology The Scientific Pages of Public Health Open Access Conundrum Two academics walk into a bar. They bring their own drinks, pay $5000, and leave feeling proud and ashamed. It's a publishing S%&T Academics Say metaphor. $5,000???!! Authors paid an average article processing charge of $178 USD per article for articles typically published within 2 to 3 months of submission. Over the studied period, predatory journals have rapidly increased their publication volumes from 53,000 in 2010 to an estimated 420,000 articles in How Bad is the Problem? 157 of the journals had accepted the paper and 98 had rejected it. Of the remaining 49 journals, 29 seem to be derelict: websites abandoned by their creators. Acceptance took 40 days on average, compared to 24 days to elicit a rejection. Of the 255 papers that underwent the entire editing process to acceptance or rejection, about 60% of the final decisions occurred with no sign of peer review. As an Author: you Don t want to be Affiliated with Them!! Bohannon J. Who's afraid of peer review? Science 2013;342(6154):

8 White List or Black List? Navigating Legit Peer Reviewed Manuscripts Medline Pubmed Pubmed Central Other Indices Criteria for Predatory Journal 15/01/criteria-2015.pdf 3

9 The Dark Side of PubMed: SOLUTIONS FOR CLINICIANS Julie K. Tilson, PT, DPT, MS Board Certified Specialist in Neurologic Physical Therapy Associate Professor of Clinical Physical Therapy University of Southern California stock.adobe.com Don t throw the baby out with the bathwater! Solutions for Clinicians 1. Synthesized Evidence 1. Synthesized Evidence 2. Search Smart 3. Evidence of Peer Review 4. Key Journals 5. Appraisal Skills stock.adobe.com Haynes RB, ACP J Club 2006;145(3):A8 APTA-Affiliated Clinical Practice Guidelines (modern) 2010 and earlier Orthopedic: 6 Neurologic: 0 Pediatric: 0 Geriatric: 0 Oncology: 0 Cardiopulmonary and Acute Care: and later Orthopedic: 15 Neurologic: 2 Pediatric: 2 Geriatric: 0 Oncology: 1 Cardiopulmonary and Acute Care: 1 1

10 2. Search Smart Fortunately, predatory journal articles can be difficult to find! Manca A. et al. How predatory journals leak into PubMed. CMAJ. 2018:190(35);E1042-E1045. Article not found 11 pages deep 2

11 3. Evidence of Peer Review Look for evidence of peer review 3

12 Methods: ü Materials and Methods ü Participants ü Procedure ü Data Collection ü Statistical Analysis Manca A. et al. How predatory journals leak into PubMed. CMAJ. 2018:190(35);E1042-E1045. Shamseer L. et al. Potential predatory and legitimate biomedical journals: can you tell the difference? A cross-sectional comparison. BMC Med. 2017;15: Key Journals Make note of the journals encounter most often in your area of practice 4

13 Journals most relevant to your practice Identifying Risk for Bias 5. Appraisal Skills Even the best journals sometimes publish bad articles Sample v Who was recruited? v How were they recruited? v How many were recruited? v How many dropped out and why? Identifying Risk for Bias Design v Logical for stated purpose? (e.g. RCT vs. Cohort Study) v Do groups have limited risk for bias? v Is blinding used where needed? v Is outcome measurement appropriate? Identifying Risk for Bias Analysis and Results v Relevant descriptive statistics? v Appropriate comparison within and between groups? v Measures of variability or dispersion? (range, SD) v Confidence intervals? v Clinically meaningful statistics? stock.adobe.com Kristensen et al

14 Appraisal Resources Summary Most research you will encounter in practice IS peer-reviewed Even that doesn t mean it is all trustworthy! Avoid information from predatory publishers by 1. Starting with synthesized evidence 2. Searching in reputable databases 3. Looking for evidence of peer review 4. Knowing the key journals in your area of practice 5. Using (and developing) your appraisal skills shutterstoock.com Web Resources Thank You!! shutterstoock.com 1) Committee on Publication Ethics (COPE): a. Principles of Transparency and Best Practice in Scholarly Publishing 2) Fact Sheet - MEDLINE Journal Selection: 3) Other resources to help identify predatory journals: a. b. c. World Association of Medical Editors, Identifying Predatory or Pseudojournals: References Cook, C. (2017). Predatory Journals: The Worst Thing in Publishing, Ever. J Ortho Phys Ther, 47(1), 1-2. Manca, A., PhD., Moher, D., PhD., Cugusi, L., PhD., Dvir, Z., PhD., & Deriu, F.,M.D.PhD. (2018). How predatory journals leak into PubMed. CMAJ, 190(35), E1042-E1045. Masten, Y., & Ashcraft, A. (2017). Due diligence in the open-access explosion era: choosing a reputable journal for publication. FEMS Microbiol Lett, 364(21), fnx206. Misra, D. P., Ravindran, V., Wakhlu, A., Sharma, A., Agarwal, V., & Negi, V. S. (2017). Publishing in black and white: the relevance of listing of scientific journals. Rheumatol Int, 37(11), Nicholson, D.R. (2017). Predatory publishing practices: Is there life after Beall s list? LIBRES, 27(2), Shamseer, L., Moher, D., Maduekwe, O., Turner, L., Barbour, V., Burch, R.,... & Shea, B. J. (2017). Potential predatory and legitimate biomedical journals: can you tell the difference? A cross-sectional comparison. BMC Med, 15(1), 28. 6