Application of user statistics and additional data for collection management of Wageningen UR digital library

Similar documents
Complétez chaque énoncé. 1 more than 400 is. 10 more than 400 is. 100 more than 400 is. 10 less than 400 is. 1 less than 400 is. 100 less than 400 is

Advertising on. Ecommerce News. Rates & Guideline

Interpreting the data. Using statistics to support decision making

NOTICE TO EMPLOYEES OF APPLICATION FOR CERTIFICATION

REQUEST FOR EXPRESSION OF INTEREST (EOI)

Purchase flow. From the launch of a tender until payment

You ve Flipped: The Implications of e-journals as Your Primary Format

Procurement Plan for P (BRICKS)

PROCUREMENT PLAN. Period covered by this Procurement Plan: September 2017, June Preamble

LowesLink Spend Management (SM)

1. TRANSIT SERVICES BY-LAW AMENDMENTS (REGULATORY REQUIREMENTS FOR FARE INSTRUMENTS)

Risk Management Gestion Des Risques En Entreprise Banque Et Assurance Management Sup

Study of the Ability of Knowledge Management and the Construction of Wisdom Capital

customs GES Customs Services Reliable and Efficient Service Value Added Service Personalized Service On-Site Representation Simplified Ordering

Wageningen UR (University & Research centre)

Real-Time Marketing Approach. Putting Information Into Action

2 Report to/rapport au :

SUBJECT: Additional Information Related to Requisitions Page 1 of 29 TABLE OF CONTENTS. Overview of the Requisition Structure... 2

Proposal for Cumulative Effects Assessment (CEA) in Air Approvals

RSM JOB BOARD. Company Manual - RSM Career Services job board. Contents

Marie Skłodowska-Curie Actions

AbacusNext Account Portal User Guide December 2018

North America Online Payment Methods First Half Table of Contents

GES Customs Services. Reliable and Efficient Service. Experienced and reliable staff you can depend on who specialize in clients a one

Managing the Acquisition of E-resources

How to work from subscriptions agreements to OA business models

Division of Macro-economic Statistics and Dissemination Publication and communications department COMMENTS. Ron Vellekoop

Microsoft Dynamics GP. Fixed Assets Management

No * Netherlands (for the European part of the Netherlands) and France

Three S s of Electronic Resource Management: Subscriptions. Oliver Pesch Chief Strategist, E-Resources EBSCO Information Services

Official name: European Railway Agency Postal address: 120 rue Marc Lefrancq Town: Valenciennes Postal code: 59300

November Video Interviewing Integration with TalentLink & easyrecrue

TERMS OF USE FOR UNIFI MOBILE #BEBAS BILLING FOR GOOGLE PLAY

Workflows for Evaluating Systemwide Ebook Offers Prepared by the CLS Ebook Framework Lightning Team Report endorsed by CLS on April 25, 2014

Reading Sample. Banking. Contents. Index. The Authors. First-hand knowledge.

Procurement Plan for P (BRICKS)

Keyword Analysis. Section 1: Google Forecast. Example, inc

SAGE White Paper on Discoverability in the Twenty-First Century: Collaborative Opportunities for Publishers, Vendors, and Librarians

University of North Dakota PeopleSoft Finance Tip Sheets. Vendor Payment Inquiry

Le Must-Have The Boostzone curation of reports, posts and articles for the Augmented Manager

#EMEARC16. TU Delft Library

GE Corporate Treasury. estatements in Web Cash

You get no more out of an ERM than you are willing to put in. -Donna Ekart. NISO Forum E-Resource Management: From Start to Finish (and Back Again)

TRAVEL IMPRESSIONS Galileo e-agent Vendor Update Advisory Date: March 7, 2006

De nombreux succès ont marqué cette décennie.

PROCUREMENT PLAN. Period covered by this Procurement Plan: March 22, 2017 December 12, Preamble

XYLOPHAGOUS BEETLES AS INDICATORS FOR LONG-TERM TIME AND SPACE CONTINUITY OF FOREST HABITATS? PRELIMINARY PROJECT REPORT

Library Automation: A Case Study of the Central Library of BGS Institute of Technology, BG Nagara

Droits et conditions de travail des employés des agences de location de main-d'oeuvre

Munis Capital Assets. Procedural Documentation. For more information, visit

CASE STUDY ON PRODUCTIVITY OF WATER SUPPLY POTENTIALS ETUDE DE CAS SUR LA PRODUCTIVITE DU POTENTIEL DE LA FOURNITURE D EAU

Administrative Monetary Penalties Process Guide

Advertising on. Ecommerce News. Rates & Guideline

BA 302: Microsoft Dynamics NAV ERP Exercise/Walkthrough

Online Payment User Guide (For Students)

Dessler Human Resource Management Chapter 14

Canadian Centre for Occupational Health and Safety

Infor10 ERP Enterprise (LN) User's Guide for Procurement

The Evolution of a New World Order: How and Why UCLA Drew the Line between "P" and "E"

 COMPUTER PROGRAM FOR THE CALCULATIONS IN THE CSA STANDARD Z "PROCEDURES FOR THE MEASUREMENT OF OCCUPATIONAL NOISE EXPOSURE"

Intota Training Session Module #1

Providing climate change scenarios for end-users,

SUPERVISING LIBRARY SPECIALIST (ACQUISITIONS/PROCESSING) MATERIALS MANAGEMENT DIVISION CENTRAL SANTA ROSA LIBRARY

PharmaClik POS Overview

CARACTÉRISTIQUES AVANTAGES. TEST DU FER en attente de brevet

Appel d'offres général ECCFIN/R4/2010/001

New World Technologies, Inc Invoice Importer

KEYING AN INVOICE IN MUNIS

2. Approve that there be no further notice pursuant to Section 34 (17) of the Planning Act.

By-Law Number 9 Concerning Procurement Contracts for Goods, Services and Construction

Fort Bend ISD Summer School

SCP-Embraer Train the Trainer. Commercial Invoice

Report to Rapport au: Agriculture and Rural Affairs Committee Comité de l'agriculture et des affaires rurales 24 November 2016 / 24 novembre 2016

The following employment package contains information to apply for the Coordinator, Harm Reduction Home and Off the Street Emergency Shelter position

Marketing Mobile with Mobile: Lessons in Strategy

Banking at the speed of your life. Online. Mobile. Superior. Safe. PARKSTERLING. Answers You Can Bank On.

REQUEST FOR EXPRESSION OF INTEREST (EOI)

Mobilizing wood or forest owners?

WELCOME TO THE WORLD COCOA FARMERS ORGANIZATION (WCFO)

The New Face of Technical Services: Opportunities and Challenges in the Cloud

DOWNLOAD OR READ : THE THEORY OF BIMETALLISM AND THE EFFECTS OF THE PARTIAL DEMONETISATION OF SILVER ON ENGLAND AND INDIA PDF EBOOK EPUB MOBI

Aquaculture products prices on the Paris market

Ad Tech Ecosystems and Challenges. Pooja Nayak VP, Director for Ad Tech

Report to / Rapport au : Council / Conseil. 1 June 2011 / le 1 juin 2011

IntegraPay + Xero. Setup guide

TALANGAI, Congo, Rep of the

State Automated Additional Pay System Guide Primary Job is Staff no Faculty Appointment

NEED HELP GETTING STARTED? Set Up Product Guide

Usability Validation of Electronic Resources Management System (Annual Report: FY2017)

Responding to Unsustainable Journal Costs A CARL Brief

NEGOCIATIONS SUR LES MARCHES PUBLICS. Offres

Loading your product data into ECCnet, Canada s National Product Registry using ECCnet ProSYNC Basic Small Business Service

SUBJECT: Additional Information for Voucher Workflow Page 1 of 22 TABLE OF CONTENTS. Supporting Documentation Required for Vouchers...

Union is strenght. The System Bibliosan in the outline of the Italian biomedical research

THE NEXT INDUSTRIAL REVOLUTION How E-commerce is transforming B2B

Establishment of LMD-Aligned Master programme in post-conflicts countries of Eastern, Central and Southern Africa

Microsoft Dynamics GP. Field Service Returns Management

EUROPEAN COMMISSION DIRECTORATE-GENERAL FOR AGRICULTURE AND RURAL DEVELOPMENT

Digital Media Mix Optimization Model: A Case Study of a Digital Agency promoting its E-Training Services

This document is a preview generated by EVS

Transcription:

Application of user statistics and additional data for collection management of Wageningen UR digital library.~. Marco G.P. Van Veller, Ger Spikman Wageningen UR Library, the Netherlands marco.vanveller@wur.nl ger.spikman@wur.nl, http://nl.linkedin.com/in/gerspikman Abstract Good collection management is necessary to guarantee the quality, quantity and costs of the online journal collection of Wageningen University and Research Centre (Wageningen UR) Digital Library. Via quantitative research on both subscription prices and usage statistics (i.e. down load data from vendors of online journals and clickthrough data statistics from the library's SFX link resolver) the library obtains data that are helpful to decision making regarding cost-effectiveness of online journals. By calculation of the price per article down load for each online journal and holding this against the costs of document delivery from outside the library, a selection of online journals with a low cost-effectiveness is possible. These online journals can further be examined for cancellation. Via optimization to cost-effective online journals only, Wageningen UR Library strives to give access to scientific literature that is important ('need to have') to the users and researchers of Wageningen UR while keeping the costs of the subscriptions into the financial budget. Keywords Digital library, Collection management, User statistics, Journal subscriptions, Prices L ' I ST D ANS L 'U NI V ER S N UMERI Q UE : M ESURE S ET U SA GE S 269

Resume Application des statistiques utilisateur et autres donnees pour la gestion de la collection de la bibliotheque numerique Wageningen Une bonne gestion des collections est necessaire pour garantir la qualite, le volume et le coot des collections de revues electroniques de la bibliotheque de I'universite de Wageningen. En associant, dans une methodologie quantitative, les coots des abonnements et les statistiques d'utilisation (donnees de telechargement en ligne fournies par les editeurs et celles du resolveur de liens SFX de la bibliotheque), la bibliotheque dispose de donnees et d'indicateurs sur une analyse de type coot-efficacite des revues electroniques. En calculant le prix du telechargement par article de chaque revue en ligne et en le comparant au coot de sa fourniture ponctuelle (FDD, PPV), il devient possible d'identifier les titres ayant un faible rapport coot-efficacite, et par la meme occasion de s'y desabonner. Par cette methode, la BU de l'universite de Wageningen s'efforce de donner acces El une large collection de revues, indispensables aux usagers, tout en tenant compte des budgets alloues. Mots-cles Bibliotheque electronique, collections, statistiques, abonnements, revues, coots-efficacite, bibliotheque Marco VAN VELLER est bibliothecaire specialise en ressources electroniques a la bibliotheque universitaire de Wageningen, aux Pays-Bas. Ger SPIKMAN est bibliothecaire a I'Universite de Wageningen, aux Pays-Bas. 11 est actuellement directeur du departement des acquisitions et de la gestion des ressources documentaires.

Application of user statistics and additional data... Wageningen University and Research Centre (or Wageningen UR) is an education and research organization in the Netherlands that includes a university, polytechnic college and several research institutes. The main topics for the educational programs and research activities at this organization all deal with "the quality of life" and are concentrated around the following three themes: food and food production, living environment and health, lifestyle and livelihood. For almost 9500 BSc and MSc students and more than 7000 staff positions, Wageningen UR Library gives access to both digital and hardcopy versions of scientific literature, especially in the fields of Agrotechnology, Food Sciences, Plant and Animal Sciences, Soil Science, Geo-information, Landscape and Spatial Planning, Water and Climate, Ecosystem Studies and Social Sciences. The services of the library are not restricted to staff and students. All locations of Wageningen UR Library are also open to the general public. Wageningen UR Library has one main location at the university campus and a few satellite libraries at research institutes and experimental stations that are distributed over the Netherlands. At its main location in Wageningen, the library holds approximately 38000 publications in it's (publically accessible) stacks and approximately 600000 publications in it's (publically closed) depot. Besides physical libraries with collections of (e.g.) books, journals and reports, Wageningen UR Library also holds a digital library with access to online resources that are possessed by the library or to which the library subscribes. Online resources that can be accessed via the digital library can be (a.o.) research reports, MSc or PhD theses, websites, databases (mostly bibliographies), electronic books or online journals. Especially, the last five years the number of electronic books that are available via the digital library grew substantially. For subscriptions to online journals, the growth started earlier at the end of the 20 th and beginning of the 21S t century. Currently, Wageningen UR Library holds around 15000 electronic books and subscribes to more than 8000 online journals (see figure 1). Whereas expenses for electronic books are (in most cases) made only once, for periodicals (like online journals) expenses are made every year for subscriptions. I n order to spend the library's budget on journals most efficiently, good collection management on online journals is essential. This paper discusses how Wageningen UR Library monitors prices to journal subscriptions and usage in order to select expensive journals with low usage that are candidates for cancellation. The monitoring information is used for decisions in collection management and optimization of the collection towards cost-effective online journals. L ' I ST D A N S L ' UNI VE RS NUMERIQUE: MES UR ES ET USA GES 271

Chapitre 16 FIGURE 1 - CUMULATIVE NUMBER OF E-BOOKS AND ONlINE JOURNAL SUBSCRIPTIONS * AT WAGENINGEN UR LIBRARY FOR THE LAST EIGHT YEARS -e.joumal swscliptions - e-book ti~ es 16000 14000 ~ 12000 ~... ~ 10000 Cl t ~ 8000 i 1 6000 a 4000 2000 o L '" 2002 / / L./..--7 / / / / / ---- 2003 2004 2005 2005 2007 2008 2009 year *For the online journals, subscriptions are only taken into account when the starting year of the subscription to the journal by Wageningen UR Library is known, 1. Online journal subscriptions at Wageningen UR Library Currently, Wageningen U R Library has 9003 online journal subscriptions, Generally, for these online journals, two categories of subscriptions can be distinguished: journal subscriptions in package deals or separate journal subscriptions, Wageningen UR Library subscribes to a tota l of 8147 journals in 37 packages with various vendors, For the majority of these journals, subscription is arranged in 'big deals': 7892 journals in 20 packages, The contents and price of these 'big deal ' packages are negotiated between the vendors and a Dutch consortium of 13 university libraries (of which Wageningen UR Library is one partner) and the National Library of the Netherlands, Besides the journals in the 'big deal' packages an additional number of 255 journals come in 17 other packages for which Wageningen UR Library negotiates directly with 272 L ' I ST D ANS L ' U N I V ERS N U MER I Q UE : M ESURES ET USAGES

Application of user statistics and additional data... the vendors. During the negations with a vendor, both the number of journals in a package (which varies between 2 and more than 1500 for the current journal packages to which Wageningen UR Library subscribes) and price for the package is settled for a certain number of years. The result is that for most vendors the contents of the packages is fixed and cannot be modified on a yearly basis; for additional journals separate subscriptions have to be started. Only for a few packages modifications in journal contents is possible. Besides subscriptions to journals in packages, Wageningen UR Library holds 856 subscriptions to separate journals. For each of these journal subscriptions, the price is negotiated with its vendor (which frequently is a publisher or scientific society) separately. For the separate journals the library holds subscriptions with 391 different vendors. For 72% of these vendors Wageningen UR Library subscribes to only a single journal that the vendor gives access to. Subscriptions to separate journals can often be started or cancelled on a yearly basis which makes them suitable for monitoring and deselection of expensive journals for cost-effective management of online journal subscriptions. Although 'big deals' will only be subscribed to if the contents of the package is of real importance to the library, it is obvious that the expenses made for them put the budget for the rest of the online journal collection under pressure. 2. Estimation of current prices for journals Table 1 shows the share in expenses that are made in 2009 on online journal subscriptions in packages as well as for separate journal subscriptions. From the table it follows that package deals dominate in the subscriptions to online journals for Wageningen UR Library. Together, the packages contain 90% of the journal subscriptions and share also 90% of the total costs made on online journals in 2009. The average paid price per journal subscription for separate journals is much higher than for journals that are part of a TABLE 1 - EXPENSES* IN 2009 ON AND NUMBER OF SUBSCRIPTIONS IN PACKAGES AND SEPARATE JOURNALS Share in total costs Number of journal Average paid price for online journals subscriptions per subscription Packages 90% 8147 212,- Separate journals 10% 856 491,- Total 9003 239- *Calculations based upon invoices paid to vendors between January and September 2009. L' I ST DANS L' UNIVERS NUMERIQUE MESU RE S ET USAGES 273

Chapitre 16 package deal. For journals that are part of a package deal the average pa id price is calculated by diving the total package price by the number of journals that are included in the package. This average price per journal is much lower than the price that would have to be paid if the library subscribes to the journal separately. As discussed above, however, only for journal subscriptions that are not part of a package deal between Wagen ingen UR and a vendor (i. e. the "separate journals") cancellation of most expensive subscriptions with low usage is possible. It is for this reason that a ranking needs to be made based upon prices and usage for these journal subscriptions. Hereby, it is important to use current prices per journal subscription. For the registration of journal subscriptions, Wageningen UR Library uses a database, named Cardex, which is part of our library content management system This database contains per journal subscription information on the journal title, print and online ISSN, estimation of the price (based upon indexed prices from last year(s», paid invoices per year, vendor, etc. From Cardex a selection can be made with estimated (indexed) prices per journal subscription and paid invoices over the current year. Paid invoices over the c urrent year are representative for current prices per journal subscription. Paid invoices over the current year, however, may contain corrections with payments of earlier years. Moreover, the amount of expenses on paid invoices are not complete when current prices per journal subscription need to be known before the end of the year. It is for these reasons that the paid invoices over the current yea r need to be corrected. Figure 2 shows the paid invoices, over 2009, for separate journal subscriptions against the estimated prices for these journal subscriptions in September 2009. The red line in this figure represents the relation between the paid and estimated price. From a regression analysis on the data in figure 2 the following relationship between paid and estimated prices can be derived: With p. 2009 = (0.9812 *p.. )' + 35.151 ~J, ~J Pi,j,2009 = Predicted price for subscription i of journal j in 2009 Pi,j = Estimated price for subscription i of journal j, based upon an indexat ion of mean prices over earlier years 274 L' I ST D ANS L'UN I V ERS NUMERIQ UE : M ESUR ES ET U SAG ES

Application of user statistics and additional data ", The price per journal subscription in 2009 is predicted with this relation from the estimated price that is listed in Cardex for each journal subscription separately, In order to obtain current prices per journal, the predicted prices for all subscriptions need to be summed: With {l ~ P, 2009 = LPi '2009 j, i_1,j. P j,2009= Current price for journal j n = number of subscriptions i to journal j Sometimes, one (or more) of the subscriptions of a separate journal is also part of a package deal. I n this case the price per journal for the package (obtained by dividing the total paid price for the package deal by the number of journals in this package) is included in the summation to obtain the total price for all subscriptions of the journal. FIGURE 2 - PAID PRICES AGAINST ESTIMATED (INDEXED) PRICES FOR ONlINE JOURNAL SUBSCRIPTIONS. ONLY PRICES FOR SEPARATE JOURNAL SUBSCRIPTIONS THAT DO NOT COME IN A PACKAGE ARE CONSIDERED 7,000,---------------------- 6,000 +--------------------- 5,000 +--------------...-----,--~'---- 11 E ::I,!!. 4000 ++-----------=----:;;;"'------ t... fl ' ':i 3,000 +-----=------~+---------... 'ii c. 2,000 +---------=>~------------- + 1,OOO +--~_.,---------------- O O 1,000 2,000 3,000 4,000 Elllimllled price per journlll 5,000 6,000 L'IST DAN S L'UNIVERS NUMERIQUE : MESURES ET USAGES 275

Chapitre 16 3. Journal usage data Access to online journals to which Wageningen UR Library subscribes is possible for licensed users via the digital library (see introduction). In general, the users can obtain articles, published in online journals, from the vendors website via four different pathways: - via the catalogue of Wageningen UR Library, - via a (bibliographical) database, - via internet (e.g. Google Scholar), or - directly via the journal website. When consulting the library catalogue, a (bibliographical) database or using Google Scholar for access to articles, the user gets access to the online journal by clicking on a Get it! button that appears for every record in the catalogue or journal to which Wageningen UR Library subscribes. After clicking on the button, a SFX-menu is shown in which the user can fill in the volume, issue and start page of the article that is needed. After further clicking on a Go button in the SFX-menu the user is directed to the vendors (or publishers) website where the requested article can be downloaded if the user is licensed (i.e. student of staff member of Wageningen UR). The clicks in the SFX-menu on the Go button for obtaining an article are counted per journal as "clickthroughs" and give an indication of the use of online journals via the Wageningen UR Library. Articles in online journals, however, can also be obtained within the network of Wageningen UR by directly going to the website of the journal. The latter is done when users know where to find the online journal on the internet or when they received alerts on new articles in the journal with direct links to the journal website. There may be also other cases of direct access to articles in online journals. In all these cases of access to articles by directly going the website of the journal the SFX-menu is not shown and no clickthroughs are counted. Independent of the used path for access to the online journals (via the catalogue, a (bibliographical) database or directly the journal website), articles need to be down loaded from the vendors (or publishers) website. Often, these article downloads are counted per journal for all licensed users from Wageningen UR and can be obtained in reports from vendors that make them available. These counts of article downloads give the most precise and complete indication of online journal use. 276 L'IST DANS L'UNIVERS NUMERIQUE: MESURES ET USAGES

Application of user statistics and additional data... 4. Selection of expensive journals with low usage Figure 3 gives the distribution of the average price per journal for vendors of separate journals to which Wageningen UR Library subscribes. For the selection of journals that are not cost-effective (i.e. expensive journals with low usage) one can start with the journal subscriptions from vendors with the highest average price per journal and collect usage data for these journals to order to assess their cost-effectiveness. FIGURE 3 - DISTRIBUTION OF PRICE PER JOURNAL PER VENDOR FOR 391 VENDORS WITH IN TOTAL 856 JOURNALS TO WHICH WAGENINGEN UR LIBRARY SUBSCRIBES SEPARATELY 120 100 +-------- I 80+-------- ~ ~ 60+-------- I i! 40 +-------- 20+-------~ pice per jou"n1l1 The 50 vendors with the highest average price per journal give access to 125 journals together. For half of these journals counts of article down loads can be obtained from the vendors. For the other half of the journals a further estimation on usage needs to be made since no down load data are available. Figure 4 shows the number of downloads against the number of clickthroughs for 62 journals from vendors with the highest average price per journal. The red line in this figure represents the relation between the number of downloads and clickthroughs for these journals. From a regression analysis on the data in figure 4 the following relationship between the number of down loads and number of clickthroughs in 2009 can be derived: L'I ST DANS L'UNIVERS NUMERIQUE: MESURES ET USAGES 277

Chapitre 16 LI 2009 =7.2273*C ')009 j, j,,-, With D j,2009 = Predicted number of down loads for journal j C 2009 = Counted number of clickthroughs in SFX-menu for journal j j, For the journals for which the vendors do not provide any article down load data the number of downloads in 2009 is predicted via this relationship. FIGURE 4 - NUMBER OF DOWNLOADS AGAINST NUMBER OF CLlCKTHROUGHS FOR ONLlNE JOURNAL SUBSCRIPTIONS FROM VENDORS WITH THE HIGHEST AVERAGE PRICE PER JOURNAL. ONLY SEPARATE JOURNAL SUBSCRIPTIONS THAT ARE NOT PART OF A PACKAGE DEAL ARE CONSIDERED 35000 30000 III 25000 'ti 1/1 0 i 20000 0 'ti '15... GI ~ :::I c 15000 10000 5000 0 0 500 1000 1500 2000 2500 3000 3500 4000 number of clicklhroughs With the (predicted) current price and the (counted or predicted) number of article down loads a measure for the cost-effectiveness of an online journal is the price per article download. By calculation of this measure and listing the journals starting with highest price per article download, the least cost-effective online journals can be selected. In case the number of article down loads is zero, cancellation of the online journal subscriptions needs to be considered since there is no indication of any use on these journals. For the online journals with a high price per article down load one may also consider cancellation if delivery of articles from other libraries is less expensive than the price per down load which is measured. 278 L'IST DAN S L'UNIV ERS NUMERIQUE: MESURES ET USA GES

Application of user statistics and additional data... For the 125 online journals from the 50 most expensive vendors, 10 journals did not have any article down loads in 2009. Further, another 22 online journals have a price higher than 6.50, which is the price for article delivery from Wageningen UR Library to another library. These 32 journals, that show the lowest cost-effectiveness, will further be examined for cancellation. 5. Concluding remarks The methodology described above can be used to get an impression on the cost-effectiveness of online journals based upon currently paid prices for their subscription and current usage data. By calculation of the price per down load for each journal a decision measure is provided for selection of low cost-effective journals. Additional examination of these journals before cancellation of their subscription, however, is very important since there may be additional reasons to have these journals in the collection of Wageningen UR Library. A variant of the above described methodology is used for judging ('big deal') packages. In this judgment, the total usage of each package is held against the paid price of the package. The price per article down load for the journals in the package is calculated to assess cost-effectiveness. In addition to the price per article download, also the total expenses for subscribing to the 'need to have' journals from a package is calculated and held against the paid price for the package to control whether the package still is cost-effective for the library. Hereby it is important to make sure that long term commitments to vendors of 'big deal' packages will not be a threat to the online journal collection as a whole. L I ST DANS L UNI V ER S NUMERIQUE: MESURES ET USAG ES 279