A public Benchmark Repository The added value of the ISBSG Ton Dekkers April 2008

Transcription

1 A public Benchmark Repository The added value of the ISBSG Ton Dekkers April 2008

2 Roles Galorath International Ltd Director of Consulting International Software Benchmarking Standards Group (ISBSG) Immediate Past President Project Management Institute (PMI) / Metrics Specific Interest Group (MetSIG) Director-At-Large ISBSG Common Software Measurement Int. Consortium (COSMIC) COSMIC Functional Size Measurement Method International Advisory Committee Netherlands Software Metrics Association (NESMA) Vice President

3 What we will cover Why does the ISBSG exist Members, structure & personnel How does the ISBSG work Products & Services What is in the repositories How we collect the data How to acquire the ISBSG repository ISBSG Data in SEER What can be achieved with the repositories

4 ISBSG Mission To help improve the management of IT resources by both business and government through the provision and exploitation of public repositories of software engineering knowledge that are standardized, verified, recent and representative of current technologies.

5 To cover the mission The ISBSG creates, builds, grows, maintains and exploits Repositories (databases) of data on Software Development Projects Maintenance & Support of applications Software Acquisition & Implementation Testing of applications A new body-of-knowledge with the potential to transform / improve the processes, relationships and structure of the Software Engineering Industry

6 Why end some projects like this?

7

8 The {bad / good} news Only 29% of IT-projects 2004 within time and budget (Chaos Report ) Source: Standish Group

9 Where are the ISBSG members

10 International Membership Current membership: Australia Japan, India, South Korea, China Finland, Germany *, Switzerland Netherlands, United Kingdom Spain, Italy, USA ** * German Speaking Software Measurement Association (DASMA) also represents Austria ** International Function Point User Group (IFPUG) also represents Canada, Mexico and Brazil

11 ISBSG Structure Members Board of Directors Vice President President Treasurer Past President Executive Officer

12 Principles of ISBSG Independence Not related to any commercial organization Data integrity Secret validation checks Anonymity Only the administrator knows Practitioner driven Contributions from practioners Practitioner accessible License structure (single user / corporate) Not for profit At cost price (research support)

13 Customers of ISBSG IT professionals require metrics data to support their business decisions (including outsourcing, off-shoring, and/or migration to new technologies) IT providers use the ISBSG data to validate project deliverables and cost when tendering. Software metrics practitioners Academic researchers and educational institutes

14 Sharing Knowledge Repositories (Data CD) Special Analysis Reports (pdf) Project Benchmarking Service Organizational Benchmarking Service The Benchmark Publications Practical Project Estimation (book) The Software Metrics Compendium (book) Estimation Course (material for members) Data available for research Software Benchmarking Standard (ISO draft)

15 ISBSG books & CD

16 Current Research Reports Web Projects how are they different? Techniques & Tools their impact Planning Projects - Role Effort Ratios Early Lifecycle Software Estimation Team Size impacts development productivity and delivery Software Project Costs Package Based Projects Estimates - how accurate are they?

17 Repository: Development Probably represents top 25% of industry Now has almost 5,000 projects 50% since 2001 Data from a wide range of: - countries demographics report (22 countries) - organizations communication, insurance, banking, manufacturing - application types management information, transaction, - development types: new, re-development and enhancement

18 Data collected Project ID + contact information Development type Size of software (functional units) Functional size measurement method (IFPUG, COSMIC, FiSMA, NESMA, Mk II,...) Total effort (hours) Implementation date Development duration Business sector (banking, insurance, ) Development language/tool(s) Platform type (PC, mid-range, mainframe) +++

19 Repository: M & S 180 applications, from 9 countries. For the Organization: - Overall productivity - Maintenance proportion - Minor enhancement proportion - Staff capacity - Organization defect density - Organization call rate - Programming language proportions - Database proportion - Effort per location - Effort per distinct user / concurrent user - Effort per installation - Effort per change

20 Data Collection (Current) Download from

21 Data Collection (Future) Web forms Repository Acquisition & Implementation Package SW Repository Testing

22 ISBSG Processes Tool: Crocus Editor

23 Data Collection Process Security Procedures Validation Procedures Repository entry Re-submission Re-rating and project update Incentive contributor Free Project Benchmark Report Free ISBSG publications for 5+ projects Free copy of the ISBSG Repository CD & free Benchmark report for 50+ projects Ability to benchmark your projects against others

24 Repository acquisition Single license Release 10, >4000 projects ISBSG direct ISBSG member site discount for members Corporate license R10 + additional projects / more data fields ISBSG direct Galorath incl. access to ISBSG add-ons in SEER format incl. access to ISBSG add-ons

25 Corporate Subscription - Usage The ISBSG data in the repository is used for: Best Practice Benchmarking Outsourcing Estimating Project Planning Project Control Validation & Verification ISBSG add-ons: Reality Checker Special Analysis Reports

26 ISBSG format

27 ISBSG SEER base format

28 ISBSG SEER filtering

29 ISBSG SEER Metrics Analysis & Trending

30 Example Project Variables Size Domain Language Platform Expectations 540 fp Business Cobol (3GL) Mainframe Constraints $ 750, Months Rate: $120 per hour

31 ISBSG Reality Checker

32 ISBSG Reality Checker Variables Expectations ISBSG Size 540 fp 540 fp Domain Business MIS Language Cobol (3GL) Cobol Platform Mainframe - Constraints $ 750, Months $ 787,920-2,428, Months

33 ISBSG Reality Checker (online)

34 SEER-SEM 7.2 (Quick estimate)

35 SEER-SEM 7.2 (Quick estimate) Variables Expectations SEER-SEM Size 540 fp 540 fp Domain Business MIS Language Cobol (3GL) Cobol Platform Mainframe - Constraints $ 750, Months $ 755, Months 5.9 Staff (peak)

36 SEER-SEM 7.2 (Optimized Cost) Variables Expectations SEER-SEM Size 540 fp 540 fp Domain Business MIS Language Cobol (3GL) Cobol Platform Mainframe - Constraints $ 750, Months $ 534, Months 3.5 Staff (peak)

37 SEM Estimate - Customer Date

38 Summary - ISBSG Strengths Not profit motivated Based on international co-operation Internationally based standards Allows direct access to its data it s an open data set Broad representation of IT technologies, organization types, geography Provides benchmarking Accessible by various tools

39 My preferred project end!

40 Questions! Answers?