Bacardi & Vodafone Case Studies : OnLine Archiving projects

Transcription

1 Bacardi & Vodafone Case Studies : OnLine Archiving projects November 22, 2007 Erwin De Smaele Presales Engineer - Applimation

2 Presentation Agenda Data Growth Challenges What s Online Archiving? Basics about Applimation & Informia Bacardi Case Study Vodafone Case Study 2

3 Data Growth Challenges Challenge: Manage the costs of data growth Growing storage costs Diminishing performance Increasing effort spent on maintenance & compliance Performance D A T A B A S E S I Z E Inactive data Active data Escalating costs T I M E 3

4 What s ONLINE Archiving? 1. Relocating history or non-critical data to separate archive database/schema 2. Garanteeing to end-users full and easy access of ALL data through SAME interfaces and reports Results Smaller Production Database Better Performance Smaller disk requirements for Production, Copies & Backups Easier to maintain (e.g. backups, migrations, etc.) 4

5 Basics about Applimation Headquartered in Chicago Founded in 1998 Data growth management software company Focus on enterprise applications Unified, integrated product suite (Informia) 3 main product lines : Archive, Subset & Secure Out of the box support for Peoplesoft, Siebel and Oracle Applications 5

6 Basics about Informia Online Archive Solution: Applimation Informia Use Archive to identify inactive data, honoring retention policy and business rules. Seamless Access Layer PRODUCTION DATABASE ONLINE ARCHIVE DATABASE Active Data Inactive Data Inactive Data (Read Only) Always Accessible No Developer Modifications Needed No Customizations Required 6

7 Online Archive Process Production AM AGENT Txn ID Transaction Table Date 01-JAN JAN FEB MAR OCT-2002 Status Closed Closed Open Closed Open Bus Rule #1 Bus Rule #2 Bus Rule #x 1. Optional Build Interim process Tables following and test archive against business rules Move Resize ONLY tablespaces rows based that on passed purged data business rules into Relocation Area Purge Reclaim additional Data from space Production from non-purged data 4. Merge Data to Online Archive 8. Right-size the underlying datafiles 5. Validate; with revised Drop Relocation growing room Area based on forward-looking retention policy Arch Flag Y N N Y N Archive / History APPLIMATION HOME HISTORY Tables RELOC Area 7

8 Bacardi Case Study

9 Bacardi s Context 50 entities worldwide submitting over a Global Network: Sales volume information monthly Financial information quarterly (monthly as of April 2006) Oracle GL is used for the financial consolidation of these 50 entities Oracle GL implemented in June 2001 History loaded into the GL back to 1998 Same chart of accounts and same calendar for all entities Challenge PERFORMANCE! 9

10 Bacardi s Performance Issues The GL Balances table had approx million rows of data Result : Slower processing for anything that hits the GL Balances table Discoverer, FSGs, Posts, Translations etc. Backups taking increasingly longer Disk space being used at an alarming rate Bacardi moving from quarterly to monthly financial consolidations in March 2006 so the data issue will only be compounded!! 10

11 Solution so far : Oracle GL Purge Bacardi was using the Oracle GL Purge to delete old Budgets Very slow must manually transfer purged transactions Bacardi has a modified version of the Oracle Purge program, utilizing a customized script to run it multiple times with different Budgets as parameters Maintenance windows decreasing therefore necessary to find efficient methods of purging and archiving Oracle Purge does not resolve the issue that Bacardi still had ACTUAL data back to

12 New Solution Oracle Consulting suggested Bacardi to look at a third party tool from Applimation called Informia Archive Discussing with Applimation, Bacardi understood that their issues were very similar to most GL customers Applimation proposed to save between % on performance to be proved during a test 12

13 Pilot of Informia Archive 5 days of consulting to install and run the pilot Comments from Bacardi: «Consulting was very professional and accomodating» Purged 19 million rows of old Budgets and archived 20 million rows of Actuals from 89 million rows in the GL Balances table Informia purge was 35-40% quicker than Oracle Purge 57.7% improved response time in Currency translation process 50.6% improved response time in FSGs 52.6% improved response time in MR Discoverer Queries Over 30% improvement overall!! 13

14 Progress to date - PRODUCTION Installed Archive Informia in Production Purged 23 million old Budget records Currently have +3 million more records to purge and growing 14

15 Next Steps Currently upgrading the GL to and the DB to Apply a small patch to Informia archive application (upload metadata for ) Archive database to be upgraded to match the GL database Continue to purge old budgets as part of an ongoing maintenance 15

16 Next Steps con t Develop an Archive Strategy Retention: Business requires last 3 years of data to be available and the remaining years to be archived All data has to be available though, for ad-hoc requests 95% of the time 3 years data is all that is required Frequency: Decisions include type of data (i.e. Budget, Actual), maintenance windows and resources Perform archive cycles of the Actual data to reduce the size of the GL Balances and supporting tables Important to implement this with monthly financial reporting on the horizon 16

17 Vodafone Case Study

18 Vodafone's Context Vodafone Czech Republic uses Oracle E-Business Suite OEBS modules : GL, AR, AP, CE, FA, PO, INV, OM OEBS v (DB 9i) live since September 2000 DB Size : over 400GB (in 2006) 18

19 Vodafone s Challenges Disk space requirements increased : High cost! VOILA project requiring 4 additional environments Import of SAZKA files (from 2004) leading to the increase of data growth per month (20GB). Performance impacted. Impossibility to find space for DB restoring in case of HW failure or necessity to restore data (audit) SOX obligations Two development environments : insufficient for SOX! Performance Financial department has issues during the month closing Technical statistical reporting too long IT Maintenance Clone of production environment takes more than 2 days 19

20 Challenge illustration : Performance Problematic long-time running maintenance for ex. gather schema statistics 20

21 Vodafone : Search for a solution Applimation Product Informia Archive is especially designed for archiving ERP/CRM and HR systems such as Oracle EBS Due to candidate generation rules ensures data consistency Possibility to display archived data through standard application/interfaces (no necessity for another GUI or custom reports) Solution from Oracle Based on Oracle Discoverer, without particular solution for EBS Disadvantage - longer time needed for implementation, higher costs, data displaying in another application (Oracle Discoverer) 21

22 Selecting Applimation s Informia Archive Achieving 2 times higher reduction of data in first year with Applimation No need special training for users to be able work with Archive with Applimation Out of the box solution rather than custom development of solution The Oracle implementation and support costs was approximately 30% higher than for Applimation 22

23 How is it implemented? Analysis Phase First : Perform a Data Growth Analysis (DGA) results Active Data 23

24 How is it implemented? Analysis Phase 24

25 How is it implemented? Archive Strategy Defining their Archive Strategy with the Business Community Retention Policy Which modules? AR and GL Active Data Cut-off line between Prod and Archive? 2 years live data Frequency How often do we wish to Archive? Yearly User Access Do we give access to all users? Selected only Which kind of access? Combined 25

26 BEFORE & AFTER THE ARCHIVE Table Name Before Removed After % Removed GL_BALANCES ,92% GL_IMPORT_REFERENCES ,90% GL_JE_BATCHES ,34% GL_JE_HEADERS ,04% GL_JE_LINES ,79% AR_ADJUSTMENTS_ALL ,00% AR_BATCHES_ALL ,46% AR_CASH_RECEIPT_HISTORY_ALL ,71% AR_CASH_RECEIPTS_ALL ,78% AR_DISTRIBUTIONS_ALL ,65% AR_MISC_CASH_DISTRIBUTIONS_ALL ,05% AR_PAYMENT_SCHEDULES_ALL ,91% AR_RATE_ADJUSTMENTS_ALL ,48% AR_RECEIVABLE_APPLICATIONS_ALL ,51% RA_BATCHES_ALL ,86% RA_CUST_TRX_LINE_GL_DIST_ALL ,51% RA_CUSTOMER_TRX_ALL ,44% RA_CUSTOMER_TRX_LINES_ALL ,46% Total ,51% 26

27 Creating the Access Layer How to access the relocated data? 27

28 Global Project Overview Project Timeline Installation and Training Install Run Sample Cycles Create Data Access Plan Next Steps Kick-Off Technical Sessions Module 1 Module 2 Module 3 Cycle Testing Hardware/ Software Configs Setups Validate DGA Train Archive User Review Business Rules Approve Business Rules Data Access Verif. Prod. Sims GO- LIVE Kick-Off Conference Room Pilot Refine Simulate Deploy 20-apr may ~ 6 Weeks ~ 6 Weeks 25-sep

29 Future plans Archiving further OEBS modules (early 2008) Order Management (ONT) Inventory (INV) Inactive customer data removal Keeping invoices in Archive due to Tax law Removal customer data from Live database / Data Privacy => compliance archiving solution 29

30 Archiving in Summary Relocation of seldom-used data from your ERP/CRM/HR system to an Online Archive Database Seamless Data Access allows users to access both current and archived data using the standard ERP application interfaces The process is fully driven by meta-data (accelerators) 30

31 A few other Informia customers City of Chicago 31

32 Thank you! Presales Engineer Erwin De Smaele 32