Whitepaper. Offshoring ETL Development in EPM projects YOUR SUCCESS IS OUR FOCUS. Published on: JANUARY 2007 Author: PEOPLESOFT PRACTICE

Transcription

1 YOUR SUCCESS IS OUR FOCUS Whitepaper Published on: JANUARY 2007 Author: PEOPLESOFT PRACTICE 2009 Hexaware Technologies. All rights reserved.

2 Table of Contents 1. Introduction 2. Subject Clarity 3. Problem Definition Re-Statement 4. Offshoring Challenges 5. Solution Proposition 6. Technology Proposition 7. Potential Benefits Author s Bio Sample Content 2009 Hexaware Technologies. All rights reserved. 2

3 1. Introduction A significant portion of the total effort in EPM (Enterprise Performance Management) projects is concentrated on data acquisition with significant trends in recent times to offshore the development and testing. 2. Subject Clarity Around 70 % or more of the total effort in PeopleSoft EPM projects is concentrated on data acquisition. A significant trend in recent times is to offshore the development and testing of ETL mappings. ETL (Extract, Transform, and Load) development projects place a particular emphasis on quick turnaround, optimal performance and iterative development. For most EPM initiatives, the data integration effort is always identified as being of key importance. Hence it becomes extremely important that this part executes smoothly and with utmost efficiency, coordination and cost effectiveness. 3. Problem Definition Re-Statement KNOW-HOW Most shortcomings in EPM projects arise from the lack of understanding of the end-users experience in the handling of application and data. Better insight into data usage and query performance can lead to faster resolution of performance bottlenecks, significant improvements in service levels and productivity, and reduced data management costs. COST The cost savings aspect of offshore sourcing can be irresistible, especially with pressure coming from the top management of the organization to do more with less. This requires the optimum balance of effort between onsite and offshore resources without compromising on the seamlessness of delivery and the quality. OFFSHORE PERFORMANCE As companies continue to rely on outsourcing and off-shoring services to third party vendors, managing and monitoring the performance of these vendors and outsourced projects is becoming a top priority. Outsourced services promise a myriad of benefits--cost savings, improved service levels, and extended knowledge base. However in order to achieve these benefits, companies need to monitor their outsourcing vendors and projects to ensure successful relationships and services. RIGHT-SHORING Having the Right mix The right mix of offsite and offshore effort delivers high quality results while mitigating risk. The first step is to establish asound development methodology and risk mitigation strategy. 4. Offshoring Challenges Challenges at Offshore include: Aggregating data coming from a large number of different sources. Proper understanding of the end users requirements Handling Unreasonable timelines Coordination with Onsite team 2009 Hexaware Technologies. All rights reserved. 3

4 5. Solution Proposition Risk Mitigation Poor Data Quality causing slippage in delivery Mitigation: An efficient effort tracking and defect prevention process in place to ensure that the gaps in the process are identified in time and timely action taken to mitigate slippage. Incomplete design documentation Mitigation: A Requirements review phase at offshore allows the developers to identify the areas that need to be explicated further. Hexaware utilizes a mapping development methodology that breaks down the components of the ETL into manageable pieces. This allows offshore to proceed with development even as the requirements are sent to the onsite team for clarifications. Unstable offshore project team Mitigation: Backups for individual developers ensure that no single member of the team is indispensable. There is a continuous process cross training within the offshore development team so that there are backups for each individual and the development is not heavily dependent on one single resource. Quality of deliverables Mitigation: A thorough QA and Review process is performed before offshore delivery. There is an extensive peer review checklist, test cases and test plans for developer testing which is then followed by a stringent Quality Assurance process in all projects to ensure that the deliverables are bug-free, timely and of the best quality. Reduction in Offshore Challenges Aggregating data coming from a large number of different sources Issue managed through effective communication with the various data teams involved. Proper understanding of the end users requirements A proper communication process is needed with emphasis on weekly sessions covering both functional & technical aspects to have a good interaction with the end users Handling Unreasonable timelines These situations can be avoided by ensuring that the estimations for the tasks are done in a scientific manner by utilizing the effort tracking sheets and arrive at a reasonable timelines. Whenever there is a concern of slippage due to reasons outside the control of the ETL development team, the concern is highlighted in front of the client well in advance so that there is a backup plan for such situations. Coordination with Onsite team Team members encouraged to over-communicate all project related issues. Daily updates through various media such as s and conference calls are desirable. The diagram below depicts the processes in a typical onsite- offshore ETL development project. These processes address the risks and incorporate the mitigation strategies outlined above. The methodology, though complex, is supported by a number of tolls and templates that allow Hexaware to deliver medium-complexity mappings within three days. The typical ETL development cycle goes through two-three iterations before the ETL is ready to be run on production data. Hexaware s methodology cuts the time on every subsequent iteration and the final iteration is usually completed within a day Hexaware Technologies. All rights reserved. 4

5 Source system file Data team reviews OWS request to ETL team Create tables Data Incorrect ETL Development- ETL team reviews specs and Data Analysis by data team Data ETL team incorporates performance enhancing techniques Review data file Validate header and trailer in file Resolves open issues and clarifications Develop job and perform business transformation and lookups Reports used for decision Move to UAT Reporting team creates Performance enhancing ETL Implementation Process The complete ETL implementation comprises of the following steps: Datastage installation: Server or Parallel jobs server installation and administration related activities by the system administrator Operational Warehouse-staging layer (OWS) tables loaded from the external source systems through staging jobs Dimension mapper jobs run as part of the dimension mapping process Operational Warehouse Enriched layer (OWE) tables loaded from the staging tables after performing the required validations/mappings and transformations based on the business requirements Multi-dimensional warehouse layer (MDW) tables loaded from the staging tables or OWE tables (as applicable) after performing the validations/mappings and transformations as per the requirement. These tables are then used in the reporting layers to build the required reports Handling support and maintenance related activities after the system has been rolled out into production A number of jobs are pre-packaged like the dimension mapper ETL jobs which account for major development time savings. The job scheduling is also be handled by the inbuilt utility Master RunUtility. Other third party tools like Control M are also supported for scheduling Hexaware Technologies. All rights reserved. 5

6 6. Technology Proposition Hexaware proposes IBM Websphere Datastage as the tool to be used for ETL. Being packaged free with Peoplesoft EPM it has the cost factor going for it. It comes with a comprehensive suite of pre-delivered ETL jobs which substantially reduces the time to market during the development. The latest Gartner report rates IBM Websphere Datastage as a premier ETL tool in the market today. Refer to the diagram for the comparison between the different technologies in the same space. Challengers leaders Informatica ability to execute Business Objects Pervasive Software Microsoft Ab Initia Oracle iway Software SAP Sybase Tibco Software Sun Microsystems Cognos ETI Group 1 Software Embarcadero Technologies IBM niche players visionaries completeness of vision Source Gartner (November 2006) As of November Potential Benefits Hexaware Technologies has specialized in the provision of ETL (Extract, Transform & Load) services that ensure the loading of both structured and unstructured data in an optimized manner. Whether it is designing ETL architectures or creating data flows through that framework, Hexaware consultants support every aspect of the ETL process through value-added integration and implementation tactics and support. Our consultants and ETL developers are equipped with exemplary skills in Designing data acquisition process architecture & transformation processes Interpreting, confirming, and modifying data acquisition specifications with business users Refining extraction routines Working with source system experts to define the system of record, develop and test the batch procedures Magic Quadrant for Data Integration Tools, Hexaware Technologies. All rights reserved. 6

7 To learn more, visit Address 1095 Cranbury South River Road, Suite 10, Jamesburg, NJ Main: Fax: Safe Harbor Certain statements on this whitepaper concerning our future growth prospects are forward-looking statements, which involve a number of risks, and uncertainties that could cause actual results to differ materially from those in such forward-looking statements. The risks and uncertainties relating to these statements include, but are not limited to, risks and uncertainties regarding fluctuations in earnings, our ability to manage growth, intense competition in IT services including those factors which may affect our cost advantage, wage increases in India, our ability to attract and retain highly skilled professionals, time and cost overruns on fixed-price, fixed-time frame contracts, client concentration, restrictions on immigration, our ability to manage our international operations, reduced demand for technology in our key focus areas, disruptions in telecommunication networks, our ability to successfully complete and integrate potential acquisitions, liability for damages on our service contracts, the success of the companies in which Hexaware has made strategic investments, withdrawal of governmental fiscal incentives, political instability, legal restrictions on raising capital or acquiring companies outside India, and unauthorized use of our intellectual property and general economic conditions affecting our industry Hexaware Technologies. All rights reserved. 7