THIS ADDENDUM IS FOR THE PURPOSE OF MAKING THE FOLLOWING CHANGES OR CLARIFICATIONS

Transcription

1 Procurement Bid Office Customer Center 1 st Floor, Room W. Church Street Jacksonville, Florida ADDENDUM NUMBER: One (1) February 20, 2019 TITLE: Data Integration and Virtualization Solution JEA RFI NUMBER: RESPONSE DUE DATE: February 22 nd, 2019 TIME OF RECEIPT: 12:00 PM TIME OF OPENING: 2:00 PM THIS ADDENDUM IS FOR THE PURPOSE OF MAKING THE FOLLOWING CHANGES OR CLARIFICATIONS Add (1): JEA adds the following questions and answers to this Solicitation. Virtualization is stated on page 2: Was that intended to be visualization as in analysis or virtualization? Please provide context for either. JEA Response: It is intended to be Virtualization: Is Cloudera already implemented or are you still evaluating other potential distributions? How many nodes are in your existing cluster? JEA Response: Our big data environment was evaluating it in a pilot environment that included 3 nodes. Long term decisions have not been made regarding this environment. Key Stakeholders / Sponsor (Roles / Responsibilities) JEA Response: This has not been defined at this time. Budgeted / Seek budget? JEA Response: There is a combined tentative budget of approx. 1.1 million to explore and pilot modern data integration and virtualization toolsets. This budget may fluctuate depending on business needs and value What are you using today to accomplish the scope provided? JEA Response: We currently have multiple legacy ETL tools in place to facilitate traditional data movement to our data warehouse environment and SOA services for point to point interfaces. The future scope will focus on creatation of a centralized data hub for provisioning data for analytics What do you like / don t like about it JEA Response: We would like a consolidated integration toolset that will offer a broader approach to pulling data (real time, close to real time, batch, event, etc) from a variety of different data sources.

2 Existing integration tools JEA Response: OWB, OBIEE and SOA services utilizing Existing visualization tools Tableau In house development team o Size JEA Response: 5 ETL developers. 3 SOA services developers Experience / Proficient in Java / Hadoop / Etc. JEA Response: Limited Data Sources outside of AWS / Cloudera / Oracle Cloud? JEA Response: Legacy transactional systems, time series data sourc. Why the change and why now? JEA Response: We would like a consolidated integration toolset that will offer a broader approach to pulling data (real time, close to real time, batch, event, etc) from a variety of different data sources. In addition, we are looking to provision large volumes of data as needed and improve data quality, security and timeliness Decision timeline / Project go-live timeline JEA Response: Decision within 6 month. Project go-live TBD. Specific Use cases you the will be using data integration to address? JEA Response: Varies. How Functional use cases is the primary focust End user deployment: JEA Response: The long term plan is to have customer s primarily interface with our data hub through the Data Virtualization layer via whatever Analytic App they are using. How many? / in house / Outside the firewall? JEA Response: TBD but needs to accommodate both. Desired end-user experience o Reports JEA Response: A data pipeline that will allow customer to consume data in the way of reports, visualizations, services for apps as well as exploratory via data discovery tools Cubes JEA Response: No. Dashboards JEA Response: Some. Predictive

3 Portal Integration Potentially Is there a need to capture / process sensor or IOT data? Do you need to install/purchase sensors on assets? Streaming requirements / throughput-volume No definitive benchmark metrics as of yet. Is the end goal of the Data Integration and Virtualization Solution to be able to provide users an agile environment to find data, perform ETL and create an analytical base table, all in one environment? JEA Response: Potentially. We are flexible on the configuration of the deployment. There is an assumption that the data hub will be separate from the virtualization environment Data Federation was not mentioned within the RFI; does JEA intend to use the solution to Federate Data across a multitude of data sources? Is JEA seeking to replace an existing vendor or looking to augment to a more agile environment? JEA Response: Both Supplier Inquirys: Can JEA provide a scenario/example of what an agile data pipeline means to you? See PDF 2.2 #4.t JEA Response: To be able to quickly integrate needed data in a real-time/close to real time scenario. Our implementation approach may need to start small and expand as business needs dictate. Please provide details on both the types of data (is it Utilities metrics, for example) and volume of data. JEA Response: This varies. We need you to assume large volumes of data from IoT sensor data. Will this solution serve a department or enterprise need? JEA Response: Enterprise need, over time. What are the key business drivers supporting the solution need? What are some of JEA s current pain points with existing environment? JEA Response: The need to consolidate integration toolsets, integrate data from a variety of data sources, types and volumes while not being restricted to a batch window. In addition, we are looking to provision large volumes of data as needed and improve data quality, security and timeliness. We currenly have some restrictions in our ability to do this with the legacy toolsets and environments. How important is self-service data preparation and data management? JEA Response: Very important How will the target data be used advanced analytics, business intelligence, etc. JEA Response: Advanced analytics, business intelligence, visualizations, app services

4 Number and listing of data sources to integrate? JEA Response: A variety of operational databases (6-7), Sensor data as well. List of current end user applications that relies on the data to be integrated JEA Response: Data Warehouse and visualization are the primary solutions currently. This will potentially expand. Is there Real time data? If so, define real time JEA Response: Not currently but in the future the desire is to have data constantly refreshed while minimizing impact to the source systems. Will JEA need help with migrating existing applications over to new environment? JEA Response: We will need integration direction on the proper deployment and configuration of the data pipeline, in addition to training. The plan is to select a viable use case to vet through the pipeline and schedule legacy integrations over time based on funding and resource availability Any integration touch points with any third-party vendors? If so, which ones? JEA Response: No not in a production state. What is JEA s implementation timeframe? JEA Response: Over the next 12 to 18 months. How many environments will JEA want to develop and support (DEV/TEST/PROD etc.)? JEA Response: All three. A better understanding of how to accomplish this in the new data pipeline is needed. Who will require training? Business Users, IT, Data Modelers? Data Scientists, etc.? JEA Response: IT and potentially Data Modelers What are the next steps in the RFI/RFP process (timeline)? JEA Response: We will review the RFI responses to get a better feel for potential solutions to close our data integration and provisioning gaps. We will then move forward with an official RFP. Section 2.2 Scope, Requirement 3: Can support and/or integrate easily with 3 rd party monitoring, modeling, governance and security tools. Please define 3 rd party monitoring tools Does JEA already have tools in use that support monitoring, modeling, governance and security? If so, please provide details. Otherwise, what 3 rd party tools specifically does JEA wish to integrate with this solution? JEA Response: We currently use OEM for transactional systems and the Data Warehouse. An official data governance and new security initiatives are in early stages and have not been selected. The vendor should just be able to demonstrate that you can integrate with these types of tools not baked into your solution set. Section General Solution Functionality, Requirement 5: Can support and/or integrate easily with 3 rd party solutions: Monitoring tools; governance tools; security tools; data modeling tools; meta data management tools Section is replicated in Appendix A. Appendix A does not contain the last bullet point for Meta data management tools. Should we add a line for Meta data management tools to Appendix A in General Solution Functionality section, question 5?

5 Would JEA please provide an understanding of current environments, platforms/systems, data sources, etc., and an understanding for how data is being access and managed today? Does JEA have a solution/tool in place for reporting and analytics? What are JEA s goals for data and reporting once it s accessed and consolidated? JEA Response: We currently have multiple legacy ETL tools in place to facilitate traditional data movement to our data warehouse environment and SOA services for point to point interfaces. The future scope will focus on creatation of a centralized data hub for provisioning data for analytics Would JEA please explain the selection timeline and process that will follow the RFI completion? JEA Response: TBD. This will be discussed with Procurement and Management but as indicated earlier the expectation is to have an RFP in place within the next few months. Would JEA please explain the deployment timeline of the proposed solution (project kick-off, Roll-out phases, go-live date, etc.)? JEA Response: TBD. Based on business drivers and resourcing. Would JEA please more clearly define the 2,500 consumers of the data? Are these named users who access a portal, or reviewing embedded dashboards, or running ad-hoc reports, etc. a. Would JEA share some of the specific use cases that fit into developing, managing, and facilitating your data integration pipeline and the management of that information? The use cases will help us more accurately rightsize the offering. JEA Response: A variery of all the above. We have a legacy DW that we are currently maintaining that will at some point be retrofitted to the Data Hub. This has a couple of hundred users across both BI toolsets (Business Objects and OBIEE). We have Tableau that a small population of individuals utilize <20 or so but the expectation is that we will scale at some point. The use cases that will will run through this process has not yet been determined. We currently have use cases surrounding Asset Creation and Meter Voltage and Load Analysis. PDF Are client references required for the RFI response? JEA Response: If you have that information available then that would be great but it is optional at this point. It will, however, be required as part of any official RFP that is submitted Are you considering a phased approach? Do you want to implement certain pieces of the solution at different times? o Characteristics of the project That is being considered. We may explore implementing more of the data integration components first and then following suit with a virtualization layer and meta data build out What fiscal year will this fit into your plan of work? JEA Response: Starting in FY19 and running over into FY20 Excel #8 Do you currently store IoT data? If so, where do you store that data? o What is your current data warehouse/data solutions? JEA Response: IoT data is currently being collected in a pilot environment as a proof of concept. Our current DW solutions is built on an Oracle Database framework and being maintained by a hybrid of What visualization tools are you currently using (prescriptive, descriptive, etc.) JEA Response: We are currently using Tableau. Do you see a need to have Advanced Analytics for their Data?

6 We are in need of advanced analytics for predictive and prescriptive model development and maintenance. To date we have partnered with a 3 rd party to do this type of analytics. Excel #5.f Do you have any specific or overall inquiries for 3rd party solutions (tools)? JEA Response: No. Excel #9.d How many source and targets do you want to replicate to/from? JEA Response: This will vary. As part of the initial deployment, we will select a particular use case to vet through tool performance and execution. Depending on our deployment strategy (TBD) that will expand over time. Excel #9.f What is your definition of synchronization (Oracle to Oracle? BiDirectional?). Could you give us an example and how it differs from replication? JEA Response: The main focus is for up to real time replication at this point. However, if we explore more of an MDM configuration in the future, bi-directional synchronization may potentially be needed. Excel #9.g Could you give us a definition of virtualization. How does it differ from federation?. JEA Response: What we are requesting is the ability to create real-time, integrated views of data to satisfy our business needs and the data may come from disparate, structured, semi-structured, and unstructured data sources. Our plan is to develop a physical data hub so the need to federate data will become less and less over the long haul but very critical in the beginning. Excel #13 Could you give us an example of how to access the product through a mobile application? What kind of mobile application (web-based, AppStore)? JEA Response: We are currenly building out our new mobile strategy but it can be either Web-based or AppStore based depending on how the application is developed. Excel #21 Could you give us an example of automatically scaling up/down based on demand resources? JEA Response: Would like the ability of the virtualization environment to detect resource needs based on customer s queries to be able to dynamically allocate resources to satisfy that need without a whole lot of manual intervention from a systems administrator.