Infosys Real Time Streams

Transcription

1 Infosys Real Time Streams Extract your business value in real-time from data in motion ABSTRACT As an aftermath to huge influx of real-time data and to close the time gap between analysis and action to bring real time insights, enterprises are evaluating a variety of tools and technologies. Infosys Real Time Streams on Hortonworks Data Platform stands first in the foray of real time race with its unique concept and architecture. It helps to build strategic value from data-in-motion with its newest next-gen analytical capabilities.

2 Infosys Real Time Streams Infosys Real Time Streams is a real-time streaming tool that will make the whole process of realtime streaming and processing of data in motion with simpler, productive, and intuitive UI. This solution has the capability to manage, monitor, analyze and visualize live streaming data. Infosys Real Time Streams on Hortonworks Data Platform is a proven, pre-integrated, tuned software solution stack designed for ease of use, reliability and flexibility to build real-time insights and protect the enterprise from rapid technology changes. Figure: Guided UI of Infosys Realtime Streams Industrial Challenges Companies cannot use yesterday s data to predict tomorrow s possibilities with a mysterious today. Datain-rest must be fused with data-on-move to generate live-insights for business agility. Below are a few challenges and complexities around: Availability of wide variety of technologies, tools, and configurations which are new to the industry Inadequate access to workforce with in-depth and end-to-end understanding of technologies involved Inadequate access to expertise to customize available market solutions Poor compatibility with existing enterprise landscape

3 How to: Building a real time pipeline Simple four steps for pipeline data flows in real-time streams are as follows: Step 1: Real Time Source Adapters Data from IoT devices is transformed, denormalized, and linked to systems of record. Further, it enables live schema mapping by integration of correlated data sources and environmental conditions as a common factor with destination. Step 2: Real Time Data Processing Real-time streams deliver a scalable, parallel processing engine which is designed exclusively for real-time data abstracting all the complexities behind the scene. From simple thresholds to more complex correlations and processing at real-time can be done in a more simpler and self-intuitive way. Step 3: Visualize for Live View on a Personalized Business Portal Infosys Real Time Streams provides an intuitive, visualization portal with report rationalization capability on the KPI generated via the business pipeline created. Real-Time Streams provides a configurable dashboard which presents a contextual view of business insight at runtime and capable of configuring the alerts generated based-on the threshold and the conditions which caused it. All of this is delivered through a user-friendly interface. Step 4: Machine Learning for Actionable Insights Automation Infosys Real Time Streams provides a machine learning integration layer that can be plugged with any external model built and trained outside Infosys Real Time Streams. The Models can be integrated into Infosys Real Time pipeline via simple and intuitive user interfaces for generating actionable insights and help in data discovery. Unique features 1. Open Source Component Stack Real-time stream is completely built on open source technologies and well supported on Hortonworks platform 2. Visual Code Free Interface A simple graphical user interface helps in building advanced real-time streaming analytical pipeline in much simpler way along with the capability of performance tuning on-the-go 3. Many Prebuilt Real Time Ingestion Adapters There are many pre-built ingestion adapters for ingesting data at real-time to the processing layer which includes Kafka, Flume, JMS, AMQP, Social Network Adapters etc. 4. Auto Metadata Discovery

4 Auto metadata discovery helps to understand any kind of complex data structure in the input data. It transforms any data into a logical flattening for human understanding. It can support various types of data formats like JSON, Delimited data structure etc. of any depth hierarchy. 5. Multi Sink Capability Real-time insights can be saved to sinks like Elassandra, OpenTSDB etc. The saved information can be sent directly to live dashboards so that end users can be acted upon quickly on these KPI s. 6. Operation Monitor and Governance Operation monitor and governance module will help end users to understand the data transactions, loss, etc. via the prebuilt audit capability in real time streams. It will also provide a holistic view of the lineage of real time pipeline. Ambari in Hortonworks Data Plaform can be used to manage the Services inside the Infosys Real Time Streams. 7. Business Portal Access control based customizable portal available for report rationalization and adding multiple dashboards across the organization 8. Performance Management Infosys Real time streams provides on-the-fly performance tuning options that can be done on the real-time pipelines. This will make performance tuning much simpler and more intuitive via GUI Industrial Use cases A few use cases on how organizations that act on live-insights enjoy a competitive edge over sheer insights-driven organizations. 1. Real-time P&L Dashboard Only those enterprises which keep a constant eye on real-time business events can influence margins. 2. Call Data record and real-time data reconciliation An effective revenue assurance system must identify risks of revenue leakage in advance; to warrant near-zero revenue losses at real time 3. Credit, debit card authorization analysis Real-time credit and debit card authorization analysis helps financial institutions control fraud. 4. Sorter Scan (IoT) message RT Processing For timely and accurate parcel deliveries sustain in the commoditized postal industry. 5. Location-based personalized advertising

5 Geofencing, and location-based advertising provides an appealing revenue stream. However, only a few global retailers are incubating it. 6. Connected Cars Connected cars can help manufacturers provide new-age car-care services to customers by predicting potential breakdowns, spotting potholes and recommending fastest routes. Key Benefits Capability Technology feasibility assessment and stack finalization Quick turnaround time in building real-time business use case Enterprise readiness and multi-tenant environment support Performance tuning of various real time components Plug and play visualization Savings against Custom Development Saves consulting and designing effort by 20% to 25% 50% effort saving in testing and real-time pipeline development Gain 20% effort saving in SCM Save 10% effort in tuning Reduce 50% effort in visualization integration and save 60% effort in portal development Remarks Uses pre-integrated technology components and evaluate performance on multiple combinations of the technology stack Do performance benchmarking, evaluate execution throughput, technology integration compatibility with real or sample dataset most appropriate to business use case and many more. Intelligent Visual Code for free Interface for building streaming pipelines. Heterogeneous prebuilt real-time ingestion adapters Template-based code development Automatic meta data discovery and live schema mapping from sources Multiple real-time processing engines Variety of data sinking options and multi distribution support. Can be quickly deployed and orchestrated on top of the Hortonworks Data Platform Portable code management Easily configurable code migration and multi environment and tenant supporting capability. GUI based performance tuning options on the go with pipelines against complex and manual tuning methodologies. Quick persona-based portal development and dashboard integrations Portal publishing and privileged user access Helps report rationalization and reduce user licenses To Know more :