Intégration de la Suite Elastic à la plateforme interne d Amadeus

Transcription

1 Intégration de la Suite Elastic à la plateforme interne d Amadeus Aymeric Gerardin, Manager SRE for Data Management & Monitoring Division, Amadeus Luca Belluccini, Elastic Stack Lead Developer for Queueing & Data Store Department, Amadeus

2 Elastic Suite integration in Amadeus platform Paris, 30 Jan 2018 Aymeric Gerardin, Manager SRE for Data Management & Monitoring Luca Belluccini, Elastic Stack Lead Developer for Queueing & Data Store

3 Solutions we offer _Business intelligence _Search _Ticketing _Merchandising _Advertising _ Self-booking tool _ User-generated content _Mid- & back-office _Point of sale Distribution Provision of indirect distribution services _e-commerce _ Social media _Expense management _Payments _Mobile _ Data Centre _ Platforms & applications _ Sales & marketing infrastructure _ Customers IT Solutions Including direct distribution technology business management to serve travelers _ Offer management _Business Intelligence _Flight sequence optimisation _ Resource optimisation _ Trip management _Customer management _Point of sale _ Distribution _Baggage reconciliation _ Passenger verification _Contract and billing _ Weight and balance _Flight management _ Self-service bag drop _ Self-service check-in _Loyalty _e-commerce _Mobile _ Revenue management _ Revenue accounting _Content management _ Reservation _ Property management _Payments 3

4 Our customers relationship ID relationship ID rid3 was rid3 was not not relationship ID rid3 was not 709 relationship ID rid3 was not relationship 110 ID 100 rid3 was not The image part with relationship ID rid3 was not found in the file. 580,000 travel agencies and corporations, online and worldwide airlines airport operators ground handlers hospitality properties relationship ID rid3 relationship ID rid3 was relationship ID rid3 was not not relationship ID was not rid3 was not relationship ID rid3 was not rail operators car rental companies tour operators insurance provider groups cruise and ferry lines 4

5 Enriching every step of the traveler s journey age part with relationship ID rid3 was not Post-trip Inspire The power shifts to end-users and drives our technology agenda. On-trip Pre-trip Book Shop Customization and Openness End-user centric travel Personalization 5

6 Behind the scene

7 Data High Volumes 145K Tps in avg. 300K Tps at peak 1.3 Petabytes of Data produced by day Applications & Infrastructure 7

8 3 was not Amadeus Technology Platform 8

9 Deploy world-wide! We operate in 190+ markets Munich Madrid Nice Endpoints Endpoints Cluster #1 Cluster #2 vdatacenter vdatacenter Datacenter #1 Data exchange VPN Endpoints Cluster #p vdatacenter Datacenter #m-1 Endpoints Cluster #n vdatacenter Datacenter #m 9

10

11 Functional Monitoring First Elastic implementation Application(s) relationship ID rid3 was not json relationship ID rid3 was not found in the file. relationship ID rid3 was not 11

12 Data platform? Qlik 2018? Couchbase 2014 MongoDB 2015 Hadoop 2014 Elastic 2016 Kafka 2015 Object store 2017

13 Use cases _Skeptic User Behavior Analytics The image part with relationship ID rid3 was not found in The image part with relationship ID rid3 was not found in the file. relationship ID rid3 was not relationship ID rid3 was not relationship ID rid3 was not relationship ID rid3 was not The image part with relationship ID rid3 was not found in the file. The image part with relationship ID rid3 was not found in _Arcane Human/Robotic activity analysis LambdaBox relationship ID rid3 was not found in the file. relationship ID rid3 was not _New SOC based on SIEMonster 13

14 Let s deep dive 14

15 Elastic Industrialization Filling the gap relationship ID rid3 was not Architecture Sizing and Infrastructure relationship ID rid3 was not found in the file. relationship ID rid3 was not Trainings Configuration & Deploy relationship ID rid3 was not found in the file. relationship ID rid3 was not Client libraries relationship ID rid3 was not Operability Backups Security Monitoring relationship ID rid3 was not relationship ID rid3 was not The image part with relationship ID rid3 was not 15

16 Architecture _Reliability & redundancy Load Balancer _Flexible in scale up/down (horizontal & vertical) _Best practices from Elasticsearch documentation relationship ID rid3 was not found in the _ support with Workshops on site file. node#1 The imag e The image part with relationship ID rid3 was not found in the file. Kibana node#2 The imag e The image part with relationship ID rid3 was not found in the file. Kibana mnode#1 The image part with relationship ID rid3 was not Master only The imag e mnode#2 The image part with relationship ID rid3 was not Master only The imag e mnode#3 The image part with relationship ID rid3 was not Master only The imag e dnode#1 The imag e The image part with relationship ID rid3 was not Data only dnode#2 The imag e The image part with relationship ID rid3 was not Data only dnode#n The imag e The image part with relationship ID rid3 was not Data only cnode#1 The imag e The image part with relationship ID rid3 was not Coordinating cnode#2 The imag e The image part with relationship ID rid3 was not Coordinating 16

17 Sizing & Infrastructure VMs on ESXi hosts _Depends on Use case Type of data Near real time constraints Document size, fields Indexing, updates & delete requests Search requests, aggregation requests Availability level _Elastic support with Questionnaire 1 VM per node instance Firecell and host awareness SSDs for production systems 17

18 Configuration & deployment _ relationship ID rid3 was not found in the file. Puppet Ansible & community support for _Operating System configuration tweaks _Documentation by elastic 18

19 Monitoring & Alerting _Integration with our internal monitoring system thanks to REST APIs Platform metrics Elasticsearch and Kibana metrics relationship ID rid3 was not found in the file. relationship ID rid3 was not _Alerting Incident triggers On-call loops relationship ID rid3 was not 19

20 Security _X-Pack security key features Network encryption System keys Authentication layer Authorization layer Access auditing logs relationship ID rid3 was not 20

21 Operability & Backups _Administration & configuration APIs _Backups via internal solution using S3 interface _Continuous service via rolling restarts _Compatibility across all the Elastic stack products 21

22 Applications Client libraries _Multiple technologies to support relationship ID rid3 was not _Improving client metrics, adding probes in client libraries relationship ID rid3 was not _Elastic supports several programming languages relationship ID rid3 was not found in the file. 22

23 Future _Proof of concept for Openshiftintegration _Improvements on client libraries relationship ID rid3 was not _New usecases relationship ID rid3 was not found in the file. _Improvements on change tracking & auditing relationship ID rid3 was not relationship ID rid3 was not 2016 Amadeus IT Group and its affiliates and subsidiaries 23

24 age part with relationship ID rid3 was not Takeaways _The industrialization process lead to reusable components within plays an important role relationship ID rid3 was not found in the file. _People Service Reliability Engineering _Processes Change management, change awareness _Growing Iterative evolution of features & requirements Plan for change 24

25 with relationship ID rid3 was not Questions? 25

26 Thank you! amadeus.com amadeus.com/blog You can follow us on: AmadeusITgroup