IBM s Intelligent Video Analytics & IBM Intelligent Public Safety

Transcription

1 IBM s Intelligent Video Analytics & IBM Intelligent Public Safety 2014 IBM Corporation

2 Pain points managing Safety and Security and Operations Constraints Efficiencies Disjointed legacy systems Need for analytics Fewer frontline staff and lower budgets are driving departments to seek out innovative methods of reducing operational gaps More efficient ways are needed to deal with crime prevention, removing criminals from the streets & creating safer neighborhoods Disjointed legacy systems are becoming an expensive weakness in the policing system due to the system sophistication requirements A growing requirement to employ advanced analytics and threat detection The industry areas who are looking at the force multiplier of advanced analytics to help close their operational gap are going to be the ones who will be best placed to manage safety security and efficiently manage operations. Using technology as a force multiplier 2 Analytics can provide value across many areas: Public Safety and Security, Public Transportation, Traffic Management, Corporate Security, Operational efficiency, Buyer Patterns, Emergency Response, Event Management

3 Why Video? Real-Time Traffic Cameras in New York City 3

4 Market Facts 900 million Number of events a security operator has to review on a monthly basis in one city 22 minutes Today there are ~72 Mil surveillance cameras in use globally ~1.5M new surveillance cameras are being deployed annually Only 3% of those cameras have intelligence Humans can not monitor these devices. Large opportunity to provide asset to make these devices intelligent Human s ability to detect an event Drops by 95% The time before the average attention span of a security operator monitoring two cameras drops by 95% 57 percent of city expenditures that can be attributed to public safety 4

5 Improves the ability to understand and respond Situational awareness Operational optimization Rapid investigation Combine alerts to reduce false notifications to personnel to improve taking action Advanced analytics developed for urban environments and mass transportation to identify individuals versus blobs Months to hours Reduce the investigation time from months to hours based on finding matches to indexed data 5

6 To improve the coordination and safety in urban environments, cities need the benefits provided by video analytics Scope of areas requiring intelligent video monitoring Power Substations Water supplies Stadiums Events/Conventions Parks & Recreation Support City Infrastructure Infrastructure What Needs Large Venues protection Streets/Traffic Business/Retail Schools/Hospitals Public Transportation Remote Tunnels Infrastructure Bridges Airports/Seaports Video analytics can enable you to 1. Prevent incidents by providing notification of potential incidents and hazardous situations especially in crowded environments 2. Deploy resources faster to stop unruly crowds before they grow and to apprehend suspects before they leave the scene 3. Improve operational efficiency by developing awareness of traffic flows and areas prone to pedestrian loitering 6

7 Prediction and Prevention What Video Analytics Can Do For You: Enable effective response to inquiries, requests for services and investigative actions in a timely manner thus increasing overall customer satisfaction. Deliver a foundation for more proactive safety and security. Provide greater predictive analysis and data mining from disparate data sources. Increase quality of decisions by providing more insightful, actionable reporting. Optimize resources to effectively meet objectives that evolve over time. Reduce operational and IT costs by providing self-service reporting and analysis to users. 7

8 Delivering on the Value Proposition CAPTURE ANALYZE DECIDE ACT Acts as a force multiplier Leverages existing infrastructure Increases Threat Deterrence Optimizes Infrastructure Reduce false alarms Minimizes manual data correlation Provides real-time analysis Facilitates faster forensic retrieval Decreases time to decision Provides real-time situational awareness Improves time to threat elimination Increases responder safety Client value examples: Investigation time moves from days to minutes Automatic alerting for immediate response Determine quickest response route Determine malicious events in planning phase Ability to monitor broad areas with limited staff 8

9 Bigger High scalability able to capture and process billions of events monthly Advancements to address challenges in urban environments and crowded scenes Faster Easy to use attribute search capabilities Rank Ordering of Search results based on Confidence Scoring 9

10 10 Intelligent Video Analytics Features and Differentiators Behavior analytics Classification - size, speed, trajectory, color, time, duration, shape, features People Search Vehicle Search Tripwires Directional motion Region of interest & un-interest Object removal Abandoned object Face capture, facial search Crowd behavior Counting Loitering Speed detection Differentiating features Full event indexing Compound alerting Crowded scene analysis High scalability able to capture and process billions of events monthly Easy to use attribute search capabilities Advanced color recognition Provides real-time alerting and rapid forensic searching with event playback Integrated with multiple VMS providers Analytics indexing events Real-time Alerting

11 Single attribute and combined attribute search capability on physical features: Baldness, Eyeglasses/Sunglasses, Head Color, (hair color, hat color, ) Skin Tone Tri-color torso via 13-color palette Torso Texture User interface to rank ordering search results based on attribute confidence levels Integration with 3 rd party Facial Recognition Engines for real-time identity alerting People Search Framework allows ability to add new physical attribute (i.e. shoe color) Provides Color Calibration Tool to manually calibrate color using artificial object colors and existing scene objects or automatic color correction. Near Field People Search Supports 13 color palette People Search Red Green Brown Black Orange Cyan Beige Dark Gray Yellow Blue Magenta Light Gray White Find all people on 4/26/2014 between 12pm and 4pm in rank order by eyeglasses, patterned green & yellow shirt 11

12 IVA In Action Nearfield People Search Channel Selection Time Criteria 12

13 IVA In Action Nearfield People Search Search Criteria Head Search Criteria Torso Query Summary 13

14 IVA In Action Nearfield People Search Search Results Ranked by Confidence 14

15 IVA In Action Nearfield People Search Video Review Detailed Metadata 15

16 IVA In Action Nearfield People Search 30 Minutes of video 91 People Search Time without IVA Minutes Search Time with IVA ~1 Minute 16

17 Targeted Cameras/Use Cases for Vehicle Search Example Detection of vehicles within crowded scenes Search attributes for vehicle width, height, length, and speed Search capability on visible vehicle appearance with 6- color Palette Color Calibration Tool to calibrate color artificial object colors existing objects with FOV automatic color correction World Metric calibration tool to enable true object measurements. Size-map and Pose-map Calibration tool to automatically learn vehicle size and pose distribution in a scene and perform manual adjustment if needed 17

18 IBM s Video Analytics provides real-time alerting based on complex activity and event detection 18

19 IBM s Video Analytics Building Management Example Building Entrance camera: Person Entering Statistics Shows distribution of people entering the building during the day Camera contains two Directional Motion alerts named Person Entering that trigger when people approach the building doors Select Building Entrance camera Go to Alerts->Search Enter the following parameters Display:Stats Statistical Bin Size: 1 Hour KeyWords: Person Entering Time Period: 7am to 7pm the previous weekday The results should show a histogram similar to what you see here with peaks when people arrive in the morning and return from lunch. Only a few results show in the afternoon because this alert only records people *entering* the building 19

20 Historical Visualization Activity Histogram Track Summary Heat Map Distribution of events over time Show tracks of all objects returned from search How long objects spent in different places 20

21 Maturity Curve building on existing investment 21

22 Crime investigation and prevention Backdrop The customer has a basic video monitoring system which records video, but needs the human eye to monitor significant events and coordinate responses. Objective Use intelligent video analytics to alert on potential threats, index events for investigations and define where malicious activity is being planned. The security officers can Prevent Incidents Deploy resources faster Improve operations Monitoring via Video Analytics Security Officer is alerted to the event Response is managed Garbage 22

23 Law Enforcement Backdrop Certain individuals have been barred from sensitive areas. Intelligent Video Analytics can be setup to look for individuals as they are channeled into a controlled environment. Objective Individual's faces are monitored The best view of their face while in the field of view is captured and forwarded to facial matching. Intelligent Video Analytics captures the best few of a face Sent to the i2 Facial Recognition module Facial match generates a list of potential suspects Once the suspects have been identified this can be sent to the security analyst Facematch Garbage Graffiti 23

24 Events or Large Facility Operations Backdrop The ability to identify and respond to an issue as soon as possible can be critical to ensuring the event is kept safe and secure Objective The Intelligent Video Analytics + Intelligent Operations Center can monitor, alert and manage crowd build up, security threats Critical areas are monitored Paving Stone Information from video analytics solution is sent to the Intelligent Operations control center Garbage Graffiti SOPs can deliver an intelligent response to issues that have be Identified by Intelligent Video Analytics 24

25 Transportation Backdrop Transport environments can be monitored for Safety, Security threats as well as operational efficiency. Event monitoring and Indexing Paving Stone People Counting Garbage Abandoned Package Alert Objective To alert station masters, bus / tram inspectors to unsafe events, security threats and to improve the efficiency of operation. Intelligent response via SOPS Platform Crowding People obstacles and on tracks 25

26 Emergency Management Backdrop A serious bombing event has gone off and the city needs to analyze all footage before the incident. Objective:- Intelligent Video Analytics can be configured to look for evidence across all cameras. Vehicles: color, speed, location. People: clothing color, facial attributes. Video from many different sources is analyzed Paving Stone Events of concern are identified Mobile command posts are dispatched to the hot-spot areas to support the investigation 26

27 High level Architecture -Full solution how it works Video Capture Sensors Prediction IVA IOC Video Management Video Archive Video Analytics Engine Metadata Engine Alerts Citizen Collaboration Social Media Events Intelligent Response 27 1 Intelligent Video Analytics *IVA Intelligent Video Analytics *IOC Intelligent Operations Center

28 IBM s Intelligent Operations Center 28

29 IBM s Intelligent Operations Center Integration with IBM Intelligent Operations Center Reports/ Analysis Advanced Visual Features Intelligent Operations Center Intelligent Alerts Directives CAPs Events Service Bus Interconnected Gateway Domain Public Safety Transport Water Building Instrumented Sensors 29

30 Analytics are key to converting data to information to insight by Integrating with the Intelligent Operations Center Event Captured, video analytics / image stored locally Captured data converted to Common Alert Protocol (CAP) message CAP stored, and processed Video Analytics Charting, Geo Spatial Data Processing Data Analytics High Level Insight 30

31 Video Capture -> Data Processing -> Insight -> Playback ( Video / Charting ) Store and Playback from Intelligent Operations Center as event or trend deemed significant All events stored and enabled alerts displayed Select On Demand based on significance 31

32 Building Management: Inside Doorway camera: Face Capture Inside Doorway camera shows the elevator lobby and a door coming from the Inside Lobby. This view is running the Face Capture profile Faces are captured both as Events and as Alerts. Alerts also appear in the Instant Alerts section of the UI Operation Center Summary View 32 Intelligent Buildings

33 Smart Government, Customer References Strengthening Public Safety. City Government of Davao: The solution helps the City more effectively manage public safety, plan and predict needs based on KRIs and near-real-time event monitoring and drastically improve the overall operating and management efficiency of its security agencies. A Free Economic Zone in Asia: Is planned to be a selfcontained living and business district. We are providing intelligent physical security systems.. Public Safety Department in Puerto Rico: Implemented a wireless mesh-based intelligent video surveillance system leveraging IVA to detect and prevent crime on major San Juan thoroughfares 33

34 34