UAS Research in Support of ODOT Operations

Transcription

1 UAS Research in Support of ODOT Operations

2 Research Team Profs: Arthur Helmicki, Victor Hunt, Kelly Cohen, Manish Kumar Staff: Mahdi Norouzi, Bryan Brown Students: Paul Guentert, Chan Ventkatesh, Niranjan Krishnan, Arjun Chiddarwar Project Objectives How can we improve ODOT core business functions by application of drone technologies? What are these missions? What drone configurations and capabilities are necessary to perform these missions? Scope of Work Acquire the sensors and hardware and develop supporting software in order to integrate into prototype systems. Test and demonstrate prototype systems for select identified missions. Develop mission SOPs and training. Deliver all prototype equipment and supporting materials to ODOT.

3 Market Survey Mission 1: Aerial Photography/GIS Platform Test Location Application Location Subject Matter Expert Survey/Questionnaire 60+ responses from across ODOT as well as externally (ODNR, Ohio Patrol, Turnpike, Ohio National Guard, Cleveland Metroparks, etc) Review of UAS Market 400+ vendors Market rapidly evolving Identified and rank ordered 11 potential mission scenarios Initial focus given to Groups 1 and 2 F o c u s Group 1 Group 2 Group 3 Group 4 Other/Secondary Mission 2: Exterior Inspection Mission 5: Construction Site Inspection Mission 6: Remote Inspection Mission 7b: Accident Scene Platform Development, Sensor testing and Software integration Mission 4: Traffic Monitoring Mission 5: Construction Site Inspection Mission 7a: Quick Clear Mission 3: Interior Inspection Mission 10: LIDAR Mission 8: Search and Rescue Mission 9: Fire Monitoring & Chemical Cloud Detection Mission 11: MARCS/Communications DJI Matrice 100/210, VGCS Prototype Intel Aero, Flamewheel Hoverfly Typhoon VGCS Prototype, Intel Aero, Hybrid Summit Park, Wilmington Airpark, MUTC, UC Victory Pkwy Labs UC Victory Pkwy Labs, Summit Park Summit Park, Wilmington Airpark, MUTC, UC Victory Pkwy Labs UC Victory Pkwy Facility Sites TBD by Subject Matter Experts, candidate sites under discussion Wilmington Air Park Sites TBD by Subject Matter Experts, candidate sites under discussion JM, FWW, Other Fred Judson, TAC, Mike Brokaw, Brandon Collett, Stephan Mather Fred Judson Fred Judson, TAC, Carl Merckle, John McAdam, Bryan Comer Fred Judson, TBD TBD Wilmington Airpark TBD Fred Judson, TBD Matrice, Hoverfly, Aero, other UC Victory Pkwy Labs, Summit Park, Wilmington Airpark WVa, MUTC, Other Fred Judson, TBD

4 Results to date Drone Fleet Acquisition VGCS, Interior Inspection Jeremiah Morrow, Real-time Milestone Uplink, and MUTC Automated Traffic Monitoring Image Analysis/Processing Common Operating Platform Visualization techniques (Hololens AR and VR Goggles)

5 Drone Fleet Vehicles selected to best meet ODOT s application needs Used for mapping, inspection, aerial imagery Manual and waypoint navigation Yuneec Typhoon H with CGO3+ 4K Camera Up to 25 minute flight time Live HD Video Link DJI Matrice 100 with X5, Z3, and Z30 Cameras Up to 25 minute flight time Z3 offers 3x optical zoom Z30 offers 30x optical zoom X5 offers high resolution imagery for mapping SDKs emerging for customization Compatible with Pix4DCapture, DJI GSPro, Drone Deploy and others

6 Drone Fleet (cont.) Intel Aero Developmental platform for multiple UAV control Allows user to operate multiple drones through single web-based ground station Equipped with ADS-B and Intel Realsense for Obstacle Avoidance of other drones, aircraft, and other objects

7 Drone Fleet (Tethered Platforms) Vehicles were selected to provide constant situational awareness by getting power through tether (e.g., traffic monitoring). This allows for hours of operation without need to switch out batteries. Payloads include cameras, lighting, MARCS repeaters, etc. Hoverfly Tethered System Includes Yuneec Typhoon H with 4K/12MP camera Max operational altitude of 150ft. Powerline Tethered Platform Works with variety of drones including: Matrice 100, Inspire 1, Inspire 2 Max operational altitude of 200ft.

8 Drone Fleet (Upcoming Platform) DJI Matrice 210 RTK: Flight Autonomy IP43 Waterproofing ADS-B Receiver Dual Battery, up to 38 min flight time Multiple Payload Configurations Camera Payloads: XT Thermal Camera Z30 30x Optical Zoom Camera X5 4K/16MP Camera Anticipated delivery in Sept/Oct 2017

9 Interior Inspection - VGCS

10 Concept Vehicles

11 Lessons Learned thru Engagement and Feedback Obstacle/Collision Avoidance and Stability Control Dust Cloud Issue Increased the Flight Time Simplified Manual Control Need to Perch for Extended Duration and for Inspection in Tight Spaces

12 Jeremiah Morrow Demolition Video Encoder

13 Jeremiah Morrow mission from Position 1 Deployed quickly to provide HD video for use by ODOT, media, etc.

14 Milestone Uplink Box Objective Capture Video from Drone Transfer Video to ODOT Video Servers (Milestone) Real-time Stream data for local officials Video Feed Control commands Remote Users On-site Users Goggles Laptop Smartphone

15 Situational Awareness, MUTC Emergency Preparedness Exercise Realtime video capture from drone and uplink to Milestone Stream data for local and remote officials

16 Traffic Video Processing Traffic Analysis Off the shelf software doesn t present drone video solution or is cost prohibitive Performed case studies of different drone video analysis solutions Currently implementing and testing robust detection process Individual Lane Detection Multi-Object Detection Proposed Method of Video Analysis Combination of Methods

17 Drone Video Captured along I75

18 Image Analysis/Processing (Mapping, Surveying, 3D Modeling) Custom UCII website Plan Capture Process Analyze Pix4DCapture DJI GSPro Matrice 100 Matrice 210 RTK Falcon 8+ Pix4D ODM Greyhound Entwyne Potree

19 Some sample models Accident scene recreation Construction site management Survey and Mapping

20 SR266 Construction Project, District 10 Aug 24 Aug 26 GSD: 1.63 cm/pixel Num of images: 256(256) No GCP GSD: 2.2 cm/pixel Num of images: 251 (261) No GCP

21 Comparison Measurements and Analysis Aug 24 Aug 26

22 Common Operating Platform Objective Central system for archiving documents, aerial images and videos Back-end for automated processing, transforming images to 3D models, etc Front-end to enable the user to interact with 3D models through the website or through AR/VR tools (e.g., Hololens) Website Authentication Upload Raw Data Users Website Database 3D Model Generation Model post-processing for fast presentation on the website Model post-processing for presentation on Virtual Reality Goggles Realtime traffic analysis Present the processed 3D model to the user Processing Server

23 Website Demo

24 Virtual/Augmented Reality objective Provide shared Interaction with 3D models (users at different physical locations) Interaction with models looking at the Avatar of other users Share notes with other users Talk to each other using the VoIP technology

25 Virtual/Augmented Reality demo