Teledyne DALSA Industrial Products Embedded vision for industry
Agenda Embedded Vision Applications, technologies and implementation choices Embedded Vision for Industry Review of off the shelf solutions 2D & 3D Vision Sensors Smart Cameras Vision Systems Software considerations Integration challenges Summary
Embedded Vision Is in use everywhere we look Vision in ADAS Vision in policing Vision in industry Vision in virtual reality Vision in sports Vision in medical Vision in security Vision in phone apps Vision in UAVs Vision in logistics Vision in agriculture Vision in traffic control
Embedded Vision Technologies Are widely available for development and/or deployment Sensing Processing Developer Integrator End User Software
Selecting Embedded Vision for Industry Which solution is right for you? Full Custom Semi Custom Off-the-shelf PROS Lowest deployment cost for high volume Build to suit PROS Modest deployment cost Build to suit PROS Fastest to implement Easiest to maintain Lowest cost of ownership CONS Highest implementation costs Longest time to market CONS Multiple suppliers to manage High cost of ownership CONS Higher runtime cost May not match application exactly
Off-the-shelf Embedded Solutions Look before reinventing the wheel Point Inspection Solutions Distributed processing 2D Vision Sensors Error proofing and ID 2D Smart Cameras General inspection 3D Line Profile Sensors Measurements Multi-point Inspection Solutions Centralized processing PC based Vision System User configurable system Hybrid Vision System Supplier-configurable system
Distributed versus Centralized Processing Which is better? Distributed Easy to setup and maintain. Predictable performance. No programming interface simplifies product validation. Easy to integrate into factory environments. System costs and spare parts are low for small system configurations. Consumes minimal space on the machine and retrofits are easy to integrate. Built for industrial use. Can be deployed in harsh environmental conditions without enclosures. IoT ready. Centralized Low cost for multi camera configurations. Flexible system architecture easy to expand and reconfigure to meet changing needs. High performance. Leverages computing advances in PC technology and optimized low-level software primitives. Greater storage capacity supports local saving of images. PC resources make it very easy to communicate information across networks. PC systems are generally windows based and open to support 3 rd party programs. This can provide additional cost benefits and access control.
2D Vision Sensors Offer lowest cost of ownership Cost Ease-of-use Flexibility Typical Characteristics Low Resolution Sensor 640, 752 or 800 horizontal Some available with color sensors Integrated M12 Lens 6, 8, 12 or 16mm Optional filter Integrated Light Red, White or Blue LED Optional support for external source Quick Setup Easy to use embedded software interface Limited inspection feature set Factory Friendly Standard factory protocols / cabling IP 65/67 rating
2D Vision Sensors Offer practical solutions for point inspection applications Error Proofing Pattern matching verify presence and position of critical features, robotic guidance Feature or part presence/absence/counting Feature or part measurements Part or assembly verification by color Identification Product verification read product codes to avoid labeling mix-ups Marking verification validate product type, lot and expiration date codes. Quality verification check markings, label position, feature presence/absence Assembly verification track assembly history at every stage of manufacturing Logistics management ensure that goods flow smoothly and efficiently from receipt through picking to sorting and shipping
2D Vision Systems Smart Cameras Offer incremental performance and cost Cost Ease-of-use Flexibility Typical Characteristics Higher Resolution Sensors 640 to 2560 horizontal (2D or 1D) Mono or color Variable Lensing C mount Integrated autofocus Optional filter Variable Lighting Some have integrated light Most connect external sources Quick Setup Somewhat easy to use software interfaces Advanced feature sets Factory Friendly Standard factory protocols / cabling IP 65/67 rating
2D Vision Systems Smart Cameras Expands the application reach of Vision Sensors Vision Sensor Sensor Low resolution M12 lens Integrated light source Applicability Targeted tool set Error proofing Identification Limited control Performance Good for targeted applications Usability Very easy setup Fixed runtime Smart Camera Range of resolution Flexible optics External light source General tool set Flexible control (inline scripting, network commands etc.) Adaptable to change in project scope Good for many applications Often combines CPU, DSP and FPGA technologies Multiple speed models Easy setup Customizable runtime
3D Vision Line Profile Sensors Measures object height & shape Models available for various Field of Views Cost Ease-of-use Flexibility Z Standoff Range X Near FOV Far FOV Typical Characteristics Profile Measurement Performance ~5-10 um Z resolution ~10-1000 mm FOV 250-5,000 profiles/sec Integrated Sensor and Laser 640-2048 points/profile (x resolution) Red or Blue laser Quick Setup Easy to use interface Limited inspection feature set Factory Friendly Standard factory protocols / cabling IP 65/67 rating
3D Vision Line Profile Sensors Contrast, color and Z position tolerant Profile measurement Height, width, angle, contour etc. Bead/weld height & width Flush and Gap Measurement Verify uniform height and gap between surfaces Position Measurement Locate or verify feature positions Surface Inspection Verify surface flatness and detect scratches, dents or holes Content Inspection Verify package contents
3D Vision Line Profile Sensors Offer complementary vision solutions Standalone solution for point profile inspection Targeted tool set for measurement and inspection Applicable for all industries Easy to use and easy to maintain Requires little or no lighting Operates independent of color or contrast Integration friendly Higher cost of ownership
Vision Systems (User Configured) Offer performance and flexibility for multi-camera inspection Cost Ease-of-use Flexibility...... Typical Characteristics Flexible Sensor interfacing 1D, 2D, 3D, LWIR, X-RAY Multiple mono or color Performance Aligned with PC technology Large storage capacity Standard communication interfaces Application Setup Flexible Advanced capabilities Easier to integrate 3 rd party tools for vertical applications Factory Ready Standard factory protocols / cabling Cabinet mount no moving parts
Vision Systems (User Configured) 5 reasons to select PC based Vision Systems 1. Camera flexibility Configure system to match application exactly. Easy to expand. Cost effective. 2. Performance Leverage latest PC technologies to tackle demanding application tasks such as rendering and inspection of 3D scanned images 3. Usability Familiar look and feel. Easier to customize user interface for runtime. Possible to combine software applications (i.e. vision + motion). 4. Memory/Storage Greater capacity and efficiency for program execution. Lots of storage for image history. 5. No other option Some applications are just not possible or practical with any other solution
Vision Systems (Supplier Configured) Smarter than a PC system? Supplier locked systems Offer camera flexibility within the supplier product family Support supplier s software model Closed to 3 rd party tools and development Single source for support Performance May or may not leverage latest PC technologies May support smart cameras to offer a hybrid processing model inspections performed on the cameras, control & communication performed on the system processor Usability Based on supplier software interfaces Includes operator and control customization Not visible as a windows machine
Consider your Software Requirements Carefully Not all software is created equal Design Environment Communications Runtime Application development interfaces vary widely, from graphical point and click to traditional programming If you are new to vision, focus on ease of use. Great progress is being made to abstract vision complexity If you have different needs, pick a software package that you can migrate across vision system platforms Vision systems often need to communicate with 3 rd party equipment, such as PLCs or robots Make sure the vision software supports standard factory protocols that interface the equipment you specify Recognize that vision suppliers are not experts in using your 3 rd party devices Most applications require an HMI for monitoring results, changing programs and changing tolerance settings Some vision software will provide boilerplate runtime interfaces that are good for typical applications If you need something unique, pick a software package that allows you to develop a custom operator interface
Don t forget about Integration Factors to consider when deciding on a vision solution Challenge Operating Environment Robust Inspection Factory Communication Runtime Requirements System Expansion Ownership Cost Questions to Consider Does the system needs to be protected to operate reliably in your environment? Are you specifying the correct lighting, optics and sensor resolution for the application? What do you need the system to communicate and how? Are the factory protocols you need supported? How do you want to interact with the system at runtime? Do you require a custom operator interface? Do you need to restrict access or log user transactions? Will the system capabilities meet your changing needs over time? Does it offer enough flexibility to expand? Who will program and maintain the system? Can you support changes to the system internally?
Summary Thank you for your time Embedded vision is in use everywhere we look. Embedded technologies and solutions are widely available for industry development and/or deployment. Consider the pros and cons of making versus buying an off-the-shelf solution Vision sensors and smart cameras offer distributed processing, where each node performs an inspection. Vision sensors and smart cameras are generally easier to setup, integrate and maintain. Vision systems offer centralized processing, where multiple cameras combine to perform an inspection. PC based systems are familiar, offer higher performance and more flexibility. Supplier locked systems offer similar, but less flexible, capabilities. Select the product that best suits the application and user requirements. What is the task and who is going to implement and maintain the solution? Software is REALLY important. Try before you buy!