High demands on products as well as high time and cost pressure are decisive competitive factors across all industries and sectors. Whether in the food or automotive industry quality, safety and speed are today more than ever before factors that determine the success of a company. Zero-defect production is the goal. But how can it be guaranteed that only flawless products leave the production line? How can faulty quality decisions, which lead to high costs, be avoided? In order to test this reliably, a wide variety of methods are used in quality assurance.

A visual inspection with the human eye is possible, but it is often error-prone and expensive: the eye tires and working time is costly. A mechanical test, on the other hand, is usually accompanied by complex calibration, i.e. setting up and adjusting all parameters of both software and hardware in order to detect every error. In addition, product or material changes require recalibration.

Furthermore, with the classic, rule-based approach, a programmer or image processor must program rules specifically for the system to explain to the system how to detect the errors. This is complex and with a very high variance of errors often a hardly solvable Herculean task. All this can cost disproportionately much time and money. In order to make quality inspection as efficient, simple, reliable and cost-effective as possible, the German company sentin GmbH develops solutions that use deep learning and industrial cameras from IDS to enable fast and robust error detection. A sentin VISION system uses AI-based recognition software and can be trained using a few sample images. Together with a GigE Vision CMOS industrial camera from IDS and an evaluation unit, it can be easily embedded in existing processes.

Defect recognition software

The system is capable of segmenting objects, patterns and even defects. Even surfaces that are difficult to detect cannot stop the system. Classical applications can be found, for example, in the automotive industry (defect detection on metallic surfaces) or in the ceramics industry (defect detection by making dents visible on reflecting and mirroring surfaces), but also in the food industry (object and pattern recognition).

Depending on the application, the AI is trained to detect errors or anomalies. With the latter, the system learns to distinguish good from bad parts. If, for example, a surface structure is inspected, see metal part in the automotive industry or ceramic part, errors are detected by Artificial Intelligence as deviations from a comparison with reference images. By using anomaly detection and pre-trained models the system can detect defects based on just a few sample images of good parts.

The hardware setup required for the training and evaluation consists of an IDS industrial camera and appropriate lighting. The recognition models used are trained using reference images. For example, a system and AI model was configured for the error-prone inspection of fabric webs in the textile industry. A difficult task, as mistakes can be very subjective and very small. The system camera for optimum image material of textiles and web materials was selected together with IDS on the basis of specific customer requirements. A GigE Vision CMOS camera (GV-5880CP) was selected, which provides high-resolution data, triggered with precise timing, for accurate image evaluation.

IDS Vision CP camera

Slippage is the proportion of products that do not meet the standard but are overlooked

The system learns what constitutes a "good" fabric structure and knows already from a few shots of the fabric what a clean and flawless product looks like. For quality inspection, the image captured by the IDS Vision CP camera is then forwarded via GigE interface to an evaluation computer and processed with the recognition model. This computer can then reliably distinguish good/bad parts and highlight deviations. It gives an output signal when an error is found. In this way, slippage and pseudo rejects can be reduced quickly and easily.

Slippage is the proportion of products that do not meet the standard but are overlooked and therefore not sorted out, often leading to complaints. Pseudo rejects, on the other hand, are those products that meet the quality standard but are nevertheless incorrectly sorted out.

Both hardware and software of the system are flexible, for multiple or wider webs, additional cameras can easily be integrated into the setup. If necessary, the software also allows for re-training of the AI models. "Experience simply shows that a certain amount of night training is always necessary due to small individual circumstances. With pre-trained models from our portfolio, you need fewer reference images for individualisation and post training," explains Christian Els, CEO and co-founder of sentin.

GV-5880CP GigE Vision CMOS camera

Extremely accurate image acquisition and precise image evaluation are among the most important requirements for the camera used. Perfectly suitable is the GigE Vision CMOS camera GV-5880CP. The model has a 1/1.8" rolling shutter CMOS sensor Sony IMX178, which enables a very high resolution of 6.4 MP (3088 x 2076 px, aspect ratio 3:2). It delivers frame rates of up to 18 fps at full resolution and is therefore ideal for visualization tasks in quality control. The sensor from the Sony STARVIS series features BSI technology (backside illumination) and is one of the most light-sensitive sensors with a low dark current close to the SCMOS range (Scientific CMOS). It ensures impressive results even under very low light conditions.

"In addition to resolution and frame rate, the interface and the price were decisive factors in the decision for the camera. The direct exchange with the IDS development department has helped us to reduce the time needed for camera integration," says Arkadius Gombos, Technical Manager at sentin. The integration into the sentin VISION system is done via GenTL and a Python interface.

Advantages of AI over human inspection or applications

The human brain is beaten by artificial intelligence in terms of consistency and reliability

Automated, image-based quality control with Artificial Intelligence offers many advantages over human visual inspection or conventional machine vision applications. "In AI-based image interpretation, the aim is to create images on which humans can see the error, because then the AI model can do it too," concludes Christian Els. The system learns to recognize the requirements of the product similar to a human being. But the human brain is beaten at any time by an artificial intelligence in terms of consistency and reliability.

Even if the brain is capable of remarkable peak performance, an AI can recognize much more complex error patterns. The human eye, on the other hand, cannot stand up to any camera in terms of fatigue and vision. In combination with deep-learning recognition software, the image processing system therefore enables particularly fast and accurate inspection. Depending on the application, image acquisition and evaluation can take place in just a few milliseconds.

Deep learning

The system can also be applied to other areas such as surface testing. Similar applications are e.g. the testing of matte metal/coatings surfaces (automotive interior), natural materials (stone, wood) or technical textiles such as leather. Scratches, cracks and other defects on consumer goods can thus be detected and the respective products sorted out. Exclude quality defects and produce only good stuff, an indispensable process within the framework of quality assurance.

IDS cameras in combination with the deep learning supported software of sentin GmbH significantly optimize the detection of defects and objects in quality control. This allows the personnel and time expenditure for complaints and rework, as well as pseudo rejects, to be significantly reduced in a wide range of industries and areas.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version Download PDF version

In case you missed it

Safety In Smart Cities: How Video Surveillance Keeps Security Front And Center
Safety In Smart Cities: How Video Surveillance Keeps Security Front And Center

Urban populations are expanding rapidly around the globe, with an expected growth of 1.56 billion by 2040. As the number of people living and working in cities continues to grow, the ability to keep everyone safe is an increasing challenge. However, technology companies are developing products and solutions with these futuristic cities in mind, as the reality is closer than you may think. Solutions that can help to watch over public places and share data insights with city workers and officials are increasingly enabling smart cities to improve the experience and safety of the people who reside there. Rising scope of 5G, AI, IoT and the Cloud The main foundations that underpin smart cities are 5G, Artificial Intelligence (AI), and the Internet of Things (IoT) and the Cloud. Each is equally important, and together, these technologies enable city officials to gather and analyze more detailed insights than ever before. For public safety in particular, having IoT and cloud systems in place will be one of the biggest factors to improving the quality of life for citizens. Smart cities have come a long way in the last few decades, but to truly make a smart city safe, real-time situational awareness and cross-agency collaboration are key areas which must be developed as a priority. Innovative surveillance cameras with integrated IoT Public places need to be safe, whether that is an open park, shopping center, or the main roads through towns Public places need to be safe, whether that is an open park, shopping center, or the main roads through towns. From dangerous drivers to terrorist attacks, petty crime on the streets to high profile bank robberies, innovative surveillance cameras with integrated IoT and cloud technologies can go some way to helping respond quickly to, and in some cases even prevent, the most serious incidents. Many existing safety systems in cities rely on aging and in some places legacy technology, such as video surveillance cameras. Many of these also use on-premises systems rather than utilising the benefits of the cloud. Smart programming to deliver greater insights These issues, though not creating a major problem today, do make it more challenging for governments and councils to update their security. Changing every camera in a city is a huge undertaking, but in turn, doing so would enable all cameras to be connected to the cloud, and provide more detailed information which can be analyzed by smart programming to deliver greater insights. The physical technologies that are currently present in most urban areas lack the intelligent connectivity, interoperability and integration interfaces that smart cities need. Adopting digital technologies isn’t a luxury, but a necessity. Smart surveillance systems It enables teams to gather data from multiple sources throughout the city in real-time, and be alerted to incidents as soon as they occur. Increased connectivity and collaboration ensures that all teams that need to be aware of a situation are informed instantly. For example, a smart surveillance system can identify when a road accident has occurred. It can not only alert the nearest ambulance to attend the scene, but also the local police force to dispatch officers. An advanced system that can implement road diversions could also close roads around the incident immediately and divert traffic to other routes, keeping everyone moving and avoiding a build-up of vehicles. This is just one example: without digital systems, analyzing patterns of vehicle movements to address congestion issues could be compromised, as would the ability to build real-time crime maps and deploy data analytics which make predictive policing and more effective crowd management possible. Cloud-based technologies Cloud-based technologies provide the interoperability, scalability and automation Cloud-based technologies provide the interoperability, scalability and automation that is needed to overcome the limitations of traditional security systems. Using these, smart cities can develop a fully open systems architecture that delivers interoperation with both local and other remote open systems. The intelligence of cloud systems can not only continue to allow for greater insights as technology develops over time, but it can do so with minimal additional infrastructure investment. Smart surveillance in the real world Mexico City has a population of almost 9 million people, but if you include the whole metropolitan area, this number rises sharply to over 21 million in total, making it one of the largest cities on the planet. Seven years ago, the city first introduced its Safe City initiative, and ever since has been developing newer and smarter ways to keep its citizens safe. In particular, its cloud-based security initiative is making a huge impact. Over the past three years, Mexico City has installed 58,000 new video surveillance cameras throughout the city, in public spaces and on transport, all of which are connected to the City’s C5 (Command, Control, Computers, Communications and Citizen Contact) facility. Smart Cities operations The solution enables officers as well as the general public to upload videos via a mobile app to share information quickly, fixed, body-worn and vehicle cameras can also be integrated to provide exceptional insight into the city’s operations. The cloud-based platform can easily be upgraded to include the latest technology innovations such as license plate reading, behavioral analysis software, video analytics and facial recognition software, which will all continue to bring down crime rates and boost response times to incidents. The right cloud approach Making the shift to cloud-based systems enables smart cities to eliminate dependence on fiber-optic connectivity and take advantage of a variety of Internet and wireless connectivity options that can significantly reduce application and communication infrastructure costs. Smart cities need to be effective in years to come, not just in the present day, or else officials have missed one of the key aspects of a truly smart city. System designers must build technology foundations now that can be easily adapted in the future to support new infrastructure as it becomes available. Open system architecture An open system architecture will also be vital for smart cities to enhance their operations For example, this could include opting for a true cloud application that can support cloud-managed local devices and automate their management. An open system architecture will also be vital for smart cities to enhance their operations and deliver additional value-add services to citizens as greater capabilities become possible in the years to come. The advances today in cloud and IoT technologies are rapid, and city officials and authorities have more options now to develop their smart cities than ever before and crucially, to use these innovations to improve public safety. New safety features Though implementing these cloud-based systems now requires investment, as new safety features are designed, there will be lower costs and challenges associated with introducing these because the basic infrastructure will already exist. Whether that’s gunshot detection or enabling the sharing of video infrastructure and data across multiple agencies in real time, smart video surveillance on cloud-based systems can bring a wealth of the new opportunities.

Which New Buzzwords Reflect The Security Industry’s Trends?
Which New Buzzwords Reflect The Security Industry’s Trends?

As an industry, we often speak in buzzwords. In addition to being catchy and easy to remember, these new and trendy industry terms can also reflect the state of the security market’s technology. In short, the latest buzzwords provide a kind of shorthand description of where the industry is - and where it’s going. We asked this week’s Expert Panel Roundtable: What new buzzword(s) rose to prominence in the security industry in 2020? (And how do they reflect industry trends?)

Biometrics Provides Industries With Security, Access Control And Data Protection
Biometrics Provides Industries With Security, Access Control And Data Protection

Several major players vigorously employ biometric recognition technologies around the globe. Governments use biometrics to control immigration, security, and create national databases of biometric profiles. Being one of the most striking examples, the Indian Aadhaar includes face photos, iris, and fingerprints of about 1.2 billion people. Financial institutions, on their part, make use of biometrics to protect transactions by confirming a client's identity, as well as develop and provide services without clients visiting the office. Besides, biometric technology ensures security and optimizes passenger traffic at transport facilities and collects data about customers, and investigates theft and other incidents in retail stores. Widespread use of biometrics Business, which suddenly boosted the development of biometrics, is an active user of biometric technology Business, which suddenly boosted the development of biometrics, is another active user of biometric technology. Industries choose biometric systems, as these systems are impossible to trick in terms of security, access control, and data protection. Being in demand in business, these three tasks are also relevant for the industry. However, the use of biometrics at industrial sites is discussed unfairly seldom. Therefore, it is the face identification that is the most convenient there, as workers often use gloves, or their hands may be contaminated, and the palm pattern is distorted by heavy labor. All these features make it difficult to recognize people by fingerprints or veins and significantly reduce identification reliability. Therefore, industries seek facial recognition solutions. Thus, let us demonstrate the application of face recognition technology at different enterprises, regardless of the area. Facial recognition use in incident management Facial biometric products are known to automate and improve the efficiency of security services by enriching any VMS system. These systems provide an opportunity of instantly informing the operator about recognized or unrecognized people, and their list membership, as well as save all the detected images for further security incident investigation. Furthermore, some sophisticated facial biometric systems even provide an opportunity to build a map of the movements of specific people around a site. Besides, it is relevant not only for conducting investigations but also in countering the spread of the COVID-19 virus. Identifying and tracking COVID-19 positive cases Therefore, if an employee or visitor with a positive COVID-19 test enters a facility, the system will help to track his/her movement and identify his/her specific location. It will also help to take the necessary measures for spot sanitary processing. Thus, the introduction of biometric facial recognition at the industrial enterprise can improve and speed up the incidents’ response and investigations without spending hours watching the video archive. Access control system to secure physical assets The right access control system can help industries secure physical and informational assets The right access control system can help industries secure physical and informational assets, cut personnel costs, and keep employees safe. Facial recognition systems may enrich access control systems of any company by providing more security. As biometric characteristics, by which the system assesses the compliance of a person with the available profiles in the database, cannot be faked or passed. The human factor is also reduced to zero, due to the fact that while identity documents can be changed, the inspector can make a mistake or treat his/her task carelessly, be in collusion with an intruder, the biometric system simply compares a person in front of the camera with the biometric profiles database. Biometric facial identification software For example, RecFaces product Id-Gate, a specialized software product for reliable access control to the site, checks the access rights by using biometric facial identification alone or in conjunction with traditional IDs (electronic passes, access keys, etc.), which means that there is almost a zero probability of passing to the site by someone else's ID. The access control system’s functionality allows one to strictly account the number and time of all the facility’s visitors and also track their movement. When unauthorized access is attempted or a person from the stop list is detected, Id-Gate sends an automatic notification to the access control system and operator. Enhanced data and information security Even despite the division of access to different industrial enterprise areas, the security service needs to provide independent information system security. Employees with the same facility access rights may have different access rights to data. However, in that case, a personal password is not enough, as an employee may forget it, write it down and leave it as a reminder, tell a colleague to do something for him/her during the vacation, or just enter it at another person’s presence. Password-free biometric authentication systems make the procedure user-friendly and secure Password-free biometric authentication Password-free biometric authentication systems make the procedure user-friendly and secure. Such systems usually provide an option of two-step verification when successful password entry is additionally confirmed by biometric recognition. Hence, it is particularly relevant due to the current lockdown in many countries. To sum up, the application of biometric technologies solves several issues of the industry, such as: Optimizes and partially automates the work of the security service, as it provides reliable identification and verification of visitors/employees, reduces the amount of time spent on finding a person on video and making a map of his/her movements, without spending hours on watching video archive in case of investigation. Provides a high level of reliability and protection from unauthorized access to the enterprise and the information system. Provides a two-step verification of the user/visitor (including password and biometric data) and almost eliminates the risk of substitution of user data/ID.