FLIR PT Series cameras were used in a surveillance project to detect and monitor illegal fishing and poaching activities along the Spanish Galician coast. The FLIR thermal imaging cameras combined with maritime video analytics from Gradiant were ideal for spotting illegal vessels on a 24/7 basis and at a long range. The vastness of the Galician coastline and the multitude of fishing and farming activities call for a more automated surveillance approach.

Fishing, shellfish harvesting, and marine aquaculture - mainly mussel farming in inshore waters are important economic activities in Galicia (northwest of Spain). Local public authorities strictly control these activities to prevent exploitation, fish stock depletion and resulting economical losses. They are fighting a constant battle against this unfair and illegal competition that affects thousands of professionals who make a living from the fishing and seafood industry.

Challenges of coastal monitoring

Illegal fishing and poaching has an enormous impact on the environment and food safety

Illegal fishing and poaching of seafood resources also has an enormous impact on the environment and food safety; especially during periods of toxic algal bloom (red tides), when fishing conditions are hazardous for public health. The detection of unauthorized fishing and shellfish harvesting is of paramount importance for the Galician authorities.

However, monitoring and protecting all of Galicia’s inshore and offshore fisheries, shellfish harvesting areas, and marine aquaculture farms is a challenging task. Galicia has 1,200 km of coastline. Its protection involves the surveillance of activity in 122 ports, including around 5,000 fishing boats, 400 beaches dedicated to shellfish harvesting, and 47 mussel aquaculture farms, with a total of more than 3,000 bateas (floating mussel farms).

Long-range thermal imaging

Moreover, most illegal activity takes place at night, making it extra difficult for law enforcers to detect any type of vessel. The Galician climate does not help either. With an average of 128 days per year of rain, visibility conditions are usually not ideal for surveillance operations. Manned surveillance patrols can only do so much; they are hindered by the climate and visibility conditions, making it impossible (from a practical and financial standpoint) for coast guards to cover the entire Galician coastline.

In 2017, the Galician Coast Guard started a project to test video surveillance of the coastline based on thermal imaging cameras. The pilot included the use of FLIR’s PT Series multi-sensor camera, combined with maritime video analytics software from Gradiant (Pontevedra, Spain).

Multi-sensor installation

FLIR thermal images were enhanced by Gradiant’s intelligent video analytics software for maritime applications

The multi-sensor installation was extensively tested on two different locations along the Galician coast. One set-up was used to monitor illegal vessels on coastal waters at short/medium range, while another set-up was used for long-range monitoring. The PT Series thermal cameras allowed the Galician Coast Guard to monitor the required area over a long range on a 24/7 basis, even at night and in adverse weather conditions.

In addition, the FLIR thermal images were enhanced by Gradiant’s intelligent video analytics software for maritime applications. This software is specifically adapted for monitoring coastal environments and allowed the coast guard to detect, track and geo-localise people and vessels, including small wooden and plastic boats.

Visible-light camera

The software enabled the thermal cameras to detect objects and people despite adverse maritime conditions, such as high waves, low contrast due to low light, fog and rain, reflections on the sea surface, camera vibrations, and the presence of distractors, such as birds and vessel wakes.

The FLIR PT Series is a high-performance multi-sensor pan/tilt security camera, incorporating an uncooled thermal camera with sensitivity of <35mK and a visible-light camera with 36x optical zoom. While the thermal camera is used to detect threats over a long range based on their heat signatures, the visible-light camera can be used for verification and identification.

Long-range surveillance

The requirements for this long-range application were extremely challenging for any thermal camera"

“FLIR is the reference for long-range surveillance applications with thermal imaging,” says José Antonio Rodríguez, Head of Video Analytics at Gradiant. “The thermal performance of the camera and the fact that this technology is easy to set up makes it ideal for this type of application. In addition, FLIR supported us from the start for lens selection, calibration of the system and much more.”

“The requirements for this long-range application were extremely challenging for any thermal camera,” says Nikitas Koutsourais, Product Marketing Manager at FLIR Systems. “Thanks to the FLIR PT Series’ unique thermal sensitivity of less than 35mK, we could provide the best image performance in the market.”

IP video streaming

Two different configurations were used in this application. The long-range surveillance station used a FLIR PT-606 camera, and was able to detect a rubber inflatable boat at 4,000m. Despite its narrow field of view, this camera allowed for wide coverage thanks to the high-precision pan/tilt unit. The camera was able to sweep a wide field of view span in a pre-programmed sequence of pan/tilt presets.

The port surveillance station used a PT-625, offering a good compromise between detection range and field of view with a single pan/tilt preset. The integration of the video analytics software with the camera was easy thanks to IP video streaming and the camera’s ONVIF compliant interfaces for pan/tilt control. Long-range surveillance typically requires the use of lenses with a narrow field of view, which is a problem when you want to monitor wide areas.

Coastal protection applications

The FLIR thermal cameras provided the Galician coastguard with increased situational awareness

However, the video analytics from Gradiant was able to take advantage of the Preset Sequencing mode of the FLIR PT Series. This allowed the coastguard to cover a wide field of view with a single camera and to perform video analysis on each pan/tilt preset. The FLIR thermal cameras provided the Galician coastguard with increased situational awareness and allowed them to respond much quicker to illegal fishing activities.

The pilot project was performed in a realistic surveillance environment along the Galician coast and generated very positive results. The combination of a multi-sensor system with Gradiant’s maritime video analytics proved to be effective to deal with the intricate Galician coast lines and a lack of open view. In addition, this technology combination is a cost-effective alternative, making automated surveillance applications accessible for fish farm companies worldwide.

Extremely rugged systems

Finally, the PT-Series are extremely rugged systems, which makes them ideal for coastal surveillance, especially in an extremely humid environment such as the Atlantic coast of Spain. The system’s vital core is well protected against dust and water ingress, and complies with IP66 requirements.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

In case you missed it

HID Global Pilot Program Demonstrates Social Distancing and Contact Tracing
HID Global Pilot Program Demonstrates Social Distancing and Contact Tracing

If one employee stands less than six feet away from another employee, a fob attached to a lanyard around his or her neck emits an auditory beep – an immediate reminder to observe social distancing. If an employee were to be diagnosed with COVID-19, a cloud-based database provides a record of who at the company the sick employee had contact with. These capabilities of HID Location Services ensure social distancing and provide contact tracing to enable companies to return to work safely. They have been deployed in a pilot program at HID Global’s Corporate Headquarters in Austin, Texas. Social distancing using a BLE beacon To ensure social distancing, a Bluetooth Low Energy (BLE) beacon is emitted from an employee’s fob (or from a badge that has the same functionality). The beacon communicates peer-to-peer with a beacon emitted by another employee’s fob or badge to alert if the location of the two employees is less than six feet apart. To ensure social distancing, a Bluetooth Low Energy (BLE) beacon is emitted from an employee’s fob For contact tracing, the beacons communicate via a nearby “reader” (a BluFi BLE-to-Wi-Fi gateway) to the Bluzone cloud-based software-as-a-service. The building area covered by each reader constitutes a “zone,” and the system records when two beacons are signaling from the same zone, which indicates contact between employees. In effect, the system records – historically and forensically – who was near whom (and for how long) using the zone-based approach. “In the workplace, we provide organizations with visibility into the location of their workforce,” says Mark Robinton, Vice President, IoT Services Business Unit at HID Global. Pilot program spans variety of environments By documenting where a sick individual moved in the building, the system also can guide any need to close off a certain area for deep cleaning. Instead of quarantining a whole building, a company could quarantine a small subset of employees who were likely exposed. Importantly, the system only reports data, while management makes the actual decisions about how to respond. The site of the pilot program is the 250,000-square-foot HID Global facility in Austin, which includes a variety of environments, including manufacturing areas, an executive suite, cubicles, a training area, a cafeteria, and lobbies. This spectrum of use cases enables the pilot program to evaluate how the system works in various scenarios. The building in Austin has two floors, plenty of natural lighting and emphasises sustainability in its design. HID Location Services ensure social distancing and provide contact tracing Pilot starts small and expands For the pilot program, 80 readers were installed in a wide area in the facility, including a variety of environments. Initially 30 badges and 30 fobs, all BLE-enabled, were issued to employees. If a badge identifies another nearby beacon (suggesting a social distancing failure), it emits a blinking LED light, which can be seen by the offending co-worker. The fobs emit an audible beep, which employees have overwhelmingly said they prefer. Observers overseeing the pilot program have documented employee reaction and comments. It emits a blinking LED light, which can be seen by the offending co-worker There were challenges in setting up the pilot program remotely to ensure fewer employees were on site during the pandemic. The equipment was provisioned in Florida and then shipped to the Austin location. Fine-tuning was required to adjust the signal strength of the BLE beacons. The badges were initially more powerful, but the strength was dialed back to be comparable to the fobs and within the six-foot social distancing range. Signal strength is also a variable in diverse environments – the 2.4 Ghz signal tends to reflect easily off metal, so adjustments in signal strength are needed in a factory setting, for example, versus a collection of cubicles.   “This facility is large enough and diverse enough that it provides great test results and quality data to analyze,” says Dean Young, Physical Security Manager at HID Global. “Our employees are eager to be part of the pilot to demonstrate that we use the technologies we provide to our customers, and they want to help us stay in compliance with social distancing and contact tracing.” Ensuring privacy while protecting employees HID Global’s headquarters had approximately 425 employees before the coronavirus pandemic lowered the number drastically to include only essential workers. As more people return to work, additional fobs and badges are being issued to expand the scope of the pilot program. The program is also incorporating contact tracing of suppliers and others who visit the facility. Except when triggered by contact among employees, locations are not recorded. Each employee’s location is always available in real-time (e.g. in case of an emergency), but they are not “tracked.” Through BluFi placement and geofence capabilities, the system closes off private areas where location should not be monitored, such as a rest room. Geofencing also identifies when employees enter and/or exit the area covered by the pilot program. Although each beacon is associated with an employee, the employee’s identity is not part of the data stored in the cloud, so there are no privacy concerns. Data is completely anonymized, and no personally identifiable information (PII) is stored in Bluzone. Other computer systems in a company, such as a human resources (HR) program, can privately and securely store the identities associated with each beacon.   Other applications for HID location services In addition to social distancing and contact tracing applications, HID Location Services offer other use cases ranging from asset tracking and employee safety/security to location analytics. For example, the system can analyze room usage for better building management and operational efficiency. It can also quickly find people in emergency situations. These use cases ensure continued value for a system even after concerns about social distancing and contact tracing have faded. The system can analyze room usage for better building management and operational efficiency Another big selling point is the ability of a company to be better prepared in case of a future pandemic, or a second wave of this one, says Robinton. The HID Location Services social distancing and contact tracing applications will be available at the end of Q3 and will be rolled out through HID Global’s existing integrator channel. Vertical markets likely to embrace the technology include healthcare, where hospitals need to track patients as they come in and to know which other patients or staff they may have been exposed to. The financial sector is another likely market, as is manufacturing, which is looking to avoid the prospect of shutting down an entire plant. It’s better to address the three or four people who were near a sick employee than to shut down the plant. In the hospitality industry, fobs can be used to signal duress by the housekeeping staff.

Debunking The Myths Of EBT Cameras In A COVID-19 World
Debunking The Myths Of EBT Cameras In A COVID-19 World

The new buzz in the thermal imaging world goes by many names. In a short time, a small niche in the world of IR, which was previously sidelined to make way for more lucrative markets such as security and defence, has taken the top spot in the attention, production and sales for many manufacturers and integrators.  It’s no surprise considering the size of this new market. Suddenly, hotels, cinemas, malls, hospitals, critical services, public transportation, office buildings and more have become consumers of thermal imaging cameras. Along with that, the more traditional markets, such as security, defense and industry are suffering from budget cuts, project cancellations, or postponements. Combine two of these elements, and the new elevated body temperature (EBT) camera market is easily 3-4 times the size of the other markets combined. Thermal imaging cameras and common misconceptions Can thermal cameras detect viruses?  The answer is NO. The best the camera can do is tell you if someone has a higher skin temperature than others. There are many reasons for an elevated body temperature which are not all health-related, such as exercise or even sitting in a warm environment without air-conditioning. Are the cameras accurate? The accuracy debate is a significant and controversial discussion with much misinformation running around. When discussing accuracy, there are two considerations: The first consideration is the accuracy of the camera itself versus a blackbody. Blackbodies are devices which can regulate temperature very accurately (although not all are equal) and have a high emissivity level, which means they are almost not affected by surrounding heat or energy. All thermal cameras are calibrated against blackbodies. Still, some manufacturers have been using them in their EBT solutions to give the camera a consistent temperature reference to which it can adjust. The accuracy of the camera in this discussion talks about the camera itself. How sensitive the detector is, internal reflections, lens aperture, noise level and the calibration process itself. Also, if you read the fine print, most manufacturers quote accuracy levels which are valid only in a controlled or laboratory environment. As in, a room with a steady 25°C and a slow shift in temperature (not more than 1°C per hour). Most field conditions don’t allow this – so this low level of accuracy is challenging to replicate in practice.Blackbodies are devices which can regulate temperature very accurately The other focuses on the fact we are not looking for COVID in black bodies. We are looking for it in humans. And, the substance known as human skin acts very differently. To date, there are no medical models which can predict how skin will behave in different scenarios. We don’t know what the external skin temperature of a man weighing X who was exposed for X minutes to direct or indirect sunlight would be. So, while the black body may be spot on – it has no bearing on the temperature reading of humans.  So, while we can improve the first issue, the second one is more complicated. One way to circumvent it is by using population statistical analysis and looking for the gradient between the healthy population (which does have existing medical models) to the people with a higher temperature which are statistical anomalies for such a camera. Thermal cameras and their suitability  Are all thermal cameras suitable for temperature readings? There is a difference between a thermal camera and a thermometric camera. A thermal camera developed for security and defence are used to detect threats and give situational awareness. We don’t care that two trees with different temperatures will have different colors – we care about the person standing between them. We manipulate the image, so the viewer has a better understanding of what he sees. With thermometric measurement (as in – thermal temperature reading) we do the exact opposite. We want accurate temperatures readings for each pixel in our screen. A thermometric camera will go through a rigorous calibration together with the lens, which often takes longer. We need to offset, in the calibration tables, minute pixel-sized blemishes in the detector and lens. Those blemishes would be invisible in a thermal image – but can skew the temperature reading and produce inaccurate results. We regularly see suppliers who are using regular thermal cameras with blackbodies to auto adjust the temperature reading as described above. But, if you take that same blackbody and move it a meter to one side, you may discover the camera suddenly registers a different temperature – as not all pixels have a uniform calibration. Does it matter where we scan in humans? Yes and no. The inner canthus of the eye (the tear duct) is the most relevant external point with the best correlation to internal temperature. People looking at the inner canthus will manage to avoid a lot of the effects of ambient temperature on the skin. The tradeoff is that the inner canthus is a tiny area, and people would need to remove their glasses. Most of the world’s health organisations consider the difference between a healthy and sick individual to be 1.5° C (or 2.7° F). That change is consistent whether you’re looking at the tear duct, the forehead or a mouth. Thus, the solutions that look at the gradient temperature (population-based solutions) are just as effective when measuring the ambient temperature on the skin of the population tested.  Do people need to stop in front of the camera? Not necessarily. It depends on the speed of the camera and the temperature detection algorithm. Some cameras can detect people walking very quickly as they only need a few frames to detect the temperature. Will the camera work outdoors? Most outdoor cameras will suffer from false alarms and misses. Some cameras have very advanced compensation algorithms for this, but they can’t take into account all the dynamic temperature changes, humidity, sporadic energy readings and the “bane of thermal imaging” - turbulence. Therefore, the conditions can strain even the most advanced algorithm.  Why invest in this technology? The WHO states, that while asymptomatic transmission exists, it’s much less contagious then symptomatic transmission. Some doctors claim that a person with a fever sheds the virus five times more aggressively than a person with no fever.  There are clear regulations for businesses to screen individuals for fever In some countries, there are clear regulations for businesses to screen individuals for fever as they come into the establishment. While you can have a person in the entrance with a contactless thermometer, they must stop people for a 5-second check each time they come in. That would cause long lines in many places with high traffic. And, during testing, standing less than 2 meters from the individual would throw social distancing out the window. If the tester got sick, the next day they would start endangering everyone else they checked. It’s better to screen automatically and only use the IR thermometer in cases where an alert was triggered and needed to be verified. Various forms of technology  We’ve also seen much use of the IR tablets recently. While they are low cost, a person usually needs to stand very close (less than 1 meter) from the monitor to be caught by the camera. Thus, spreading his germs on the glass or plastic cover of the tablet while being screened.  In conclusion – Thermal EBT cameras are important. They aren’t a miracle cure, and they won’t stop the spread of the virus. And one should be careful of false promises. But along with other solutions (most importantly – masks), they can help protect us during these times and allow the wounded global economy to rejuvenate itself.

Beyond Video Analytics, What Are the Benefits of AI and Machine Learning?
Beyond Video Analytics, What Are the Benefits of AI and Machine Learning?

Artificial intelligence (AI) and machine learning have made a big splash in the physical security market, transforming video analytics to a new level of accuracy. In fact, the terms have become common buzzwords throughout the industry. However, the potential for AI and machine learning to impact the physical security industry goes far beyond their ability to improve video analytics. We asked this week’s Expert Panel Roundtable: Beyond better video analytics, how can artificial intelligence (AI) and/or machine learning benefit the physical security market?