The evolution of facial recognition: from bodycams to video surveillance

Download PDF version

Facial recognition has a long history dating back to the 1800s. To track down criminals, such as infamous bandits Jesse Woodson James and Billy the Kid, law enforcement would place “Wanted Alive or Dead” posters advertising bounties and soliciting public cooperation to help locate and even apprehend the alleged criminals. In addition to the bounty, these posters would include a photo and brief description of the crime, which would then be circulated to law enforcement agencies around the country and displayed in every US Post Office to speed up apprehension.

Facial Recognition

Advancements in artificial intelligence and biometric technology have led to the widespread use of computerised facial recognitionToday, technology such as social media, television and other more specialized communication networks play a more influential role in the recognition process. Advancements in artificial intelligence and biometric technology, including the development of Machine Learning capabilities, have led to increased accuracy, accessibility and the widespread use of computerized facial recognition. The significance of this means that facial recognition can occur on an even larger scale and in more challenging environments.

This article will explore key milestones and technological advances that have resulted in the modern incarnation of facial recognition, before discussing the capabilities of cutting-edge “one-to-many” technology which is increasingly being used by counter-terror defense, police and security forces around the world.

Technology Inception And Developments

The technology was able to match 40 faces an hour, which was considered very impressive at the time

The 1960s marked the start of computerized facial recognition, when Woodrow Wilson (Woody) Bledsoe developed a way to classify faces using gridlines. Bledsoe’s facial recognition still required a large amount of human involvement because a person had to extract the co-ordinates of the face’s features from a photograph and enter this information into a computer. The technology was able to match 40 faces an hour (each face took approximately 90 seconds to be matched) which was considered very impressive at the time.

By the end of the 1960s, facial recognition had seen further development at the Stanford Research Institute where the technology proved to outperform humans in terms of accuracy of recognition (humans are notoriously bad at recognizing people they don’t know). By the end of the century, the leading player in the field was a solution that came out of the University of Bochum in Germany – and the accuracy of this technology was such that it was even sold on to bank and airport customers.

From this stage on, the facial recognition market began to blossom, with error rates of automatic facial recognition systems decreasing by a factor of 272 from 1993 to 2010 according to US Government-sponsored evaluations.

The safety and security market requires near instant feedback on who a person matched against a watchlist is

The aim for facial technology is to achieve successful and accurate recognition on commonly available hardware like live CCTV feeds and standard computing hardware

Modern Usage Of Facial Recognition

Fast-forward to the modern day and facial recognition has become a familiar technology when using applications such as the iPhone X’s Face ID capability or MasterCard Identity Check, passport e-gates at airports and other security and access control points. These solutions implement a consensual form of identity verification, as the user has a vested interest in being identified.

This is a “one-to-one” facial recognition event, one person in front of the camera being compared to one identity either on a passport or the app. In these scenarios, the hardware is specifically developed for the application at hand, therefore technically much easier to accomplish.

Facial recognition can now be used in a variety of governmental and commercial environments The safety and security world brings a much more complex problem to solve – how to pick out a face in a moving and changing environment and compare it to several faces of interest. “One-to-many” facial recognition is a much harder problem to solve.

It’s even more challenging when the aim is to achieve successful and accurate recognition on commonly available hardware like live CCTV feeds and standard computing hardware. And unlike in the 1960’s where identifying a face every 90 seconds was acceptable; the safety and security market requires near instant feedback on who a person matched against a watchlist is.

Security And Safety Applications

The idea behind all facial recognition technologies is broadly the same: you start with an image of a person’s face (ideally a high quality one, although machine learning means that to a point we can now even use video without reducing accuracy). A fully front facing image is best, think a passport photo, but machine learning and new software has made this more flexible.

An algorithm converts this image into a numeric template, which cannot be converted back to an image and so represents a secure one way system. Every numeric template is different, even if it started out as an image of the same person, although templates from the same person are more similar than templates from different people.

The accuracy of facial recognition continues to increase alongside deployments in more challenging and complex environments What happens next sounds simple although the technology is extremely complex: templates of people’s faces are taken in real time and compared to those in the database. The technology identifies individuals by matching the numeric template of their face with all the templates saved in a database in a matter of seconds or milliseconds. To put this into perspective, imagine you are at the turnstiles of a busy train station looking for a person on the run.

Today’s facial recognition technology would be able to identify that person should they pass in view of a CCTV camera, as well as notify the police of any additional persons of interest, whether they are a known terrorist or missing vulnerable person on an entirely separate watch list.

Because of technical progression, facial recognition can now be used in a variety of governmental and commercial environments, from identifying barred hooligans attempting entry at a football stadium or helping self-excluded gamblers at casino to overcome addiction.

Real-Time Assessments

The latest evolution of facial recognition pits the technology against an even more challenging application – directly matching individuals from body worn cameras for real time recognition for police officers on the beat. This capability equips first responders with the ability to detect a person from a photo and verify their identity with assurance.

The broader implication for this means that every interaction, such as stop and search or arrest, can be supported by real-time facial recognition which will see cases of mistaken identity driven down on the streets. First responders can now for the first time be deployed and furnished with the ability to identify wider groups of people of interest with a degree of accuracy that previously relied only on the fallible human memory.

As the accuracy of the technology continues to increase alongside deployments in more challenging and complex environments, its ability to support government initiatives and law enforcement means the debate about the lawful and appropriate use of facial recognition must be addressed. Facial recognition should not be everywhere looking for everyone, but when used properly it has the potential to improve public safety and we should make the most of its potential.

Download PDF version

Author profile

Fernande van Schelle Product Manager, Digital Barriers

Related companies
Digital Barriers

Related links
Face Recognition Software Access control software
Articles by Fernande van Schelle

View all news from
Digital Barriers

In case you missed it

What Security Technologies Are Impacting The Retail Market?

With the advent of online shopping, brick-and-mortar retail businesses are challenged to make transactions more convenient while enhancing the “experience” aspects that differentiate real-life shopping from the simpler route of clicking on a website. Technology is helping retailers create that differentiation, including technologies such as video systems, deep learning analytics and point-of-sale (POS) integrations that have evolved from innovation in the physical security market. For more insights, we asked this week’s Expert Panel Roundtable: What new security industry technologies are having an impact on the retail market?

Healthcare Facilities Need To Focus On Cyber Security

From small-town dental offices to major hospitals, healthcare facilities of all kinds need to be safe, secure, and protected. Security guards are often needed in emergency departments, quality doors and windows need to be installed to prevent unwanted entry or escape, and employees need to handle every situation with care to avoid malpractice claims. These aspects are crucial for a medical facility's success, however, there is another major factor that needs to remain top of mind: cybersecurity. Importance of cybersecurity in healthcare According to a Healthcare Industry Cybersecurity Report by SecurityScorecard, over 75% of the entire healthcare industry has been infected with some kind of malware over the last year. The study examined 700 healthcare organizations including health insurance agencies, healthcare manufacturing companies, and medical treatment facilities. The report revealed that the healthcare sector is lacking basic cybersecurity awareness - putting the entire medical infrastructure at risk. The healthcare sector relies much more on technology than ever before. Devices that are connected to the internet are crucial for not only employee convenience but patient's wellbeing and safety, as well. From patient data and lab results to radiology equipment /and hospital elevators - everything needs to be functioning properly in order to ensure maximum efficiency across each facility. Sadly, those technologies are often vulnerable to cyberattacks, which can lead to hacked patient data, hijacked drug infusion devices, cryptocurrency scams, and even shut down an entire facility. Over 75% of the entire healthcare industry has been infected with some kind of malware over the last year Hospitals try to improve security, but in practice, these measures can get bypassed by clinicians, and then they're not as effective" "Hospitals try to improve security, but in practice, these measures can get bypassed by clinicians, and then they're not as effective," said Sung Choi, assistant professor at the University of Central Florida's department of health management and informatics. "Security adds inconvenience by design. The next step is figuring out how to improve it without the inconvenience." Healthcare cybersecurity facts Here are some interesting facts pertaining to cybersecurity within the healthcare sector: 63% of the 27 largest U.S. hospitals have a C or lower in Patching Cadence, which measures a facility's ability to implement security software patches in a timely fashion. Over 50% of the healthcare industry has a Network Security score of a C or lower. 96% of all ransomware targeted medical treatment centers. According to CynergisTek's survey of 60 C-level healthcare executives: 40% of respondents stated that third-party risks are the most concerning cyber threat. CynergisTek's survey: 33% of respondents reported that medical device security is one of the top five risks facing the healthcare sector. CynergisTek's survey: 54% of respondents said the biggest barrier to meeting security challenges was due to lack of adequate resources. In 2017, the healthcare industry saw an average of almost 32,000 cyberattacks per day. According to the Journal of the American Medical Association: healthcare delivery organizations (HDOs) were the fastest growing targeted group, accounting for over 70% of the 2,149 breaches tracked. The global healthcare Internet of Things (IoT) market is expected to grow with a 12.5% compound annual growth rate (CAGR) to $136 billion by 2021. 95% of all cybersecurity breaches are caused by human error. Thankfully, there are plenty of things that healthcare executives can do to fight back against digital threats "It is safe to say that costs to healthcare organizations will continue to rise as one of the fastest-growing threats, ran ransomware, successfully wreaks havoc in the industry," said authors of a recent IBM X-Force Research report. Steps to enhance cybersecurity Thankfully, there are plenty of things that healthcare executives can do to fight back against these digital threats. Here are some of the best security practices for healthcare facilities in 2019: 1. Risk Assessment First, an organization needs to evaluate any and all risks associated with the entire operation. From digital security to equipment theft, here are some of the most common risks to consider: Distributed Denial-of-Service (DDOS) attacks (attempting to crash servers). Viruses, malware, and ransomware threats by unintentional internet use. Active attempts to infiltrate network security.- Deliberate theft or corruption by employees. Data loss through software issues or hardware failures. Accidental unauthorized viewing of confidential data. A healthcare center needs to have all of its security and privacy policies documented, printed out, and visible 2. Continuous Education and Training Healthcare employees are critical to a facility's success. Investing in their education and training will surely pay off in the long run. Regular training will help them not only perform better but give them the ability to handle issues competently when something goes wrong. Investing in healthcare employees education and training will pay off in the long run 3. Document Everything A healthcare center needs to have all of its security and privacy policies documented, printed out, and visible. Doing this will ensure compliance with legislation and will serve as a reference point for the entire staff throughout the training process. 4. Assign a Security Specialist No matter how large your medical operation is, it's always a good idea to designate a specific individual (or team) to handle your in-house and digital security. Since tech security is so complex, your specialist will likely need to research the government's compliance information to ensure that every staff member follows the guidelines. 5. Develop a Back-Up Plan No matter how well prepared you are, something will always go wrong From the moment people started using computers, backing up data has been a crucial step. No matter how well prepared you are, something will always go wrong. Every practice needs to develop - and document - a detailed back-up plan to avoid serious issues. Not only that, but it's just as important to develop a comprehensive procedure for restoring back-ups after an issue has occurred. 6. Handle the Basics Many of these might seem obvious, but they are extremely important and often forgotten. Here are some general and everyday practices that should be performed: Updating and strengthening user passwords. Using security logs to monitor suspicious network activity and login attempts. Preventing unauthorized software installations. Removing unnecessary browser plugins and software. Restricting access to social media, chat, and dubious websites. Disabling or removing unnecessary accounts (ex-employees). Restricting access to physical ports on company machines. "If executive leadership truly understood the business risks posed by inadequate cybersecurity and realised the major operational, financial, and patient safety implications a security incident can have, they would ensure any and all resources needed were available," added David Finn, Executive Vice President of Strategic Innovation at CynergisTek. "We need to make sure we are effectively communicating these issues to executive leadership, so they make cybersecurity a business priority."

How Are Standards Changing Physical Security?

The definition of a standard is “an authoritative principle or rule that usually implies a model or pattern for guidance, by comparison with which the quantity, excellence, correctness, etc., of other things may be determined.” In technology markets, such as physical security, standards are agreed-upon language, specifications or processes that are used across the board by multiple stakeholders to enable easier interconnectivity and smoother operation of systems. We asked this week’s Expert Panel Roundtable: How are standards shaping change in the physical security market?