Knights of medieval times are known for impossible quests and challenging missions seeking rare religious items. The quest for the Holy Grail is perhaps the most notable. Today’s security professionals are often on their own quest, seeking what sometimes feels like the impossible – the search for perfect security metrics!

What are metrics and are they really that hard to find? Metrics are simply a measure to show effectiveness or to track performance. We are surrounded by metrics every day. For someone who wants to lose weight, a daily stop on the scale to track progress is an example of a metric. For someone interested in building muscle, the metric used may be the amount lifted in a bench press or leg press. Companies use metrics to measure key progress in areas such as sales, repeat customers or net income.

Security Metrics Best Defined By Finance Team

How do you measure the success of a security program? If your security program were primarily about preventing crime, you would need to track every time you deter a criminal – something that is very hard to know or track. Basically, it means tracking something that didn’t happen. There is good news though. There are other ways to measure success and to provide ways to showcase what the security program has accomplished. 

If there is one group that uses and understands metrics, it is the finance team of a business. The finance team deals with every part of an organization and understands the value of setting targets and measuring progress, in terms of budget, income and expenses. We are going to look at security metrics used in one case study that came about after the security department reported to the CFO. 

Understanding Security Metrics From The CFO

The CFO had several support groups reporting to him and was interested in how to track progress of each of the groups. It was quickly determined that there were four core areas to track. Activity, Efficiency, Quality and Customer Satisfaction were the categories focused on.


Service Area Background
Activity

Crime trends that pose a concern or need to be tracked;
what events take security's time and efforts?

Efficiency Budget, of course. What else affects efficiency?
Quality

What makes the security department stand out? What
does security offer to add value or improve quality of
services?

Customer Satisfaction What makes employees feel safe at work?

Security Activity Measurement 

The first category was to measure overall activity. The specifics may change from one organization to another, but looks at the types of responses and incidents handled by the security team. This should include general crime rates on campus, or may be a focus on specific issues. For example, in healthcare, a top priority has become the issue of violence and assaults on clinical staff by patients. 

By nature, many of these metrics are lagging metrics. In other words, the metric is a measurement of something that already happened. However, it is possible to include leading metrics as well. Leading metrics are a measurement of an activity that is pro-active or preventative in nature. An example of a leading metric could be tracking the number of exterior patrols done by security officers. The theory being highly visible and pro-active patrols are a deterrent and reduce overall crime on campus. For a system integrator, regular maintenance of access control or video systems that prevent downtime could be a measure of a leading indicator instead. 

Financially Efficient Security Program

Efficiency was the next category. Of course, since this was coming from the CFO, financial efficiency was involved. One metric was budget compliance, a ratio of budgeted funds versus actual spend as a percentage. Another efficiency number tracked was the number of voluntary turnovers. This number tracked how many security employees left for other pursuits. It did not include involuntary turnover, as it was felt that this could potentially influence leaders to keep unsavory employees to limit the turnover data. Other examples of efficiency could include storage of valuables for guests or patients, or number of lost items returned to the owner.

Quality Of Security Program

The next category considered was quality. To track the quality of the security program, a variety of options were considered. In this case, the number of security employees who received certification in the industry was tracked. The CFO also wanted to see the security department provide, or at least facilitate, security training for staff. The metric used was the number of training sessions provided to staff, including brief internal education meetings with different departments or ‘brown bag’ lunch and learn sessions that could include outside speakers. Again, education sessions were a more pro-active measure and could be considered a leading indicator.

Customer Satisfaction

A metric is something that you are going to want to measure on a regular basis and if the work involved getting that number is too difficult, it will quickly be ignored or left undone and you end up having no measure at all

The last area considered in this example was customer satisfaction. Fortunately, there were several options from which to choose. One vital measure was an annual survey that asked about staff perception of safety and security at the organization. The scale was 1-5 and allowed to track the number in the top category, those who felt very safe at work. This was the measure used with the goal to move people from the next category, feeling somewhat safe, to the top or feeling very safe. Response time by the security team was another area that linked directly to customer satisfaction. There was also a secret shopper program in place where an individual would contact security about a routine matter and provide feedback, scoring the officer on customer service and friendliness to the appearance of the officer’s uniform. 

Importance Of Security Metrics

Of course, tracking all of the metrics mentioned is great, but what does it really mean? Once you begin tracking results, the past results can be used as a baseline that allows you to set goals, establish targets moving forward, and identify areas of improvement. Keep in mind that these baselines are different from industry benchmarks. Benchmarks are comparisons or numbers based on a mix of different organizations, often within the same industry, to gauge where one company is in relation to the industry. 

When selecting metrics there are a few things to keep in mind. Probably the most important is to make sure that the data you need for the metric is easily available. A metric is something that you are going to want to measure on a regular basis and if the work involved getting that number is too difficult, it will quickly be ignored or left undone and you end up having no measure at all. A good rule of thumb is that the data or measure should be able to be collected within 15 minutes.

Also, pick metrics that are something that the security team can act upon or have a direct impact on. If the measure reflects something that the security team has no control over, then it tells very little about the success or effectiveness of the security program. For example, neighborhood crime stats may be valuable to track for awareness sake, but do not reflect on the security team’s performance so should not be included as part of the performance metrics.  

If there is one group that uses and understands metrics, it is the finance team of a business
(see bigger image)
Visuals and charts can be very helpful in seeing exactly what areas may need attention and what is going well

Evaluating Security Metrics

The last word about metrics: be sure to do something with the metrics collected. Use the data to tell a story about what the security department is doing. Visuals and charts can be very helpful in seeing exactly what areas may need attention and what is going well. Keep evaluating the value of the metrics used as well. An idea that originally seemed great, may turn out to not really reflect what you had hoped and should be changed and a new metric identified instead. This is an ongoing process.

Done right, a good metric program will help tell the story of the security department and highlight the successes as well as help identify potential areas for improvement.

Download PDF version

Author Profile

In case you missed it

Top 10: What Were Security Professionals Reading About In 2017?
Top 10: What Were Security Professionals Reading About In 2017?

Our most popular articles in 2017 reflected changing trends in the U.S. security market, from deep learning to protection of mobile workers, from building automation to robotics. Again in 2017, the most read articles tended to be those that addressed timely and important issues in the security marketplace. In the world of digital publishing, it’s easy to know what content resonates with the market: Our readers tell us with their actions; i.e., where they click.   Let’s look back at the Top 10 most-clicked articles we posted in 2017. They are listed in order here with the author’s name and a brief excerpt.  1. Las Vegas Massacre Demands Reevaluation of Hospitality Sector Security The Oct. 1, 2017, sniper attack from a 32nd-floor room at Mandalay Bay, overlooking 22,000 people attending a country music festival, has been compared to “shooting fish in a barrel.” When the bullets rained down, there was nowhere to hide. The attack came from outside the “perimeter” of the event, so any additional screening of attendees would not have prevented it. There are also implications of the Las Vegas massacre for the hospitality industry. Hotels and resorts such as Mandalay Bay have not generally embraced technologies like the explosives scanners or X-ray machines used at airport terminals, at least not in the United States. 2. Deep Learning Algorithms Broaden the Scope of Video Analytics [Zvika Ashani] Until recently there have been minimal applications of Machine Learning used in video analytics products, largely due to high complexity and high resource usage, which made such products too costly for mainstream deployment. However, the last couple of years have seen a tremendous surge in research and advances surrounding a branch of Machine Learning called Deep Learning. The recent increased interest in Deep Learning is largely due to the availability of graphical processing units (GPUs). GPUs can efficiently train and run Deep Learning algorithms The last couple of years have seen a tremendous surge in research and advances surrounding a branch of Machine Learning called Deep Learning 3. Home Security Systems: Why You Need to Upgrade From 3G to 4G Technology [Missy Dalby] The current communication method for most home security systems is via CDMA and 3G (GSM) technologies. With the emergence of faster, better, and stronger 4G LTE technology, carriers are migrating away from old technology standards and methods towards new, more efficient ones. As such, the older technology is going dark, and soon. Manufacturers of cellular modules have stopped making them. At the end of 2018 they will stop letting customers add systems utilizing 3G radios to their channels. 4. Diving into AI and Deep Learning at NVIDIA’s San Jose Conference [Larry Anderson] Video analytics applications fall under NVIDIA's “AI City” initiative, which they describe as a combination of "safe cities" (video surveillance, law enforcement, forensics) and "smart cities" (traffic management, retail analytics, resource optimization). Depending on the application, AI City technology must function in the cloud, on premises and/or at the edge. NVIDIA’s new Metropolis initiative offers AI at every system level, from the Jetson TX2 "embedded supercomputer" available at the edge, to on-premises servers (using NVIDIA’s Tesla and Quadro) to cloud systems (using NVIDIA’s DGX). 5. Physical Security Evolves to Protect Mobile Workers [Annie Asrari] With an increasing number of employees traveling and working remotely, the days of a dedicated worker who commutes to and from a single location every day of the week are just about over. Security professionals must take a second look at their policies and procedures for employee safety. To protect employees in this new mobile world, where people, assets and brand reputation threats may face higher than normal levels of safety and security risks, businesses must focus less on securing physical, four-wall perimeters and instead take a global approach to security that focuses on protecting traveling, remote and lone workers. Businesses must take a global approach to security that focuses on protecting traveling, remote and lone workers 6. New Security Technologies Driving Excitement on Busy ISC West Day One [Larry Anderson] ISC West in Las Vegas kicked off April 5 with an expanding focus on new technologies and new applications, including some that go beyond any narrow definition of security. “Technology is disrupting the market and executives are taking our solutions beyond security,” says Moti Shabtai, CEO and President of Qognify. “They are starting with security and quickly moving to other risk and business continuity issues in the organizations. They want a clear return on investment (ROI), which we can deliver if we move from covering a limited island of ‘security’ issues and give them the value of also managing risk, safety, and operations.” 7. Optimizing Building Automation for Good Return on Investment [Minu Youngkin] Smart buildings are on the rise around the world, not only because a growing number of companies are considering their environmental impact, but also because of the dramatic cost savings that can be realized through integration. In every building that has an integrated security and access control system, an opportunity awaits to also integrate the building’s energy use, water use, ventilation and more. The key is to effectively convey the tremendous potential of this new technology to the end user. 8. ISC West 2017: How Will IT and Consumer Electronics Influence the Secuirty Industry? [Fredrik Nilsson] A good way to predict trends [at the upcoming ISC West show] is to look at what’s happening in some larger, adjacent technology industries, such as IT and consumer electronics. Major trends on these fronts are the most likely to influence what new products will be launched in the electronic security industry. Proof in point is H.264, an advanced compression technology ratified in 2003 and adopted as the new standard by the consumer industry a few years later. By 2009, it became the new compression standard for the video surveillance industry as well. Violence will continue to challenge the healthcare sector in the future 9. The Future of Healthcare Security: Violence Response and Emergency Preparedness [Ben Scaglione and David LaRose] Violence will continue to challenge the healthcare sector in the future. Domestic violence, child abuse, behavioral health, drug and alcohol abuse will all continue to challenge hospital staff in the Emergency Department, Women’s Health, and behavioral health areas. The Hazard Vulnerability Assessments (HVA) along with facility wide risk assessments helps in defining risk severity and identifying historical patterns of violence. 10. Robot Revolution: Uncovering the Real Value of Security Robots [Steve Reinharz] The security coverage that a robot offers in the case of a shopping mall can be easily overshadowed by the fact that the machines seem to serve to entertain the population. Instead, security robots can best be utilized for more high-level roles, such as in critical infrastructure sites, corporate campuses and educational facilities, where wide, expansive spaces require continuous protection. In these locales, security can be difficult to achieve, as cost, location and lack of resources make the logistics of deployment difficult.

How To Prepare For Active Shooter Incidents | Infographic
How To Prepare For Active Shooter Incidents | Infographic

This Active Shooter infographic summarises information about trends among active shooter incidents, and outlines how an organization can develop a plan before tragedy occurs, including:   Statistics on the numbers and types of recent active shooter incidents. A profile of common traits among active shooters. How to prepare beforehand, and what to do when the police arrive. How organizational planning ensures maximum preparedness. Pre-attack indicators to look for. Be sure to share this information with coworkers and managers. Awareness is key to preventing active shooter incidents, and to minimising their tragic consequences. When sharing this infographic on your website, please include attribution to  SecurityInformed.com More resources for active shooter preparedness: How hospitals can prepare for active shooter attacks Six steps to survive a mass shooting Technologies to manage emergency lockdowns  How robots can check for active shooters  Background checks to minimise insider threats Gunfire detection technologies for hospitals, retail and office buildings 21 ways to prevent workplace violence in your organisation Non-invasive security strategies for public spaces    

Intelligent Surveillance: AI For Police Body-worn Cameras
Intelligent Surveillance: AI For Police Body-worn Cameras

Working together to develop an intelligent body-worn camera for public safety users, Motorola Solutions and artificial intelligence (AI) company Neurala are demonstrating how AI can be added to everyday devices such as smart phones using existing hardware platforms.  AI software, working at the “edge,” provides the capability to add AI functionality to existing cameras, such as Motorola’s Si500 body-worn camera. An agreement to develop the products follows Motorola’s strategic investment in Neurala in January 2017. “The technology is real, as our prototypes have demonstrated,” says Massimiliano “Max” Versace, Neurala CEO. “The technology will mature dramatically by the end of the year.” A final, marketable product from Motorola might be a year or more away, and the timing will depend on extensive testing in the meantime, he says. The goal is to enable police officers to more efficiently search for objects or persons of interest, such as missing children or suspects. Adapting Hardware For Artificial Intelligence Neurala’s learning capabilities “at the edge” are hardware-agnostic; its software-only focus enables the principles of artificial intelligence to be applied to a variety of hardware platforms, including low-cost platforms used inside smart phones. Typically, cost and the need for speed are limitations that determine what hardware can be leveraged using the software. The goal is to enable police officers to more efficiently search for objects or persons of interest, such as missing children or suspects In the case of the Motorola body-worn camera, AI functionality is being added to existing hardware in the device, which is much like a smart phone encased in the form factor of a body-cam. Today’s smart phones include cameras, gyroscopes and accelerometers to provide sufficient data to drive AI applications. Software adapts existing hardware to transform them into AI devices capable of continuous learning in the field. Finding Missing People In Crowds Neurala and Motorola are promoting the new agreement with a use case of how a policeman’s body-worn camera could help find a missing child in a crowd. A network “pushes” a photo of a missing child to a network of 1,000 body-worn and/or dashboard cameras in the field, which employ AI to search for the child within each camera’s field of view and then provide an alert when a match is found. The cameras operate passively, without involving police officers, in effect automating the process without police officers having to look at every face in a crowd. AI’s contribution is to eliminate the need for humans to do repetitive or boring work, such as look at hours of video footage. Neurala began working in AI 11 years ago, long before the current buzz in the market. In a sense, awareness has caught up with the company, which has been developing its technologies ahead of the curve. “The same technology could be applied to closed circuit cameras to detect other objects,” says Versace. “The Neurala Brain is neural network software that can be trained to find a variety of objects, such as backpacks or vehicles, in the air or on the ground.” AI’s contribution is to eliminate the need for humans to do repetitive or boring work, such as look at hours of video footage   Adding AI To Existing Security Devices Other applications are also being developed. For example, Neurala has applied its technology to help the Lindbergh Foundation fight poaching of elephants and rhinos in southern Africa using video from drones as part of its Air Shepherd Program. Neurala’s software helps human analysts by searching through terabytes of video, including infrared, in real time as the drone is flying, pinpointing animals, vehicles and poachers during the day and at night. Versace expects the first applications of AI on existing products, including cameras and drones, before it is applied to robotics and other new applications. In effect, Neurala provides a “brain plug-in” that can add AI to change an existing solution from a passive sensor to a device that is “active in its thinking,” he adds. AI is here to stay, says Versace. “The market should know that AI has reached a point of no return. Companies that don’t use AI will be left behind. It’s the way to go to amplify your output.” Does Artificial Intelligence Threaten Humans? However, the technology isn’t perfect and shouldn’t be expected to be. “It’s still a growing technology, so you can’t expect 100 percent correct performance, especially if you deploy it in a constrained environment such as a cell phone,” says Versace. “AI can approximate 90 percent of a human’s ability to detect an object, and it’s tireless and can work 24 hours a day. It’s a liberating technology that takes on jobs that are not interesting, such as looking for a backpack on a computer screen.” AI tends to engender anxiety among some, with people like Elon Musk warning of an existential threat of the technology and a coming AI apocalypse. We should all relax, says Versace. “It’s a liberating technology,” he says. “Anyone who talks about AI as dangerous is not an AI expert. The less you know about AI, the more alarmist you are.” He suggests the physical security market should “learn more about it so they won’t be so scared.”