What do users want from their surveillance system? Ask any security professional, and you will hear answers like these: sharp, high quality images; widespread camera coverage; real-time analytics; fast search and retrieval of video footage with minimal, if any, intervention from people in the information technology department.

In other words, they want the tools they need to do their job. Delivering those tools requires an underlying technology infrastructure that includes a storage file system—preferably, one designed for video applications.

How do you know if one storage solution is better suited for video than another? What makes a file system ideal for video applications? There are several factors to think about.

Optimizing for write operations

What type of work do you expect the storage system to perform? It’s important to know because some systems are designed to handle certain types of work better than others.

Traditional information technology (IT) workloads consist of high volumes of transactions. Files are written to disk and then many read operations are performed. File systems that are optimized for read operations perform well for this type of workload, but they are not ideal for surveillance systems.

Surveillance workloads are different from typical transaction-based workloads. Streaming video and sensor data, from a network of hundreds or even thousands of multifunction cameras, flows continuously. Video management software (VMS) is used to manage the process—from image acquisition through visualization, analysis, and storage—while performing real-time analytics and metadata generation.

According to IHS, adoption of network cameras is moving quickly, and unit shipments of HD cameras are increasing

In storage terms, that means the file system should be optimized for write operations, not read operations. To perform well, the file system must be capable of ingesting streaming video from many cameras concurrently and performing simultaneous write operations without creating input/output bottlenecks.

Multiple Tiers Of Video Storage

How much storage capacity is needed to support a surveillance system? It depends on how many cameras are installed, what type of cameras they are, and how long the video must be retained.

High-definition (HD) cameras require more storage than analog cameras. Thanks to dropping camera prices, more organizations are replacing older cameras with digital units and expanding their surveillance coverage. According to IHS, adoption of network cameras is moving quickly, and unit shipments of HD cameras are increasing. By the time we reach 2019, according to IHS, 2.5 exabytes of surveillance data will be produced every day.

Since storage costs can account for as much as 60% of the budget for a surveillance system, the storage configuration must balance capacity, performance, and cost. That’s best accomplished by implementing multiple tiers of storage where older video files can be stored on a lower cost medium such as tape. The way files are managed between tiers, however, can make a big difference when working with video.

Managing Video Data Storage

What method does the file system use to manage data and storage? The advantage of a multi-tier storage architecture is that you can make better use of high-performance disk by moving older files off to tape, lowering your storage costs, but still be able to retrieve them later if needed.

Many information technology-centric storage solutions use a process called information lifecycle management (ILM) to manage data and storage. With ILM, usage policies are created for files. When the policy conditions are met, the file is moved to another tier of storage using an archive or data mover application.

Since storage costs can account for as much as 60% of the budget for a surveillance system, the storage configuration must balance capacity, performance, and cost
Thanks to dropping camera prices, more organizations are replacing older cameras with digital units and expanding their surveillance coverage

This process is not ideal when working with video. High-resolution cameras generate large files. When ILM policy conditions are met, the video files are copied across the same ingest network to another tier, which impacts system performance. To lessen the impact, the data often is saved to a lower resolution (a process called grooming) before it is moved.

Using the ILM method, if a file resides on archive storage, it must be restored back to the VMS system before it can be searched. That adds complexity and time. Plus, if the file has been groomed, the image quality is not as clear and sharp because of the lower resolution.

File Systems For Video Surveillance

When security professionals need to access recorded video, they want an easy way to search, find, and view it at the highest image quality possible, regardless of where the files are stored. Working in the timeline is important to security professionals. They want to perform their job from within the VMS application, not bounce between the VMS and an archive or data mover application to restore files.

Using the ILM method, if a file resides on archive storage, it must be restored back to the VMS system before it can be searched

File systems designed specifically for video applications meet these criteria. Like ILM, multiple tiers of storage are incorporated, and usage policies dictate when files are moved between tiers. The method used to manage data and storage, however, is better suited for video files.

These file systems can write multiple copies of the files at the same time. For example, when a file is written to disk it is simultaneously written to a tape device residing on a separate network. That way, when the usage policy is met, the data doesn’t need to be groomed and copied across the ingest network; the copy already resides on tape, so the storage management software just releases the blocks on disk, avoiding any performance issues.

Choosing File Systems For Video Performance

In addition, file systems designed for video applications are integrated with the VMS software and don’t require a separate archive or data mover application to move files between tiers. From the user’s perspective, they see one drive letter—a single name space—that represents all storage, instead of separate drive letters for each tier. That makes searching files easier. Plus, if the file that a user wants resides on tape, it doesn’t have to be restored before it can be searched. The user works within the VMS system without worrying about where the file is located, and the storage management software does the rest.

Evaluating a file system to determine if it will perform well for video applications requires digging into the details. You need to examine the architecture and understand how the file system operates – but the results are worth the effort.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version Download PDF version

Author profile

Wayne Arvidson Vice President, Strategic Alliances, Pivot3, Inc.

Wayne Arvidson is Vice President, Strategic Alliances at Pivot3 where he is responsible for managing the company’s key technology partnerships and identifying emerging players in the market. He has vast experience on best practices for video management, and is helping to drive industry transformation by educating the market on the role hyperconverged platforms can play as the foundation of a safe and smart infrastructure. He sits on the Security Industry Association’s International Relations and Government Affairs Committees, Working Groups on Body-Worn Video Technology and Homeland Security. He is also a member of the International Association of Chiefs of Police where he is active with the Law Enforcement Information Management group.

In case you missed it

New Markets For AI-Powered Smart Cameras In 2021
New Markets For AI-Powered Smart Cameras In 2021

Organizations faced a number of unforeseen challenges in nearly every business sector throughout 2020 – and continuing into 2021. Until now, businesses have been on the defensive, reacting to the shifting workforce and economic conditions, however, COVID-19 proved to be a catalyst for some to accelerate their long-term technology and digitalization plans. This is now giving decision-makers the chance to take a proactive approach to mitigate current and post-pandemic risks. These long-term technology solutions can be used for today’s new world of social distancing and face mask policies and flexibly repurposed for tomorrow’s renewed focus on efficiency and business optimization. For many, this emphasis on optimization will likely be precipitated by not only the resulting economic impacts of the pandemic but also the growing sophistication and maturity of technologies such as Artificial Intelligence (AI) and Machine Learning (ML), technologies that are coming of age just when they seem to be needed the most.COVID-19 proved to be a catalyst for some to accelerate their long-term technology and digitalization plans Combined with today’s cutting-edge computer vision capabilities, AI and ML have produced smart cameras that have enabled organizations to more easily implement and comply with new health and safety requirements. Smart cameras equipped with AI-enabled intelligent video analytic applications can also be used in a variety of use cases that take into account traditional security applications, as well as business or operational optimization, uses – all on a single camera. As the applications for video analytics become more and more mainstream - providing valuable insights to a variety of industries - 2021 will be a year to explore new areas of use for AI-powered cameras. Optimizing production workflows and product quality in agriculture Surveillance and monitoring technologies are offering value to industries such as agriculture by providing a cost-effective solution for monitoring of crops, business assets and optimizing production processes. As many in the agriculture sector seek to find new technologies to assist in reducing energy usage, as well as reduce the environmental strain of modern farming, they can find an unusual ally in smart surveillance. Some niche farming organizations are already implementing AI solutions to monitor crops for peak production freshness in order to reduce waste and increase product quality.  For users who face environmental threats, such as mold, parasites, or other insects, smart surveillance monitoring can assist in the early identification of these pests and notify proper personnel before damage has occurred. They can also monitor vast amounts of livestock in fields to ensure safety from predators or to identify if an animal is injured. Using video monitoring in the growing environment as well as along the supply chain can also prove valuable to large-scale agriculture production. Applications can track and manage inventory in real-time, improving knowledge of high-demand items and allowing for better supply chain planning, further reducing potential spoilage. Efficient monitoring in manufacturing and logistics New challenges have arisen in the transportation and logistics sector, with the industry experiencing global growth. While security and operational requirements are changing, smart surveillance offers an entirely new way to monitor and control the physical side of logistics, correcting problems that often go undetected by the human eye, but have a significant impact on the overall customer experience. Smart surveillance offers an entirely new way to monitor and control the physical side of logistics, correcting problems that often go undetected by the human eye. Video analytics can assist logistic service providers in successfully delivering the correct product to the right location and customer in its original condition, which normally requires the supply chain to be both secure and ultra-efficient. The latest camera technology and intelligent software algorithms can analyze footage directly on the camera – detecting a damaged package at the loading dock before it is loaded onto a truck for delivery. When shipments come in, smart cameras can also alert drivers of empty loading bays available for offloading or alert facility staff of potential blockages or hazards for incoming and outgoing vehicles that could delay delivery schedules planned down to the minute. For monitoring and detecting specific vehicles, computer vision in combination with video analysis enables security cameras to streamline access control measures with license plate recognition. Smart cameras equipped with this technology can identify incoming and outgoing trucks - ensuring that only authorized vehicles gain access to transfer points or warehouses. Enhance regulatory safety measures in industrial settings  Smart surveillance and AI-enabled applications can be used to ensure compliance with organizational or regulatory safety measures in industrial environments. Object detection apps can identify if employees are wearing proper safety gear, such as facial coverings, hard hats, or lifting belts. Similar to the prevention of break-ins and theft, cameras equipped with behavior detection can help to automatically recognize accidents at an early stage. For example, if a worker falls to the ground or is hit by a falling object, the system recognizes this as unusual behavior and reports it immediately. Going beyond employee safety is the ability to use this technology for vital preventative maintenance on machinery and structures. A camera can identify potential safety hazards, such as a loose cable causing sparks, potential wiring hazards, or even detect defects in raw materials. Other more subtle changes, such as gradual structural shifts/crack or increases in vibrations – ones that would take the human eye months or years to discover – are detectable by smart cameras trained to detect the first signs of mechanical deterioration that could potentially pose a physical safety risk to people or assets. Early recognition of fire and smoke is another use case where industrial decision-makers can find value. Conventional fire alarms are often difficult to properly mount in buildings or outdoor spaces and they require a lot of maintenance. Smart security cameras can be deployed in difficult or hard-to-reach areas. When equipped with fire detection applications, they can trigger notification far earlier than a conventional fire alarm – as well as reduce false alarms by distinguishing between smoke, fog, or other objects that trigger false alarms. By digitizing analog environments, whether a smoke detector or an analog pressure gauge, decision-makers will have access to a wealth of data for analysis that will enable them to optimize highly technical processes along different stages of manufacturing - as well as ensure employee safety and security of industrial assets and resources. Looking forward to the future of smart surveillance With the rise of automation in all three of these markets, from intelligent shelving systems in warehouses to autonomous-driving trucks, object detection for security threats, and the use of AI in monitoring agricultural crops and livestock, the overall demand for computer vision and video analytics will continue to grow. That is why now is the best time for decision-makers across a number of industries to examine their current infrastructure and determine if they are ready to make an investment in a sustainable, multi-use, and long-term security and business optimization solution.

How Technology Can Elevate Guest Services And Their Security
How Technology Can Elevate Guest Services And Their Security

The return to the workplace is a focal point for many in the built environment but one of the most important elements is easy to overlook. Guest services will be vital in the return to the workplace. Front-of-house teams will be responsible for welcoming building users back and reassuring them as they negotiate shared spaces in the post-Covid era. The workplace will inevitably look different after Covid. We have become more aware of our spaces, how clean they are, and what spaces building users share. Employees have also become more conscious of the pros and cons of the workplace. For some, a year of working from home has been a welcome break from the stress and time taken by a commute. Many organizations are considering moving to hybrid workplace approaches, downsizing their corporate real estate portfolio, and using shared spaces more consciously, be that for focussed quiet work or collaboration. We will also see heightened care in workplace cleaning and more data-led solutions. Front-of-house teams will be at the center of helping building users get used to these changes. The role of technology Front-of-house personnel will likely be responsible for ensuring buildings do not exceed safe occupancy levels and will be aided by visitor management systems.  Another change to look out for in the workplace will be the use of technology. Tech-led organizations have long reminded us that gut instinct and trusting our senses is not enough anymore, but Covid-19 has forced us to come to terms with this. Now that adopting technology has become crucial in cleaning, we will see a reticence to adopt it elsewhere fade too. A survey from McKinsey suggests that the pandemic has accelerated the adoption of technologies by several years. Why is this important for guest services? Much like other workplace changes, new technologies will alter how building users interact with their environment. Tech will also enable front-of-house teams to focus on the key ingredient of their role – human interaction. This will be vital in helping occupants feel comfortable, safe, and happy. Occupancy and visitor management systems These systems have been around in the workplace for many years, and pre-Covid were used to help us maximize our space and utilization. These systems are even more important as we are likely to see some return to the workplace before everyone has been vaccinated. We may see systems that contact only those occupants in an affected area of a building, rather than a whole workforce, to limit worry and ensure most people can remain confident in the hygiene of their workspace. For the rest of 2021 at least, precautions such as social distancing will need to be in place. Workplaces will continue to function at limited occupancy for some time to keep people safe. Front-of-house personnel will likely be responsible for ensuring buildings do not exceed safe occupancy levels and will be aided by visitor management systems. These may be used by individual organizations or by multi-tenanted buildings. Temperature checks and identity verification systems Organizations are mitigating risks where possible. Handheld digital thermometers have been in high demand. The use of such devices has reshaped the role of security officers over the past year. Officers have become familiar faces in shops and shared spaces, keeping people safe and acting as the first point of contact. The security sector has been placed under immense pressure, balancing the need to enforce precautions with responding to stressed building users in an empathetic way. Officers have demonstrated agility that security technology cannot replace. Post-pandemic, we will likely see a greater appreciation for what manned guarding can offer and a greater potential for officers in front of house roles. Front-of-House staff are becoming responsible for temperature verification. Some organizations may choose to increase the collaboration between their front-of-house and security teams. This could include implementing identity verification systems, as well as touchless systems. This will allow the focus of front-of-house teams to remain on the people and giving a warm welcome to users as they return to the office. Using monitoring to make guest services more available  Monitoring solutions may be the first things that come to mind when discussing security technology. We have seen an increasing trend toward integrating remote monitoring with manned guarding since before the pandemic. Such a move may be even more important now.Beyond keeping employees safe, guest services are going to play a central role in making the workplace an attractive option. For many organizations, the pandemic has forced a rapid switch in focus. Organizations have had to face the security challenges of caring for vacant premises and the additional complications of managing cybersecurity for remote work. Rebalancing the cost and focus of security may feel as though it has left some businesses without the capacity to utilize front-of-house officers. Yet when employees return to the workplace, front-of-house teams will be more important than ever. For those that did not do so during the pandemic, now is the time to be investing in effective monitoring solutions. The falling cost of technology means such a solution can be combined with manned guarding and front-of-house roles. Organizations may need to invest in fewer officers, but their roles can be more focused upon the occupant experience. Encouraging employees back Beyond keeping employees safe, guest services are going to play a central role in making the workplace an attractive option. Remote working has had both pros and cons but many of those downsides will be diminished with the end of the pandemic. Loneliness will no longer be such a challenge when seeing friends and neighbours is an option, and the return of children and partners to school and work will relieve distractions. It may be tempting, then, for many employees to continue working from home. As a result, many opportunities for collaborative work will be lost. For employers looking to encourage their workforce to return, creating an amazing workplace experience is key. Technology alone can’t offer this. Rather, too much tech could create an environment that feels clinical and impersonal. Use technology to streamline the boring or stressful elements of the workplace and invest in friendly faces who will welcome your workforce back.

What are the Security Challenges of Protecting the Cannabis Industry?
What are the Security Challenges of Protecting the Cannabis Industry?

The advent of a truly new market for the physical security industry is a rare occurrence. Particularly rare is a new market that is both fast-growing and provides an environment that is not just conducive to application of physical security technologies but that actually demands it. Such is the case with the market for legalized marijuana. We asked this week’s Expert Panel Roundtable: What are the security challenges of protecting the cannabis industry?