Download PDF version Contact company

Video storage is the foundation for new video surveillance infrastructures. Depending on your platform, storage can enhance your surveillance system’s capabilities, or it can limit them. But one thing is certain: your storage decision can no longer be an afterthought.

Tremendous Growth In Data Storage

Digital technology is transforming the surveillance industry. In fact, it’s estimated that 66 million network cameras and 28 million high-definition CCTV cameras will ship by the end of 2016. High definition has become the camera technology of choice for new installations, and that’s resulting in tremendous growth in the amount of data to be stored.

Measuring in exabytes (one exabyte (EB) is approximately equal to one billion gigabytes (GB)), some estimates predict the amount of surveillance video stored over the next two years will nearly double, growing from 3.96 EB this year to 7.89 EB in 2018. And by 2019, projections estimate 2.5 EB of video will be produced every day.

That’s a lot of data to store. Combine the growth estimates with the fact that retention times are getting longer due to changing regulations and legal requirements, and you have an industry desperately in need of more storage capacity. Hence, it’s no surprise that the enterprise storage market for video surveillance will surpass $1 billion by the end of the year.

Security Project Budgets

Video surveillance projects consist of many parts. Typically, project budgets are split between cameras, infrastructure, analytics solutions, video management system (VMS) software, and storage. But storage is often the largest single line-item expense with traditional implementations comprising 55-60% of the total budget dollars.

Technology decision makers and systems integrators need to evaluate the storage component of any video surveillance solution
Data management is an ongoing challenge for every organization

In fact, the total spending for storage compared to other components in a video surveillance solution can be dramatically different. For example, the San Diego Police Department’s body-worn camera project in 2015 estimated spending $267,000 to purchase 1,000 cameras and $3.6 million (over a five-year period) on data storage and other storage-related expenses. In another instance, the Duluth Police Department project called for $5,000 to be spent on cameras compared to $78,000 (over a three-year period) on data storage. And in another case, the Los Angeles Police Department is expecting to spend $7 million to outfit 7,000 officers with body cameras while paying a five-year cost of approximately $50 million on data storage, maintenance, and program expenses.

Data Management Challenge

Data management is an ongoing challenge for every organization. Factoring in the growth of surveillance video and the influx of unstructured data from the Internet of Things (IoT), which is expected to surpass 100 billion devices by 2020, the effort becomes even more difficult. As a result, storage decisions have become much more strategic.

Both technology decision makers and systems integrators working on behalf of customers need to evaluate the storage component of any video surveillance solution design carefully to ensure it meets their needs for today and tomorrow. Here are some questions to consider:

1. Does the storage solution you are considering strike the right balance of performance and retention time required while meeting the project budget? Storing data on high performance disk when it is really suited for long-term retention is expensive. Make sure your design enables you to prioritise the right storage technology and take advantage of less expensive formats such as tape and cloud whenever performance is not the main requirement.

2. Is the solution optimized for your expanding performance needs? Adding more high-definition cameras and performing real-time analytics requires high-performance storage to ingest parallel streams of high-resolution video without dropping frames or impeding processing. Make sure the storage platform you select can handle the demands of advanced video applications.

Smarter storage options, such as a multi-tier solution, can save you money and free up dollars in your budget to spend on additional cameras or analytics software

3. Will the storage platform make it easy to access the data you need, when you need it? Visibility and accessibility are important. Finding the files you need when you need them should not be a time-consuming, arduous task. Make sure your platform delivers a single view that simplifies search and retrieval of your files.

4. How well will your storage solution integrate with your existing infrastructure? Interoperability is imperative. Being locked in with one vendor or platform doesn’t provide the flexibility you need for today’s heterogeneous environments. Make sure your storage solution integrates with all major platforms, operating systems, networks, and video management solutions.

5. Will the storage platform scale to accommodate adding more devices and new technologies? Camera counts are going up. High-definition, multi-sensor units are replacing analog And the IoT continues to evolve, adding new devices and sensors to the mix and creating untold numbers of opportunities for data analysis. Make sure your storage platform will integrate with complex data from disparate sources and will scale accordingly to accommodate the need for more capacity.

6. Does the storage solution comply with your existing security requirements? Legal and institutional requirements for data vary, depending on the type of information stored and industry regulations. Make sure your storage solution satisfies all requirements for retention, access, and security.

7. Will the storage platform easily build onto your current infrastructure without overhauling the whole system? Adding capacity onto an existing infrastructure may be the most cost-effective way to address storage challenges. Make sure your storage solution is flexible and capable of building onto your existing infrastructure in a non-disruptive fashion.

Storage is a strategic decision, and is increasingly the foundation new video surveillance infrastructures are built upon
Smarter storage options can save you money and free up dollars in your budget to spend on additional cameras or analytics software

 

Multi-Tier Storage Options

Smarter storage options, such as a multi-tier solution, can save you money and free up dollars in your budget to spend on additional cameras or analytics software. Unlike solutions confined to primary storage, multi-tier options deliver high performance and give you more control over where your files are stored. Through user-defined policies, higher priority files can be stored on high-performance disk while lower priority files can be moved off to less expensive storage alternatives, such as tape or cloud.

More control saves money on storage costs. Consider this relative comparison: If high-performance primary disk costs $1, object storage costs $.35, file-based tape costs about $.18, and the cloud costs somewhere between $.08-.16. By managing data across the available tiers, you can reduce storage costs by up to 33% and still deliver the total storage capacity required.

Today, storage is a strategic decision, and is increasingly the foundation new video surveillance infrastructures are built upon. Using a multi-tier solution is the most high-performing, cost-effective approach to meeting today’s and tomorrow’s demanding capacity needs.

Download PDF version Download PDF version

Author profile

Wayne Arvidson Vice President, Strategic Alliances, Pivot3, Inc.

Wayne Arvidson is Vice President, Strategic Alliances at Pivot3 where he is responsible for managing the company’s key technology partnerships and identifying emerging players in the market. He has vast experience on best practices for video management, and is helping to drive industry transformation by educating the market on the role hyperconverged platforms can play as the foundation of a safe and smart infrastructure. He sits on the Security Industry Association’s International Relations and Government Affairs Committees, Working Groups on Body-Worn Video Technology and Homeland Security. He is also a member of the International Association of Chiefs of Police where he is active with the Law Enforcement Information Management group.

In case you missed it

Access The Right Areas - Making A Smart Home Genius With Biometrics
Access The Right Areas - Making A Smart Home Genius With Biometrics

Household adoption of smart home systems currently sits at 12.1% and is set to grow to 21.4% by 2025, expanding the market from US$ 78.3 billion to US$ 135 billion, in the same period. Although closely linked to the growth of connectivity technologies, including 5G, tech-savvy consumers are also recognizing the benefits of next-generation security systems, to protect and secure their domestic lives. Biometric technologies are already commonplace in our smartphones, PCs and payment cards, enhancing security without compromising convenience. Consequently, manufacturers and developers are taking note of biometric solutions, as a way of leveling-up their smart home solutions. Biometrics offer enhanced security As with any home, security starts at the front door and the first opportunity for biometrics to make a smart home genius lies within the smart lock. Why? Relying on inconvenient unsecure PINs and codes takes the ‘smart’ out of smart locks. As the number of connected systems in our homes increase, we cannot expect consumers to create, remember and use an ever-expanding list of unique passwords and PINs. Indeed, 60% of consumers feel they have too many to remember and the number can be as high as 85 for all personal and private accounts. Biometric solutions strengthen home access control Biometric solutions have a real opportunity to strengthen the security and convenience of home access control Doing this risks consumers becoming apathetic with security, as 41% of consumers admit to re-using the same password or introducing simple minor variations, increasing the risk of hacks and breaches from weak or stolen passwords. Furthermore, continually updating and refreshing passwords, and PINs is unappealing and inconvenient. Consequently, biometric solutions have a real opportunity to strengthen the security and convenience of home access control. Positives of on-device biometric storage Biometric authentication, such as fingerprint recognition uses personally identifiable information, which is stored securely on-device. By using on-device biometric storage, manufacturers are supporting the 38% of consumers, who are worried about privacy and biometrics, and potentially winning over the 17% of people, who don’t use smart home devices for this very reason. Compared to conventional security, such as passwords, PINs or even keys, which can be spoofed, stolen, forgotten or lost, biometrics is difficult to hack and near impossible to spoof. Consequently, homes secured with biometric smart locks are made safer in a significantly more seamless and convenient way for the user. Biometric smart locks Physical access in our domestic lives doesn’t end at the front door with smart locks. Biometrics has endless opportunities to ease our daily lives, replacing passwords and PINs in all devices. Biometric smart locks provide personalized access control to sensitive and hazardous areas, such as medicine cabinets, kitchen drawers, safes, kitchen appliances and bike locks. They offer effective security with a touch or glance. Multi-tenanted sites, such as apartment blocks and student halls, can also become smarter and more secure. With hundreds of people occupying the same building, maintaining high levels of security is the responsibility for every individual occupant. Biometric smart locks limit entry to authorized tenants and eliminate the impact of lost or stolen keys, and passcodes. Furthermore, there’s no need for costly lock replacements and when people leave the building permanently, their data is easily removed from the device. Authorized building access Like biometric smart locks in general, the benefits extend beyond the front door Like biometric smart locks in general, the benefits extend beyond the front door, but also throughout the entire building, such as washing rooms, mail rooms, bike rooms and community spaces, such as gyms. Different people might have different levels of access to these areas, depending on their contracts, creating an access control headache. But, by having biometric smart locks, security teams can ensure that only authorized people have access to the right combination of rooms and areas. Convenience of biometric access cards Additionally, if building owners have options, the biometric sensors can be integrated into the doors themselves, thereby allowing users to touch the sensor, to unlock the door and enter. Furthermore, the latest technology allows biometric access cards to be used. This embeds the sensor into a contactless keycard, allowing the user to place their thumb on the sensor and tap the card to unlock the door. This may be preferable in circumstances where contactless keycards are already in use and can be upgraded. Smarter and seamless security In tandem with the growth of the smart home ecosystem, biometrics has real potential to enhance our daily lives, by delivering smarter, seamless and more convenient security. Significant innovation has made biometrics access control faster, more accurate and secure. Furthermore, today’s sensors are durable and energy efficient. With the capacity for over 10 million touches and ultra-low power consumption, smart home system developers no longer have to worry about added power demands. As consumers continue to invest in their homes and explore new ways to secure and access them, biometrics offers a golden opportunity for market players, to differentiate and make smart homes even smarter.

Quantum Focuses On Unstructured Data, Embraces Pivot3 Acquisition
Quantum Focuses On Unstructured Data, Embraces Pivot3 Acquisition

Video is an enormous wellspring of unstructured data in the enterprise environment. Finding new ways to use video data requires easy access for analysis. Gone are the days when video was recorded just to be played back later. New computer capabilities can analyze video to provide business intelligence and trends, all of which requires that a lot of unstructured data be captured, stored and kept immediately accessible. It's a driving force for companies specializing in video storage such as Quantum, which is focused on storing and managing unstructured data, including video, photos, music and sound. Managing various analytics “Unstructured data is driving the massive growth in storage today, and video surveillance fits right in there,” says Jamie Lerner, CEO and President, Quantum. As data multiplies in business, matters of storing and accessing the data take on a larger profile. Especially challenging is meeting the need to store and access expanding amounts of unstructured data, such as video. Video is also part of a changing end-to-end architecture in the enterpriseWhereas 10 years ago, video surveillance was all about recording and playback, now the emphasis is much more on an end-to-end approach. In addition to capturing and playing back video, systems have to manage various analytics, archival and data retention aspects as well as recording. Video is also part of a changing end-to-end architecture in the enterprise, including hybrid, cloud and on-premise storage. Video surveillance industry Historically, structured data, such as financial information, was stored to allow future analytics. The same trend extends to unstructured data, such as video analytics. Quantum has expanded its video storage capabilities with acquisition this year of the video surveillance business of Pivot3, provider of a hyperconverged system that provides recording, analysis and seamlessly archives data on a converged platform that is less expensive and easier to manage. In acquiring Pivot3, Quantum is refocusing the smaller company on the video surveillance industry. “We are now focused 100% on surveillance and having the highest quality while being very cost-effective,” says Lerner. “The industry is ready for an IT-forward solution that is totally focused on surveillance. You can’t make a platform all things to all people.” Traditional security customers There is overlap in large stadiums and theme parks, where Lerner sees even more opportunity to expand Pivot3 will also help to expand Quantum’s customer base. The larger company has a history of serving customers in entertainment, movies, television and sports production. The addition of Pivot3’s 500 new customers in large surveillance, transportation and critical infrastructure markets will expand the mix. There is overlap in large stadiums and theme parks, where Lerner sees even more opportunity to expand. Pivot3 also helps to bridge the gap between traditional security customers and the information technology (IT) department. “Pivot3 has a reputation as simple to use,” says Lerner. “My belief is that physical security can run separately [from IT] until you reach a certain size, then IT has to be involved. Pivot3 gives IT people in the security space a product that is well formed and fits into an IT strategy. They are not undertaking a piece of equipment that will be a burden.” Physical security presence Customers expect their infrastructure vendors to provide systems that allow them to “Set it and forget it,” says Lerner. It’s one of the big advantages of cloud computing and also central to Quantum’s approach with their traditional products. “At the end of the day, you want to run a hospital, for example, so you want your systems to be easy to use,” says Lerner. The Pivot3 acquisition will also allow Quantum to expand their physical security presence more broadly and globally. Previously, the geographic reach of Pivot3 was limited by the high cost of placing personnel in diverse locations. Under Quantum, which has been serving global companies for 40 years, the problem disappears. “Quantum has global support on all continents and in more countries,” says Lerner. “It’s a higher level of support, given size and legacy of our organization.”

Data Explosion: Futureproofing Your Video Surveillance Infrastructure
Data Explosion: Futureproofing Your Video Surveillance Infrastructure

Video surveillance systems are producing more unstructured data than ever before. A dramatic decrease in camera costs in recent years has led many businesses to invest in comprehensive surveillance coverage, with more cameras generating more data. Plus, advances in technology mean that the newest (8K) cameras are generating approximately 800% more data than their predecessors (standard definition). Traditional entry-level solutions like network video recorders (NVRs) simply aren’t built to handle massive amounts of data in an efficient, resilient and cost-effective manner. This has left many security pioneers grappling with a data storage conundrum. Should they continue adding more NVR boxes? Or is there another, better, route? Retaining video data In short, yes. To future proof their video surveillance infrastructure, an increasing number of businesses are adopting an end-to-end surveillance architecture with well-integrated, purpose-built platforms for handling video data through its lifecycle. This presents significant advantages in terms of security, compliance and scalability, as well as unlocking new possibilities for data enrichment. All of this with a lower total cost of ownership than traditional solutions. Security teams would typically delete recorded surveillance footage after a few days or weeks Previously, security teams would typically delete recorded surveillance footage after a few days or weeks. However, thanks to increasingly stringent legal and compliance demands, many are now required to retain video data for months or even years. There’s no doubt that this can potentially benefit investigations and increase prosecutions, but it also puts significant pressure on businesses’ storage infrastructure. Data lifecycle management This necessitates a more intelligent approach to data lifecycle management. Rather than simply storing video data in a single location until it’s wiped, an end-to-end video surveillance solution can intelligently migrate data to different storage platforms and media as it ages. So, how does this work? Video is recorded and analyzed on a combination of NVR, hyperconverged infrastructure (HCI) and application servers. Then, it’s moved to resilient file storage for a pre-determined period, where it can be immediately retrieved and accessed for review. Finally, based on policies set by heads of security, data is moved from file storage to highly secure, low-cost archive storage such as an object, tape or cloud. Data is moved from file storage to highly secure, low-cost archive storage Long-Term storage This process is known as tiering. It allows businesses to use reliable, inexpensive long-term storage for most of their data, whilst still enabling security pioneers to retrieve video data when the need arises, such as during a compliance audit, or to review footage following a security breach. In a nutshell, it offers them the best of both worlds. Scaling your video surveillance infrastructure can be a headache. Businesses that rely on NVRs – even high-end units with 64 or even 96 hard drives – are finding themselves running out of capacity increasingly quickly. In order to scale, security pioneers then have to procure new boxes. With NVRs, this inevitably involves a degree of guesswork. Should they go for the largest possible option, and risk over provisioning? Or perhaps a smaller option, and risk running out of capacity again? Common management console Security pioneers can easily add or remove storage capacity or compute resources – separately or together As businesses add new cameras or replace existing ones, many end up with inadequate surveillance infrastructure made up of multiple NVR boxes along with several application servers for running other surveillance functions such as access control, security photo databases, analytics, etc. This patchwork approach leaves security pioneers scrambling for capacity, maintaining various hardware footprints, repeating updates and checks across multiple systems, and taking up valuable time that could be better spent elsewhere. By contrast, flexible HCI surveillance platforms aggregate the storage and ecosystem applications to run on the same infrastructure and combine viewing under a common management console, avoiding ‘swivel chair’ management workflows. Plus, they offer seamless scalability. Security pioneers can easily add or remove storage capacity or compute resources – separately or together. Data storage solutions Over time, this ensures a lower total cost of ownership. First and foremost, it removes the risk of over provisioning and helps to control hardware sprawl. This in turn leads to hardware maintenance savings and lower power use. Many security pioneers are now looking beyond simple data storage solutions for their video surveillance footage. Meta tags can provide context around data, making it easier to find and access when needed Instead, they’re asking themselves how analyzing this data can enable their teams to work faster, more efficiently and productively. Implementing an end-to-end video surveillance architecture enables users to take advantage of AI and machine learning applications which can tag and enrich video surveillance data. These have several key benefits. Firstly, meta tags can provide context around data, making it easier to find and access when needed. Object storage platform For instance, if security teams are notified of a suspicious red truck, they can quickly find data with this tag, rather than manually searching through hours of data, which can feel like looking for a needle in a haystack. Plus, meta tags can be used to mark data for future analysis. This means that as algorithms are run over time, policies can be set to automatically store data in the right location. For example, if a video is determined to contain cars driving in and out of your premises, it would be moved to long-term archiving such as an object storage platform for compliance purposes. If, on the other hand, it contained 24 hours of an empty parking lot, it could be wiped. These same meta tags may be used to eventually expire the compliance data in the archive after it is no longer needed based on policy. Video surveillance architecture Continuing to rely on traditional systems like NVRs will fast become unsustainable for businesses Even if your organization isn’t using machine learning or artificial intelligence-powered applications to enhance your data today, it probably will be one, three, or even five years down the line. Implementing a flexible end-to-end video surveillance solution prepares you for this possibility. With new advances in technology, the quantity of data captured by video surveillance systems will continue rising throughout the coming decade. As such, continuing to rely on traditional systems like NVRs will fast become unsustainable for businesses. Looking forward, when moving to an end-to-end video surveillance architecture, security pioneers should make sure to evaluate options from different vendors. For true futureproofing, it’s a good idea to opt for a flexible, modular solution, which allow different elements to be upgraded to more advanced technologies when they become available.