Download PDF version Contact company

By providing an open platform and access to documentation, software development kits (SDKs), and application programming interfaces (APIs), individual developers and partner organizations can explore the full potential of Axis products and solutions.

And by doing so, creating advanced applications that bring new and compelling use cases to market. Long-time Axis Communications (Axis) partner, Citilog has been developing traffic management analytics applications alongside Axis for more than a decade. Citilog’s Vice-President Jean-Marie Guyon helped understand the benefits that the Axis Camera Application Platform (ACAP) brings to the company’s business.

Axis ADP Program

Axis Communications is a company that truly believes that ‘the whole is greater than the sum of the parts'

Axis Communications is a company that truly believes that ‘the whole is greater than the sum of the parts’. Through the Axis Developer Community, which is open to all developers, whether already working within an Axis partner company or not, and the Axis Application Development Partner (ADP) Program, the company provides a wealth of resources that connect the ecosystem around Axis products and technologies.

In doing so, and particularly in giving early access to new technology, innovation is accelerated, and connections are made that bring benefits to partners and customers alike. Within the ADP Program and through the Axis Developer Community, partners and developers gain access to the Axis Camera Application Platform (ACAP), which specifically allows for the development of applications that sit within surveillance cameras themselves (and an increasing number of other products).

As the capabilities of Axis surveillance cameras increases and particularly, cameras are now available, which includes a Deep Learning Processing Unit (DLPU). ACAP represents a place where some of the most cutting-edge innovation is taking place.

A fundamental change to the business

The partnership between Axis and Citilog, a specialist in advanced traffic management analytics applications, began in 2009, at around the same time that ACAP itself was created (and well before Citilog was acquired by Axis in 2016).

Jean-Marie Guyon, Vice President at Citilog, talks about how the first possibilities of developing in camera analytics would fundamentally change their business. He explains how the company immediately saw the opportunity in ACAP when it was first announced. He said, “Citilog had already been an Axis partner for a number of years when the capacity of the camera processors became sufficient to port our applications on the edge.

Jean-Marie adds, “But, as soon as we saw the possibilities for developing analytics applications that were integrated into surveillance cameras themselves, we knew it would fundamentally change our business, even if it took longer for customers to realize the potential!

Decreased need of bandwidth with rise of edge analytics

By analyzing the video within the camera, we only need to transfer the data that matters rather than everything"

Prior to the ability to develop in-camera analytics applications, often known as ‘edge analytics’, the analysis of video took place on centralized hardware and servers, either housed within the customer’s own premises or within a data center. This meant the transfer of huge amounts of video footage from the camera to the data center, with associated demand for bandwidth and the inevitable cost.

Jean-Marie continues, “We immediately saw the opportunity to remove a significant proportion of the bandwidth demands through in-camera analytics. Put simply, by analyzing the video within the camera, we only need to transfer the data that matters rather than everything. For cameras that are monitoring roads 24 hours a day, seven days a week for incidents that can be relatively rare, it’s obvious to see what a difference this could make.

Market slow to respond

But as Jean-Marie mentions, while Citilog’s developers immediately saw the potential, the market was, as usual, slower to respond. He stated, “Over the past decade we’ve done a lot of promotion and evangelizing of the benefits of in-camera analytics. It takes time for sectors to change and adapt new approaches, and not least when it requires a change in hardware and the first few years were tough going.

Jean-Marie adds, “However, persevering has been worth it, and today more than 70% of our business is based on ACAP. More than that, in the past few years we’ve seen the majority of tenders demanding in-camera analytics.

Change in capabilities of in-camera analytics

At its heart, ACAP is a platform for innovation and Citilog is always looking towards the future. Deep learning represents the next area of innovation. Jean-Marie expands on this by stating, “With the combination of our current deep learning-based solution (CT-ADL: Citilog Applied Deep Learning) and the evolution of the in-camera processing capabilities, it feels like we’re on the cusp of a real step-change.

Jean-Marie adds, “With the AXIS Q1615-LE Mk III, we have the first Axis camera in the market that includes a deep learning processing unit (DLPU) which combined with the CT-ADL makes it the first operational DL-based solution running on the edge. It’s difficult to overstate the scale of the step forward that this represents.

Deep learning (DL)

But deep learning is something that requires huge amounts of processing power

Deep learning (DL) is a subset of Artificial Intelligence (AI). In very simple terms, in relation to video analytics on the edge, the primary benefits relate to much greater accuracy in the detection, identification, and classification of all types of object - a generic ‘vehicle’ becomes a car, lorry, bus, or motorcycle and critically, objects that aren’t relevant can be safely ignored.

But deep learning is something that requires huge amounts of processing power and while this was previously only available through the use of remote servers, it’s now accessible in the camera itself.

Reduced number of false alarms

In a sector such as traffic management, the ability to differentiate between a greater number of objects is critical, as Jean-Marie explains, “One of the biggest issues for any surveillance operation is the cost of false alarms: alerts being triggered that required attention and prompt action, but which aren’t actually materially important.

He adds, “In traffic management, as an example, traditionally one of the most common causes of false alarms is shadows and rain puddles. These can often be mistaken as a vehicle, and if they’re in the fast lane of a motorway, will create an alert. The power of deep learning reduces these false alarms substantially. In fact, that’s an understatement as we’re typically finding that the number of false alarms is reduced by a factor of 10.

Reduced need for hardware

These ‘lighter’ solutions are therefore easier to maintain and further reduce operational costs

Such a substantial reduction in false alarms is one obvious benefit to customers, but the switch from processing power in the server and data center to the camera also means a reduced need for hardware.

These ‘lighter’ solutions are therefore easier to maintain and further reduce operational costs. They also open up new use cases for in-camera analytics where lack of available bandwidth would have previously made it impossible.

High potential for deep learning edge analytics

While Citilog’s focus remains on traffic management and through that, using the analytics and data created to deliver on the vision for smart cities, the potential for deep learning edge analytics is there for every industry sector and use case.

Harnessing the creative power of the largest number of people has always been at the heart of the Axis ethos. Through the Axis Developer Community, Axis ADP, and ACAP, the opportunities for all developers and partners to learn, experiment, and innovate are infinite.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version Download PDF version

In case you missed it

How Have Security Solutions Failed Our Schools?
How Have Security Solutions Failed Our Schools?

School shootings are a high-profile reminder of the need for the highest levels of security at our schools and education facilities. Increasingly, a remedy to boost the security at schools is to use more technology. However, no technology is a panacea, and ongoing violence and other threats at our schools suggest some level of failure. We asked this week’s Expert Panel Roundtable: How have security solutions failed our schools and what is the solution?

Why Visualization Platforms Are Vital For An Effective Security Operation Center (SOC)
Why Visualization Platforms Are Vital For An Effective Security Operation Center (SOC)

Display solutions play a key role in SOCs in providing the screens needed for individuals and teams to visualize and share the multiple data sources needed in an SOC today. Security Operation Center (SOC) Every SOC has multiple sources and inputs, both physical and virtual, all of which provide numerous data points to operators, in order to provide the highest levels of physical and cyber security, including surveillance camera feeds, access control and alarm systems for physical security, as well as dashboards and web apps for cyber security applications. Today’s advancements in technology and computing power not only have increasingly made security systems much more scalable, by adding hundreds, if not thousands, of more data points to an SOC, but the rate at which the data comes in has significantly increased as well. Accurate monitoring and surveillance This has made monitoring and surveillance much more accurate and effective, but also more challenging for operators, as they can’t realistically monitor the hundreds, even thousands of cameras, dashboards, calls, etc. in a reactive manner. Lacking situational awareness is often one of the primary factors in poor decision making In order for operators in SOC’s to be able to mitigate incidents in a less reactive way and take meaningful action, streamlined actionable data is needed. This is what will ensure operators in SOC truly have situational awareness. Situational awareness is a key foundation of effective decision making. In its simplest form, ‘It is knowing what is going on’. Lacking situational awareness is often one of the primary factors in poor decision making and in accidents attributed to human error. Achieving ‘true’ situational awareness Situational awareness isn’t just what has already happened, but what is likely to happen next and to achieve ‘true’ situational awareness, a combination of actionable data and the ability to deliver that information or data to the right people, at the right time. This is where visualization platforms (known as visual networking platforms) that provide both the situational real estate, as well as support for computer vision and AI, can help SOCs achieve true situational awareness Role of computer vision and AI technologies Proactive situational awareness is when the data coming into the SOC is analyzed in real time and then, brought forward to operators who are decision makers and key stakeholders in near real time for actionable visualization. Computer vision is a field of Artificial Intelligence that trains computers to interpret and understand digital images and videos. It is a way to automate tasks that the human visual system can also carry out, the automatic extraction, analysis and understanding of useful information from a single image or a sequence of images. There are numerous potential value adds that computer vision can provide to operation centers of different kinds. Here are some examples: Face Recognition: Face detection algorithms can be applied to filter and identify an individual. Biometric Systems: AI can be applied to biometric descriptions such as fingerprint, iris, and face matching. Surveillance: Computer vision supports IoT cameras used to monitor activities and movements of just about any kind that might be related to security and safety, whether that's on the job safety or physical security. Smart Cities: AI and computer vision can be used to improve mobility through quantitative, objective and automated management of resource use (car parks, roads, public squares, etc.) based on the analysis of CCTV data. Event Recognition: Improve the visualization and the decision-making process of human operators or existing video surveillance solutions, by integrating real-time video data analysis algorithms to understand the content of the filmed scene and to extract the relevant information from it. Monitoring: Responding to specific tasks in terms of continuous monitoring and surveillance in many different application frameworks: improved management of logistics in storage warehouses, counting of people during event gatherings, monitoring of subway stations, coastal areas, etc. Computer Vision applications When considering a Computer Vision application, it’s important to ensure that the rest of the infrastructure in the Operation Center, for example the solution that drives the displays and video walls, will connect and work well with the computer vision application. The best way to do this of course is to use a software-driven approach to displaying information and data, rather than a traditional AV hardware approach, which may present incompatibilities. Software-defined and open technology solutions Software-defined and open technology solutions provide a wider support for any type of application the SOC may need Software-defined and open technology solutions provide a wider support for any type of application the SOC may need, including computer vision. In the modern world, with everything going digital, all security services and applications have become networked, and as such, they belong to IT. AV applications and services have increasingly become an integral part of an organization’s IT infrastructure. Software-defined approach to AV IT teams responsible for data protection are more in favor of a software-defined approach to AV that allow virtualised, open technologies as opposed to traditional hardware-based solutions. Software’s flexibility allows for more efficient refreshment cycles, expansions and upgrades. The rise of AV-over-IP technologies have enabled IT teams in SOC’s to effectively integrate AV solutions into their existing stack, greatly reducing overhead costs, when it comes to technology investments, staff training, maintenance, and even physical infrastructure. AV-over-IP software platforms Moreover, with AV-over-IP, software-defined AV platforms, IT teams can more easily integrate AI and Computer Vision applications within the SOC, and have better control of the data coming in, while achieving true situational awareness. Situational awareness is all about actionable data delivered to the right people, at the right time, in order to address security incidents and challenges. Situational awareness is all about actionable data delivered to the right people Often, the people who need to know about security risks or breaches are not physically present in the operation centers, so having the data and information locked up within the four walls of the SOC does not provide true situational awareness. hyper-scalable visual platforms Instead there is a need to be able to deliver the video stream, the dashboard of the data and information to any screen anywhere, at any time — including desktops, tablets phones — for the right people to see, whether that is an executive in a different office or working from home, or security guards walking the halls or streets. New technologies are continuing to extend the reach and the benefits of security operation centers. However, interoperability plays a key role in bringing together AI, machine learning and computer vision technologies, in order to ensure data is turned into actionable data, which is delivered to the right people to provide ‘true’ situational awareness. Software-defined, AV-over-IP platforms are the perfect medium to facilitate this for any organizations with physical and cyber security needs.

Securing Mobile Vehicles: The Cloud and Solving Transportation Industry Challenges
Securing Mobile Vehicles: The Cloud and Solving Transportation Industry Challenges

Securing Intelligent Transportation Systems (ITS) in the transportation industry is multi-faceted for a multitude of reasons. Pressures build for transit industry players to modernise their security systems, while also mitigating the vulnerabilities, risks, and growth-restrictions associated with proprietary as well as integrated solutions. There are the usual physical security obstacles when it comes to increasingly integrated solutions and retrofitting updated technologies into legacy systems. Starting with edge devices like cameras and intelligent sensors acquiring video, analytics and beyond, these edge devices are now found in almost all public transportation like buses, trains, subways, airplanes, cruise lines, and so much more. You can even find them in the world’s last manually operated cable car systems in San Francisco. The next layer to consider is the infrastructure and networks that support these edge devices and connect them to centralized monitoring stations or a VMS. Without this layer, all efforts at the edge or stations are in vain as you lose the connection between the two. And the final layer to consider when building a comprehensive transit solution is the software, recording devices, or viewing stations themselves that capture and report the video. The challenge of mobility However, the transportation industry in particular has a very unique challenge that many others do not – mobility. As other industries become more connected and integrated, they don’t usually have to consider going in and out or bouncing between networks as edge devices physically move. Obviously in the nature of transportation, this is key. Have you ever had a bad experience with your cellular, broadband or Wi-Fi at your home or office? You are not alone. The transportation industry in particular has a very unique challenge that many others do not – mobility Can you trust these same environments to record your surveillance video to the Cloud without losing any frames, non-stop 24 hours a day, 7 days a week, 365 days a year? To add to the complexity – how do you not only provide a reliable and secure solution when it’s mobile, traveling at varying speeds, and can be in/out of coverage using various wireless technologies? Waiting to upload video from a transport vehicle when it comes into port, the station, or any centralized location is a reactive approach that simply will not do any longer. Transit operations require a more proactive approach today and the ability to constantly know what is going on at any given time on their mobile vehicles, and escalate that information to headquarters, authorities, or law enforcement if needed; which can only occur with real-time monitoring. This is the ultimate question when it comes to collecting, analyzing, and sharing data from mobile vehicles – how to get the video from public transportation vehicles alike to headquarters in real time! Managing video data In order to answer this question, let’s get back to basics. The management and nature of video data differs greatly from conventional (IT) data. Not only is video conducted of large frames, but there are specific and important relationships among the frames and the timing between them. This relationship can easily get lost in translation if not handled properly. This is why it’s critical to consider the proper way to transmit large frames while under unstable or variable networks. The Internet and its protocols were designed more than two decades ago and purposed for conventional data. Although the Internet itself has not changed, today’s network environments run a lot faster, expand to further ranges, and support a variety of different types of data. Because the internet is more reliable and affordable than in the past some might think it can handle anything. However, it is good for data, but not for video. This combination makes it the perfect time to convert video recording to the Cloud! Video transmission protocol One of the main issues with today’s technology is the degradation of video quality when transmitting video over the Internet. ITS are in dire need for reliable transmission of real-time video recording. To address this need a radical, yet proven, video transmission protocol has recently been introduced to the market. It uses AI technology and to adapt to different environments in order to always deliver high quality, complete video frames. This protocol, when equipped with encryption and authentication, enables video to be transmitted reliably and securely over the Internet in a cloud environment. One of the main issues with today’s technology is the degradation of video quality when transmitting video over the Internet Finally, transportation industry has a video recording Cloud solution that is designed for (massive) video that can handle networks that might be experiencing high error rate. Such a protocol will not only answer the current challenges of the transportation industry, but also make the previously risky Cloud environment safe for even the most reserved environments and entities. With revolutionary transmission protocols, the time is now to consider adopting private Cloud for your transportation operations.