Download PDF version Contact company

AxxonSoft has announced the release of version 4.11 of the Intellect PSIM. The new version provides neural network–based analytics, video wall management interface, automatic object tracking with a PTZ camera, support for Intel Quick Sync Video hardware decoding, and servers for ONVIF and SIP protocols.

The new release also includes updated versions of Face Intellect, POS Intellect, Auto Intellect, and Web Reporting subsystem, along with many other enhancements and improvements introduced.

Video Analytics

Neural Tracker

The neural tracker uses DNN (deep neural network) to recognize specific types of objects, e.g., humans or vehicles. The neural tracker tracks objects in motion, which allows the application of any VMD-based detection tool: motion in an area, line crossing, appearance/disappearance of an object, etc.

Detection based on the neural tracker can be applied to complex scenes with a large amount of non-relevant detail, whereas classic motion detection would be drowned out by false alarms.

One neural tracker can work with several individually set-up counters, with various detection zones

Object Counter

A neural tracker can be linked to a counter that will periodically report the number of objects within a specified area in the FOV. One neural tracker can work with several individually set-up counters, with various detection zones, reporting intervals, etc.

Neural Filter

The neural filter works in parallel with the standard tracker, which allows the detection only of moving objects of a specified type or abandoned objects, while ignoring all other movement in the FOV.

The results of their joint operation can be used by VMD-based detection tools in real time and recorded to a database that allows the quick location of objects of a specified type in recorded footage.

Custom training of neural networks

AxxonSoft offers custom training of the neural networks used by the neural tracker and neural filter

To deliver high-quality video analytics, AxxonSoft offers custom training of the neural networks used by the neural tracker and neural filter. For each particular project, these AI tools are trained with the help of videos shot on site.

Behavioral Analytics

The neural network analyzes video and generates data on the postures of people in the FOV. This data is processed by analytical algorithms which are capable of detecting specified postures, such as crouching, lying prone, shooting, with hands up, or the appearance of an individual in any posture.

Behavioral analytics detects potentially dangerous scenarios by specific postures, for example:

  • An individual crouched down next to an ATM could be a burglar;
  • One in a shooting position and other(s) with hands up could be an armed robbery.

Enhanced and Optimized

  • Added an option to save and recall templates for Forensic Search in Video Footage. A saved template can be re-used for further searches by using the same criteria.
  • Updated neural algorithms for fire and smoke detection. Added Alarm Expired events for these detection tools, and an option to select processing hardware: GPU or CPU.
  • Optimized memory consumption by the sweet-hearting neural detection tool that shows items not being swiped at the cash desk.
  • Improved the stopped vehicle detection tool.

Video Surveillance

  • Added Tag&Track Pro feature that automatically tracks an object with a PTZ camera using coordinates obtained from the fixed camera's tracker. To start tracking a moving object, just click on its image. The PTZ camera will track it until the object leaves the fixed camera's FOV.
  • Implemented support for the hardware decoding of H.264 streams using the Intel Quick Sync Video technology. The decoding is performed by an Intel GPU, which significantly reduces the Server's CPU load when applying video analytics, and the Client's CPU load when displaying video feeds.
  • Added an option to hide selected portions of an archive. The availability of the options of hiding records and viewing hidden archives depends on the assigned user rights. One can now also mask faces on exported videos. To make it possible, the neural network automatically locates faces in recorded footage. These functions are required to comply with privacy and data protection requirements, such as the GDPR.
  • Added an option to export videos from external storage, such as IP camera archives or NVRs. Added a comprehensive set of system events to audit operator's actions.

Communication Protocols

  • ONVIF Server - The ONVIF server is used for media streaming to external systems. It allows ONVIF clients to connect to an operating Intellect PSIM system, as they would to an ONVIF compatible device. Supported video streaming with synchronized audio in H.264/H.265/MPEG-4/MJPEG formats, multi-streaming, access to Video Footage, multicasting, authentication, and transmission of I/O events from devices and metadata.
  • SIP Server - The SIP server allows the Intellect PSIM to connect to intercom devices such as IP door stations and push plates, and to create and route calls. The server supports audio and video calls, which can be recorded for further monitoring. Security system operators can now communicate via a new SIP Panel client interface. Each device and SIP Panel is assigned a calling ID number, and address books containing available call numbers are set up on SIP Panels.
  • Other Protocols - Added support for the AMQP open messaging protocol, which allows the Intellect PSIM to receive and send RabbitMQ messages. Implemented the HTTP Server module, which is capable of sending events to an external system via HTTP polling.

The User Interface

Screen Manager

Screen Manager is a new UI for video wall management. It enables convenient monitor layout management on selected PCs. Screen Manager can be used to:

  • Create, edit, or delete layouts, and assign them to selected PCs;
  • Remotely switch layouts on PCs.

Operator Protocol

For objects linked to a camera, they can now display a still image or recorded video of an event

Operator Protocol is now completely revamped. Events list is now displayed as tiles, sortable by time and priority. Events processed by other operators are marked with a gray background, and their cells include the name of the Operator Protocol in which the processing has been completed. Users can now escalate an event to a specified operator.

The parameters displayed along with the event are now selectable. For objects linked to a camera, they can now display a still image or recorded video of an event and zoom in on the alarm snapshot in a separate window. If an object is linked to multiple cameras, users can scroll between their images and can set video display in the Camera Window or ActiveX component.

Set Bookmark checkbox

All buttons and comments are now located on a single upper panel. An operator can now select several events, and work with them simultaneously.

Another new feature added is a Set Bookmark checkbox for automatic creation of a bookmark in Video Footage when an event is processed by the operator. Operator's text comments are used for bookmark names.

Incident management

Additionally, a new feature added is the incident management function. If an operator selects an event, a list of required processing actions is displayed.

The operator selects the required checkboxes, and information about their actions is added to text comments along with date/time stamps. In addition, the operator can now view processing instructions for events from any source object.

Other new interfaces and enhancements

The object context menu on the Map now includes an option to set the number of recent events to be displayed (up to 99).

  • Introduced an option to request single frames or camera archives (also for cameras under a parent object) via the ActiveX component.
  • The Main Control panel now includes the following information about the system - product name and version, installed subsystems' names and versions, available system objects list and the number of used objects, and license expiration date.
  • Also added is a new graphs interface containing analog sensor data representations, and an interface allowing display of statistical data about objects' statuses as a table or a chart.

User Rights

  • Added support for Active Directory service, which enables synchronization between users and groups of the Intellect PSIM and their relevant Active Directory objects.
  • When creating a new user rights group, operators can now import settings from an existing group. If multiple groups are selected, their combination is created.
  • Added a setting to automatically shut down the session if the operator becomes idle.
  • Added an option to limit the list of available actions on objects in video surveillance monitor and Map UIs.
  • Added an option to disable frame/video export and printing a still frame from the video surveillance monitor.

Auto Intellect 5.5

  • Introduced a module that uses the neural network to detect vehicle types. The module is capable of classifying passenger cars, vans, buses, trucks, and motorcycles.
  • Integrated the IntLab container number recognition module.
  • Updated the IntelliVision car number recognition module. Added support for new national license plate formats and running recognition on GPU and increased overall recognition quality. Basic virtual loop is now replaced with the IntelliVision virtual loop.
  • The SDK for the AutoUragan LPR module is updated to version 3.7. Added new national formats and templates and increased operational stability.
  • Updated VIT LPR module to version 2.7.2. Added new national formats and templates, increased recognition quality and stability; the GUI now includes tools for fine-tuning the module.

Face Intellect 7.3

  • Integrated new YITU and SCT facial recognition modules. Updated VisionLabs facial recognition module to version 3.6.3.
  • In the Tevian engine, recognition of emotion, race, and facial attributes (glasses, mustache, beard, hair color, headwear, etc.) was added to the existing age and gender guesstimation capabilities. Facial recognition now warns of faces covered with masks etc. and performs "liveness" checks to preclude identity spoofing.
  • Operators can now use facial attributes for filtering, e.g., to find all males wearing glasses and/or with a beard. Emotion recognition allows you to evaluate the quality of personnel operations and the degree of customer satisfaction in banking, retail, and other industries.

The Face Search tab now includes filters by name, department, and similarity rate, time window presets, and saving search parameters (filters) option. Operators can now launch a filtered search by double clicking a facial image in the captured/recognized faces log.

Other new features:

  • The full names of recognized persons now appear on live video under the facial bounding box;
  • Users can now check an entire folder containing facial images against your DB;
  • Facial recognition now has a configurable capture area;
  • Facial DB replication across servers now allows a face to be added to all DBs by adding it to just one database.

POS Intellect 5.4

Integration of the screening system allows data to be received from connected devices

Integrated 5 models of POS terminals, 2 models of vehicle scales, a printer scales and the Sphinx screening management system that supports up to 5 handheld metal or metal/radiation detectors.

The integration of the screening system allows data to be received from connected devices, recorded to the POS Intellect DB, used for captioning screening videos, and utilized for searching by text comments in Video Footage. The integrated solution allows one to control equipment and personnel operations for more efficient and reliable screening.

In POS Intellect, existing integrations have been enhanced, and the wildcard search in captions has been introduced.

Intellect Web Report System 3.4

The web report subsystem now includes new and updated reports, and new functions have been introduced.

New Types of POS Reports -

  • A "sweet-hearting" report allows one to view event video live.
  • A canceled items report contains data filtered by specified cashiers and item names over a specified period.
  • A canceled amount report is similar to the one previously listed and includes the total value of canceled items.

New Types of Time and Attendance Reports

  • A consolidated employees report contains data on the total number of employees in specified departments, and the number of employees staying in a specified area at the moment of reporting, or on a specified time/date.
  • A detailed employees report contains data on the number of employees staying in a specified area during each day of a specified time period.

Other New Report Types -

  • A customer counter report contains information about the number of visitors who entered/exited a specified area over a specified period and is presented as a graph or as a table.
  • A graphical report on events represents the number of events of a specified type for the selected types of objects over a specified time period. The exported report includes both a graph and a table.
  • A pass card report contains information about the times of issuing pass cards for specified employees, or departments, as well as the types of cards and their expiration dates.
  • A recognized rail car numbers report contains information about error detection with a check digit and a photo from the linked camera.
Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version Download PDF version

In case you missed it

The Post-Pandemic Mandate For Entertainment Venues: Digitally Transform Security Guards
The Post-Pandemic Mandate For Entertainment Venues: Digitally Transform Security Guards

As the COVID-19 pandemic wanes and sporting venues open-up to full capacity, a new disturbing trend has hit the headlines - poor fan behavior. Five NBA teams have issued indefinite bans on fans, who crossed the line of unacceptable behavior, during the NBA playoffs. Major League Baseball stadiums have a recurring problem with divisive political banners being strewn over walls, as part of an organized campaign, requiring fan ejections. There was a brawl between Clippers and Suns fans after Game 1 of their playoff series. And, the U.S. vs. Mexico Nations League soccer game over the Fourth of July weekend had to be halted, due to fans throwing objects at players and screaming offensive chants. Cracking down on poor fan behavior Security directors are consistently reporting a disturbing uptick in poor fan attitude and behavior With players across all major sports leagues commanding more power than ever before, they are demanding that sports venues crack down on poor fan behavior, particularly when they are the targets of that behavior. Whether it’s an extension of the social-media divisiveness that’s gripped society, or people unleashing pent up negative energy, following 15 months of social isolation, during the COVID-19 global pandemic, security directors are consistently reporting a disturbing uptick in poor fan attitude and behavior. They’re also reporting a chronic security guard shortage, like many businesses that rely on relatively low-cost labor, finding candidates to fill open positions has been incredibly difficult. Low police morale To add the third component to this perfect storm, many police departments are struggling with morale issues and officers are less likely to put themselves into positions, where they could wind up in a viral video. According to the Police Executive Research Forum, police officer retirements in the U.S. were up 45% in the April 2020 - April 2021 period, when compared to the previous year. Resignations were up 18%. In this environment, officers may be less likely to undertake fan intervention unless it’s absolutely necessary. This can seem like the worst of times for venue security directors, as they need more staff to handle increasingly unruly patrons, but that staff simply isn’t available. And, because the security guard staffing industry is a commoditized business, companies compete almost solely on price, which requires that they keep salaries as low as possible, which perpetuates the lack of interest in people participating in the profession. Digital Transformation There is only one way out of this conundrum and that is to make security personnel more efficient and effective. Other industries have solved similar staffing and cost challenges through digital transformation. For example, only a small percentage of the total population of restaurants in the U.S. used to offer home delivery, due to cost and staffing challenges of hiring dedicated delivery personnel. Advent of digital efficiency tools But with the advent of digital efficiency tools, now virtually all restaurants can offer delivery But with the advent of digital efficiency tools, such as UberEATS and DoorDash, now virtually all restaurants can offer delivery. Likewise, field-service personnel are digitally connected, so when new jobs arise, they can be notified and routed to the location. Compare this to the old paper-based days, when they wouldn’t know about any new jobs until they picked up their work schedule at the office, the next day and you can see how digital transformation makes each worker significantly more efficient. Security guards and manned guarding The security guard business has never undergone this kind of digital transformation. The state-of-the-art ‘technology’ has never changed - human eyes and ears. Yes, there are video cameras all over stadiums and other venues, but behind the scenes is a guard staring at a bunch of monitors, hoping to identify incidents that need attention. Meanwhile, there are other guards stationed around the stadium, spending most of their time watching people who are doing nothing wrong. Think about all the wasted time involved with these activities – not to mention the relentless boredom and ‘alert fatigue’ from false-positive incident reporting and you understand the fundamental inefficiencies of this labor-based approach to security. Now think about a world where there’s ubiquitous video surveillance and guards are automatically and pre-emptively notified and briefed, when situations arise. The fundamental nature of the security guards profession changes. Instead of being low paid ‘watchers’, they instead become digitally-empowered preventers. AI-based screening and monitoring technology This world is happening today, through Artificial Intelligence-based screening and monitoring technology. AI-powered weapons-detection gateways inform guards, when a patron entering the venue is carrying a gun, knife or other forbidden item. Instead of patting down every patron with metal in their pockets, which has been the standard practise since walk-through metal detectors were mandated by sports leagues following 9/11, guards can now target only those who are carrying these specific items. Video surveillance and AI-based analytics integration Combining surveillance video with AI-based advanced analytics can automatically identify fan disturbances Combining surveillance video with AI-based advanced analytics can automatically identify fan disturbances or other operational issues, and notify guards in real time, eliminating the need to have large numbers of guards monitoring video feeds and patrons. The business benefits of digitally transformed guards are compelling. A National Hockey League security director says he used to have 300 guards manning 100 walk-through metal detectors. By moving to AI solutions, he can significantly reduce the number of scanning portals and guards, and most importantly redeploy and gain further operational efficiencies with his overall operational strategy. Changing staffing strategy This changes the staffing strategy significantly and elevates the roles of guards. Suddenly, a US$ 20-per-hour ‘job’ becomes a US$ 40-per-hour profession, with guards transformed into digital knowledge workers delivering better outcomes with digitally enabled staffs. Beyond that, these digitally transformed guards can spend a much higher percentage of their time focused on tasks that impact the fan experience – whether it’s keeping weapons out of the building, pro-actively dealing with unruly fans before a broader disruption occurs, or managing business operations that positively impact fan patron experience. Digitally transforming security guards Perhaps most important, digitally transforming security guards elevates the profession to a more strategic level, which means better pay for the guards, better service for clients of guard services, and an overall better experience for fans. That’s a perfect storm of goodness for everyone.

Why Visualization Platforms Are Vital For An Effective Security Operation Center (SOC)
Why Visualization Platforms Are Vital For An Effective Security Operation Center (SOC)

Display solutions play a key role in SOCs in providing the screens needed for individuals and teams to visualize and share the multiple data sources needed in an SOC today. Security Operation Center (SOC) Every SOC has multiple sources and inputs, both physical and virtual, all of which provide numerous data points to operators, in order to provide the highest levels of physical and cyber security, including surveillance camera feeds, access control and alarm systems for physical security, as well as dashboards and web apps for cyber security applications. Today’s advancements in technology and computing power not only have increasingly made security systems much more scalable, by adding hundreds, if not thousands, of more data points to an SOC, but the rate at which the data comes in has significantly increased as well. Accurate monitoring and surveillance This has made monitoring and surveillance much more accurate and effective, but also more challenging for operators, as they can’t realistically monitor the hundreds, even thousands of cameras, dashboards, calls, etc. in a reactive manner. Lacking situational awareness is often one of the primary factors in poor decision making In order for operators in SOC’s to be able to mitigate incidents in a less reactive way and take meaningful action, streamlined actionable data is needed. This is what will ensure operators in SOC truly have situational awareness. Situational awareness is a key foundation of effective decision making. In its simplest form, ‘It is knowing what is going on’. Lacking situational awareness is often one of the primary factors in poor decision making and in accidents attributed to human error. Achieving ‘true’ situational awareness Situational awareness isn’t just what has already happened, but what is likely to happen next and to achieve ‘true’ situational awareness, a combination of actionable data and the ability to deliver that information or data to the right people, at the right time. This is where visualization platforms (known as visual networking platforms) that provide both the situational real estate, as well as support for computer vision and AI, can help SOCs achieve true situational awareness Role of computer vision and AI technologies Proactive situational awareness is when the data coming into the SOC is analyzed in real time and then, brought forward to operators who are decision makers and key stakeholders in near real time for actionable visualization. Computer vision is a field of Artificial Intelligence that trains computers to interpret and understand digital images and videos. It is a way to automate tasks that the human visual system can also carry out, the automatic extraction, analysis and understanding of useful information from a single image or a sequence of images. There are numerous potential value adds that computer vision can provide to operation centers of different kinds. Here are some examples: Face Recognition: Face detection algorithms can be applied to filter and identify an individual. Biometric Systems: AI can be applied to biometric descriptions such as fingerprint, iris, and face matching. Surveillance: Computer vision supports IoT cameras used to monitor activities and movements of just about any kind that might be related to security and safety, whether that's on the job safety or physical security. Smart Cities: AI and computer vision can be used to improve mobility through quantitative, objective and automated management of resource use (car parks, roads, public squares, etc.) based on the analysis of CCTV data. Event Recognition: Improve the visualization and the decision-making process of human operators or existing video surveillance solutions, by integrating real-time video data analysis algorithms to understand the content of the filmed scene and to extract the relevant information from it. Monitoring: Responding to specific tasks in terms of continuous monitoring and surveillance in many different application frameworks: improved management of logistics in storage warehouses, counting of people during event gatherings, monitoring of subway stations, coastal areas, etc. Computer Vision applications When considering a Computer Vision application, it’s important to ensure that the rest of the infrastructure in the Operation Center, for example the solution that drives the displays and video walls, will connect and work well with the computer vision application. The best way to do this of course is to use a software-driven approach to displaying information and data, rather than a traditional AV hardware approach, which may present incompatibilities. Software-defined and open technology solutions Software-defined and open technology solutions provide a wider support for any type of application the SOC may need Software-defined and open technology solutions provide a wider support for any type of application the SOC may need, including computer vision. In the modern world, with everything going digital, all security services and applications have become networked, and as such, they belong to IT. AV applications and services have increasingly become an integral part of an organization’s IT infrastructure. Software-defined approach to AV IT teams responsible for data protection are more in favor of a software-defined approach to AV that allow virtualised, open technologies as opposed to traditional hardware-based solutions. Software’s flexibility allows for more efficient refreshment cycles, expansions and upgrades. The rise of AV-over-IP technologies have enabled IT teams in SOC’s to effectively integrate AV solutions into their existing stack, greatly reducing overhead costs, when it comes to technology investments, staff training, maintenance, and even physical infrastructure. AV-over-IP software platforms Moreover, with AV-over-IP, software-defined AV platforms, IT teams can more easily integrate AI and Computer Vision applications within the SOC, and have better control of the data coming in, while achieving true situational awareness. Situational awareness is all about actionable data delivered to the right people, at the right time, in order to address security incidents and challenges. Situational awareness is all about actionable data delivered to the right people Often, the people who need to know about security risks or breaches are not physically present in the operation centers, so having the data and information locked up within the four walls of the SOC does not provide true situational awareness. hyper-scalable visual platforms Instead there is a need to be able to deliver the video stream, the dashboard of the data and information to any screen anywhere, at any time — including desktops, tablets phones — for the right people to see, whether that is an executive in a different office or working from home, or security guards walking the halls or streets. New technologies are continuing to extend the reach and the benefits of security operation centers. However, interoperability plays a key role in bringing together AI, machine learning and computer vision technologies, in order to ensure data is turned into actionable data, which is delivered to the right people to provide ‘true’ situational awareness. Software-defined, AV-over-IP platforms are the perfect medium to facilitate this for any organizations with physical and cyber security needs.

Gunshot Detectors Shorten Response Times And Make Cities Safer
Gunshot Detectors Shorten Response Times And Make Cities Safer

Gunshot detectors use digital microphones installed on (or in) buildings or along streets that listen for evidence of gunshots, provide near instantaneous notification, triangulate the location of shooters and direction of a shot, detect the type of gun and ultimately aid in catching fleeing suspects and solving crimes. Gunshot detection is just one technology playing a role in the larger trend by city agencies to improve core city services. Cities are turning to what are referred to as ‘smart city’ solutions – new, innovative technologies that improve and maintain a high quality of life and ‘liveability’ for citizens. Several cities in the United States have implemented gunshot detection systems. Identifying And Deterring Gun Violence ShotSpotter, a provider of gunshot detection solutions that help law enforcement officials and security personnel identify, locate and deter gun violence, announced that seven new cities have deployed ShotSpotter technology in their communities. Gunshot detection systems can shorten the response time in an active shooter situation The new cities include Cincinnati, OH; Jacksonville, FL; Louisville, KY; Newburgh, NY; Pittsfield, MA; Syracuse, NY and St. Louis County, MO – joining the more than 90 jurisdictions that rely on ShotSpotter to ensure a fast, accurate response to gunfire incidents. Three existing ShotSpotter cities, New York City, Chicago and Birmingham have also recently expanded their coverage areas. Gunshot detection systems can shorten the response time in an active shooter situation. Early detection should be a primary aim, second only to prevention. Security professionals must be part of both of these areas, working in partnership with relevant administrators, local government, law enforcement, first responders and the community to help prevent and better respond to gun violence. Gunshot Localization Solution In addition, active shooter events – large or small – are almost always sudden and unexpected, which places a burden on security personnel to manage these risks without creating a prison-like environment. A gunshot localization solution can turn a video camera system into a real-time safety system in the event of an active shooter A gunshot localization solution can turn a video camera system into a real-time safety system in the event of an active shooter. Called ShotPoint, the system is completely automated. Working with a video management system (VMS), it can enable a video image of an active shooter to be provided in seconds based on the location of a gunshot. ShotPoint is a network of sensors which can be mounted on walls, ceilings, streetlight poles or other indoor or outdoor locations. Using a ‘sensor mesh approach’, ShotPoint reliably detects and localizes the source of gunfire; ranging from small handguns to high caliber rifles. The system can cover large indoor or outdoor areas such as schools, office buildings, retail centers, campuses, and parks. Accurately Provides Gunshot Location Each sensor has an array of four acoustic channels (microphones) that can locate the source of a gunshot sound, the time of arrival and the time distance of arrival. ‘Hearing’ shots from several vantage points (using multiple sensors) enables the system to take into account the angle and time of the sound, which vary in different environments, thus accurately providing the location of the gunshot. A ‘fusion processor’ box (at the edge) listens to the various sensor nodes and computes the location of the gunshot, relative to a floorplan and/or based on global positioning system (GPS) location. In an outdoor location, additional information may also be inferred, such as the trajectory of the gunshot and/or the caliber of the firearm.