In this article

Key Takeaways
What video analytics means for security
How an alert gets from the camera to a person
Use cases by property type
What video analytics detects well, and what it does not
False alarms and missed events
Keep a person in the loop
Privacy, legal, and cybersecurity questions
Planning an analytics project
How GuardEX approaches it
FAQ
Sources
Recommended

Video analytics is software that watches camera video for you. It looks for events you define, such as a person in a closed area, a vehicle at a gate after hours, or someone lingering at a fence, and it sends an alert to a person who decides what to do. The U.S. Department of Homeland Security describes it as algorithms that process digital video streams for real-time detection and later review. It does not replace cameras, guards, or a response plan. It decides which moments on those cameras deserve a human’s attention.

This guide is for New Jersey property managers and business owners. It explains how the technology works, where it fits on different kinds of sites, what limits to expect, and what to settle before you buy.

Key Takeaways

Video analytics turns passive cameras into a rule-based alerting tool, but someone still has to verify each alert and respond.
Results depend on camera placement, lighting, and rule tuning at least as much as on the software.
AI analytics can learn what is normal for a scene, but it can still produce false alarms and miss events, so plan for both.
Face recognition and other biometric features carry privacy and legal risk. Decide whether you need them before you ask for them.
The value comes from the whole chain: camera, analytics, monitoring, response, and reporting.

What video analytics means for security

A traditional camera system records. If nobody is watching a live feed, you find out what happened when you review the footage afterward. That is useful evidence, but it is reactive.

Video analytics adds a layer that examines the images as they arrive. It can run on the camera itself, on a local recorder or server, or in the cloud. DHS’s 2025 handbook update notes that video security systems now include edge analytics, cloud storage, and AI. Edge analytics means the computation happens at or near the camera, which reduces delay and cuts the amount of video sent to central servers.

There are two broad types, and the difference matters when you read a proposal.

Rule-based analytics

Fixed-algorithm analytics look for specific, predefined behaviors such as loitering or movement in the wrong direction. Trade press describes these as looking for set behaviors, while AI-based tools learn what is normal for a scene after being connected to a camera for several weeks. Rule-based tools are predictable. You draw a line or a zone, set a time threshold, and the system alerts when the rule is broken.

AI video analytics

AI analytics use machine learning to detect and classify objects and behaviors. A person, a vehicle, and an animal look different to the software, so it can ignore the raccoon that would have set off a basic motion alarm. Security Magazine describes advanced behavioral analytics as AI-driven technology that autonomously detects, analyzes, and recognizes actions and events.

Most modern products combine both: AI classifies what is in the frame, and rules decide whether that object, in that place, at that time, deserves an alert.

How rule-based and AI analytics work together

How an alert gets from the camera to a person

The chain has four links. A weakness in any one limits the others.

Capture. The camera produces a usable image. Resolution, angle, lens, and lighting set the ceiling for everything downstream.
Detection. The software identifies objects or behaviors in the video and compares them with the rules you configured.
Verification. A trained person, or a trained person assisted by software, looks at the clip and decides whether it is a real event.
Response. Someone acts: a voice-down message, a call to the on-site guard, a patrol dispatch, a call to the property manager, or a call to police.

Most disappointment with analytics happens at links 3 and 4. An alert that lands in an inbox nobody checks at 2 a.m. is not protection. This is why analytics pairs naturally with remote video monitoring, where trained operators review alerts as they arrive and follow your escalation steps.

Use cases by property type

The common thread is a place where something should not happen at a certain time, or where you cannot afford to have a person watching a screen all day. The examples below are general guidance on how these tools are commonly applied. They are not a promise of what any system will catch on your property.

Warehouses and 3PL distribution

Large yards, many dock doors, and shift changes create gaps. Typical rules include:

Person or vehicle detected in the yard outside operating hours.
Dock door open with no scheduled activity.
Vehicle stopped in a fire lane or at a gate longer than a set time.
People entering a restricted cage or high-value zone.

Docks are where access, inventory, and drivers meet, so analytics works best when paired with a clear dock procedure. Our guide to loading dock security covers the procedural side that cameras alone cannot fix.

Construction sites

Sites are open, change weekly, and are often empty at night. Analytics is commonly used for after-hours intrusion alerts at the fence line or laydown yard, and for flagging vehicles near material storage. Because the layout changes, cameras and zones need to be revisited when phases change, or rules will point at areas that no longer matter.

Manufacturing and food processing plants

Plants have a mix of public-facing areas, employee-only zones, and sensitive production or storage areas. Analytics can alert when someone enters a restricted zone, when a gate is left open, or when a person is in a loading area at an unexpected time. For plants that handle food, see our notes on food processing security. Any rule that involves employees also raises workplace privacy questions, covered below.

Schools and campuses

Schools generally need less automatic detection of people and more attention to doors, perimeters, and after-hours activity. Analytics may help flag a propped exterior door or a person on a roof or in a closed area at night. Because students are involved, any system that identifies individuals needs a careful legal and policy review before it goes live.

Residential and gated communities

Gates, clubhouses, pools, mailrooms, and parking areas are the usual focus. Typical alerts include after-hours activity at amenities, vehicles lingering at a gate, and people in a parking structure at night. Residents tend to care about both safety and being recorded, so notice and clear policies matter. Our article on parking lot security explains why lighting should be fixed before cameras are added.

Retail, healthcare, and offices

Main uses include after-hours alerts at entrances, queue or crowd counting for staffing, and monitoring of parking areas and rear doors. Counting and occupancy features generally use less sensitive data than identification features.

What video analytics detects well, and what it does not

DHS’s 2022 SAVER TechNote on AI and machine learning lists video surveillance, facial recognition, contraband detection, and anomaly detection among the security uses of these tools. Not all of those are equally mature or equally appropriate for a private property.

In practice, the most dependable uses are the simplest:

Presence of a person or vehicle in a defined area during a defined time.
Crossing a virtual line.
Loitering beyond a time threshold.
Counting people or vehicles.

The less dependable uses are those that require the system to interpret intent, such as judging whether a person’s behavior is suspicious. Treat any claim that software can reliably spot “bad intent” with skepticism and ask for the test conditions behind it.

Why performance varies from site to site

Axis Communications’ 2021 whitepaper lists camera hardware, configuration, scene dynamics, and illumination among the factors that affect analytics performance. In plain terms:

Lighting. Deep shadows, headlight glare, and low light all reduce accuracy.
Camera angle and distance. A person who is only a few pixels tall is hard to classify.
Weather and scene motion. Rain, snow, swaying trees, and reflective surfaces can trigger alerts or hide real events.
Configuration. Zones that are too large or thresholds that are too sensitive create noise.

The same whitepaper notes that AI systems currently cannot learn new skills after deployment and need retraining with accurate data to improve. Learning what is normal for a scene is not the same as learning new tasks. If your site changes, expect to retune.

DHS also notes that machine learning needs sufficient quantity, quality, and breadth of data to handle a broad set of scenarios and avoid bias. A product trained mostly on bright, clear, open scenes may behave differently on a rainy New Jersey loading yard at dusk.

False alarms and missed events

Both errors cost you something. A false alarm wastes attention and, if it triggers a dispatch, money. A missed event defeats the purpose. You cannot eliminate either, but you can manage the balance.

Start narrow. Begin with a few high-value zones and hours rather than the whole property.
Use duration and zone rules. Requiring a person to stay in a zone for a set time filters out passersby.
Fix the environment. Add lighting, trim vegetation, and reposition cameras that face glare.
Review alert logs weekly at first. Track how many alerts were real, how many were nuisances, and which cameras produce most of the noise.
Adjust, then recheck. Change one setting at a time so you know what helped.

Ask any vendor how it measures false-alert rates and under what conditions. A figure with no test conditions is a marketing number.

Keep a person in the loop

Security professionals widely recommend that automated detection feeds a human decision. Genetec has said there should always be a human in the loop, because machines are good at finding patterns in large amounts of data while people decide the best next action. The Security Industry Association likewise supports AI that is human-centric, ethical, and trustworthy.

For a property manager, that means deciding in advance:

Who receives each type of alert, and at what hours.
What the verifying person is allowed to do: talk down through a speaker, call the on-site guard, dispatch a patrol, or call 911.
What gets written down after every real event.

If you have an on-site officer, analytics can tell them where to look. If you do not, a mobile patrol can be the physical response to a verified alert. Either way, the person in the field should know what the alert looked like and what the post orders say to do next.

Privacy, legal, and cybersecurity questions

This section is general information, not legal advice. Have your New Jersey attorney review any system that records employees, residents, students, or the public, especially if it uses biometrics or audio.

Face recognition and biometrics

Face recognition is the feature that draws the most scrutiny. The FTC’s order in the Rite Aid matter required deletion of specified photos, videos, and derived data and a monitoring program with risk assessments at least every 12 months for automated biometric security or surveillance systems. A separate FTC order requires one analytics vendor to substantiate claims about facial-recognition accuracy or lack of bias with competent and reliable testing.

NIST’s OSAC guidance on live facial recognition recommends privacy-by-design features such as immediate deletion of non-match data and operator-led verification. It also says organizations should do due diligence on the algorithms they deploy, since generalized accuracy claims are often unsupported. For most commercial properties, detection of people and vehicles in defined zones answers the security need without identifying anyone.

Face recognition and biometrics — overview diagram

Liability and explainability

DHS warns that AI and machine learning decisions may be hard to explain or defend in court, and that legal liability for errors is still debated. It also stresses that domain experts should work with technical and legal experts to balance operational needs with regulatory and ethical limits. In practice, avoid automated actions with serious consequences for a person, such as denying entry or making an accusation, without a human check.

Practical privacy steps

Do not point cameras at restrooms, locker rooms, or other places where people expect privacy.
Post clear notice that video is recorded where appropriate, and tell employees in writing what is monitored.
Treat audio recording separately from video. It is governed by different rules, so get legal advice first.
Set a retention period and a rule for who may export footage.
Secure the system itself: unique passwords, current firmware, and network separation from your business network. Ask your IT provider to review it.

Planning an analytics project

DHS suggests that a video security design team include security, facility maintenance, and management personnel, and it may consult IT professionals. It also advises assessing site-specific requirements and checking interoperability with existing security software. That is a sound outline for a property of any size.

A short checklist before you buy

Define the risk. Write down the two or three events you want to know about, such as after-hours entry at the rear fence or a propped dock door.
Walk the site at night. Check lighting, glare, and blind spots with the person who will design the system.
Audit your cameras. Older or poorly aimed cameras may limit what software can do. Our comparison of analog and IP cameras explains what to check.
Decide who responds. Name the monitoring party, the escalation order, and the backup contact.
Ask about reporting. You should be able to see alerts, verified events, and actions taken.
Plan a trial period. Run the rules for a few weeks, then review false alerts before expanding.
Get legal and IT review. Cover privacy, retention, and network security.

Questions to ask any provider

Which analytics run on the camera, and which in the cloud?
What happens to alerts if the internet connection drops?
How are rules tuned after installation, and who does it?
What do you log, and can I export it?
How is video stored, for how long, and who can access it?
If the system uses facial recognition, how has accuracy been tested, and can I turn it off?

How GuardEX approaches it

GuardEX is a New Jersey security company that plans coverage around each property’s risks and operations. Analytics only helps when it is connected to cameras that suit the site, someone who verifies alerts, and a clear response. Our video security systems service covers planning and installation, and our remote security monitoring service adds monitoring on top. Guards, mobile patrol, and access control can then be combined as the site requires.

If you are considering analytics for a warehouse, plant, school, construction site, or residential community, start with a site review. We will discuss your risks, what your current cameras can support, and how alerts would reach people who can act. Contact GuardEX to start the conversation.

FAQ

Is AI video analytics the same as regular video analytics?

Not exactly. Older analytics follow fixed rules, such as flagging loitering or movement in the wrong direction. AI analytics use machine learning to recognize objects and learn what is normal for a scene. Many products combine the two, with AI identifying what is in view and rules deciding when to alert.

Can video analytics replace security guards?

It generally should not be treated as a replacement. Analytics detects and alerts, but a person must verify the event and respond. Many properties use analytics to direct guards and patrols to the right place at the right time, rather than to remove them.

Will analytics eliminate false alarms?

No. Camera hardware, configuration, scene changes, and lighting all affect performance, and every system produces some false alerts and may miss some events. Narrow rules, better lighting, regular tuning, and human verification reduce the problem but do not remove it.

Do I need facial recognition for security?

Most commercial properties do not. Detecting a person or vehicle in a restricted zone at a set time usually meets the need without identifying anyone. Facial recognition adds privacy, accuracy, and legal risk, so have counsel review it before you consider it.

Does my property need new cameras?

Sometimes. Analytics depends on image quality, angle, and lighting. A site review will show whether existing cameras can support your rules or whether specific cameras should be replaced or repositioned.

Video Analytics for Security: What It Does and Where It Fits