Twenty minutes after clocking in to work, the average security guy, who sits in a control room watching a bank of television screens, will be giving no more than 30% of his attention to the video streams. His severely diminished attention will be spread across 8 or more such video streams - that is, unless he’s brought his own portable TV to work to watch, or he’s playing cards with the other security guy. That’s often the way it is.

The simple fact is that the weakest element in the security systems built from large populations of intelligently placed cameras and banks of DVRs is the human watcher. Even if this system component is conscientious, its performance is pathetic. The human is at his or her best when there’s a real incentive to watch the screen. Video surveillance does an effective job in casinos, where the watcher’s attention is drawn to follow specific individuals who (horror of horrors) appear to be winning. (If you like attention then go to a casino and start winning - you’ll get buckets of attention.) In most other situations, the human component needs to be upgraded, because it is simply not up to the job.

What job?  - the job of scanning hours of video in order to notice if anything significant is happening.

The truth about video security systems is that they are genuinely useful in three ways:

  • The presence of cameras acts as a deterrent to would be intruders.
  • The video record will provide useful information in the event of any actual incident.
  • Having security guards in the building watching videos can be very useful if a genuine intrusion is detected.

All of which is fine, and may be well worth the cost, but more is possible - a great deal more.

Avocado Security: The Technology

Avocado Security has built a software platform that makes a big difference to this situation (both product and company are called Avocado Security.) The best way for me to describe it is to call it a video mining product. You could say it was a physical security product, but in truth its a video mining product and physical security happens to be its current primary area of application. As far as I know it’s the only  product of its kind.

There are two important aspects to the product:

1. Data analysis/video mining: Avocado analyzes video streams. It analyzes these streams to extract a whole series of “attributes” it identifies human beings (distinguishing them from animals) captures their direction of movement, counts them, identifies them (in some circumstances) takes note of background variances (due to weather), spots small changes of detail and so on. In total a video stream is analyzed for 35 attributes and this data is recorded as data.

The data can then be analyzed in various ways. In particular, for security applications, you can compare activity by time of day, or day of week or any other time frame to highlight irregularities. What Avocado Security does, in effect, is reduce video to sets of data that can be analyzed and compared. If you want, it can do this in “real-time” - there’s a lag between an action being captured on video and it being translated into analyzable form, but it’s only about 10 seconds.

This makes a big difference to the surveillance situation because the system can warn someone that something unusual is happening - and it can be investigated immediately - by someone who will give it 100% attention.

2. Avocado Security is a Platform. It is a platform in the sense that you can plug a whole series of components into it. On one side, the components you plug in are surveillance technology - cameras and DVRs - video feeds plug directly into the platform. On the other side you can plug BI tools into the platform. The platform has its own BI capabilities in the sense that it has a series of dials, bar charts and graphics that it has built to highlight specific situations. However as Avocado Security has interfaces to many of the commonly used BI and reporting tools, they can also be used to analyze data in any way that you choose to look at it.

Video Mining

You could say that video mining already exists to some extent in the sense that there are ways to analyze video and extract data from it. You could use face recognition, for example, to identify all scenes from “Raiders of the Lost Ark” in which Harrison Ford appears. And that’s very useful if you’re in the process of cataloging movies. But Avocado Security is doing something quite different. It is caturing and codifying activity.

Some of its customers have already realized that the usefulness of this extends way beyond security. In retail, for example, you may already have cameras deployed that capture the movement of people through a shop, in order to spot shoplifting activity. With Avocado Security you may well be better able to do this because there may be characteristic patterns in shoplifter behavior. But you can also observe the order in which people browse through the store. You may discover, for example, that even though a given product sells well, it is rarely browsed - so you are giving it too much shelf space. You may discover that certain types of customers (men over forty, say) never buy any of the shirts on display, and so on. You cannot gather such data from video by having people watch the video. You need to condense the information into an analyzable form and them point the number crunching software at it.

The exciting things about video mining in this way is that it’s pretty much a green field. We simply have no idea what we do not know about the behavior of people (or animals or cars or truck or whatever). Just as there has been a big pay-off from the data mining of transactional data, there is going to be a big pay-off from the data mining of video streams. It will surely make a huge impact in security and I have little doubt that it will have an impact in retail and transport. But it’s quite possible that it will make a difference in many other activities - in the health sector, in education, in leisure. It’s hard to know, because right now very little of this data has been analyzed in this way.

Avocado Security is breaking new ground. It’s a company to watch and this is technology to watch. You have not heard the last of it.

  Subscribe to HaveMacWillBlog in a reader