CA2325635C - Efficient pre-alarm buffer management - Google Patents
Efficient pre-alarm buffer management Download PDFInfo
- Publication number
- CA2325635C CA2325635C CA002325635A CA2325635A CA2325635C CA 2325635 C CA2325635 C CA 2325635C CA 002325635 A CA002325635 A CA 002325635A CA 2325635 A CA2325635 A CA 2325635A CA 2325635 C CA2325635 C CA 2325635C
- Authority
- CA
- Canada
- Prior art keywords
- video
- video data
- alarm
- data signals
- buffer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
- H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19604—Image analysis to detect motion of the intruder, e.g. by frame subtraction involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19634—Electrical details of the system, e.g. component blocks for carrying out specific functions
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19645—Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19665—Details related to the storage of video surveillance data
- G08B13/19667—Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19665—Details related to the storage of video surveillance data
- G08B13/19671—Addition of non-video data, i.e. metadata, to video stream
- G08B13/19673—Addition of time stamp, i.e. time metadata, to video stream
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19678—User interface
- G08B13/1968—Interfaces for setting up or customising the system
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19678—User interface
- G08B13/19682—Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N5/9201—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
- H04N5/9205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal the additional signal being at least another television signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/78—Television signal recording using magnetic recording
- H04N5/781—Television signal recording using magnetic recording on disks or drums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/78—Television signal recording using magnetic recording
- H04N5/782—Television signal recording using magnetic recording on tape
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/78—Television signal recording using magnetic recording
- H04N5/782—Television signal recording using magnetic recording on tape
- H04N5/783—Adaptations for reproducing at a rate different from the recording rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
Abstract
A hard disk (100) in a video data storage apparatus (20) includes a first section in which video data is stored and appointed for permanent recording (216), and a second section in which the video data is stored subject to rewriting after a short period of time. If an alarm event occurs (204), some or all of the data in the second section may be secured for permanent storage (216). The process to be employed in securing the data in the second section for permanent storage (216) is adapted to the proportion of the data in the second section which is desired to be secured.
Description
Efficient Pre-Alarm Buffer Management The above-referenced parent patent application discloses a digital video recorder which has intelligent video information management capabilities. A preferred application of the recorder of the parent application, as disclosed therein, is for selective recording of video signal streams generated by closed-circuit video security surveillance cameras. For this application, the recorder disclosed in the parent application is adapted to receive simultaneous input video signal streams from up to I6 cameras.
It is often desirable to record signal streams output from surveillance video cameras in order to preserve a record of unusual events captured by the video cameras.
However, o because of the enormous quantity of raw information present in a video signal stream, it is difficult to provide,, in an economical manner sufficient storage capacity for video signals corresponding to long periods of time. There have been a number of proposals intended to provide for efficient storage of surveillance video signals. For example, it has been proposed to record surveillance video signal streams only at very low frame rates (say, on the order of 5 one field or frame per second). Low frame rate recording, however, carries the risk that crucial images will go unrecorded.
The difficulties in providing adequate storage capacity are increased when it is desired to have more than one video camera share a single recording device. One technique that has been utilized to improve the effectiveness of a shared recording device is to allocate larger 2o portions of the recording bandwidth to video signal streams in which motion is detected. The premise is that signal streams representative of static images are unlikely to include information that is important. While this is a useful strategy, there remain significant risks that important information will be left out of the stream of images actually selected for I
recording.
The parent patent application discloses an additional strategy, referred to as pre-alaim buffering, which also promotes efficient use of limited signal storage capacity. The basic concept is that the respective video streams generated by some or all of the cameras connected to the recorder are not usually selected for permanent storage. Instead, a ring buffer is provided to record the signal streams at a given (perhaps shared) field rate for a limited period of time, say one minute. If a significant event is detected, such as tripping of an alarm sensor, actuation of an alarm condition by a human operator, or detection of a predetermined characteristic of an incoming image stream by machine analysis of the image stream, then the 1 o video signal stream in the ring buffer, which would normally have been overwritten, is preserved for permanent storage. Pre-alarm buffering represents a desirable compromise which avoids devoting permanent storage capacity to large quantities of uninteresting information, while increasing the likelihood that significant information will be permanently recorded. The present application is concerned with techniques for efficiently managing pre alarm buffering operations.
nBTECTS AND SUMMARY OF THE INVENTION
It is accordingly an object of the invention to provide a digital video recorder with pre-alarm buffering capabilities.
It is a further object of the invention to provide a digital video recorder in which the 2o signal storage capability is efficiently utilized.
According to a first aspect of the invention, there is provided a video data storage apparatus, including a plurality of video cameras, each generating a respective stream of video signals; conversion circuitry, connected to the plurality of video signals, for selectively converting the streams of video signals into respective streams of video data signals; a circular data buffer for selectively storing ones of the streams of video data signals subject to overwriting by more current video data signals; a main data store for selectively storing ones of the streams of video signals and for writing the video data signals in the main data store to a removable archive recording medium; a detection circuit for detecting an alarm condition;
and a control circuit for selecting between a first process and a second process different from 3o the first process, on the basis of the alarm condition detected by the detection circuit, the first and second processes both being processes for transferring a stream of video data signals from the circular data buffer to the main data store.
It is often desirable to record signal streams output from surveillance video cameras in order to preserve a record of unusual events captured by the video cameras.
However, o because of the enormous quantity of raw information present in a video signal stream, it is difficult to provide,, in an economical manner sufficient storage capacity for video signals corresponding to long periods of time. There have been a number of proposals intended to provide for efficient storage of surveillance video signals. For example, it has been proposed to record surveillance video signal streams only at very low frame rates (say, on the order of 5 one field or frame per second). Low frame rate recording, however, carries the risk that crucial images will go unrecorded.
The difficulties in providing adequate storage capacity are increased when it is desired to have more than one video camera share a single recording device. One technique that has been utilized to improve the effectiveness of a shared recording device is to allocate larger 2o portions of the recording bandwidth to video signal streams in which motion is detected. The premise is that signal streams representative of static images are unlikely to include information that is important. While this is a useful strategy, there remain significant risks that important information will be left out of the stream of images actually selected for I
recording.
The parent patent application discloses an additional strategy, referred to as pre-alaim buffering, which also promotes efficient use of limited signal storage capacity. The basic concept is that the respective video streams generated by some or all of the cameras connected to the recorder are not usually selected for permanent storage. Instead, a ring buffer is provided to record the signal streams at a given (perhaps shared) field rate for a limited period of time, say one minute. If a significant event is detected, such as tripping of an alarm sensor, actuation of an alarm condition by a human operator, or detection of a predetermined characteristic of an incoming image stream by machine analysis of the image stream, then the 1 o video signal stream in the ring buffer, which would normally have been overwritten, is preserved for permanent storage. Pre-alarm buffering represents a desirable compromise which avoids devoting permanent storage capacity to large quantities of uninteresting information, while increasing the likelihood that significant information will be permanently recorded. The present application is concerned with techniques for efficiently managing pre alarm buffering operations.
nBTECTS AND SUMMARY OF THE INVENTION
It is accordingly an object of the invention to provide a digital video recorder with pre-alarm buffering capabilities.
It is a further object of the invention to provide a digital video recorder in which the 2o signal storage capability is efficiently utilized.
According to a first aspect of the invention, there is provided a video data storage apparatus, including a plurality of video cameras, each generating a respective stream of video signals; conversion circuitry, connected to the plurality of video signals, for selectively converting the streams of video signals into respective streams of video data signals; a circular data buffer for selectively storing ones of the streams of video data signals subject to overwriting by more current video data signals; a main data store for selectively storing ones of the streams of video signals and for writing the video data signals in the main data store to a removable archive recording medium; a detection circuit for detecting an alarm condition;
and a control circuit for selecting between a first process and a second process different from 3o the first process, on the basis of the alarm condition detected by the detection circuit, the first and second processes both being processes for transferring a stream of video data signals from the circular data buffer to the main data store.
WO 99/56216 PCf/US99/09317 According to this aspect of the invention, the circular data buffer and the main data store may respectively include first and second portions of a hard disk drive.
Moreover, the first process may include reading the stream of video data signals to be transferred from the circular data buffer and rewriting that stream of video data signals to the main data store, and the second process may include designating the first portion of the hard disk to be a portion of the main data store.
According to a second aspect of the invention, there is provided a method of operating a digital video recorder which includes a disk-shaped storage medium and which selectively records on the storage medium digital data signals representing respective streams of video Io signals generated by a plurality of video cameras connected to the recorder, the recorder including a pre-alarm buffer as a designated portion of the storage medium, and the method including the steps of detecting an alarm condition, selecting, on the basis of the detected alarm condition, one of two processes for designating for permanent storage video data signals stored in the pre-alarm buffer, and executing the selected one of the two processes; wherein the first of the two processes includes reading some but not all of the video data signals stored in the pre-alarm buffer and writing the read video data signals into a portion of the storage medium different from the pre-alarm buffer, and the second of the two processes includes (i) redesignating the designated portion of the storage medium corresponding to the pre-alarm buffer such that all of the video data signals stored in the designated portion are appointed for 2o permanent storage, and (ii) designating a new portion of the storage medium to be the pre-alarm buffer.
According to a third aspect of the invention, there is provided a method of operating a digital video recorder which includes a disk-shaped storage medium and which selectively records on the storage medium digital data signals representing respective streams of video signals generated by a plurality of video cameras connected to the recorder, the method including the steps of selecting ones of the video cameras for recording on the storage medium in a pre-alarm buffer mode; for each of the selected video cameras, designating a respective portion of the storage medium to serve as a circular buffer for temporarily storing video data signals representing video signals generated by the respective camera;
temporarily storing in 3o the designated portions video data signals representing video signals generated by the respective selected cameras; detecting an alarm condition; determining that at least one of the selected cameras is relevant to the detected alarm condition; and, for each camera determined _ _ WO 99/56216 PCT/US99/09317 to be relevant to the detected alarm condition: (i) re-designating for permanent storage the respective portion of the storage medium previously designated to be the circular buffer for the respective camera, and (ii) designating a portion of the storage medium, different from the redesignated portion, to serve as a circular buffer for temporarily storing video data signals generated by the respective camera.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a perspective view of a video recording/personal computer (VR/PC) unit provided in accordance with the invention.
Fig. 2 is a summary block diagram representation of electronic components of the 1o VR/PC unit of Fig. 1.
Fig. 3 is a summary block diagram representation of a front end processing/compression component shown in Fig. 2.
Fig. 4 illustrates video data and index data formats utilized by the VRIPC
unit in storing video data on the hard disk provided therein.
Fig. 5 illustrates processing carried on by a main processor in the VR/PC unit in response to an indication of an alarm condition.
Fig. 6 illustrates in flow-chart form a video storage processing software module, provided in accordance with the invention, for the main processor of the VR/PC
unit.
Fig. 7 illustrates an alternative video data format provided, according to an aspect of 2o the invention, for the VR/PC hard disk.
Fig. 8 is a flow-chart illustrating an alternative pre-alarm buffer management technique provided in accordance with the invention.
DESCRIPTION OF PREFERRED EMBODIMENTS
Fig. 1 is a perspective view of an integrated device which combines digital video recording, random access retrieval of recorded video data, and user-friendly personal-computer-based functionality. Reference numeral 20 generally indicates the integrated device, which may be referred to as a video recording/personal computer or "VR/PC"
unit. The VR/PC unit is adapted to receive streams of video signals generated by one or more video cameras. A preferred embodiment is configured to receive simultaneous input from 16 3o cameras (which are not shown in Fig. 1). The VR/PC unit also provides an output video signal, either live from one or more video cameras, or reproduced from video data storage facilities provided within the VR/PC unit, to drive one or more display monitors, which also are not shown in Fig. 1.
The internal components of the VR/PC unit 20 are contained within a molded plastic housing 22. As will be seen, the internal components include control and signal processing circuitry, as well as a number of data recording devices. For example, integrated within the VR/PC unit there are preferably two or more fixed or "hard" data recording drives of the magnetic type, as well as at least one drive for a removable data storage medium. A~preferred embodiment includes both a floppy disk drive and a digital audio tape (DAT) drive. The floppy drive may be used for loading software programs; the DAT drive may be used to store video data, retrieved from the internal hard drives, for permanent or archival storage on a o magnetic tape formatted in accordance with the standard DAT format. Access to the drives for removable media (which are not shown in the drawing) may be had via a hinged dust-shield 24 provided at a front elevation 26 of the housing 22. Also provided at the front elevation 26 is a front panel 28 on which a plurality of switches are mounted.
The switches permit the user to control various functions such as selecting input cameras for displaying, setting a format for a displayed video signal, and controlling playback operations.
A commercial embodiment of a VR/PC unit, of a type in which the present invention may be applied, is currently being sold under the trademark "INTELLEX" by the assignee of the present invention, Sensormatic Electronics Corporation, Boca Raton, Florida.
An overview of the internal components of the VR/PC unit will now be provided, with 2o reference to Fig. 2. As seen from Fig. 2, primary components include a motherboard 40 and front end processing/compression electronics 42.
The motherboard 40 provides the overall intelligence and control for the VRIPC
unit.
Preferably, the motherboard 40 is constructed in accordance with conventional architecture for personal computer motherboards. The central processing unit for the motherboard is preferably constituted by a conventional microprocessor 44, which may, fox example, be one of the models of the well known Pentium line of microprocessors.
The motherboard 40 controls, and exchanges data with, data storage devices such as the above-mentioned hard disk drives, DAT drive and floppy disk drive. The motherboard is also adapted to receive user control signals, which may be input via the front panel 28 (Fig.
3o 1 ) or via conventional user input devices (not shown) such as a mouse and/or a keyboard. The motherboard 40 also exchanges data with the front end processing/compression electronics 42 while receiving an input digital video signal from the front end electronics 42, and - WO 99/56216 PC"fIUS99109317 providing an output video signal to a display monitor, which is not explicitly shown in Fig.
2.
It should be understood that the motherboard 40 includes conventional features such as program memory, working memory, input and output data communication ports, data signal bus connections, interfaces for recording medium drives, and video interface ports. All of these are preferably of conventional construction.
The front end electronics 42 provide signal processing with respect to input video signals received via a back panel 46. The arrangement of the front end electronics 42 may be like that incorporated in the above-mentioned INTELLEX video recorder and/or as disclosed 1 o in the above-referenced parent patent application.
Certain features of the front end electronics 42 are schematically illustrated in Fig. 3.
At the input side of the front end electronics 42 is a muldplexer 50 which selects ones of the input camera streams for recording and/or display by the VR/PC unit. Any one of the input video signal streams may be assigned to any one of three video signal locking channels 52-1, 52-2 and 52-3. At the output side of the signal locking channels, a channel-selection multiplexer 54 is arranged to assign any one of the three signal locking channels to either one of two signal conversion channels 56-l and 56-2. The signal conversion channels are provided to convert the selected stream of analog video signals into a sequence of digital video data. The resulting digital video data is then subjected to further processing, including 2o data compression, as indicated at 58 in Fig. 3. The processed data is then made available for storage via the motherboard and/or for display.
Preferably, the digital video data is also supplied to a signal processing circuit (not separately shown in Fig. 3) which selectively applies image content analysis algorithms to one or more of the input video streams in order to detect significant characteristics of the images represented by the video streams. Among other possibilities, the signal processing circuit may be programmed to detect motion, or certain types of motion, in the input video signal streams.
Fig. 4 illustrates a format in which compressed video data is stored on one or more of the hard disk drives of the VR/PC unit. As seen from Fig. 4, the data stored on the hard drives includes compressed video data 100 and indexed data 102. The video data corresponds to the 3o incoming streams from all 16 cameras (if as many as 16 cameras are connected to the VR/PC, are in operation, and are selected for either permanent or pre-alarm buffer recording). The video data is preferably stored in an audio/video interleave (AVI) format.
- - WO 99/56216 PC'f/US99/09317 The data corresponding to the streams of incoming video signals are stored interleaved together in the form of fixed length files 104, of which N files 104 are shown in Fig. 4-as being recorded on the hard disk. A preferred size for each of the files 104 is about 20 megabytes. By dividing up the continuous streams of video data into files, loss of data due to a drop out or data corruption on the hard disk can be limited.
Even with data compression, the storage capacity provided by the files 104 is limited.
It is therefore a preferred mode of operating the VR/PC that the video data files be transferred to a removable storage medium, such as a magnetic tape, for archival storage.
In addition to the quasi-permanent video data files 104, there is also stored on the hard 1 o disk video data maintained in a pre-alarm buffer section of the disk (reference numeral 106).
The pre-alarm buffer 106 preferably stores video data corresponding to the incoming video signals from all 16 cameras in an interleaved fashion and at what is substantially the full frame rate for the system (e.g., 45 fields per second divided among the 16 cameras).
By contrast, it should be understood that some or all of the I 6 cameras may not be currently recorded at all in the quasi-permanent f les I 04, or may be stored at a "time lapse" rate that is substantially less frequent than 45/16 fields per second. The pre-alarm buffer 106 is preferably implemented as a ring buffer on the hard disk and may, for example, store all of the video fields captured at the front end electronics over the past 60 seconds. As in the files 104, the respective signal streams are stored in an interleaved fashion in the pre-alarm buffer 106. It 2o should also be understood that at least some of the 16 cameras may be placed in an "inactive"
mode, such that not even pre-alarm buffering is performed for the signals generated from such cameras. In this case, greater storage bandwidth for each other camera is available in the pre-alarm buffer.
Turning now to the index data on the hard disk, overall indexing information covering all of the files 104 is indicated at reference numeral 108. For each of the N
files 104, a starting date and time and an ending date and time are provided. An additional, file-specific index is provided with respect to each one of the individual files 104. This file-specific index is illustrated at 110 and provides, for each field of video data, the date and time at which the field was captured, the camera by which the field was captured, event-related information, and 3o the offset within the file at which the field can be found. As indicated at reference numeral 112, the event information given for a particular field may include data indicative of the occurrence of more than one type of event at the time that the field was captured. The detection of events may be accomplished through alarm sensors interfaced to the VR/PC unit, and/or by analysis of characteristics of the image stream. The analysis may have occurred either at the time the image stream was received or by playing back the image stream at a later time. The image stream analysis algorithms used to detect the events may return confidence factor values in addition to detecting that an event itself has occurred. In such cases, the data indicating that an event has been detected may be accompanied by the confidence factor provided by the event detection algorithm, as indicated at reference numeral 114.
In a preferred embodiment of the invention, the indexing information 102 is stored on the same hard disk with the associated video data files 100, and the indexing inforniation is 1o also stored on a second hard disk. The second hard disk may then be accessed in order to search for the locations on the first hard disk of video data that is of interest to the user, while access to the first hard disk for the purpose of stoning new video data thereon continues without interruption for index searching. In one embodiment of the invention, two hard disks are provided, of which one is used for video data storage {and associated indexing) while the ~ 5 other hard disk is not used for video data storage, but rather is dedicated to backup or "shadow" index information and storage of programs or the like. In another embodiment of the invention, three or more hard disk drives are provided. In the latter embodiment, one of the hard drives is dedicated to the shadow index and program information storage, and the other two or more hard disks are available for video data storage.
2o There will now be described an alarm handler software component which controls operation of the microprocessor 44 (Fig. 2) in connection with responding to detection of alarm conditions. The alarm handler software component is illustrated in flow-chart form in Fig. 5. For the purposes of Fig. 5, it is assumed that an alarm message has been received by the microprocessor 44 from the front end electronics 42. It is then determined, at step 120, 25 whether a user of the VR/PC unit has elected to have alarms handled according to a standard protocol or a custom protocol. If a standard protocol has been selected, then step 122 follows step 120. At step 122, one or more predetermined "alarm out" signals are generated according to the type of alarm message that was received. For example, the "alarm out"
signal or signals may automatically close or lock doors, actuate sirens or visible alarm indications, or the like.
3o Following step 122 is step 124, at which a message is generated to cause the front end electronics 42 to change the sequence in which the video signal fields are captured from the respective cameras attached to the VR/PC unit. For example, cameras expected to produce images relevant to the alarm condition may be added to the sequence of cameras selected for recording, or may have their share of the recording bandwidth increased.
The next step is step 126, at which it is determined whether the VR/PC unit is being operated in a pre-alarm buffering mode. If so, then step 128 follows step 126.
In step 128, s a software message is dispatched to instruct a video storage software component to capture for permanent storage relevant data in the pre-alarm buffer, as will be described in more detail below.
Following step 128 is step 130 (which directly follows step 126 if the VR/PC
is not being operated in a pre-alarm buffering mode). At step 130, the alarm timer is set (or 1 o extended, if an alarm condition is already in effect), and the detected alarm event is added to a Iist of alarm events maintained by the microprocessor 44.
Step 132 follows step 130. Step 132 indicates that the recording sequence established at step 124 is maintained until the alarm timer times out. The determination as to whether the last alarm has timed out is made at step 134, and if this occurs, the alarm timer is shut down 1 s (step 136).
If at step 120 it was determined that a custom alarm handling mode is in effect, then step 138 follows step 120. At step 138, the determination is made as to the camera, type of event and the time of occurrence relative to the alarm condition which has been detected.
There follows step 140, at which the relevant camera, event type and time data are used to 2o fetch the appropriate event response script from an event response script database 142.
Following step 140 is a software loop, indicated at step 144, which is carried out for each command in the retrieved event response script. The loop is made up of steps 146, 148 and 150. At step 146, the command corresponding to the present line in the script is read. At step 148, a message corresponding to the command is encoded, and at step 150 the message is sent 2s to a system director software component, which functions as a message clearing house for the software which programs the microprocessor 44. It will be understood that the command messages sent to the system director software component will trigger appropriate responses in other software components which control operation of the microprocessor 44.
An example of a typical event response script follows:
Event Response Script (Example) ALARM 1 OUT = ON ( 1 ) ALARM2 OUT = ON (2) CAMERA1RATE = 30 (3) CAMERA I = ON (4) WAIT = 30 (5) RESUME (6) It will be observed that the exemplary event response script set forth above consists 0 of six lines. The first line indicates that the alarm 1 output signal is to be turned on. This may be, for example, a signal to actuate a visual alarm indicator such as a flashing light. The second line indicates that the alarm 2 output signal is to be turned on. This may operate, for example, an audible alarm indicator, such as a siren.
The third line indicates that the rate at which fields from camera 1 are to be captured 15 for recording is set to 30 fields per second. The remaining recording bandwidth will then be allocated among other cameras which had previously been sequenced for recording.
The fourth line indicates that recording status for camera I is to be set to "on". This command would override any previous command that had software-disabled camera 1.
The fifth command indicates that the status defined by the first four lines of the 2o response script is to be maintained for 30 seconds.
The sixth and final line of the script indicates that the prior operating status of the system is to resume after the 30-second alarm response.
The exemplary event response script shown above contains no commands in regard to video data that has been pre-alarm buffered, but it will be appreciated that the script may 25 include commands to secure for permanent storage relevant video data in the pre-alarm buffer, as discussed above in connection with step 128.
The above-mentioned video storage software component will now be described.
The video storage software component performs the functions of managing pre-alarm video data buffering on the hard disk or disks, storing incoming video streams on the hard disk, and 3o indexing the stored video data on the hard disk. The video data format on the disk was described above, in connection with Fig. 4.
The video storage software component is illustrated in flow-chart form on Fig.
6.
Initially, it is determined at step 200 whether the video storage software component is now engaged in the pre-alarm buffer management portion of its function or the function of storing incoming video data for quasi-permanent recording (represented by block 202).
For the sake of the further discussion, it will be assumed that the video storage software component is engaged in pre-alarm buffer management. In this case, it is determined, as represented at decision step 204, whether an alarm condition has been detected. If not, the next "chunk" of video data to be stored in the pre-alarm buffer is placed at the next storage location in the portion of the hard disk utilized as a ring buffer for pre-alarm storage (step 206; it will be recalled that the pre-alarm buffer portion of the hard disk's space was indicated by reference 1o numeral 106 in Fig. 4; it should also be understood that a "chunk" of video data corresponds to a quantity of data that is conveniently handled and buffered in preparation for writing the data onto the hard disk). After step 206, it is determined whether the end of the ring buffer portion 106 of the hard disk has been reached (step 208). If so, the pointer indicative of the next storage location in the ring buffer 106 is moved to the front of the ring buffer (step 210).
Otherwise, the pointer is simply moved to the next storage location in the ring buffer 106 (step 212).
If at step 204 an alarm condition was found to have been detected, then step follows step 204. Step 214 represents a decision point in the video storage software component, at which a selection is made between alternative processes for preventing video 2o data stored in the pre-alarm buffer from being overwritten, and securing the data of interest for permanent storage. The decision as to which one of the alternative processes to employ may be made on a number of different bases, but preferably is to be made by determining what proportion of the video data stored in the pre-alarm buffer is relevant to the alarm condition that was detected. One way this may be done is by comparing the total number of camera streams stored in the pre-alarm buffer with the number of cameras indicated as "relevant" in an alarm-handling script that has been established for the detected alarm condition. If the number of relevant cameras is few in comparison to the number of cameras currently being recorded in the pre-alarm buffer, then a first process, represented by steps 216-220 would be selected. If all or a relatively large number of the camera streams being recorded in the pre-3o alarm buffer are relevant to the alarm condition, then a process represented by steps 222 and 224 would be selected. Thus, the process for securing for permanent storage video data in the pre-alarm buffer is adapted to the currently-detected alarm condition. The process of securing for permanent recording video data stored in the pre-alarm buffer may be referred to as pre-alarm buffer "integration" in the sense that data from the pre-alarm buffer is being integrated with other video data selected for permanent storage.
The pre-alarm buffer integration process of steps 216-220 begins with copying from the pre-alarm buffer portion of the hard disk to the "permanent storage"
portion of the hard disk the video data in the pre-alarm buffer which was generated by cameras that are relevant to the currently-detected alarm condition. That is, the relevant data is read from the pre-alarm buffer portion 106 of the hard disk (Fig. 4) and then is written into the one of the permanent storage files 104 into which interleaved video data is currently being recorded. As indicated in step 218 of Fig. 6, the copying of the relevant data from the pre-alarm buffer portion to the permanent storage portion of the hard disk continues until all of the relevant data has been transferred. Then, as indicated at step 220, the pointer data for the pre-alarm buffer is reset.
The alternative pre-alarm buffer integration process, represented by steps 222 and 224, avoids the processing burden required for reading data from the pre-alarm buffer and rewriting the data in the permanent storage portion of the hard disk. Instead, a new portion of the disk, different from that currently being used for the pre-alarm buffer, is designated to be the pre-alarm buffer and the existing pre-alarm buffer data, in its entirety, is designated for permanent storage. This can be accomplished entirely by updating pointer values and index data, so that no reading and rewriting of the video data itself is required. Although this technique is 2o advantageous in terms of conserving processing resources, it represents a potential waste of storage capacity, to the extent that any of the data in the pre-alarm buffer is not relevant to the currently detected alarm condition.
The pre-alarm buffer integration process of steps 216 and 218, which entails reading video data from the pre-alarm buffer and then writing that data into a permanent storage file, may also be carried out according to the following alternative. In this alternative technique, the occurrence of an alarm initiates reading from the pre-alarm buffer of implicated camera streams for transfer to the permanent data file; at the same time, current data for those streams continues to be written into the pre-alarm buffer. The reading/transfer proceeds at a faster rate than the writing of the current data, and continues until the reading/transfer "catches up" to 3o the current data. At that point, the current data is written directly into the permanent storage file, and this continues until the alarm interval ends. Upon expiration of the alarm, recording of the relevant camera streams into the pre-alarm buffer resumes.
WO 99/56216 PC"T/US99/09317 An alternative approach to the problem of pre-alarm buffer integration will now be described with reference to Figs. 7 and 8. This approach relies upon separate pre-alarm ring buffers for each camera that is to be buffered, in place of the shared, interleaved pre-alarm buffer I06 shown in Fig. 4.
Fig. 7 shows a modification to the video data format of Fig. 4, in that the pre-alarm buffer 106 is replaced with separate ring buffers 230, each of which is dedicated to a respective one of the cameras selected for pre-alarm buffering.
As indicated in Fig. 8, provision of dedicated buffers for each camera to be pre-alarm recorded eliminates any need for reading and rewriting the pre-alarm buffered data in the to event of any relevant alarm condition. Initially in Fig. 8, it is determined (step 232) whether an alarm condition is detected. If not, normal pre-alarm buffer recording takes place, as represented by block 234 in Fig. 8, and as described above in connection with steps 206-212 of Fig. 6.
Continuing to refer to Fig. 8, if an alarm condition was detected, then step 236 follows is step 232. As indicated at step 236, for each camera stream determined to be relevant to the detected alarm condition, steps 238 and 240 are carned out. At step 238, the ring buffer corresponding to the relevant camera is redesignated for permanent storage and then a new ring buffer is established for the camera (step 240). The impact of step 238 is illustrated at 242 in Fig. 7, which provides some details of a "permanent recording" video data file 104 20 which has been designated "file number 1 ". In Fig. 7, blocks 244-1 and 244-2 represent blocks of video data which include interleaved streams generated from a plurality of cameras.
Blocks 244-1 and 244-2 represent the data format produced when a number of camera streams were designated for concurrent recording in a permanent portion of the hard disk with time-division multiplexing of the recording bandwidth. A non-interleaved data block 246 is shown 25 as present between blocks 244-I and 244-2. Block 246 corresponds to video data produced by a single camera, originally recorded in a pre-alarm ring buffer for that camera which was later re-designated for permanent storage. Marker 248 is present in the sequence of data blocks to indicate that the next block is a non-interleaved block. It will be understood that the sequence of blocks illustrated at 242 is a virtual sequence, established by index and pointing 3o information used to manage the data recorded on the hard disk.
Moreover, the first process may include reading the stream of video data signals to be transferred from the circular data buffer and rewriting that stream of video data signals to the main data store, and the second process may include designating the first portion of the hard disk to be a portion of the main data store.
According to a second aspect of the invention, there is provided a method of operating a digital video recorder which includes a disk-shaped storage medium and which selectively records on the storage medium digital data signals representing respective streams of video Io signals generated by a plurality of video cameras connected to the recorder, the recorder including a pre-alarm buffer as a designated portion of the storage medium, and the method including the steps of detecting an alarm condition, selecting, on the basis of the detected alarm condition, one of two processes for designating for permanent storage video data signals stored in the pre-alarm buffer, and executing the selected one of the two processes; wherein the first of the two processes includes reading some but not all of the video data signals stored in the pre-alarm buffer and writing the read video data signals into a portion of the storage medium different from the pre-alarm buffer, and the second of the two processes includes (i) redesignating the designated portion of the storage medium corresponding to the pre-alarm buffer such that all of the video data signals stored in the designated portion are appointed for 2o permanent storage, and (ii) designating a new portion of the storage medium to be the pre-alarm buffer.
According to a third aspect of the invention, there is provided a method of operating a digital video recorder which includes a disk-shaped storage medium and which selectively records on the storage medium digital data signals representing respective streams of video signals generated by a plurality of video cameras connected to the recorder, the method including the steps of selecting ones of the video cameras for recording on the storage medium in a pre-alarm buffer mode; for each of the selected video cameras, designating a respective portion of the storage medium to serve as a circular buffer for temporarily storing video data signals representing video signals generated by the respective camera;
temporarily storing in 3o the designated portions video data signals representing video signals generated by the respective selected cameras; detecting an alarm condition; determining that at least one of the selected cameras is relevant to the detected alarm condition; and, for each camera determined _ _ WO 99/56216 PCT/US99/09317 to be relevant to the detected alarm condition: (i) re-designating for permanent storage the respective portion of the storage medium previously designated to be the circular buffer for the respective camera, and (ii) designating a portion of the storage medium, different from the redesignated portion, to serve as a circular buffer for temporarily storing video data signals generated by the respective camera.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a perspective view of a video recording/personal computer (VR/PC) unit provided in accordance with the invention.
Fig. 2 is a summary block diagram representation of electronic components of the 1o VR/PC unit of Fig. 1.
Fig. 3 is a summary block diagram representation of a front end processing/compression component shown in Fig. 2.
Fig. 4 illustrates video data and index data formats utilized by the VRIPC
unit in storing video data on the hard disk provided therein.
Fig. 5 illustrates processing carried on by a main processor in the VR/PC unit in response to an indication of an alarm condition.
Fig. 6 illustrates in flow-chart form a video storage processing software module, provided in accordance with the invention, for the main processor of the VR/PC
unit.
Fig. 7 illustrates an alternative video data format provided, according to an aspect of 2o the invention, for the VR/PC hard disk.
Fig. 8 is a flow-chart illustrating an alternative pre-alarm buffer management technique provided in accordance with the invention.
DESCRIPTION OF PREFERRED EMBODIMENTS
Fig. 1 is a perspective view of an integrated device which combines digital video recording, random access retrieval of recorded video data, and user-friendly personal-computer-based functionality. Reference numeral 20 generally indicates the integrated device, which may be referred to as a video recording/personal computer or "VR/PC"
unit. The VR/PC unit is adapted to receive streams of video signals generated by one or more video cameras. A preferred embodiment is configured to receive simultaneous input from 16 3o cameras (which are not shown in Fig. 1). The VR/PC unit also provides an output video signal, either live from one or more video cameras, or reproduced from video data storage facilities provided within the VR/PC unit, to drive one or more display monitors, which also are not shown in Fig. 1.
The internal components of the VR/PC unit 20 are contained within a molded plastic housing 22. As will be seen, the internal components include control and signal processing circuitry, as well as a number of data recording devices. For example, integrated within the VR/PC unit there are preferably two or more fixed or "hard" data recording drives of the magnetic type, as well as at least one drive for a removable data storage medium. A~preferred embodiment includes both a floppy disk drive and a digital audio tape (DAT) drive. The floppy drive may be used for loading software programs; the DAT drive may be used to store video data, retrieved from the internal hard drives, for permanent or archival storage on a o magnetic tape formatted in accordance with the standard DAT format. Access to the drives for removable media (which are not shown in the drawing) may be had via a hinged dust-shield 24 provided at a front elevation 26 of the housing 22. Also provided at the front elevation 26 is a front panel 28 on which a plurality of switches are mounted.
The switches permit the user to control various functions such as selecting input cameras for displaying, setting a format for a displayed video signal, and controlling playback operations.
A commercial embodiment of a VR/PC unit, of a type in which the present invention may be applied, is currently being sold under the trademark "INTELLEX" by the assignee of the present invention, Sensormatic Electronics Corporation, Boca Raton, Florida.
An overview of the internal components of the VR/PC unit will now be provided, with 2o reference to Fig. 2. As seen from Fig. 2, primary components include a motherboard 40 and front end processing/compression electronics 42.
The motherboard 40 provides the overall intelligence and control for the VRIPC
unit.
Preferably, the motherboard 40 is constructed in accordance with conventional architecture for personal computer motherboards. The central processing unit for the motherboard is preferably constituted by a conventional microprocessor 44, which may, fox example, be one of the models of the well known Pentium line of microprocessors.
The motherboard 40 controls, and exchanges data with, data storage devices such as the above-mentioned hard disk drives, DAT drive and floppy disk drive. The motherboard is also adapted to receive user control signals, which may be input via the front panel 28 (Fig.
3o 1 ) or via conventional user input devices (not shown) such as a mouse and/or a keyboard. The motherboard 40 also exchanges data with the front end processing/compression electronics 42 while receiving an input digital video signal from the front end electronics 42, and - WO 99/56216 PC"fIUS99109317 providing an output video signal to a display monitor, which is not explicitly shown in Fig.
2.
It should be understood that the motherboard 40 includes conventional features such as program memory, working memory, input and output data communication ports, data signal bus connections, interfaces for recording medium drives, and video interface ports. All of these are preferably of conventional construction.
The front end electronics 42 provide signal processing with respect to input video signals received via a back panel 46. The arrangement of the front end electronics 42 may be like that incorporated in the above-mentioned INTELLEX video recorder and/or as disclosed 1 o in the above-referenced parent patent application.
Certain features of the front end electronics 42 are schematically illustrated in Fig. 3.
At the input side of the front end electronics 42 is a muldplexer 50 which selects ones of the input camera streams for recording and/or display by the VR/PC unit. Any one of the input video signal streams may be assigned to any one of three video signal locking channels 52-1, 52-2 and 52-3. At the output side of the signal locking channels, a channel-selection multiplexer 54 is arranged to assign any one of the three signal locking channels to either one of two signal conversion channels 56-l and 56-2. The signal conversion channels are provided to convert the selected stream of analog video signals into a sequence of digital video data. The resulting digital video data is then subjected to further processing, including 2o data compression, as indicated at 58 in Fig. 3. The processed data is then made available for storage via the motherboard and/or for display.
Preferably, the digital video data is also supplied to a signal processing circuit (not separately shown in Fig. 3) which selectively applies image content analysis algorithms to one or more of the input video streams in order to detect significant characteristics of the images represented by the video streams. Among other possibilities, the signal processing circuit may be programmed to detect motion, or certain types of motion, in the input video signal streams.
Fig. 4 illustrates a format in which compressed video data is stored on one or more of the hard disk drives of the VR/PC unit. As seen from Fig. 4, the data stored on the hard drives includes compressed video data 100 and indexed data 102. The video data corresponds to the 3o incoming streams from all 16 cameras (if as many as 16 cameras are connected to the VR/PC, are in operation, and are selected for either permanent or pre-alarm buffer recording). The video data is preferably stored in an audio/video interleave (AVI) format.
- - WO 99/56216 PC'f/US99/09317 The data corresponding to the streams of incoming video signals are stored interleaved together in the form of fixed length files 104, of which N files 104 are shown in Fig. 4-as being recorded on the hard disk. A preferred size for each of the files 104 is about 20 megabytes. By dividing up the continuous streams of video data into files, loss of data due to a drop out or data corruption on the hard disk can be limited.
Even with data compression, the storage capacity provided by the files 104 is limited.
It is therefore a preferred mode of operating the VR/PC that the video data files be transferred to a removable storage medium, such as a magnetic tape, for archival storage.
In addition to the quasi-permanent video data files 104, there is also stored on the hard 1 o disk video data maintained in a pre-alarm buffer section of the disk (reference numeral 106).
The pre-alarm buffer 106 preferably stores video data corresponding to the incoming video signals from all 16 cameras in an interleaved fashion and at what is substantially the full frame rate for the system (e.g., 45 fields per second divided among the 16 cameras).
By contrast, it should be understood that some or all of the I 6 cameras may not be currently recorded at all in the quasi-permanent f les I 04, or may be stored at a "time lapse" rate that is substantially less frequent than 45/16 fields per second. The pre-alarm buffer 106 is preferably implemented as a ring buffer on the hard disk and may, for example, store all of the video fields captured at the front end electronics over the past 60 seconds. As in the files 104, the respective signal streams are stored in an interleaved fashion in the pre-alarm buffer 106. It 2o should also be understood that at least some of the 16 cameras may be placed in an "inactive"
mode, such that not even pre-alarm buffering is performed for the signals generated from such cameras. In this case, greater storage bandwidth for each other camera is available in the pre-alarm buffer.
Turning now to the index data on the hard disk, overall indexing information covering all of the files 104 is indicated at reference numeral 108. For each of the N
files 104, a starting date and time and an ending date and time are provided. An additional, file-specific index is provided with respect to each one of the individual files 104. This file-specific index is illustrated at 110 and provides, for each field of video data, the date and time at which the field was captured, the camera by which the field was captured, event-related information, and 3o the offset within the file at which the field can be found. As indicated at reference numeral 112, the event information given for a particular field may include data indicative of the occurrence of more than one type of event at the time that the field was captured. The detection of events may be accomplished through alarm sensors interfaced to the VR/PC unit, and/or by analysis of characteristics of the image stream. The analysis may have occurred either at the time the image stream was received or by playing back the image stream at a later time. The image stream analysis algorithms used to detect the events may return confidence factor values in addition to detecting that an event itself has occurred. In such cases, the data indicating that an event has been detected may be accompanied by the confidence factor provided by the event detection algorithm, as indicated at reference numeral 114.
In a preferred embodiment of the invention, the indexing information 102 is stored on the same hard disk with the associated video data files 100, and the indexing inforniation is 1o also stored on a second hard disk. The second hard disk may then be accessed in order to search for the locations on the first hard disk of video data that is of interest to the user, while access to the first hard disk for the purpose of stoning new video data thereon continues without interruption for index searching. In one embodiment of the invention, two hard disks are provided, of which one is used for video data storage {and associated indexing) while the ~ 5 other hard disk is not used for video data storage, but rather is dedicated to backup or "shadow" index information and storage of programs or the like. In another embodiment of the invention, three or more hard disk drives are provided. In the latter embodiment, one of the hard drives is dedicated to the shadow index and program information storage, and the other two or more hard disks are available for video data storage.
2o There will now be described an alarm handler software component which controls operation of the microprocessor 44 (Fig. 2) in connection with responding to detection of alarm conditions. The alarm handler software component is illustrated in flow-chart form in Fig. 5. For the purposes of Fig. 5, it is assumed that an alarm message has been received by the microprocessor 44 from the front end electronics 42. It is then determined, at step 120, 25 whether a user of the VR/PC unit has elected to have alarms handled according to a standard protocol or a custom protocol. If a standard protocol has been selected, then step 122 follows step 120. At step 122, one or more predetermined "alarm out" signals are generated according to the type of alarm message that was received. For example, the "alarm out"
signal or signals may automatically close or lock doors, actuate sirens or visible alarm indications, or the like.
3o Following step 122 is step 124, at which a message is generated to cause the front end electronics 42 to change the sequence in which the video signal fields are captured from the respective cameras attached to the VR/PC unit. For example, cameras expected to produce images relevant to the alarm condition may be added to the sequence of cameras selected for recording, or may have their share of the recording bandwidth increased.
The next step is step 126, at which it is determined whether the VR/PC unit is being operated in a pre-alarm buffering mode. If so, then step 128 follows step 126.
In step 128, s a software message is dispatched to instruct a video storage software component to capture for permanent storage relevant data in the pre-alarm buffer, as will be described in more detail below.
Following step 128 is step 130 (which directly follows step 126 if the VR/PC
is not being operated in a pre-alarm buffering mode). At step 130, the alarm timer is set (or 1 o extended, if an alarm condition is already in effect), and the detected alarm event is added to a Iist of alarm events maintained by the microprocessor 44.
Step 132 follows step 130. Step 132 indicates that the recording sequence established at step 124 is maintained until the alarm timer times out. The determination as to whether the last alarm has timed out is made at step 134, and if this occurs, the alarm timer is shut down 1 s (step 136).
If at step 120 it was determined that a custom alarm handling mode is in effect, then step 138 follows step 120. At step 138, the determination is made as to the camera, type of event and the time of occurrence relative to the alarm condition which has been detected.
There follows step 140, at which the relevant camera, event type and time data are used to 2o fetch the appropriate event response script from an event response script database 142.
Following step 140 is a software loop, indicated at step 144, which is carried out for each command in the retrieved event response script. The loop is made up of steps 146, 148 and 150. At step 146, the command corresponding to the present line in the script is read. At step 148, a message corresponding to the command is encoded, and at step 150 the message is sent 2s to a system director software component, which functions as a message clearing house for the software which programs the microprocessor 44. It will be understood that the command messages sent to the system director software component will trigger appropriate responses in other software components which control operation of the microprocessor 44.
An example of a typical event response script follows:
Event Response Script (Example) ALARM 1 OUT = ON ( 1 ) ALARM2 OUT = ON (2) CAMERA1RATE = 30 (3) CAMERA I = ON (4) WAIT = 30 (5) RESUME (6) It will be observed that the exemplary event response script set forth above consists 0 of six lines. The first line indicates that the alarm 1 output signal is to be turned on. This may be, for example, a signal to actuate a visual alarm indicator such as a flashing light. The second line indicates that the alarm 2 output signal is to be turned on. This may operate, for example, an audible alarm indicator, such as a siren.
The third line indicates that the rate at which fields from camera 1 are to be captured 15 for recording is set to 30 fields per second. The remaining recording bandwidth will then be allocated among other cameras which had previously been sequenced for recording.
The fourth line indicates that recording status for camera I is to be set to "on". This command would override any previous command that had software-disabled camera 1.
The fifth command indicates that the status defined by the first four lines of the 2o response script is to be maintained for 30 seconds.
The sixth and final line of the script indicates that the prior operating status of the system is to resume after the 30-second alarm response.
The exemplary event response script shown above contains no commands in regard to video data that has been pre-alarm buffered, but it will be appreciated that the script may 25 include commands to secure for permanent storage relevant video data in the pre-alarm buffer, as discussed above in connection with step 128.
The above-mentioned video storage software component will now be described.
The video storage software component performs the functions of managing pre-alarm video data buffering on the hard disk or disks, storing incoming video streams on the hard disk, and 3o indexing the stored video data on the hard disk. The video data format on the disk was described above, in connection with Fig. 4.
The video storage software component is illustrated in flow-chart form on Fig.
6.
Initially, it is determined at step 200 whether the video storage software component is now engaged in the pre-alarm buffer management portion of its function or the function of storing incoming video data for quasi-permanent recording (represented by block 202).
For the sake of the further discussion, it will be assumed that the video storage software component is engaged in pre-alarm buffer management. In this case, it is determined, as represented at decision step 204, whether an alarm condition has been detected. If not, the next "chunk" of video data to be stored in the pre-alarm buffer is placed at the next storage location in the portion of the hard disk utilized as a ring buffer for pre-alarm storage (step 206; it will be recalled that the pre-alarm buffer portion of the hard disk's space was indicated by reference 1o numeral 106 in Fig. 4; it should also be understood that a "chunk" of video data corresponds to a quantity of data that is conveniently handled and buffered in preparation for writing the data onto the hard disk). After step 206, it is determined whether the end of the ring buffer portion 106 of the hard disk has been reached (step 208). If so, the pointer indicative of the next storage location in the ring buffer 106 is moved to the front of the ring buffer (step 210).
Otherwise, the pointer is simply moved to the next storage location in the ring buffer 106 (step 212).
If at step 204 an alarm condition was found to have been detected, then step follows step 204. Step 214 represents a decision point in the video storage software component, at which a selection is made between alternative processes for preventing video 2o data stored in the pre-alarm buffer from being overwritten, and securing the data of interest for permanent storage. The decision as to which one of the alternative processes to employ may be made on a number of different bases, but preferably is to be made by determining what proportion of the video data stored in the pre-alarm buffer is relevant to the alarm condition that was detected. One way this may be done is by comparing the total number of camera streams stored in the pre-alarm buffer with the number of cameras indicated as "relevant" in an alarm-handling script that has been established for the detected alarm condition. If the number of relevant cameras is few in comparison to the number of cameras currently being recorded in the pre-alarm buffer, then a first process, represented by steps 216-220 would be selected. If all or a relatively large number of the camera streams being recorded in the pre-3o alarm buffer are relevant to the alarm condition, then a process represented by steps 222 and 224 would be selected. Thus, the process for securing for permanent storage video data in the pre-alarm buffer is adapted to the currently-detected alarm condition. The process of securing for permanent recording video data stored in the pre-alarm buffer may be referred to as pre-alarm buffer "integration" in the sense that data from the pre-alarm buffer is being integrated with other video data selected for permanent storage.
The pre-alarm buffer integration process of steps 216-220 begins with copying from the pre-alarm buffer portion of the hard disk to the "permanent storage"
portion of the hard disk the video data in the pre-alarm buffer which was generated by cameras that are relevant to the currently-detected alarm condition. That is, the relevant data is read from the pre-alarm buffer portion 106 of the hard disk (Fig. 4) and then is written into the one of the permanent storage files 104 into which interleaved video data is currently being recorded. As indicated in step 218 of Fig. 6, the copying of the relevant data from the pre-alarm buffer portion to the permanent storage portion of the hard disk continues until all of the relevant data has been transferred. Then, as indicated at step 220, the pointer data for the pre-alarm buffer is reset.
The alternative pre-alarm buffer integration process, represented by steps 222 and 224, avoids the processing burden required for reading data from the pre-alarm buffer and rewriting the data in the permanent storage portion of the hard disk. Instead, a new portion of the disk, different from that currently being used for the pre-alarm buffer, is designated to be the pre-alarm buffer and the existing pre-alarm buffer data, in its entirety, is designated for permanent storage. This can be accomplished entirely by updating pointer values and index data, so that no reading and rewriting of the video data itself is required. Although this technique is 2o advantageous in terms of conserving processing resources, it represents a potential waste of storage capacity, to the extent that any of the data in the pre-alarm buffer is not relevant to the currently detected alarm condition.
The pre-alarm buffer integration process of steps 216 and 218, which entails reading video data from the pre-alarm buffer and then writing that data into a permanent storage file, may also be carried out according to the following alternative. In this alternative technique, the occurrence of an alarm initiates reading from the pre-alarm buffer of implicated camera streams for transfer to the permanent data file; at the same time, current data for those streams continues to be written into the pre-alarm buffer. The reading/transfer proceeds at a faster rate than the writing of the current data, and continues until the reading/transfer "catches up" to 3o the current data. At that point, the current data is written directly into the permanent storage file, and this continues until the alarm interval ends. Upon expiration of the alarm, recording of the relevant camera streams into the pre-alarm buffer resumes.
WO 99/56216 PC"T/US99/09317 An alternative approach to the problem of pre-alarm buffer integration will now be described with reference to Figs. 7 and 8. This approach relies upon separate pre-alarm ring buffers for each camera that is to be buffered, in place of the shared, interleaved pre-alarm buffer I06 shown in Fig. 4.
Fig. 7 shows a modification to the video data format of Fig. 4, in that the pre-alarm buffer 106 is replaced with separate ring buffers 230, each of which is dedicated to a respective one of the cameras selected for pre-alarm buffering.
As indicated in Fig. 8, provision of dedicated buffers for each camera to be pre-alarm recorded eliminates any need for reading and rewriting the pre-alarm buffered data in the to event of any relevant alarm condition. Initially in Fig. 8, it is determined (step 232) whether an alarm condition is detected. If not, normal pre-alarm buffer recording takes place, as represented by block 234 in Fig. 8, and as described above in connection with steps 206-212 of Fig. 6.
Continuing to refer to Fig. 8, if an alarm condition was detected, then step 236 follows is step 232. As indicated at step 236, for each camera stream determined to be relevant to the detected alarm condition, steps 238 and 240 are carned out. At step 238, the ring buffer corresponding to the relevant camera is redesignated for permanent storage and then a new ring buffer is established for the camera (step 240). The impact of step 238 is illustrated at 242 in Fig. 7, which provides some details of a "permanent recording" video data file 104 20 which has been designated "file number 1 ". In Fig. 7, blocks 244-1 and 244-2 represent blocks of video data which include interleaved streams generated from a plurality of cameras.
Blocks 244-1 and 244-2 represent the data format produced when a number of camera streams were designated for concurrent recording in a permanent portion of the hard disk with time-division multiplexing of the recording bandwidth. A non-interleaved data block 246 is shown 25 as present between blocks 244-I and 244-2. Block 246 corresponds to video data produced by a single camera, originally recorded in a pre-alarm ring buffer for that camera which was later re-designated for permanent storage. Marker 248 is present in the sequence of data blocks to indicate that the next block is a non-interleaved block. It will be understood that the sequence of blocks illustrated at 242 is a virtual sequence, established by index and pointing 3o information used to manage the data recorded on the hard disk.
Claims (9)
1. A video data storage apparatus, comprising:
a plurality of video cameras, each generating a respective stream of video signals;
conversion means, connected to said plurality of video cameras, for selectively converting said streams of video signals into respective streams of video data signals;
circular buffer means for selectively storing ones of said streams of video data signals subject to overwriting by more current video data signals;
main storage means for selectively storing ones of said streams of video data signals and for writing the video data signals stored in said main storage means to a removable archive recording medium;
detection means for detecting an alarm condition; and control means for selecting between a first process and a second process different from said first process, on the basis of the alarm condition detected by said detection means; said first and second processes both being processes for transferring a stream of video data signals from said circular buffer means to said main storage means.
a plurality of video cameras, each generating a respective stream of video signals;
conversion means, connected to said plurality of video cameras, for selectively converting said streams of video signals into respective streams of video data signals;
circular buffer means for selectively storing ones of said streams of video data signals subject to overwriting by more current video data signals;
main storage means for selectively storing ones of said streams of video data signals and for writing the video data signals stored in said main storage means to a removable archive recording medium;
detection means for detecting an alarm condition; and control means for selecting between a first process and a second process different from said first process, on the basis of the alarm condition detected by said detection means; said first and second processes both being processes for transferring a stream of video data signals from said circular buffer means to said main storage means.
2. A video data storage apparatus according to claim 1, wherein:
said circular buffer means and said main storage means comprise, respectively, first and second portions of a hard disk drive;
said first process comprises reading said stream of video data signals to be transferred from said circular buffer means and writing said read stream of video data signals to said main storage means; and said second process comprises designating said first portion of said hard disk drive to be a portion of said main storage means.
said circular buffer means and said main storage means comprise, respectively, first and second portions of a hard disk drive;
said first process comprises reading said stream of video data signals to be transferred from said circular buffer means and writing said read stream of video data signals to said main storage means; and said second process comprises designating said first portion of said hard disk drive to be a portion of said main storage means.
3. A video data storage apparatus according to claim 1, wherein said detection means includes means for analyzing images represented by at least one of said streams of dynamic video signals generated by said video cameras.
4. A video data storage apparatus according to claim 1, wherein said detection means includes at least one alarm sensor.
5. A method of operating a digital video recorder which includes a disk-shaped storage medium and selectively records on said storage medium digital data signals representing respective streams of video signals generated by a plurality of video cameras connected to the recorder, the recorder including a pre-alarm buffer as a designated portion of said storage medium, the method comprising the steps of:
detecting an alarm condition;
selecting, on the basis of the detected alarm condition, one of two processes for designating for permanent storage video data signals stored in said pre-alarm buffer; and executing the selected one of said two processes;
a first of said two processes including reading some but not all of video data signals stored in said pre-alarm buffer and writing the read video data signals in a portion of said storage medium different from said pre-alarm buffer; and a second of said two processes including (i) redesignating said designated portion of said storage medium corresponding to said pre-alarm buffer such that all of the video data signals stored in said designated portion are appointed for permanent storage, and (ii) designating a new portion of said storage medium to be the pre-alarm buffer.
detecting an alarm condition;
selecting, on the basis of the detected alarm condition, one of two processes for designating for permanent storage video data signals stored in said pre-alarm buffer; and executing the selected one of said two processes;
a first of said two processes including reading some but not all of video data signals stored in said pre-alarm buffer and writing the read video data signals in a portion of said storage medium different from said pre-alarm buffer; and a second of said two processes including (i) redesignating said designated portion of said storage medium corresponding to said pre-alarm buffer such that all of the video data signals stored in said designated portion are appointed for permanent storage, and (ii) designating a new portion of said storage medium to be the pre-alarm buffer.
6. A method according to claim 5, wherein said storage medium is a hard disk.
7. A method according to claim 5, wherein said pre-alarm buffer is maintained in an interleaved condition for storing respective signal streams generated by more than one of said plurality of video cameras.
8. A method of operating a digital video recorder which includes a disk-shaped storage medium and selectively records on said storage medium digital data signals representing respective streams of video signals generated by a plurality of video cameras connected to the recorder, the method comprising the steps of:
(a) selecting ones of said video cameras for recording on said storage medium in a pre-alarm buffer mode;
(b) for each of said selected video cameras, designating a respective portion of said storage medium to serve as a circular buffer for temporarily storing video data signals representing video signals generated by the respective camera;
(c) temporarily storing in said designated portions video data signals representing video signals generated by the respective selected cameras;
(d) detecting an alarm condition;
(e) determining that at least one of the selected cameras is relevant to the detected alarm condition; and (f) for each camera determined to be relevant to the detected alarm condition, (i) re-designating for permanent storage the respective portion of the storage medium designated at step (b) to be the circular buffer for the respective camera; and (ii) designating a portion of said storage medium, different from said redesignated portion, to serve as a circular buffer for temporarily storing video data signals generated by the respective camera.
(a) selecting ones of said video cameras for recording on said storage medium in a pre-alarm buffer mode;
(b) for each of said selected video cameras, designating a respective portion of said storage medium to serve as a circular buffer for temporarily storing video data signals representing video signals generated by the respective camera;
(c) temporarily storing in said designated portions video data signals representing video signals generated by the respective selected cameras;
(d) detecting an alarm condition;
(e) determining that at least one of the selected cameras is relevant to the detected alarm condition; and (f) for each camera determined to be relevant to the detected alarm condition, (i) re-designating for permanent storage the respective portion of the storage medium designated at step (b) to be the circular buffer for the respective camera; and (ii) designating a portion of said storage medium, different from said redesignated portion, to serve as a circular buffer for temporarily storing video data signals generated by the respective camera.
9. A method according to claim 8, wherein said storage medium is a hard disk.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US09/069,257 | 1998-04-29 | ||
| US09/069,257 US5996023A (en) | 1996-10-31 | 1998-04-29 | Efficient pre-alarm buffer management in intelligent video information management system |
| PCT/US1999/009317 WO1999056216A1 (en) | 1998-04-29 | 1999-04-29 | Efficient pre-alarm buffer management |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2325635A1 CA2325635A1 (en) | 1999-11-04 |
| CA2325635C true CA2325635C (en) | 2006-07-18 |
Family
ID=22087761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002325635A Expired - Lifetime CA2325635C (en) | 1998-04-29 | 1999-04-29 | Efficient pre-alarm buffer management |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US5996023A (en) |
| EP (1) | EP1073964B1 (en) |
| JP (1) | JP2002513224A (en) |
| AR (1) | AR015030A1 (en) |
| AU (1) | AU755668B2 (en) |
| BR (1) | BR9909922A (en) |
| CA (1) | CA2325635C (en) |
| WO (1) | WO1999056216A1 (en) |
Families Citing this family (61)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999003466A1 (en) * | 1997-07-15 | 1999-01-28 | Daiichi Pharmaceutical Co., Ltd. | Prophylactic or therapeutic agent for amnesia |
| US7088387B1 (en) * | 1997-08-05 | 2006-08-08 | Mitsubishi Electric Research Laboratories, Inc. | Video recording device responsive to triggering event |
| US7391443B2 (en) * | 1998-08-21 | 2008-06-24 | Sony Corporation | Information processing apparatus, information processing method, and medium |
| US6317152B1 (en) * | 1999-07-17 | 2001-11-13 | Esco Electronics Corporation | Digital video recording system |
| JP4282201B2 (en) * | 2000-03-06 | 2009-06-17 | 株式会社東芝 | Encoded data recording device |
| US6570496B2 (en) * | 2000-04-04 | 2003-05-27 | Rick A. Britton | Networks and circuits for alarm system operations |
| CA2441106C (en) * | 2001-03-14 | 2011-05-24 | Comtrak Technologies, Llc | Digital video recording system |
| KR20030009669A (en) * | 2001-07-23 | 2003-02-05 | 삼성전자주식회사 | multi channel image encoding apparatus and encording method thereof |
| JP4020626B2 (en) * | 2001-11-14 | 2007-12-12 | 三洋電機株式会社 | Monitoring and recording device |
| FI116167B (en) * | 2001-12-18 | 2005-09-30 | Valtion Teknillinen | Archive file server |
| GB2386244A (en) * | 2002-03-07 | 2003-09-10 | Nokia Corp | Method of digital recording |
| EP1351500B1 (en) * | 2002-03-07 | 2009-10-21 | Nokia Corporation | Method of digital recording |
| TWI292535B (en) * | 2002-04-26 | 2008-01-11 | Nti Inc | Information providing method, information processing apparatus, information collecting system, communication method, communication system, relaying apparatus, and communication apparatus |
| US7256818B2 (en) * | 2002-05-20 | 2007-08-14 | Simmonds Precision Products, Inc. | Detecting fire using cameras |
| EP2107720B1 (en) * | 2002-07-29 | 2017-05-10 | UHS Systems Pty Ltd. | A remote terminal for use in a telemetry system |
| US7437053B2 (en) * | 2003-01-15 | 2008-10-14 | Matsushita Electric Industrial Co., Ltd. | Digital video recorder, method of driving the video recorder and program |
| US20040189871A1 (en) * | 2003-03-31 | 2004-09-30 | Canon Kabushiki Kaisha | Method of generating moving picture information |
| JP4256714B2 (en) * | 2003-04-25 | 2009-04-22 | パイオニア株式会社 | Recording apparatus and control method thereof |
| US7817716B2 (en) * | 2003-05-29 | 2010-10-19 | Lsi Corporation | Method and/or apparatus for analyzing the content of a surveillance image |
| US7577199B1 (en) | 2003-06-19 | 2009-08-18 | Nvidia Corporation | Apparatus and method for performing surveillance using motion vectors |
| US8004565B2 (en) | 2003-06-19 | 2011-08-23 | Nvidia Corporation | System and method for using motion vectors for object tracking |
| CN1303541C (en) * | 2003-08-20 | 2007-03-07 | 上海乐金广电电子有限公司 | Memory operating method and device for disc recording player |
| US7519504B2 (en) * | 2004-03-31 | 2009-04-14 | Emc Corporation | Method and apparatus for representing, managing and problem reporting in surveillance networks |
| US20090122875A1 (en) * | 2005-03-07 | 2009-05-14 | Koninklijke Philips Electronics, N.V. | Buffering of video stream data |
| US8520069B2 (en) * | 2005-09-16 | 2013-08-27 | Digital Ally, Inc. | Vehicle-mounted video system with distributed processing |
| US7403115B2 (en) * | 2005-09-21 | 2008-07-22 | International Business Machines Corporation | System and method for surveillance of suspects of automated banking machine fraud |
| US8928752B2 (en) | 2006-08-31 | 2015-01-06 | Stellar Llc | Recording device with pre-start signal storage capability |
| US7593034B2 (en) | 2006-08-31 | 2009-09-22 | Dekeyser Paul | Loop recording with book marking |
| US7818474B2 (en) * | 2006-09-29 | 2010-10-19 | Hibbard Gary D | Provisional load sharing buffer for reducing hard disk drive (HDD) activity and improving reliability and lifetime |
| US7974522B2 (en) * | 2006-09-29 | 2011-07-05 | Hibbard Gary D | Systems and methods to improve consumer product reliability and lifetime of a hard disk drive by reducing its activity |
| US8503972B2 (en) * | 2008-10-30 | 2013-08-06 | Digital Ally, Inc. | Multi-functional remote monitoring system |
| EP2407943B1 (en) | 2010-07-16 | 2016-09-28 | Axis AB | Method for event initiated video capturing and a video camera for capture event initiated video |
| CN102376146A (en) * | 2010-08-20 | 2012-03-14 | 上海弘视通信技术有限公司 | Image analysis alarm signal-based method for storing information of alarm event |
| US9019431B2 (en) | 2012-09-28 | 2015-04-28 | Digital Ally, Inc. | Portable video and imaging system |
| US10272848B2 (en) | 2012-09-28 | 2019-04-30 | Digital Ally, Inc. | Mobile video and imaging system |
| US9958228B2 (en) | 2013-04-01 | 2018-05-01 | Yardarm Technologies, Inc. | Telematics sensors and camera activation in connection with firearm activity |
| US9565462B1 (en) * | 2013-04-26 | 2017-02-07 | SportXast, LLC | System, apparatus and method for creating, storing and transmitting sensory data triggered by an event |
| US10075681B2 (en) | 2013-08-14 | 2018-09-11 | Digital Ally, Inc. | Dual lens camera unit |
| US10390732B2 (en) | 2013-08-14 | 2019-08-27 | Digital Ally, Inc. | Breath analyzer, system, and computer program for authenticating, preserving, and presenting breath analysis data |
| US9253452B2 (en) | 2013-08-14 | 2016-02-02 | Digital Ally, Inc. | Computer program, method, and system for managing multiple data recording devices |
| US9159371B2 (en) | 2013-08-14 | 2015-10-13 | Digital Ally, Inc. | Forensic video recording with presence detection |
| US20150110455A1 (en) * | 2013-10-23 | 2015-04-23 | Nvidia Corporation | Utility and method for capturing computer-generated video output |
| CN104639859B (en) * | 2013-11-08 | 2017-10-27 | 浙江大华技术股份有限公司 | A kind of video monitoring equipment and its method for carrying out data syn-chronization |
| TWI606342B (en) | 2014-10-20 | 2017-11-21 | 愛克勝企業公司 | Systems and methods for distributed control |
| FR3028129B1 (en) * | 2014-11-03 | 2016-12-30 | Vigipack | VIDEO SURVEILLANCE SYSTEM FOR MULTIPLE CAMERAS |
| WO2016100356A1 (en) | 2014-12-15 | 2016-06-23 | Yardarm Technologies, Inc. | Camera activation in response to firearm activity |
| US9841259B2 (en) | 2015-05-26 | 2017-12-12 | Digital Ally, Inc. | Wirelessly conducted electronic weapon |
| US10013883B2 (en) | 2015-06-22 | 2018-07-03 | Digital Ally, Inc. | Tracking and analysis of drivers within a fleet of vehicles |
| US10192277B2 (en) | 2015-07-14 | 2019-01-29 | Axon Enterprise, Inc. | Systems and methods for generating an audit trail for auditable devices |
| US10157333B1 (en) | 2015-09-15 | 2018-12-18 | Snap Inc. | Systems and methods for content tagging |
| WO2017136646A1 (en) | 2016-02-05 | 2017-08-10 | Digital Ally, Inc. | Comprehensive video collection and storage |
| US11334768B1 (en) * | 2016-07-05 | 2022-05-17 | Snap Inc. | Ephemeral content management |
| US10521675B2 (en) | 2016-09-19 | 2019-12-31 | Digital Ally, Inc. | Systems and methods of legibly capturing vehicle markings |
| JP6854886B2 (en) * | 2016-09-26 | 2021-04-07 | アマゾン テクノロジーズ インコーポレイテッド | Streaming and storing video for audio / video recording communication equipment |
| US10911725B2 (en) | 2017-03-09 | 2021-02-02 | Digital Ally, Inc. | System for automatically triggering a recording |
| US11024137B2 (en) | 2018-08-08 | 2021-06-01 | Digital Ally, Inc. | Remote video triggering and tagging |
| WO2020071828A1 (en) * | 2018-10-04 | 2020-04-09 | Samsung Electronics Co., Ltd. | Method and system for recording a super slow motion video in a portable electronic device |
| JP7127616B2 (en) * | 2019-06-04 | 2022-08-30 | 横河電機株式会社 | Information processing device, alarm management system, and alarm management method |
| US11237708B2 (en) | 2020-05-27 | 2022-02-01 | Bank Of America Corporation | Video previews for interactive videos using a markup language |
| US11461535B2 (en) | 2020-05-27 | 2022-10-04 | Bank Of America Corporation | Video buffering for interactive videos using a markup language |
| US11950017B2 (en) | 2022-05-17 | 2024-04-02 | Digital Ally, Inc. | Redundant mobile video recording |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2528789B2 (en) * | 1985-06-26 | 1996-08-28 | 中央電子 株式会社 | Video information management device |
| US5825969A (en) * | 1994-02-18 | 1998-10-20 | Hitachi, Ltd. | Information management apparatus for inhibiting reproduction in a video cassette recorder |
| ATE206548T1 (en) * | 1995-03-06 | 2001-10-15 | Bell Addison | COMPUTER-ASSISTED EVENT RECORDING SYSTEM WITH FLEXIBLE RECORDING |
| US5724475A (en) * | 1995-05-18 | 1998-03-03 | Kirsten; Jeff P. | Compressed digital video reload and playback system |
| US5982418A (en) * | 1996-04-22 | 1999-11-09 | Sensormatic Electronics Corporation | Distributed video data storage in video surveillance system |
| US5854902A (en) * | 1996-10-31 | 1998-12-29 | Sensormatic Electronics Corporation | Video data capture and formatting in intelligent video information management system |
| US5862342A (en) * | 1996-10-31 | 1999-01-19 | Sensormatic Electronics Corporation | Intelligent video information management system with information archiving capabilities |
| US5822542A (en) * | 1996-10-31 | 1998-10-13 | Sensormatic Electronics Corporation | Electronic and structural components of an intelligent video information management apparatus |
| US5909548A (en) * | 1996-10-31 | 1999-06-01 | Sensormatic Electronics Corporation | Apparatus for alerting human operator to status conditions of intelligent video information management system |
-
1998
- 1998-04-29 US US09/069,257 patent/US5996023A/en not_active Expired - Lifetime
-
1999
- 1999-04-28 AR ARP990101958A patent/AR015030A1/en not_active Application Discontinuation
- 1999-04-29 CA CA002325635A patent/CA2325635C/en not_active Expired - Lifetime
- 1999-04-29 EP EP99918899A patent/EP1073964B1/en not_active Expired - Lifetime
- 1999-04-29 JP JP2000546311A patent/JP2002513224A/en not_active Withdrawn
- 1999-04-29 BR BR9909922-5A patent/BR9909922A/en not_active IP Right Cessation
- 1999-04-29 AU AU36706/99A patent/AU755668B2/en not_active Ceased
- 1999-04-29 WO PCT/US1999/009317 patent/WO1999056216A1/en active IP Right Grant
Also Published As
| Publication number | Publication date |
|---|---|
| AU3670699A (en) | 1999-11-16 |
| AR015030A1 (en) | 2001-04-11 |
| CA2325635A1 (en) | 1999-11-04 |
| BR9909922A (en) | 2000-12-26 |
| US5996023A (en) | 1999-11-30 |
| AU755668B2 (en) | 2002-12-19 |
| EP1073964A4 (en) | 2009-03-04 |
| EP1073964B1 (en) | 2011-07-20 |
| JP2002513224A (en) | 2002-05-08 |
| EP1073964A1 (en) | 2001-02-07 |
| WO1999056216A1 (en) | 1999-11-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2325635C (en) | Efficient pre-alarm buffer management | |
| US6144797A (en) | Intelligent video information management system performing multiple functions in parallel | |
| US5862342A (en) | Intelligent video information management system with information archiving capabilities | |
| US5909548A (en) | Apparatus for alerting human operator to status conditions of intelligent video information management system | |
| US5884042A (en) | Data identification in an intelligent video information management system | |
| US5822542A (en) | Electronic and structural components of an intelligent video information management apparatus | |
| EP1463325B1 (en) | Intelligent video information management system | |
| US5875304A (en) | User-settable features of an intelligent video information management system | |
| US5828848A (en) | Method and apparatus for compression and decompression of video data streams | |
| US5917958A (en) | Distributed video data base with remote searching for image data features | |
| US5854902A (en) | Video data capture and formatting in intelligent video information management system | |
| US6421080B1 (en) | Digital surveillance system with pre-event recording | |
| US5875305A (en) | Video information management system which provides intelligent responses to video data content features | |
| US20020175995A1 (en) | Video surveillance system | |
| AU735899B2 (en) | Intelligent video information management system | |
| AU760578B2 (en) | Intelligent video information management system | |
| AU1867002A (en) | Intelligent video information management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKEX | Expiry |
Effective date: 20190429 |