US 20090181640 A1
An interactive personal surveillance and security (IPSS) system for users carrying wireless communication devices. The system utilizes portable communication devices that are also capable of capturing and or sending surveillance information (video, images, audio, sensor data, etc.). The system allows users carrying these devices to automatically capture surveillance information, have the information sent to one or more automated and remotely located surveillance (RLS) systems, and establish interactivity for the verification of determining secure or dangerous environments, encounters, logging events, or other encounters or observations. The remotely located surveillance (RLS) systems receives information from user communication devices and can follow user-definable parameters that establish the level or type of interactivity and determining when alarms or messages to third parties are needed. This user-definable interactive personal surveillance system may become tailored and may respond to one or more users differently, based on each users set-up and changes to the system. The interactive personal surveillance system may also react differently based on a users location, the users potential safety or risk, when the users reacts differently to an event, others around them, etc.
1. An interactive personal security and surveillance system including a mobile telephone equipped with security and surveillance software for automatically determining user activities and matching the user activity to different security and or surveillance modes or levels for determining when automatic activations are needed; and once activated remotely report alarms and or surveillance information to one or more remotely located server/s which are capable of interactively responding to the user and also others when needed, comprising;
said mobile telephone comprising two or more user security and or surveillance modes that match the user activity including, a user travel method (within or on a vehicle, riding a bike, riding a motorcycle, snow skiing, skate boarding, etc); or a user motion (walking, running, jumping, climbing, falling, standing or laying down); or a user location that increases or decreases the need for security or surveillance (mall parking lot, high or low crime areas, home or work, highway or street, play ground, etc.), or a time of day, time into an activity, time expiration, or other time measurement;
said user security and or surveillance modes within the said mobile phone will automatically activate an alarm and or start reporting information to a remotely located automated interactive security and surveillance server when the alarm and or surveillance criteria is met;
said remotely located interactive server automatically, after receiving an alarm or surveillance information will start attempting to communicate with the user, if communication attempts are unsuccessful or the user does not disengage the activation, the system will automatically contact one or more people, enforcement agencies or organizations and provide location information, type of event/alarm and play surveillance information when/if appropriate and available.
2. The user motion and or travel method detection of
3. The motion and or travel method detection of
4. The motion and or travel detection of
5. The mobile phone security and or surveillance mode level of
6. The mobile phone security and or surveillance alarm of
7. A system, comprising:
a personal communications device (PCD) having:
means for sensing surveillance information;
means for communicating the surveillance information;
a computer situated remotely from the PCD and having:
means for receiving the surveillance information;
means for storing one or more alert criteria;
means for initiating an alert communication based upon the surveillance information and the alert criteria.
This application claims priority to copending U.S. provisional application entitled, “Interactive Personal Surveillance System and Method,” having Ser. No. 61/021,447, filed Jan. 16, 2008, which is entirely incorporated herein by reference.
The present invention relates to surveillance and security systems and, more particularly, to an interactive personal surveillance and security (IPSS) system utilizing common communication devices capable of monitoring the users, regardless of the users location, time-of-day, traveling, or in any area where standard surveillance is or is not present. The present invention enhances security and surveillance by determining a users activities, including (a.) the user travel method (Car, bus, motorcycle, bike, snow skiing, skate boarding, etc.) (b.) the user motion (walking, running, climbing, falling, standing, laying down, etc.)
(c.) the user location and the time of day or time allowance of an activity, then automatically uses the user activities to set or engage alarms or surveillance (some interactive) including the activation of an alarm, engaging time-response security checks, capturing of video, still images and or audio and sends the information to a remotely located surveillance (RLS) system while automatically interacting with its user for the purpose of determining if other measures of security are needed or if the system should be turned off. The automated interactive personal surveillance system is capable of some, if not all, decisions to change modes of operation and capturing surveillance information to help safeguard and protect its users.
There are many situations when individuals, carrying communication devices, would benefit from an interactive personal surveillance and security (IPSS) system which utilizes most, if not all of the same hardware that they already have with them. A surveillance and security system within a common communication device, carried throughout the day, while entering higher risk areas, while active in travel or exercise, encountering individuals on the street or at their home as a stranger knocks on their door, or just as an increased margin of safety to have it everywhere and at anytime without the limitation of fixed security and surveillance systems in cars, homes, parking lots, businesses, etc.
The inherent nature of stationary surveillance systems is to capture information for protecting buildings, homes, business operations and individuals while visiting a particular site. A personal surveillance system is for the protection of one or more users anywhere and all the time and not limited to areas but following the user throughout the day, from home to business, to shopping, to banking, walking through a park, traveling, snow skiing or any other place a person may reside, go to, travel in, walk, or be a part of.
Many individuals would benefit from an interactive personal surveillance and security (IPSS) system that acted and reacted proactively based on their own individual and constantly changing requirements.
As in many of the past inventions, the ability to record and send this information to live monitors which people are watching, becomes inadequate and sometimes a resource overload if to many camera's are reporting. The true fact is that alarms or surveillance reporting on an individual level must be smart enough to activate automatically, before a crime or user needs assistance but not all the time, it must understand what its user is actively engaged in, how the user is engaged, where the user is engaged and respond and activate counter measures to suit the user's current (ever changing) needs.
The need for an interactive personal surveillance and security (IPSS) system may be witnessed by observing individuals when walking to and from parking lots. Many individuals use their wireless communication device to call and talk to friends, relatives and other people when they enter unsafe or unknown environments. This common habit for people to talk to someone else when an individual is alone and feels uneasy, scared or potentially endangered, will be eased with the current interactive personal surveillance system invention.
The need for an Interactive Personal Surveillance and Security (IPSS) system that utilizes existing technologies already carried by many users, that captures and protects the surveillance information from being erased, stolen or lost, interactivity that's tailored to each individuals requirements, alarms that may locate other individuals or businesses near by, activate other alarms which may sound around or near the user in need, the verification of people, places, businesses would be a valuable and needed system.
The above and other needs are met by the present invention which, in one embodiment, provides a personal interactive surveillance and security system that's always with the user. The system comprises software (or firmware) installed on a users portable communication device (Cell Phone, Wireless PDA, etc.) and capable of gathering GPS, accelerometer (or other motion device) readings, time, camera (or video), and audio (among others). A remotely located server (RLS) configured to communicate with and control alarm activations or surveillance information from each portable communication device. The system, both components are configured to interact and to send/receive surveillance and or alarm information, and counter measures to each other.
Another aspect of the present invention is its capable of capturing/taking surveillance information, remotely storing and or processing the surveillance information away from the device (that could be destroyed, disposed-of or damaged) in a safe area.
It is desirable for people to tailor their own automated personal surveillance system to meet their own personal needs and requirements. Effective surveillance must match each users needs by fitting into their own environments, daily lives, activities, everywhere and all the time. The user will select, at least in part, how the surveillance system will determine when actions are needed to help or assist the user. Through a user-definable online area within the system it may be programmed differently at one location over another, when traveling, time of day, day of week, when near known criminals or high crime areas, when codes are entered or not entered when required, listening modes, allows another friend or person to receive live or recorded surveillance information for making a determination when authorities or help is needed, allowing others to remotely operate your surveillance mobile device, allowing others users (parents) to program a particular surveillance mode or complete operation (for children), specialized mobile device screens showing or not showing the operation of surveillance, contacting other near-by-users or closest authorities, activation of other surveillance systems, make the mobile device operational but have it seem to be in an off position, activate alarm sounds and lights, provide samples of surveillance information back to the mobile device and more options that allow this system to meet each users specific needs.
Criminal actions normally include a plan to get around people, systems and authorities but the present invention makes it almost impossible to get around its security because every IPSS system acts and reacts differently, based on each users preferences or at least codes. As example, one users action may turn off the alarm, may another person's IPSS may activate an alarm. A code that seemingly is turning off the system may actually turn on a silent or other alarm.
One feature of the invention, includes a user being approached by a stranger on an isolated street, the user activates the surveillance by pressing a button or audible voice commands and discretely (or obviously) aims the camera at the individual as he approaches. The information is sent to the remote server. Based on the user defined personal criteria, the system may notify others within 15 minutes if a deactivation code is not entered, or call/message the user back with or without another person knowing, or listen for the users “key phrases or loud voice” to immediately activate alarms.
Another example includes a user exiting a mall and walking to their car. The Interactive Personal Surveillance (IPS) system may manually or automatically (via location, tracking, sensors or wireless acknowledgments at the mall door) go into an active mode such as “listening” for the users voice as in key phrases (“what do you want, help, stop, don't, police, get away, etc.) or higher volume (screaming, yelling, etc.). Once the system determines the user needs help, it may contact the local security, police, friends, or other individuals near to the user. The interactive system may have the users alarm sound, trigger other alarms near by (car alarm/s, cellular phones, spot lights in areas, etc.), or turn on the speaker phone with 911 or other emergency agency person asking “is everything all right” or “police will be their immediately”.
Another feature of this invention includes linking this Interactive personal surveillance and surveillance system (IPSS) to home and business alarm systems. As individuals check for noises or indications that an intruder may be inside their premises, the IPSS may engage the activation of home and business alarm systems. The IPSS may go into this mode automatically based on location (i.e. GPS, Logging into Wifi, sensors, etc.) or information determining a zone, once the user activates surveillance the system automatically starts sending audio, images and or video to the server. It also may use the IPSS mobile device to respond back to the user and ask the user if they are ok, the user must input the correct code, voice match, or other acknowledgement, this cycle continues until the user enters their code and selects cancel surveillance. If the user does not respond when the main server/database or within their own IPSS, the system will activate alarms and follow preset or user defined guidelines.
Another example includes a user catching a taxi in another country, the user before getting into the taxi activates their surveillance system and captures the license tag, drivers face and posted taxis license-of-operation. This information is sent to the remotely located server and the text and images are annualized (OCR—optical character recognition, automatic number plate recognition (ANPR), face recognition algorithms for matching normalized gradients or others facial differences/similarities, etc.) identifies/verifies the taxi company and the drivers information. The drivers face may be sent to a database for criminal matching. The users may have programmed the system to place the mobile device into listening mode for matching “key phrases”, determining stress within the voice, high volume speech, or any audible indicator from the user. In this case, the user has set-up many key phrases and without the driver knowing the activation the phrase “I'm not telling you again, Stop” is matched. The system has automatically previously determined the taxi company name and phone number, and has contacted the authorities (police), taxis company, driver and the user all on a conference call. Or in some cases an automatic message is played explaining the surveillance and the activation which identified the individual driver and company. The message explains “unless the user enters a deactivation code within 3 minutes the closest law enforcement will be notified”. Because the users device or the taxi has GPS the message also mentions the taxi current address.
Another example is a user activates their surveillance system and the system is pre-programmed to contact other users that are close by, and to activate their surveillance systems if they see the individual within the photo/description. If another user identifies the user within the photo and or description, they will press a button that sends this information to the user's account (identifying one or more events of the same subject) that's requesting the information. It also should be noted, automatic payment or reward postings (such as $25 more/less) may also be included within the notification for actively engaging others to look for individuals.
Another feature of the present invention includes preprogrammed messages that are played to people or organizations when the surveillance is turned on, triggered, or security levels are increased/decreased. This feature may include a manual or automatic mode (security level) changes for sending different messages based on the time, location, or user activity. For example, “this is a surveillance message from John Smith. My location is the corner of Atlantic and Delk Road and I need help. Please come quickly and or contact the police. Also, if my wireless device is turned on, please wait and you will hear live conversations between myself and anyone else within hearing range. . .
Still another feature of the present invention may include the ability to use “other recording” devices or surveillance systems. As an example the system may provide the mobile device with an indicator (green light, map with location, etc.) showing where other surveillance systems are located. This information may be determined many ways, but an easy method is to have the RLS check the company or business name, registration of surveillance devices/systems, and other IPSS users.
Another feature of the present invention is the Surveillance Information Protection (SIP) system that will not allow users to delete or change surveillance information. A predefined time period (1 to 20 years) where the system or user cannot delete any surveillance information. This feature is used to keep criminals from demanding that the users delete surveillance recorded illegal activities. As an example, in a case where the user is forced to log-into the system and attempt to delete the recorded illegal activity information, the user may start the log-in procedure, enter their user log-in name and then while inputting their password enter all the numbers or letters correctly except one (or two, more or a special code). This will activate a false response to the user that the information was deleted, or the information may be deleted from a certain location (Library, Local Business Near By, etc.), while actually contacting authorities and telling them where a criminal will be taking the user. The system will follow the predefined instructions set forth by the user and/or system.
Another feature of the present invention is the User Activation of an alarm may be accomplished when a button is held down and then released. For example, the IPSS takes an image or video and sends this information to the RLS when the user pressing the hot-key on their device, if the user releases this key and does not enter a cancel or repeat delay (5, 15, 30, or 50 minutes), then an alarm is activated.
Another feature of the present invention is its ability to disguise or hide alarms surveillance when activated. Another feather is the ability to interact with the user device that may assist the user—negotiating or dealing with criminal activity. This feature may indicate false screens on the mobile device, for example; high level of wireless coverage (bars or meter for signal strength show good when actually no wireless is available), information was already sent (maybe even a review of part of the information “supposedly” sent), maybe a response that stays within the phone but seems to be coming from the RLS or Authorities (i.e. “your surveillance information was received and Authorities have been notified to your location—help is on the way”). It should be noted that only the user will know the difference between a fake or false screen and may have already programmed the messages that come onto the users screen (within the phone or server).
Another feature of the present invention includes software or firmware that after the activation, if the WCD is turned off for a period of time or until the surveillance system is deactivated, the system will automatically turn the WCD back on. This is normally located within the WCD but it is also accomplished by the RLS communicating with the WCD in silent, sleep and wake-up, or time based health type checks verifying the WCD has not been destroyed or battery removed.
Another feature of this invention, triggers another call or text message to the closest cell phones (location based) and informs them of the surveillance activation. For example, if a user activates the IPSS in a taxi, the contact information of the driver of the taxi would be determined and called and be told of the surveillance, their name identified, authorities are/will be notified, and the importance to follow the instructions of the user (riding in the taxi). This may also trigger another call to the taxi management and offer them the opportunity to review the surveillance recordings (normally after the individual is known to be safe or when authorities or system management feel this action is appropriate).
Still another feature of the present invention includes the location based IPSS which allows activation of other user devices that are close to the individual who has activated the surveillance. For example, other devices capable of sending audio, images or video may be remotely turned on (or a request the user for allowance). End users may have an automatic setting that allows it to be remotely turned on or, the user may want to be prompted or the user may refuse any surveillance information from their device.
Another feature of the present invention is the Response Check-In (RCI). The mobile unit allows the user to activate and enter a time for the system to check back with them for verifying safety (user must enter code or have a voice match/key word).
Another feature of the present invention is the Automated Programming Listening Mode. The listening mode is capable of capturing sounds and or wireless communication from others systems and devices and allows the user to name, identify or associate these sounds or communication with a mode or action that helps the system determine the users environment. For example, the users IPS system may record turning off their car engine, opening and closing the car door, and or then setting the car alarm. The capturing of the car alarm may be a sound (such as the car horn, alarm chirp or other) or the capture of the wireless key security information sent wirelessly to the car's alarm system and IPS system. Then the system may automatically change the surveillance mode [to walking] and based on time of day or the use of location technologies determine the condition [safety] of this area to walk thru and adjust the surveillance mode accordingly.
Another feature of the present invention includes sending surveillance information to two or more public servers (areas) that is accessible and or searchable by internet search engines. When user summit uploaded (or directly sent) surveillance information to the public server, the surveillance videos, images and or audio includes at least one or more of these searchable areas, location, address, date and time, event name or category, and or name describing video. When someone, as example finds their car broken into, they will go to this website and enter the location, date and time to see if anyone has photo's or videos, or other information about the event. If someone has surveillance information then the information will be available from most common internet (or other) search engines.
It should also be noted that Interactive Personal Surveillance and Security (IPSS) systems may incorporate basic functionality, such as sending an email or electronic message with images or video, the message recipient software automatically processing the text within the title, sender address or other areas and automatically taking additional actions. These actions may notify others with the surveillance recording and ask them to take additional measures. Or the system may respond back to the user with automated procedures and unless “deactivated” with a code, word or phrase the system takes additional measures to help the user.
Having thus described the invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
The present invention can be better understood with reference to the following drawings. The drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present invention. Moreover, like reference numerals designate corresponding parts throughout the several views.
The listening sound and voice matching feature of this invention allows users to have the mobile device pickup sounds and internally process them or have the RLS (or combination of both) process the sounds to determine when users need additional help or surveillance. The system to hear sounds, such as but not limited to, key phrases or words, increased volume from the user (screaming, talking aggressively, etc.), or any other sound that may active or deactivate the alarms or surveillance.
The image matching feature of this invention allows users to capture video or images and have these images matched with one or more databases for people identified as threats or potential criminal activity. When the match occurs, the user device may inform the user and or activate additional surveillance or alarms.
Also shown in
Still another feature of the present invention includes a shock sensor, impact sensor or extreme deceleration, that once triggered, may automatically notify authorities, emergency services or others and activate speaker phone conferencing with one or more, the system may also be used if the device is attempted to be destroyed it may send out an emergency code to the RLS.
Another feature is to active alarms and show images/audio that have been or appear to have been sent for surveillance.
Another feature is manipulating the screen to look off, but when surveillance was activated to not turn off but look off. Or another feature is to ask the user to enter code or alarm will activate (or activate with a preset time frame).
It should be noted that automation is used when appropriate to increase or decrease the levels (user risks or potential risks), as an example—Level 3 may require the user device to ring (from within or from the RLS) but if not answered or replied to (or otherwise), the system may automatically go from “Level 4” to “Level 5” (or any other levels). Or another example, as shown in the “Listening Mode” of 12345, any match may automatically increase or decrease the “risk level” and associated actions defined by the user.
It should be noted, this invention manages surveillance information as public, semi-public, and private. While many activities look like crime or criminal activity, the person may be completely innocent. Therefore, the system refers to activities as possible crimes also, makes publicly posted (or uploaded) surveillance information available to others that know a location, time or date, of an activity. In the preferred embodiment, the user seeking random criminal activities must know part of the crime seen or crime, to obtain the information (surveillance).
As shown in this flow chart diagram the user has selected or entered different Surveillance Modes (SM) based on location. For example, the user has entered different instructions for surveillance, alarms and actions for identifying problems for home, taxis, airports and airlines, hotels, shopping and eating out (restaurants). For at least the purposes of determining when higher/lower or different types of security is needed, modes may be changed by these tracking events.
The present invention now will be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like numbers refer to like elements throughout.
Referring now in more detail to the drawings, wherein like reference numerals designate corresponding parts throughout the several views;
The interactive personal surveillance (IPS) system 10 includes, software (or firmware) operating on the user Wireless Communication Device (WCD) 30 which interacts or controls many of the WCD features including the camera capable of capturing video or still images (and or audio), communication that includes uploading 21 or sending live information 22 wirelessly to a Remotely Located Surveillance (RLS) 12 server for the purpose of storing surveillance information away and in a secure area from the user's WCD and for activating and or monitoring the user activity for future activation of alarms or assisting the user as needed or required and the ability to listen (or compare images) for events that will change the surveillance mode/s or activation of alarms.
The remotely located surveillance (RLS) system 12 manages a plurality of users with wireless communication devices 30 and/or, as depicted by
As configured in the interactive personal surveillance 10 system, a remotely located surveillance (RLS) system or Wireless Communication Device (WCD) or both, automatically determines what, if any action is needed/required when surveillance is active or activated. Based on the User Definable 82 entries and or the System Processes 84. some of the follow up actions require the RLS 12 to contact the user, others, and or online databases for potentially increasing the users safety (or otherwise) through predefined criteria.
Activations of surveillance and alarms are determined automatically, based on user or system definitions/programming and or manually. Listening Mode allows the user device to hear sounds, receive data from other wireless devices and take images or videos for determining if or when surveillance modes should change or when alarms are needed. This automatic Listening Mode may operate independent of the user or with user reminders or requests for instructions.
The WCD 30 will now be described with reference to
The software operating inside the WCD is capable of sending, receiving information and changing one or more surveillance operations.
The WCD can be configured on the RLS before downloading, during or after installation. An example of the software options are, but not limited to;
1.) Does your phone have an extra memory card? Y/N—If Yes what is size?
2.) Does your phone have a camera? For video and pictures both? Still images only?
3.) Does your phone have GPS or other location technologies? Y/N
4.) Does your phone have sensors, such as motion, light, Glass break, sound identifying, impact or others? Y/N/Do Not Know
5.) Does your phone have text messaging? Y/N
6.) Does your phone have internet access? Y/N
7.) The software will do a system check for determining more features your phone has to work with the Interactive Personal Surveillance (IPS) system. Part of this system check will determine; the battery life per full charge cycle, communication options and abilities, if the mobile device screen may be modified when surveillance (silence mode) and alarms are activated.
8.) Will you allow the surveillance software to stop the phone from being powered off, when alarms or surveillance is activated? Y/N (More Information—This feature stops anyone, except yourself from turning off and stopping your alarms and surveillance. You will be required to enter a code to turn the phone off when surveillance or alarms are activated.)
9.) Will you allow the surveillance software to control your cellular phone screens, lights and indicators? Y/N (More Information—This feature allows the RLS and the cellular phone to manipulate the cellular phone screen/indicators to imitate power off screens and looks, offer onscreen information and assist you in many ways when or if needed.)
10.) Select one or more hot-key/s for activation of Listening-Mode (LM)? (What is Listening-Mode?) This feature allows your voice and sounds to be monitoring for the activation of surveillance or alarms. For example, you say “help me” and this phrase activates an alarm. You may add as many phrases as you would like and tell the IPS system what to do afterwards.
11.) Select one or more special Hot-Key/s for activation of surveillance
12.) Select one or more special Hot-Key/s for activation of the alarm feature. You may select the same key as the surveillance activation but pressed three or more times in a row.
13.) Would you allow the phone to be programmed with sound matching? (More Information) This feature allows the IPS system to learn sounds and wireless data to match them with your own user-definable actions. For Example, the sound of the car turning off and open door sound (bell ringing), will identify you existing your car and your IPS system could go into a higher level of security than when you were in your car traveling.
14.) Would you like the system to verify its working? Y/N (more information) Because the WCD interacts with the RLS system for sharing information, it is recommended that all of the foregoing features be employed to provide redundant checking and control of communication. More specifically, the system menu within the RLS system website offers scheduled communication checks between itself and the WCD carried by the user or the setting may be defined within the WCD. It is recommended that communication is verified, based on time of day/night and activities. If this setting is set to global and communication is verified evenly 24/7 then 10 minutes to 1 hour is recommended.
15.) Would you like to activate the learning mode of the system? Y/N (More Information) The learning mode offers onscreen selections for helping the system identify and verify locations, businesses, transit, walking areas, friends places, and areas or events you encounter. For example, while traveling on the transit bus scroll down and select “Bus”, the system may ask you additional questions such as, “do you ride the bus each day? Monday thru Friday? Please enter the time periods you travel on buses. Do you always travel to the same stops? This information is then shared with the RLS and a surveillance mode will be assigned to this action. For example the surveillance mode may be listening for key phrases such as “get away from me”, “security”, “help me”, etc.
16. Please allow the ring-tone “alarm” to be installed within your phone. (More Information) The ring-tone alarm is a special sound that is used when the surveillance alarm is activated. Additionally, if the special sound is heard (or data is shared) by other users systems, their alarms (if sound matching is enabled) will be activated as well.
After the software is installed, the tutorial comes on screen and ask the user to follow the basic (normally 4 minutes) or advanced (normally 10 minutes) instructions and final setup procedures. The User enters their user name (Mary Jones) and the password (12345678). As this is entered the WCD attempts to connect and verify the account and communication with the RLS. After this is verified the Interactive Personal Surveillance (IPS) system starts the interactive programming process.
The user reads from the WCD screen phrases such as; “Security, Security Guard, Police, I need Help, Get Away, and other preprogrammed phrases and the users voice is matched with each phrase. Then the system ask if the user would like to add any additional phrase? The user may type in the phrase and then record the word or phrase.
Next the user will be shown surveillance modes. These are actions to take when particular occurrences are acknowledged, determined or activated. Surveillance modes are normally associated with one or more criteria, such as; risk levels, user activity, actions based on activity, interactions for changing the current status of surveillance or alarms or many others based on circumstances of the user.
The user assigns an action with a phrase;
“When you mention the phrase “Security Guard”, these actions will—[(1.) automatically or (2.) prompt you first or (3.) display on screen with count-down with/without sound prompts, then automatically activate unless cancelled with a code]—Activate a level 4 surveillance mode of programming; Level 4 includes start recording, make surveillance known by alarm sound, stop alarm sound and turn on speaker phone when connected with 911 or other security or monitoring agency.
In the example above, when the user's device is in listening mode and hears the users voice say “security guard” the phrase activates a level 4 surveillance mode. This activates live recording of audio and video, sounds periodic alarms, sends a message to the RLS to notify the closest security (mall security guard or 911), and turns on the speaker phone when the security agency answers the call from the RLS.
With reference to the surveillance modes, essentially an endless number of modes are possible although the system normally provides a preset template of normally between 3 and 10 modes. In many cases the modes are modified to include or exclude actions and are renamed.
Also the IPSS system has a constant learning mode that ask the user questions as it hears, receives sensor inputs (“are you walking” or “snow skiing”) or observes images. The process may ask the user, if this sound or image name is correct; (as an example—“was this sound your transit bus?” Or “was this sound your home door bell ringing?” Or “is this sound street traffic or cars as you walk?”. This allows the sounds to be matched more accurately with modes of surveillance. While modes are matched with many things (location, time, etc.) this helps to cross reference or provide the best decision if it's the only element available.
18. Sharing Surveillance With Public Server (information available for internet search engines).
The IPS system is setup to capture surveillance information to help the user and to keep the information private, but sometimes it may be used to help or assist others. This second party surveillance recordings (recording of others or crimes not involving the user) would be sent to a public (searchable) server, database or website and allow the user captured recordings to be found by victimized individuals. For example, if a user captures surveillance information that may or may not contain a crime, such as someone breaking into a car, breaking a lock and taking a bike, or strange or suspicious van parked in a driveway, this information can be posted on an internet assessable website (automatically sent to search engines) and for anyone seeking evidence of an activity.
To post this information on a website, the user selects “send to public website” and then enters their user password. Additional information such as time, date, location (etc.) may be automatically sent and other details may be manually entered.
The RLS operates as, but not limited to, a remote storage area/s for recordings (away from the WCD), a system for interacting with the user/WCD, a system for determining how to assist and for assisting the user, controlling the WCD or one or more functions of the WCD, and for communicating with other systems, users, people and agencies/companies.
Remotely locating the surveillance information (video, image/s, sound, sensors, location, an other) helps to protect the information from be erased or stolen. In an example of a stranger approaching the user and stealing their WCD, the surveillance information of the criminal remains safe within the RLS. Additionally, the information within the surveillance may be automatically annualized V. Remotely Located Surveillance System Control Processes (SSCP)
The SSCP determines how to assist and manage information that it receives. The SSCP is also preferably configured so as to be capable of determining what each individual user wants or requires based on alarms, receiving surveillance information or based on sensor inputs that are known by the control processes. For example, each system control process may have a unique action for instance, a command signal initiating a simple on/off communication with a WCD speaker phone. It may turn on/off a system component comprising a camera, GPS, accelerometer, or other device when additional information may be utilized. The command signal may direct the WCD to display an alarm or blank the user screen. Further, in instances where the system comprises a microphone the command signal may direct the audio device to increase or decrease a volume level, and then broadcast audio data to third parties (friends, law enforcement, security staff, or the like). One skilled in the art will thus appreciate that the functionality of the SSCP may be appropriately adapted and configured in correspondence to the nature of the system components, the users level of protection, and the level of information that any communication device is capable of.