|Publication number||US7668990 B2|
|Application number||US 11/042,178|
|Publication date||Feb 23, 2010|
|Filing date||Jan 26, 2005|
|Priority date||Mar 14, 2003|
|Also published as||CA2589821A1, CN101124530A, CN101124530B, EP1842363A2, EP1842363A4, US20050128048, WO2006080975A2, WO2006080975A3|
|Publication number||042178, 11042178, US 7668990 B2, US 7668990B2, US-B2-7668990, US7668990 B2, US7668990B2|
|Inventors||Paul Krzyzanowski, Justin Flores, Glenn Harter|
|Original Assignee||Openpeak Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (109), Non-Patent Citations (41), Referenced by (20), Classifications (51), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is a continuation-in-part of U.S. patent application Ser. No. 10/783,511, filed Feb. 23, 2004, by Killian et al., entitled “User Interface for Multi-Device Control,” incorporated herein by reference in its entirety.
This application is also a continuation-in-part of U.S. patent application Ser. No. 10/782,923, filed Feb. 23, 2004, by Krzyzanowski et al., entitled “Method, System, and Computer Program Product for Automatically Managing Components within a Controlled Environment,” incorporated herein by reference in its entirety.
This application is also a continuation-in-part of U.S. patent application Ser. No. 10/783,017, filed Feb. 23, 2004, by Krzyzanowski et al., entitled “Device Control System, Method, and Apparatus,” incorporated herein by reference in its entirety.
This application is also a continuation-in-part of U.S. patent application Ser. No. 10/387,590, filed Mar. 14, 2003, by Krzyzanowski et al., “Legacy Device Bridge for Residential or Non-Residential Networks,” incorporated herein by reference in its entirety.
1. Field of the Invention
The present invention relates generally to control of consumer electronics, and more specifically, to a process for creating activity or experience-based operations for controlling consumer electronics.
2. Related Art
The installation of computer networks (for homes and businesses) presents several challenges. For example, installing a computer network can be time extensive and expensive to deploy. Additionally, there is no easy method to integrate, for example, home computer networks with other residential devices, such as televisions, stereos, DVD players, and other home electronics. Being able to efficiently distribute digital audio/video (AV) data among personal computers and other AV devices (such as, televisions, DVD players, PVRs, etc.) is complicated by differing and evolving communications standards and/or formats.
Another significant challenge is being able to effectively control networked residential devices. Although a remote control unit (RCU) can be trained to send signals to components of an entertainment center (such as, a television, stereo, and DVD player), a conventional RCU cannot communicate and control multiple personal computers and other analog and/or digital devices at a residence. In addition, a conventional RCU cannot communicate and control multiple residential devices without user intervention. Even with a conventional RCU, a user must manually activate a hard key to send a command (in the form of infrared signals) to a controllable consumer electronic (CE) device having direct line-of-sight connectivity with the RCU.
A conventional RCU suffers from other serious deficiencies that limit its usefulness without constant user intervention. For instance in the “set up” process of a conventional RCU, the user can program the device by assigning a particular key with a series of key strokes that are stored in the RCU's memory. However, the user cannot inform the RCU of critical operational information of the controllable devices (e.g., television, DVD player, etc.).
Such critical operational information includes the input state (i.e., what signals are coming into what input).
For example, if a television is set to the tuner input (instead of the input for receiving DVD data) when a RCU is operated to play a DVD installed in a DVD player, the television will display the broadcast channel to which it is tuned at the time, and not the desired DVD. The user must physically select the proper input by cycling through the available inputs using the input selection button. The lack of input state information also precludes the user from switching between different activities (e.g., watching DVD, watching broadcast TV, watching cable) without also physically changing from the current input state to the new state, thereby placing the television in the proper input state.
Although the combination of improved computer processing capabilities and global access to information has resulted in significant advancements in the information processing age, there exists a need for a simple, inexpensive, yet versatile system that can integrate the functions of multiple residential devices connected to a residential network and facilitate the operations of these devices with minimal user intervention.
A method, system, and computer program product are provided to configure and manage a plurality of system components within a controlled environment, such as a home, business, school, etc, as well as its surrounding areas. The system components include legacy and/or non-legacy devices, and the controlled environment includes a peer-to-peer communications system and/or a client-server network.
In an embodiment of the present invention, “activity-based” or “experienced-based” operations are created and defined during an initialization or setup session for a system component, with minimum or no user interaction. The activity-based or experienced based operations include favorite settings, playlists, security protocols, context-sensitive operations, user-specific operations, follow-me system controls, control macros (including context-based control macros), or the like.
For non-legacy devices, relevant information about the system component is collected via a discovery protocol interface. For legacy devices, a variety of system interfaces are provided for receiving the relevant information.
In an embodiment, the system components (both legacy and non-legacy devices) are added, removed, or configured via a setup wizard. During this initialization or setup process, relevant device information (e.g., device type, make, model, region assignment, etc.) is automatically discovered or added by user input. For a legacy device that is not automatically discoverable, the user adds the legacy device by identifying the device (by device type, make, model, etc.) and assigning the device to a particular room/region.
The initialization or setup process is also designed to acquire “device metadata,” which includes basic operational information or idiosyncrasies about each new device (such as, tuning rules, types and order of inputs, etc.). The concept of metadata is further described in the application entitled “Device Control System, Method, and Apparatus” (U.S. patent application Ser. No. 10/783,017). The present invention includes mechanisms for optimizing the collection of device metadata with little or no human intervention. In an embodiment, a series of questions or informational prompts are dynamically optimized to avoid seeking irrelevant or unnecessary information. In an embodiment, device metadata is contained in an accessible database. As such, the setup process can be tailored and streamlined based on the type and model number of the system component being added or configured. The setup process is dynamically tailored to seek only that which is specific to and necessary to control the particular system component in light of its user-specific configuration.
Once the device information (including device metadata) has been collected, the system components (e.g., the assigned legacy and non-legacy devices) are configured to support one or more activity-based or experienced-based operations.
The accompanying drawings, which are incorporated herein and form part of the specification, illustrate the present invention and, together with the description, further serve to explain the principles of the invention and to enable one skilled in the pertinent art(s) to make and use the invention. In the drawings, generally, like reference numbers indicate identical or functionally or structurally similar elements. Additionally, generally, the leftmost digit(s) of a reference number identifies the drawing in which the reference number first appears.
The present invention describes methodologies and/or techniques for configuring and managing a system component of a controlled environment (such as, a residence, business, school, or the like). The controlled environment can be implemented with a peer-to-peer communications system and/or a client-server network. The system component includes legacy as well as non-legacy devices. A “non-legacy” device is defined herein to include any type of device or peripheral that is capable of communicating via a discovery protocol interface (e.g., interfaces defined by the Universal Plug and Play (UPnP™) Forum). Having a discovery protocol interface, non-legacy devices are specially adapted for discovery and control by other devices. A “legacy device,” on the contrary, is defined herein to include any type of device or peripheral that is not capable of communicating via a discovery protocol interface. Lacking a discovery protocol interface, legacy devices, therefore, are not conventionally adapted for discovery and control by other devices.
According to embodiments of the present invention during the initialization or setup phase, the system component is configured to perform one or more activity-based or experienced-based operations with minimum or no user interaction. For non-legacy devices, relevant information about the system component is collected via a discovery protocol interface. For legacy devices, a variety of system interfaces are provided for receiving the relevant information, as described in greater detail below.
In an embodiment, the activity-based or experience-based operations include one or more “favorite” settings for the system component. For example, a favorite setting can be established for television programming, audio/video recordings, room temperature, hot tub controls, clock alarms, light/dimmer settings, web sites, news broadcasts, financial channels, or the like.
In another embodiment, the activity-based or experience-based operations include one or more “playlists” for the system component. For example, a series of video or audio recordings can be prepared and/or stored for playback on, for example, a television, monitor, or audio client. A sequence of graphic images or photographs can be prepared and/or stored for playback on, for example, a monitor or computer client. A playlist of other forms of media and/or multimedia can also be created according to embodiments of the present invention.
In another embodiment, the activity-based or experience-based operations include one or more “security” protocols for the system component. For example, the system component can be configured to block certain content from being accessed by a designated user. Non-adult users, for instance, can be prevented from accessing designated television channels, web sites, areas (such as, lockable rooms, drawers, safes, etc.), or the like.
In another embodiment, the activity-based or experience-based operations are “context-sensitive”. The system component can have one or more configurations based on a particular context. Depending on the type of system component, a configuration can be established for evening entertainment, which includes, without limitation, presets for lighting, audio/video presentations, security access warnings, hot tub controls, or the like. Another configuration can be established for home office activities, which includes, without limitation, presets for a baby monitor, a playlist of classical recordings, coffee maker timer controls, or the like. A configuration can be established for morning rituals, which includes, without limitation, presets for alarm/snooze controls, coffee maker timer controls, lighting, news broadcasts, or the like.
In another embodiment, the activity-based or experience-based operations are “user-specific”. For example, a user-specific configuration can be established with security controls set to block certain televisions programming, web sites, audio recordings, or the like when in the company of minors. However, when in the company of adults, a configuration can be established with a lower security setting.
In another embodiment, the activity-based or experience-based operations include “follow-me” system controls. For instance, “follow-me video” is implemented to transfer a selected video production to various displays throughout the controlled environment. As a user migrates from room to room within the controlled environment, the user, or a system component in communications with the user, is tracked to determine the user's current location, and a display (e.g., monitor or television) positioned in the current location will automatically start to present a pre-selected video production. Similarly, the activity-based or experience-based operations can include “follow-me audio,” “follow-me lighting,” or the like.
In another embodiment, the activity-based or experience-based operations are defined by one or more control macros. A control macro includes a set of commands that, when executed, enables a controller to control multiple operations and/or functions of one or more system components. In an embodiment, the set of commands are stored in a central location and are associated with a generic command. When activated, the generic command retrieves and transmits the set of commands to the appropriate system component(s) for execution. In other words, the present invention enables a remote or portable controller to transmit a single high-level request to a centralized command center (which can be coupled to another computer). The centralized command center interprets the single request and finds the corresponding sequence of commands that needs to be transmitted to the appropriate system component(s).
In an embodiment, the control macro is defined to execute automatically upon the occurrence of a commencement parameter. The commencement parameter can be a predefined time, date, state, event, or the like, or any combination thereof. For example, a pre-defined sequence of control commands can be executed upon the occurrence of a pre-set time (i.e., clock based) and/or date (i.e., calendar based) automatically (i.e., without direct user intervention). A user can desire to have the bedroom television automatically turned on and tuned to a particular channel at 6:30 am as part of his or her “wake up” routine. In another example, a pre-defined sequence of control commands can be executed upon the occurrence of a particular event or the occurrence of a particular system or component state. A control macro can be automatically executed when, for example, a television in the family room has been powered on.
In an embodiment, the control macro is defined to be automatically particularized for application in a specific context. Herein referred to as a “context-based control macro”, a control macro can be particularized for use in any context (e.g., any region, or any device of comparable type). In other words, a specific system component or combination of components is not identified in the control macro. A context-based control macro is defined by specifying the “type” of system component that is required to perform the activity-based or experienced-based operation. Upon activation, the control macro is interpreted to select the appropriate system component(s). In an embodiment, the system component is selected by determining the current location of the user (or a system component in communications with the user). In another embodiment, the user interacts with a remote or portable controller to specify the appropriate system component(s) at the time of activating the context-based control macro.
The above-mentioned activity-based or experience-based operations have been provided by way of example and not limitation. Other types of activity-based or experienced-based operations can be used and are intended to be within the scope of the present invention. Additional examples of activity-based or experience-based operations (including further descriptions of the above-mentioned operations) are described in the application entitled “Method, System, and Computer Program Product for Automatically Managing Components within a Controlled Environment” (U.S. patent application Ser. No. 10/782,923), which is incorporated herein by reference in its entirety; and in U.S. Pat. No. 6,792,323 to Krzyzanowski et al., which is incorporated herein by reference in its entirety
As described in greater detail below, activity-based or experienced-based operations are created and defined during an initialization or setup session, and are executed with the function and/or operation of system components, including consumer electronic (CE) devices. The activity-based or experienced-based operations support the control of multiple devices of the same type (e.g., two DVD players). The activity-based or experienced-based operations also support the segmentation of devices among multiple rooms (e.g., a television in a living room versus a television in a bedroom); the control of non-IR, networked devices (such as devices having a discovery protocol interface); the control of devices beyond line-of-sight (via a wireless network); and setup directly on a remote control device (as opposed to a fixed stationary interface).
II. Example Controlled Environment
The present invention can be implemented in any type of controlled environment, such as a residence, business, school, or the like. A residential controlled environment includes the confines of a home, apartment, mobile home, houseboat, or other types of residences. However in embodiments, a residential environment includes the surrounding area of the residence, as well as any shelters, constructs, improvements, or the like, within a designated perimeter.
In other embodiments, the present invention is implemented in a non-residential environment. A non-residential environment includes, but is not limited to, an office complex, suite of small offices, production studio, warehouse, entertainment arena, school or university, health care facility, hotel, vacation resort, aircraft, ship, automobile, or the like. In embodiments, the controlled environment for a non-residential embodiment includes not only the actual confines of the aforementioned structures but also their surroundings within a designated perimeter.
Examples of a controlled environment are described in the application entitled “Method, System, and Computer Program Product for Managing Controlled Residential or Non-Residential Environments” (U.S. patent application Ser. No. 10/382,897), and the application entitled “Method, System, and Computer Program Product for Managing Controlled Residential or Non-Residential Environments,” (U.S. patent application Ser. No. 10/180,500), both of which are incorporated herein by reference in their entireties. As described in these applications, various methods and systems can be provided to manage the distribution of information (including video, audio, voice, text, graphics, control messages, etc.) to other devices and/or applications within the controlled environment. Such devices and/or applications include, but are not limited to, communications equipment (such as, telephones, intercoms, etc.), entertainment systems (such as, televisions, CD/DVD players, gaming applications, stereos, etc.), monitoring systems (such as, security cameras, baby monitors, etc.), safety/security systems (such as, fire alarms, sprinkler systems, locks on doors or windows, etc.), personal computers (such as, desktops, notebooks, notepads, personal digital assistants, etc.), cooking appliances (such as, ovens, coffee makers, electrical food/beverage warmers, etc.), comfort systems (such as, heating and air conditioning (HVAC), humidifiers, dehumidifiers, air purifiers, light switches, light dimmers, etc.), power outlets, power supplies, or the like.
An example of such controlled environments is shown in
Positioning unit 102 designates spatial locations within the residence that serves as the hosting environment for system 100. Positioning unit 102 is coupled to the other system components (e.g., portable controller 108) via a wired and/or wireless interface. Positioning unit 102 is operable to designate a floor or room within the residence. Positioning unit 102 is also operable to designate a specific location or region within a floor or room. Moreover, positioning unit 102 can be situated outside of the residence to thereby, designate external areas of the residence.
Computer client 106 includes a wired and/or wireless personal computer, personal digital assistant (PDA), enhanced telephone, personal television, or other data processing device linked to communications network 180. As a personal computer, computer client 106 can be a desktop, notebook, notepad, or the like.
Portable controller 108 is a wired and/or wireless data processing device that enables a user to interact with, send control messages to, and/or manage the distribution of information (including audio, video, voice, and other data) among the other system components. Portable controller 108 can be a portable version of the devices listed as computer client 106. For example, portable controller 108 can be a personal notebook or notepad computer, PDA, enhanced telephone, or other device linked to communications network 180 and including a display with the ability to interact with the other system components. Hence, portable controller 108 enables a user to remotely control the operations of various components of system 100. In an embodiment, the display for portable controller 108 is capable of receiving video and/or audio from the other system components. In an embodiment, portable controller 108 includes a flash ROM that enables wireless downloads and/or uploads.
Television 104 is a conventional television. In an embodiment, television 104 is enhanced to support interactive and/or personal services. Personal services include virtual recording, programming, pausing/rewinding live broadcasts, or the like. For example, television 104 can be a personal television enhanced to support the MSN® TV service, hosted by WebTV Networks, Inc. (Mountain View, Calif.), that supports the WEBTV® services available from Microsoft Corporation (Redmond, Wash). As shown, television 104 can be connected to cable set-top box 118, DSS set-top box 120, and/or media player 116 (e.g., PVR, VCR, or DVD player).
The aforementioned system components are not intended to be exhaustive. Other devices (including appliances), applications, and/or the like can be implemented, including, but not limited to, a refrigerator, stove, microwave, toaster, coffee-maker, alarm clock, humidifiers, sprinkler system, lighting, light dimmers, etc. In an embodiment, portable controller 108 controls the operations and/or functions of such components, such as on/off, timers, modulation (e.g., oven temperatures, etc.), pause, snooze, etc.
As discussed, communications network 180 provides a transmission medium for communicating among the system components. Communications network 180 is a wired and/or wireless local area network (LAN). Thus, communications network 180 includes wired, wireless, or both transmission media, including satellite, terrestrial (e.g., fiber optic, copper, UTP, STP, coaxial, hybrid fiber-coaxial (HFC), or the like), radio, microwave, free-space optics, and/or any other form or method of transmission.
As shown in
In an embodiment, portable controller 108 includes several functions of server 208, as described herein, and manages the distribution of information (including audio, video, voice, and other data) among the other system components. In another embodiment supporting peer-to-peer communications, the system components exchange audio, video, voice, other data, and/or control messages directly with each other and without being centrally managed.
In an embodiment using a wired transmission medium, communications network 180 is an Ethernet LAN having a CAT-5 cable, or the like, distributed to each system component, such as television 104, media player 116, etc. The system component includes an audio/video (AV) connector that is responsive to receive the cable. In an embodiment, communications network 180 includes a telephone line and/or powerline (such as the communications technologies made available from the Home Phone Networking Alliance (HomePNA) or the like).
In an embodiment using a wireless transmission medium, communications network 180 supports the IEEE standard 802.11(a), which specifies a wireless Ethernet protocol for large-sized video. In another wireless embodiment, communications network 180 supports the IEEE standard 802.11(b), which specifies a wireless Ethernet protocol for small-size video. In another wireless embodiment, communications network 180 supports the IEEE standard 802.11(g). In another embodiment, the BLUETOOTH™ wireless technology (developed by Bluetooth SIG, Inc.) is used to support short-range wireless interfaces with system 100.
As shown in
System 100 also includes a plurality of infrared/serial bridges 130(a)-130(d), which comply with the IEEE 802.11(b) standard for wireless communications. Each infrared/serial bridge 130 interacts with one or more components. As shown, infrared/serial bridge 130(a) interacts with television 104(a), cable box 118, and media player 116. Infrared/serial bridge 130(b) interacts with tuner 114 or any type of proprietary device that rely on infrared/serial communications protocols as would be apparent to one skilled in the relevant art(s). Infrared/serial bridge 130(c) interacts with thermostat 112. Infrared/serial bridge 130(d) interacts with lighting device 110. A wireless-Ethernet bridge 130(e) interacts with television 104(b) and a DSS box 120. Wireless-Ethernet bridge 130(e) can support any IP addressable device. As such, television 104(b) and DSS box 120 are “next generation” plug and play devices that have IP addresses.
Therefore, the present invention can integrate legacy devices (e.g., CE devices that rely on infrared/serial communications protocols), as well as devices having a discovery protocol interface (e.g., devices defined by the UPNP™ Forum) as system components. An example of a controlled environment implementing an IEEE 802.11(b) infrared/serial bridge is described in the application entitled “Legacy Device Bridge for Residential or Non-Residential Networks” (U.S. patent application Ser. No. 10/387,590), which is incorporated herein by reference in its entirety.
In an embodiment of the present invention, a “virtual plug and play protocol interface” enables a legacy device to function similarly to a device having a conventional “plug and play” protocol interface. For example, one or more bridges 130(a)-130(e) can be modified to include a virtual plug and play protocol interface that enables a legacy device, such as a conventional CE device, to be advertised to and controlled by non-legacy system components as if the legacy device were compliant with, for example, a packet-based discovery and control protocol, such as those defined by the UPnP™ Forum. As would be appreciated by one skilled in the relevant art(s), the UPnP™ Forum is an open industry standard that uses Internet and Web protocols to enable devices such as personal computers, peripherals, intelligent appliances, and wireless devices to be connected to a controlled environment (such as, system 100) and to become automatically aware of each other. In accordance with a plug and play protocol (such as the UPnP™ Forum), when a user plugs a non-legacy device into a controlled environment (e.g., system 100), the device configures itself, acquires a TCP/IP address, and uses a discovery protocol based on the Hypertext Transfer Protocol (HTTP) to announce its presence to other devices on within the controlled environment (e.g., system 100). Other plug-and-play-compliant network entities can then negotiate a communications protocol with the device, determine its capabilities, and control it. Note that although this embodiment is described with respect to the UPnP protocol, the present invention is not limited to the UPnP protocol, but also encompasses other standards-based discovery protocols, such as the Rendezvous™ protocol, developed, in part, by Apple Computer, Inc. of Cupertino, Calif. The present invention also encompasses proprietary discovery protocols designed for specific network devices. For example, the Panasonic® KX-HCM250 Wireless Network Camera, sold by Matsushita Electric Industrial Co. Ltd. of Osaka, Japan, employs a proprietary protocol for discovery and control of that device in a network.
In an embodiment of the present invention, one or more bridges 130(a)-130(e) act as a plug and play proxy for a piece of legacy equipment and is herein referred to as a “plug-and-play-enhanced” bridge 130(a)-130(e). The “plug-and-play-enhanced” bridge 130(a)-130(e), therefore, includes a virtual plug and play protocol interface that enables the plug-and-play-enhanced bridge 130(a)-130(e) to advertise itself to other network entities as a conventional plug and play device, exhibiting attributes similar to the legacy device that is communicatively connected to it. When plug and play commands arrive from the network (e.g., network 180), plug-and-play-enhanced bridge 130(a)-130(e) translates them into an appropriate set of commands for controlling the legacy device, such as IR commands or serial commands. Note that although this embodiment is described with respect to plug and play virtualization, the present invention is not limited to plug and play virtualization, but also encompasses legacy device virtualization in accordance with other packet-based discovery and control protocols, including but not limited to Jini™, developed by Sun Microsystems of Santa Clara, Calif., or the Rendezvous™ protocol, which is an open protocol developed, in part, by Apple Computer, Inc. of Cupertino, Calif.
Therefore in an embodiment, bridges 130(a)-130(e) are provided to “control” legacy system components. In another embodiment, bridges 130(a)-130(e) are enhanced with a virtual plug and play protocol interface to enable “discovery and control” of legacy system components within system 100. It should be noted that the wireless aspects of the present invention is not restricted to infrared communications. In other embodiments, bridges 130(a)-130(e) support other modes of wireless communications (e.g., RF, WiFi, BLUETOOTH™, etc.) that enable discovery and/or control of legacy system components. In another embodiment, a bridge 130(a)-130(e) is modified to enable discovery and/or control of legacy system components over a wired interface (e.g., serial or parallel) with other system components of system 100. In other embodiments, a bridge 130(a)-130(e) can support a wired interface to a legacy system component and a wireless interface to another system components, a wireless interface to a legacy system component and a wired interface to other system components, wireless interfaces to both the legacy system component and other system components, and/or wired interfaces to both the legacy system component and other system components.
III. Setup Optimization
In an embodiment of the present invention, activity-based or experienced-based operations are created and defined during an initialization or setup session with minimum or no user interaction, and are executed with the function and/or operation of various system components. This can be explained with reference to
The control flow of flowchart 300 begins at step 301 and passes immediately to step 303. At step 303, a room or region within the controlled environment (e.g., system 100) is designated. In an embodiment, a control screen is presented on a display device to enable a user to perform this operation. The control screen, therefore, enables the user to add, remove, and/or configure a system component for the controlled environment. In an embodiment, a set-up wizard allows the user to navigate among a plurality of control screens to add or configure system components.
Referring back to
Referring back to
Referring back to
As shown, legacy device control screen 800 provides an example for adding, removing, or configuring an “audio/video” device. In an embodiment supporting a manual device assignment, the “audio/device” device type is specified in legacy device control screen 700. In another embodiment supporting automatic discovery of legacy devices (e.g., coupled to a plug-and-play-enhanced wireless controller), legacy device control screen 800 would be presented upon discovery of the legacy device. As shown in device information window 802, the discovered legacy device (or manually assigned device, if appropriate) is an “audio/video” device that has been discovered (or manually assigned, if appropriate) to the “living room.” The device information fields 804 a-804 d are automatically populated (or manually completed, if appropriate) with the relevant device information (e.g., assigned room/region, device type, make, model, etc.).
Using a setup wizard (such as illustrated by device control screens 600, 700, and 800), various system components (both legacy and non-legacy devices) can be added, removed, or configured for control by system 100. During the setup process, relevant device information (e.g., device type, make, model, region assignment, etc.) is automatically discovered or added by user input. For a legacy device that is not automatically discoverable, the user adds the legacy device to system 100 by identifying the device (by device type, make, model, etc.) and assigning the device to a particular room/region via the set-up process (e.g., device control screens 600, 700, and 800).
The setup process is also designed to acquire basic operational information about each new device (such as, tuning rules, types and order of inputs, etc.) The basic operational information is also referred to as “device metadata” and includes information regarding the unique control behavior(s) or operational “idiosyncrasies” of a particular device. As described in greater detail below, device metadata is executed to ensure a system component is placed in the appropriate state or mode for executing activity-based or experienced-based operations of the present invention. Examples of device metadata include the input mode or state, input types, order of inputs, and tuning rules for operating a device. Device metadata is described in greater detail in the application entitled “Device Control System, Method, and Apparatus” (U.S. patent application Ser. No. 10/783,017), which is incorporated herein by reference in its entirety.
Device control screen 1000 specifies the inputs and input order for controlling a system component. For example, a television can include two inputs “AUX1” and “AUX2.” Input AUX1 can be used to receive input from a satellite receiver, and input AUX2 can be used to receive input from a DVD player.
The present invention includes mechanisms for optimizing the collection of device metadata with little or no human intervention. In an embodiment, a series of questions or informational prompts that comprise the set-up process can be dynamically optimized to avoid seeking irrelevant or unnecessary information. In an embodiment, device metadata is contained in an accessible database (such as, the metadata database described in the application entitled “Device Control System, Method, and Apparatus” (U.S. patent application Ser. No. 10/783,017), which is incorporated herein by reference in its entirety). As such, the setup process can be tailored and streamlined based on the type and model number of the system component being added or configured. For example, the setup process would avoid asking for information that either is already known via the metadata database or that is not relevant to that particular system component, such as types of inputs, tuning rules, power-on delay, etc. Instead, the setup process would be dynamically tailored to seek only that which is specific to and necessary to control the particular system component in light of its user-specific configuration (e.g., what devices are connected to the AV1 and AV2 inputs of a television).
Additionally, certain system components, such as some digital media adapters, provide some functions that can only be controlled via IR while other functions can be controlled through a wired interface. Based on the stored profile for such system components, the IR-controlled functions can be enumerated for and confirmed by the user during setup.
Referring back to
If the activity-based or experienced-based operations have already been defined by the system (default operations) or a user, a new activity-based or experienced based operation is established after a new system component has been added to the controlled environment (as described above with reference to steps 303-312). For example, if a context-based control macro already exists for playing a DVD movie, and a new television is added to a bedroom, the existing control macro is updated to specify the new television as an optional system component for displaying the DVD movie upon activation of the control macro.
After creating or defining the activity-based or experienced-based operation(s), the control flow ends as indicated at step 395. Thus, the present invention includes a setup process that provides far more flexibility than other proprietary processes for setting-up a controlled environment (e.g., system 100). For example, the Harmony™ remote controller (available from Logitech) supports a setup scheme, whereby device-control information is gathered according to certain discrete user activities (e.g., watching a DVD, watching television, and listening to a radio). The Harmony™ remotes, however, have several limitations. For example, because the Harmony™ remotes are IR-based, they require direct line-of-sight connectivity with the devices they control, and therefore, can only control devices in a single room. Moreover, the Harmony™ remotes only allow one set of devices to be designated to participate in an activity. If the user has multiple devices of a particular type in a room (e.g., more than one TV), only one device of that type can be designated to participate in a user activity. In addition, the setup interface used by the Harmony™ remotes is only available through a personal computer having connectivity to a website via the Internet.
However, the present invention allows a user to define any number or any type of experiences that is desired, subject only to the kinds of devices available to the user and the manner in which such devices are interconnected. In other words, the setup process of the present invention allows the user to define activity-based or experience-based operations that can be executed with all possible media source-renderer combinations.
For example, unlike other proprietary setup schemes that lock users into a particular source in defining an activity, the present invention's setup process supports a number of activity-based or experience-based operations that utilize any available source, such as “Watch DVD from DVD player” and “Watch DVD from game console”. By contrast, other proprietary schemes allow only a single “Watch DVD” experience that is confined to a single player/source, even though there may be two or more devices capable of playing a DVD.
The setup process of the present invention also supports activity-based or experience-based operations on multiple media renderers (e.g., “Watch DVD on TV” and/or “Watch DVD on projection TV”). By contrast, other proprietary schemes limit the user to one “Watch DVD” experience that is confined to a single rendering device, even though two or more valid rendering devices may be available.
Unlike other proprietary setup schemes that limit a user's ability to define activities to one device per type, the setup process of the present invention supports activity-based or experience-based operations that utilize source/renderer devices of the same type, such as “Watch DVD on TV-1” and “Watch DVD on TV-2”; or “Watch DVD-1 on TV” and “Watch DVD-2 on TV”. By contrast, other proprietary setup schemes do not let the user define activities for more than one device of the same type.
The present invention's setup process contemplates use in a wireless network in which a single controller (e.g., portable controller 108) can control any system component in any room or region from any location in a controlled environment (e.g., system 100). Accordingly, each system component is assigned to a specific room or region. The user can then define activity-based or experience-based operations for each room or region using the system components available in that room or region.
The present invention contemplates control of multiple system components of the same type (e.g., two televisions in the same room). The user can define a plurality of the same activity-based or experience-based operations in the same room, using different sets and combinations of interconnected system components. For example, the user can setup multiple “Watch DVD” experiences using different DVD players and/or different TVs (“Watch Bedroom DVD player-1 on Bedroom TV-2” or “Watch Bedroom DVD player-2 on Bedroom TV-1”). Thus, multiple user-defined activity-based or experience-based operations can be created on a per-room basis.
In addition, the present invention accommodates system components that are accessible from multiple rooms or regions (shared) or that are connected to a switching device that sends its output to multiple rooms or regions (e.g., matrix switcher, multi-zone audio-video system, etc.).
Accordingly, the user can define a per-room/region activity-based or experience-based operation that is not necessarily limited to system components that are physically located in that particular room or region. For example, a “watch DVD in the master bedroom” experience can be defined using a DVD player located in the living room that is a shared device or that is accessible to the television (e.g., television 104) in the master bedroom via a switcher.
Based on the rooms/regions and experience categories that are defined, the present invention allows for a control interface to be generated that allows a user to navigate to the selected room/region, select an experience category (e.g., audio, video), and select a specific activity within the category (e.g., watch a movie on DVD player 1). Control interface examples are described in greater detail in the application entitled “User Interface for Multi-Device Control” (U.S. patent application Ser. No. 10/783,511), which is incorporated herein by reference in its entirety.
As described above, the setup process of the present invention contemplates use of “networked devices” such as plug and play media players (e.g., media player 116) and servers (e.g., server 208) that can be automatically discovered when they are powered on and connected to the controlled environment. Once a networked device is found, Applicants' set-up process will automatically display the device for the user and the user will be asked to assign that device to a particular room, if it is not automatically positioned in accordance with the location/positioning mechanisms of the present invention.
As described above, the setup process of the present invention also accommodates use of a bridge device that converts commands from a packet-based format (e.g., Ethernet or 802.11) to a format that is intelligible by most CE devices in existence today (IR or Serial). As disclosed in the application entitled “Legacy Device Bridge for Residential or Non-Residential Networks” (U.S. patent application Ser. No. 10/387,590), the bridge device allows IR-controlled CD devices (which require direct line-of-sight connectivity to a remote control unit) to be connected to a WiFi network. Once connected to a controlled environment (e.g., system 100) via the bridge device, the user is not required to be in the same room as the device in order to control it. During the setup process, the user can assign a bridge device to control a particular CE device. (See device control screen 500 in
According to an embodiment of the present invention, a user engages the setup process through a wireless portable controller (e.g., portable controller 108), not through a stationary PC-based interface. An advantage of the present invention is that the user is no longer required to setup devices by sitting in front of a personal computer (computer client 106) having a fixed location, which may not be anywhere near the CE devices at issue. Having the PC-based set-up interface in a location that is not proximately located to the devices that are being setup can result in significant inconvenience for the user. For example, certain information requires physical interaction with the CE device, such as identifying and labeling input cycles and determining IR delays which dictates how quickly commands can be sent to the device (e.g., the time it takes a television to change channels upon receiving a channel-entry command or the time it takes for the television to turn-on upon receiving a power-on command). The present invention obviates the inconvenience of having to run back and forth between the device and the personal computer in order to input the requested set-up information
IV. Example Computer System
Additionally, the present invention can be implemented in one or more computer systems or other processing systems, capable of carrying out the functionality described herein. Referring to
The computer system 1100 includes one or more processors, such as processor 1104. Processor 1104 can be a special purpose or a general purpose digital signal processor. The processor 1104 is connected to a communication infrastructure 1106 (e.g., a communications bus, cross-over bar, or network).
Computer system 1100 can include a display interface 1102 that forwards graphics, text, and other data from the communication infrastructure 1106 (or from a frame buffer not shown) for display on the display unit 1130.
Computer system 1100 also includes a main memory 1108, preferably random access memory (RAM), and can also include a secondary memory 1110. The secondary memory 1110 can include, for example, a hard disk drive 1112 and/or a removable storage drive 1114, representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc. The removable storage drive 1114 reads from and/or writes to a removable storage unit 1118 in a well-known manner. Removable storage unit 1118, represents a floppy disk, magnetic tape, optical disk, etc. which is read by and written to removable storage drive 1114. As will be appreciated, the removable storage unit 1118 includes a computer usable storage medium having stored therein computer software (e.g., programs or other instructions) and/or data.
In alternative embodiments, secondary memory 1110 includes other similar means for allowing software and/or data to be loaded into computer system 1100. Such means include, for example, a removable storage unit 1122 and an interface 1120. Examples of such means include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as, an EPROM or PROM) and associated socket, and other removable storage units 1122 and interfaces 1120 which allow software and data to be transferred from the removable storage unit 1122 to computer system 1100.
Computer system 1100 can also include a communications interface 1124. Communications interface 1124 allows software and/or data to be transferred between computer system 1100 and external devices. Examples of communications interface 1124 include a modem, a network interface (such as an Ethernet card), a communications port, a PCMCIA slot and card, etc. Software and data transferred via communications interface 1124 are in the form of signals 1128 which can be electronic, electromagnetic, optical or other signals capable of being received by communications interface 1124. These signals 1128 are provided to communications interface 1124 via a communications path (i.e., channel) 1126. Communications path 1126 carries signals 1128 and can be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link, free-space optics, and other communications channels.
In this document, the term “computer program product” is used to generally refer to computer-readable storage media such as removable storage unit 1118, removable storage unit 1122, and a hard disk installed in hard disk drive 1112. These computer program products are means for providing software to computer system 1100. The invention, in an embodiment, is directed to such computer program products.
Computer programs (also called computer control logic or computer readable program code) are stored in main memory 1108 and/or secondary memory 1110. Computer programs can also be received via communications interface 1124. Such computer programs, when executed, enable the computer system 1100 to implement the present invention as discussed herein. In particular, the computer programs, when executed, enable the processor 1104 to implement the processes of the present invention, such as the method(s) implemented using, for example, portable controller 108, control screens 400-1000, and/or other system components of system 100 described above, such as method 300, for example. Accordingly, such computer programs represent controllers of the computer system 1100.
In an embodiment where the invention is implemented using software, the software can be stored in a computer program product and loaded into computer system 1100 using removable storage drive 1114, hard drive 1112, interfaces 1120, or communications interface 1124. The control logic (software), when executed by the processor 1104, causes the processor 1104 to perform the functions of the invention as described herein.
In another embodiment, the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs). Implementation of the hardware state machine so as to perform the functions described herein will be apparent to persons skilled in the relevant art(s).
In yet another embodiment, the invention is implemented using a combination of both hardware and software.
While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example, and not limitation. It will be apparent to persons skilled in the relevant art(s) that various changes in form and detail can be made therein without departing from the spirit and scope of the invention. Moreover as previously discussed, it should be understood that the method, system, and computer program product of the present invention should not be limited to a residential environment. The present invention can be implemented in other types of environments having a central processing system for distributing media and sending command and/or control signals to a plurality of devices and/or applications dispersed throughout a designated region. In addition to a residence, the designated region includes, but is not limited to, office complexes, suite of small offices, production studios, warehouses, entertainment arenas, health care facilities, hotels, vacation resorts, aircrafts, ships, automobiles, or the like. Thus, the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5414426||Dec 11, 1992||May 9, 1995||Universal Electronics Inc.||Favorite key macro command and chained macro command in a remote control|
|US5519878||Jul 15, 1994||May 21, 1996||Echelon Corporation||System for installing and configuring (grouping and node address assignment) household devices in an automated environment|
|US5537463||May 31, 1994||Jul 16, 1996||Universal Electronics Inc.||Magnetic modem in a remote control|
|US5552917||Sep 29, 1994||Sep 3, 1996||Universal Electronics Inc.||Remote control|
|US5570085||Nov 22, 1994||Oct 29, 1996||Ludo A. Bertsch||Programmable distributed appliance control system|
|US5689353||Sep 3, 1996||Nov 18, 1997||Universal Electronics Inc.||Remote control with two-way data coupling|
|US5771388||May 6, 1997||Jun 23, 1998||National Instruments Corporation||System and method for mapping driver level event function calls from a process-based driver level program to a session-based instrumentation control driver level system|
|US5802467||Sep 28, 1995||Sep 1, 1998||Innovative Intelcom Industries||Wireless and wired communications, command, control and sensing system for sound and/or data transmission and reception|
|US5805812||May 15, 1996||Sep 8, 1998||Electronic Data Systems Corporation||Communication system for the remote control of equipment|
|US5875108||Jun 6, 1995||Feb 23, 1999||Hoffberg; Steven M.||Ergonomic man-machine interface incorporating adaptive pattern recognition based control system|
|US5898386||Sep 5, 1996||Apr 27, 1999||Sony Corporation||Electronic appliance system, electronic appliance and remote controller|
|US5926108||Feb 12, 1997||Jul 20, 1999||Sony Corporation||Movie information pager|
|US5930699||Nov 12, 1996||Jul 27, 1999||Ericsson Inc.||Address retrieval system|
|US5953144||Jun 16, 1997||Sep 14, 1999||Universal Electronics Inc.||Upgradeable remote control device|
|US5956025||Jun 9, 1997||Sep 21, 1999||Philips Electronics North America Corporation||Remote with 3D organized GUI for a home entertainment system|
|US5956487||Oct 25, 1996||Sep 21, 1999||Hewlett-Packard Company||Embedding web access mechanism in an appliance for user interface functions including a web server and web browser|
|US5959751||Jun 13, 1997||Sep 28, 1999||Universal Electronics Inc.||Universal remote control device|
|US5963624||Dec 5, 1997||Oct 5, 1999||Zilog, Inc.||Digital cordless telephone with remote control feature|
|US6005861||Mar 3, 1999||Dec 21, 1999||Samsung Electronics Co., Ltd.||Home multimedia network architecture|
|US6026150||Oct 30, 1997||Feb 15, 2000||Epigram||Network protocol--based home entertainment network|
|US6032202||Jan 6, 1998||Feb 29, 2000||Sony Corporation Of Japan||Home audio/video network with two level device control|
|US6049711||Aug 23, 1995||Apr 11, 2000||Teletrac, Inc.||Method and apparatus for providing location-based information services|
|US6052750||Jan 6, 1998||Apr 18, 2000||Sony Corporation Of Japan||Home audio/video network for generating default control parameters for devices coupled to the network, and replacing updated control parameters therewith|
|US6085236||Jan 6, 1998||Jul 4, 2000||Sony Corporation Of Japan||Home audio video network with device control modules for incorporating legacy devices|
|US6131028||Dec 10, 1997||Oct 10, 2000||Integrated Telecom Solutions, Inc.||Method of providing services specified by feature codes based upon location of a wireless telephone unit|
|US6148205||Jun 30, 1998||Nov 14, 2000||Motorola, Inc.||Method and apparatus for secure registration within an in-home wireless network|
|US6154745||Dec 23, 1997||Nov 28, 2000||Nokia Mobile Phones Ltd.||Method for transmission of information to the user|
|US6167046||Jan 9, 1998||Dec 26, 2000||Sharp Kabushiki Kaisha||Communication method, communication system and computer readable recording medium recording communication program|
|US6170007||Aug 31, 1999||Jan 2, 2001||Hewlett-Packard Company||Embedding web access functionality into a device for user interface functions|
|US6198479||Jun 24, 1998||Mar 6, 2001||Samsung Electronics Co., Ltd||Home network, browser based, command and control|
|US6199066||Jul 20, 1998||Mar 6, 2001||Telefonaktiebolaget L M Ericsson||Meta-service activating interface between a customer administrative system and database network elements of a communications network|
|US6199136||Sep 2, 1998||Mar 6, 2001||U.S. Philips Corporation||Method and apparatus for a low data-rate network to be represented on and controllable by high data-rate home audio/video interoperability (HAVi) network|
|US6208341||Aug 5, 1998||Mar 27, 2001||U. S. Philips Corporation||GUI of remote control facilitates user-friendly editing of macros|
|US6208866||Dec 30, 1998||Mar 27, 2001||Ericsson Inc.||System and method for location-based marketing to mobile stations within a cellular network|
|US6218931||Oct 8, 1999||Apr 17, 2001||Advanced Micro Devices, Inc.||Home-appliance network with nodes identified by direct-sequence spreading codes|
|US6222530||Aug 21, 1998||Apr 24, 2001||Corporate Media Partners||System and method for a master scheduler|
|US6223348||Sep 3, 1997||Apr 24, 2001||Universal Electronics Inc.||Universal remote control system|
|US6243707||Jun 24, 1998||Jun 5, 2001||Samsung Electronics Co. Ltd.||Method and apparatus for creating home network macros|
|US6243772||Jan 31, 1997||Jun 5, 2001||Sharewave, Inc.||Method and system for coupling a personal computer with an appliance unit via a wireless communication link to provide an output display presentation|
|US6259707||Oct 30, 1998||Jul 10, 2001||Sony Corporation||Synchronizing a data driven interaction controller and a non-data driven interaction controller|
|US6266612||Jun 16, 1999||Jul 24, 2001||Trimble Navigation Limited||Position based personal digital assistant|
|US6275865||Nov 25, 1998||Aug 14, 2001||Sony Corporation Of Japan||Method and system for message dispatching in a home audio/video network|
|US6282714||Jan 31, 1997||Aug 28, 2001||Sharewave, Inc.||Digital wireless home computer system|
|US6288716||Jun 24, 1998||Sep 11, 2001||Samsung Electronics, Co., Ltd||Browser based command and control home network|
|US6292554||Oct 7, 1999||Sep 18, 2001||Simplified Telesys||System and method for communicating with and controlling disparate telecommunications devices in a telecommunications network|
|US6317028||Feb 3, 1999||Nov 13, 2001||Electronic Security And Identification Llc||Electronic identification, control, and security system and method for consumer electronics and the like|
|US6317718||Feb 26, 1999||Nov 13, 2001||Accenture Properties (2) B.V.||System, method and article of manufacture for location-based filtering for shopping agent in the physical world|
|US6321092||Sep 15, 1999||Nov 20, 2001||Signal Soft Corporation||Multiple input data management for wireless location-based applications|
|US6349352||Jan 6, 1998||Feb 19, 2002||Sony Corporation Of Japan||Home audio/video network with both generic and parameterized device control|
|US6359636||Jul 17, 1995||Mar 19, 2002||Gateway, Inc.||Graphical user interface for control of a home entertainment system|
|US6363434||Mar 30, 1999||Mar 26, 2002||Sony Corporation Of Japan||Method of managing resources within a network of consumer electronic devices|
|US6388399||Jan 26, 2001||May 14, 2002||Leviton Manufacturing Co., Inc.||Network based electrical control system with distributed sensing and control|
|US6405261||Nov 2, 2000||Jun 11, 2002||International Business Machines Corporation||Method and apparatus for an automatic multi-rate wireless/wired computer network|
|US6463343||Aug 10, 1999||Oct 8, 2002||International Business Machines Corporation||System and method for controlling remote devices from a client computer using digital images|
|US6496135||Jun 1, 2001||Dec 17, 2002||Universal Electronics Inc.||Remote control with LED capabilities|
|US6512754||Aug 24, 1998||Jan 28, 2003||Lucent Technologies Inc.||Point-to-point protocol encapsulation in ethernet frame|
|US6563430||Dec 11, 1998||May 13, 2003||Koninklijke Philips Electronics N.V.||Remote control device with location dependent interface|
|US6587067||Feb 23, 2001||Jul 1, 2003||Universal Electronics Inc.||Universal remote control with macro command capabilities|
|US6597374||Nov 12, 1998||Jul 22, 2003||Microsoft Corporation||Activity based remote control unit|
|US6600421||Jul 31, 2001||Jul 29, 2003||Koninklijke Philips Electronics N.V.||System to automatically locally control a device according to preferences of a user entering a local area of the device from a remote area|
|US6642852||Mar 1, 2002||Nov 4, 2003||Universal Electronics Inc.||Remote control device with appliance power awareness|
|US6647426||Apr 2, 2002||Nov 11, 2003||Kineto Wireless, Inc.||Apparatus and method for integrating an unlicensed wireless communications system and a licensed wireless communications system|
|US6728784||Aug 21, 1997||Apr 27, 2004||Netspeak Corporation||Collaborative multimedia architecture for packet-switched data networks|
|US6741853||Nov 9, 2000||May 25, 2004||Nortel Networks Limited||Device aware internet portal|
|US6748343||Sep 28, 2001||Jun 8, 2004||Vigilos, Inc.||Method and process for configuring a premises for monitoring|
|US6792469||Mar 21, 2000||Sep 14, 2004||General Electric Company||System and method for monitoring and controlling the production of audio and video streams|
|US6914551||Apr 12, 2002||Jul 5, 2005||Apple Computer, Inc.||Apparatus and method to facilitate universal remote control|
|US20010000194||Nov 29, 2000||Apr 5, 2001||Sequeira William J.||System and method for a master scheduler|
|US20010018663||Apr 30, 2001||Aug 30, 2001||Dussell William O.||Position based personal digital assistant|
|US20010036192||Mar 19, 2001||Nov 1, 2001||Chiles David Clyde||Home-networking|
|US20010041561||Jan 12, 2001||Nov 15, 2001||Thomas Ventulett||System and method for location-based stimuli motivated information delivery|
|US20010049275||Feb 15, 2001||Dec 6, 2001||Pierry Cristiano L. S.||Automated alert state change of user devices for time-based and location-based events|
|US20010049846||Jun 13, 2001||Dec 13, 2001||Guzzi Brian Daniel||Method and system for optimizing performance of consumer appliances|
|US20010053274||Jun 19, 2001||Dec 20, 2001||Koninklijke Philips Electronics N.V.||System and method for remote control of consumer electronics over data network with visual feedback|
|US20010054060||Feb 1, 2001||Dec 20, 2001||Fillebrown Lisa A.||Personal wireless network|
|US20010055954||Mar 29, 2001||Dec 27, 2001||Cheng Vernon S.||Digital cordless telephone home network|
|US20020006788||May 7, 2001||Jan 17, 2002||Per Knutsson||Method and apparatus for a mobile access system delivering location based information and services|
|US20020019984||Jul 3, 2001||Feb 14, 2002||Rakib Selim Shlomo||Headend cherrypicker with digital video recording capability|
|US20020022991 *||Feb 15, 2001||Feb 21, 2002||Sharood John N.||Building marketing system|
|US20020031120||Jul 3, 2001||Mar 14, 2002||Rakib Selim Shlomo||Remote control for wireless control of system including home gateway and headend, either or both of which have digital video recording functionality|
|US20020033760||Sep 17, 2001||Mar 21, 2002||Shinji Kobayashi||Portable information divice, access device for portable information device, home network system, and home network access method|
|US20020034292||Aug 22, 2001||Mar 21, 2002||Tuoriniemi Veijo M.||System and a method to match demand and supply based on geographical location derived from a positioning system|
|US20020035403||Jun 1, 2001||Mar 21, 2002||Tim Clark||Method and apparatus for remotely monitoring and controlling a pool or spa|
|US20020035404||Jun 11, 2001||Mar 21, 2002||Michael Ficco||Device control via digitally stored program content|
|US20020035605||Mar 16, 2001||Mar 21, 2002||Mcdowell Mark||Use of presence and location information concerning wireless subscribers for instant messaging and mobile commerce|
|US20020035621||Mar 16, 2001||Mar 21, 2002||Zintel William Michael||XML-based language description for controlled devices|
|US20020036795||Sep 7, 2001||Mar 28, 2002||Ricoh Company, Ltd.||Printing apparatus and printing system|
|US20020068984||Dec 6, 2001||Jun 6, 2002||Bruce Alexander||System and method for implementing open-protocol remote device control|
|US20020087746||Mar 7, 2001||Jul 4, 2002||Ludtke Harold Aaron||Media manager for controlling autonomous media devices within a network environment and managing the flow and format of data between the devices|
|US20030103088||Nov 6, 2002||Jun 5, 2003||Universal Electronics Inc.||User interface for a remote control application|
|US20030105854||Dec 11, 2002||Jun 5, 2003||Vilhjalmur Thorsteinsson||Method and system for controlling and coordinating devices and appliances, such as from a central portal and via a wide-area communications network|
|US20030163626||Feb 27, 2002||Aug 28, 2003||Cheng-Tien Chen||Wireless communication module with a portable digital camera|
|US20030191826||Mar 7, 2003||Oct 9, 2003||Atreus Systems Corp.||Initiation module for initiating network-based services|
|US20030204582||Apr 29, 2002||Oct 30, 2003||Shimoda Marion H.||Wireless personal area network scalable migration of resources|
|US20030207668||May 3, 2002||Nov 6, 2003||Mcfarland William J.||Dual frequency band wireless lan|
|US20030208595||Apr 27, 2001||Nov 6, 2003||Gouge David Wayne||Adaptable wireless proximity networking|
|US20030220988||May 22, 2002||Nov 27, 2003||Hymel James A.||Method and electronic device for establishing an interface to control an accessory device|
|US20030224735||Jun 3, 2002||Dec 4, 2003||Moursund Carter M.||Wireless infrared network transceiver|
|US20030224807||May 28, 2002||Dec 4, 2003||Honeywell International Inc.||Method and apparatus for control of presentation equipment|
|US20030236890||Jun 25, 2002||Dec 25, 2003||Intel Corporation||Wireless communication device and method for sharing device resources|
|US20040003051||Jun 27, 2002||Jan 1, 2004||Openpeak Inc.||Method, system, and computer program product for managing controlled residential or non-residential environments|
|US20040003073||Mar 7, 2003||Jan 1, 2004||Openpeak Inc.||Method, system, and computer program product for managing controlled residential or non-residential environments|
|US20040046677||Sep 3, 2003||Mar 11, 2004||Universal Electronics Inc.||Remote control device with appliance power awareness|
|US20040047347||Nov 13, 2001||Mar 11, 2004||Michael Worry||Method, system and apparatus for reprogramming a digital electronic device via a computer network|
|US20040054789||Sep 12, 2002||Mar 18, 2004||International Business Machines Corporation||Pervasive home network portal|
|US20040071136||Jan 18, 2002||Apr 15, 2004||Josef Laumen||Message transfer device and method for transferring messages|
|US20040098456||Feb 3, 2003||May 20, 2004||Openpeak Inc.||System, method and computer program product for video teleconferencing and multimedia presentations|
|US20050015764||Jul 2, 2003||Jan 20, 2005||Intel Corporation||Method, system, and program for handling device interrupts in a multi-processor environment|
|US20050108369 *||Feb 27, 2004||May 19, 2005||Sather Dale A.||Simple and dynamic configuration of network devices|
|1||"Creston Introduces RMC2e "Mini" Control System" Home Toys New Release, URL http://www.hometoys.com/releases/mar03/creston-02.html, Oct. 14, 2004, 2 pages.|
|2||"Creston Introduces RMC2e "Mini" Control System" Home Toys New Release, URL http://www.hometoys.com/releases/mar03/creston—02.html, Oct. 14, 2004, 2 pages.|
|3||"EtherWind(TM) 802.11b(TM) Wireless Print Server", URL http://www.troygroup.com/wireless/documents/datasheets/TROYU%20EtherWind.pdf, Nov. 19, 2003, 2 pages.|
|4||"EtherWind(TM) IEEE 802.11b Wireless Print Server", URL http://www.troygroup.com/wireless/products/wireless/etherwind.asp, Nov. 19, 2003, 3 pages.|
|5||"EtherWind-Plus(TM) 802.11b OEM Module", URL http://www.troygroup.com/wireless/documents/datasheets/TROY%20EtherWind%20Plus%20data%20sheet.pdf, Nov. 19, 2003, 2 pages.|
|6||"EtherWind-Plus(TM) IEEE 802.11b OEM Connectivity Module", URL http://www.troygroup.com/wireless/products/wireless/etherwindplus.asp, Nov. 19, 2003, 2 pages.|
|7||"EtherWind-Plus™ 802.11b OEM Module", URL http://www.troygroup.com/wireless/documents/datasheets/TROY%20EtherWind%20Plus%20data%20sheet.pdf, Nov. 19, 2003, 2 pages.|
|8||"EtherWind-Plus™ IEEE 802.11b OEM Connectivity Module", URL http://www.troygroup.com/wireless/products/wireless/etherwindplus.asp, Nov. 19, 2003, 2 pages.|
|9||"EtherWind™ 802.11b™ Wireless Print Server", URL http://www.troygroup.com/wireless/documents/datasheets/TROYU%20EtherWind.pdf, Nov. 19, 2003, 2 pages.|
|10||"EtherWind™ IEEE 802.11b Wireless Print Server", URL http://www.troygroup.com/wireless/products/wireless/etherwind.asp, Nov. 19, 2003, 3 pages.|
|11||"GC-100 Key Features and Benefits" GC-100 Network Adapter, URL http://wwwglobalcache.com/products/gc-features.html, Oct. 11, 2006, 2 pages.|
|12||"Global Caché GC-100 Network Adapter-Control & Automate Common Devices Over A Network" GC-100 Network Adapter, URL http://wwwglobalcache.com/products/gc-index.html, Oct. 11, 2004, 2 pages.|
|13||"Global Caché GC-100 Network Adapter—Control & Automate Common Devices Over A Network" GC-100 Network Adapter, URL http://wwwglobalcache.com/products/gc-index.html, Oct. 11, 2004, 2 pages.|
|14||"Global Caché GC-100 Network Adapter-Control & Automate Common Devices Over A Network", Product Data Sheet, 2 pages, 2004.|
|15||"Global Caché GC-100 Network Adapter—Control & Automate Common Devices Over A Network", Product Data Sheet, 2 pages, 2004.|
|16||"Harmony Remote SST-659 User Manual", dated Oct. 16, 2003, published at http://www.harmonyremote.com, downloaded from the World Wide Web on Feb. 9, 2004, 20 pages.|
|17||"Harmony Remote SST-659", published at http://www.harmonyremote.com, downloaded from the World Wide Web on Feb. 9, 2004, 1 page.|
|18||"Harmony Remote SST-748", published at http://www.harmonyremote.com, downloaded from the World Wide Web on Feb. 9, 2004, 1 page.|
|19||"Harmony Remote SST-768 User Manual", dated Mar. 25, 2003, published at http://www.harmonyremote.com, downloaded from the World Wide Web on Feb. 9, 2004, 37 pages.|
|20||"Harmony Remote SST-768t", published at http://www.harmonyremote.com, downloaded from the World Wide Web on Feb. 9, 2004, 1 page.|
|21||"Harmony Remote-Features", URL http://www.harmonyremote.com/product-features.htm, downloaded from the World Wide Web on Feb. 9, 2004, 5 pages.|
|22||"Harmony Remote—Features", URL http://www.harmonyremote.com/product—features.htm, downloaded from the World Wide Web on Feb. 9, 2004, 5 pages.|
|23||"Harmony Remote-Frequently Asked Questions", URL http://www.harmonyremote.com/faq.htm, downloaded from the World Wide Web on Feb. 9, 2004, 2 pages.|
|24||"Harmony Remote—Frequently Asked Questions", URL http://www.harmonyremote.com/faq.htm, downloaded from the World Wide Web on Feb. 9, 2004, 2 pages.|
|25||"Harmony Remote-Overview", URL http://www.harmonyremote.com/product-overview.htm, downloaded from the World Wide Web on Feb. 9, 2004, 2 pages.|
|26||"Harmony Remote—Overview", URL http://www.harmonyremote.com/product—overview.htm, downloaded from the World Wide Web on Feb. 9, 2004, 2 pages.|
|27||"IPL T SFI244, Two Serial, Four Flex I/O, and Four IR Port IP Link(TM) Ethernet Control Interface With IR Learner", Extron IPL T SF1244 IP Link(TM) Products, URL http://www.extron.com/product/product.asp?id=ipltsfi244&version=print, Oct. 11, 2004, 6 pages.|
|28||"IPL T SFI244, Two Serial, Four Flex I/O, and Four IR Port IP Link™ Ethernet Control Interface With IR Learner", Extron IPL T SF1244 IP Link™ Products, URL http://www.extron.com/product/product.asp?id=ipltsfi244&version=print, Oct. 11, 2004, 6 pages.|
|29||"Pronto RF Extender, RFX 6000, Pronto accessory for operating devices inside a closed cabinet, closet or even in another room", URL http://www.pronto.philips.com/index.cfm?id=577f, Nov. 19, 2003, 2 pages.|
|30||"Pronto RF Extender, RFX 6000, RF extender for TSU6000 & TSU3000", URL http://www.remotecontrol.philips.com/library/documents/SPEC-RFX6000.pdf, Nov. 19, 2003, 2 pages.|
|31||"Pronto RF Extender, RFX 6000, RF extender for TSU6000 & TSU3000", URL http://www.remotecontrol.philips.com/library/documents/SPEC—RFX6000.pdf, Nov. 19, 2003, 2 pages.|
|32||"Specifications for Harmony Remote", URL http://www.harmonyremote.com/product-specifications.htm, downloaded from the World Wide Web on Feb. 9, 2004, 2 pages.|
|33||"Specifications for Harmony Remote", URL http://www.harmonyremote.com/product—specifications.htm, downloaded from the World Wide Web on Feb. 9, 2004, 2 pages.|
|34||"Troy Serial Server," URL, http://www.troygroup.com/Connectivity/products/SerialDeviceConnectivity/SerialServers.asp, downloaded Jul. 9, 2004, 2 pages.|
|35||"Troy Serial Servers," URL, http://www.troygroup.com/Connectivity/products/DataSheets/Troy%20Serial%20Server%20data%20sheet.pdf, downloaded Jul. 9, 2004, 1 page.|
|36||"Troy Wireless Introduces EtherWind-Plus 802.11b Wireless OEM Board-Level Product; New Product Enables Wireless and Ethernet Connectivity on OEM Devices", URL http://www.troygroup.com/wireless/company/news/081302.asp, Nov. 19, 2003, 2 pages.|
|37||International Search Report for International Application No. PCT/US03/20189, Issued on Oct. 29, 2003.|
|38||Total Remote Software: Griffin Technology Downloads, 1 page, printed from Internet-URL-http://www.griffintechnology.com/software/software-totalremote.html, (printed Feb. 23, 2004).|
|39||Total Remote Software: Griffin Technology Downloads, 1 page, printed from Internet—URL—http://www.griffintechnology.com/software/software—totalremote.html, (printed Feb. 23, 2004).|
|40||Total Remote v2.0 user guide, 29 pages, printed from Internet-URL-http://www.griffintechnology.com/downloads/pdf/manuals/Total-Remote-user-manual.pdf, (printed Feb. 23, 2004).|
|41||Total Remote v2.0 user guide, 29 pages, printed from Internet—URL—http://www.griffintechnology.com/downloads/pdf/manuals/Total—Remote—user—manual.pdf, (printed Feb. 23, 2004).|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7987294 *||Oct 16, 2007||Jul 26, 2011||Altec Lansing Australia Pty Limited||Unification of multimedia devices|
|US8042049||Feb 23, 2004||Oct 18, 2011||Openpeak Inc.||User interface for multi-device control|
|US8234363 *||Jul 31, 2012||Kuo-Hua Kuo||Dynamic object management protocol|
|US8290603 *||Feb 21, 2008||Oct 16, 2012||Sonos, Inc.||User interfaces for controlling and manipulating groupings in a multi-zone media system|
|US8483853 *||Sep 11, 2007||Jul 9, 2013||Sonos, Inc.||Controlling and manipulating groupings in a multi-zone media system|
|US8588949||Sep 14, 2012||Nov 19, 2013||Sonos, Inc.||Method and apparatus for adjusting volume levels in a multi-zone system|
|US8731689 *||May 6, 2008||May 20, 2014||Abl Ip Holding, Llc||Networked, wireless lighting control system with distributed intelligence|
|US8788080||Apr 8, 2011||Jul 22, 2014||Sonos, Inc.||Multi-channel pairing in a media system|
|US8843228||May 17, 2013||Sep 23, 2014||Sonos, Inc||Method and apparatus for updating zone configurations in a multi-zone system|
|US8886347||May 10, 2013||Nov 11, 2014||Sonos, Inc||Method and apparatus for selecting a playback queue in a multi-zone system|
|US8910265||Sep 28, 2012||Dec 9, 2014||Sonos, Inc.||Assisted registration of audio sources|
|US8934997||May 16, 2013||Jan 13, 2015||Sonos, Inc.||Controlling and manipulating groupings in a multi-zone media system|
|US8938637||Feb 10, 2014||Jan 20, 2015||Sonos, Inc||Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices without a voltage controlled crystal oscillator|
|US8995687||Aug 1, 2012||Mar 31, 2015||Sonos, Inc.||Volume interactions for connected playback devices|
|US9014834||Apr 18, 2014||Apr 21, 2015||Sonos, Inc.||Multi-channel pairing in a media system|
|US9052810||Sep 28, 2011||Jun 9, 2015||Sonos, Inc.||Methods and apparatus to manage zones of a multi-zone media playback system|
|US9094706||Oct 19, 2012||Jul 28, 2015||Sonos, Inc.||Systems and methods for wireless music playback|
|US20050097478 *||Feb 23, 2004||May 5, 2005||Openpeak Inc.||User interface for multi-device control|
|US20090278479 *||Nov 12, 2009||Platner Brian P||Networked, wireless lighting control system with distributed intelligence|
|US20110284516 *||Dec 22, 2009||Nov 24, 2011||Burda Worldwide Technologies Gmbh||Modular heating and lighting system for the construction of lighting and heating elements|
|U.S. Classification||710/72, 710/62, 710/8, 709/221, 709/220, 709/222|
|International Classification||H04N7/24, G08C19/00, G06F3/00, G05B23/02, G05B15/00, G06F13/12, G06F15/177|
|Cooperative Classification||H04L67/16, H04L67/125, H04L2012/285, G08C2201/50, H04L2012/2849, G08C2201/33, H04L12/282, G08C23/04, H04N21/64753, H04N21/4131, G05B19/042, H04N21/64784, H04N21/43615, H04N21/4751, H04N21/43637, H04N21/6332, H04L2012/2841, H04N21/654, H04L12/2809, G08C2201/40, H04N21/485, G08C17/02, G05B2219/23027|
|European Classification||G08C23/04, H04L29/08N15, G08C17/02, G05B19/042, H04L29/08N11M, H04L12/28H2A, H04N21/647P, H04N21/647N1, H04N21/475A, H04N21/41P6, H04N21/485, H04N21/4363W, H04N21/436H, H04N21/6332, H04N21/654|
|Jan 26, 2005||AS||Assignment|
Owner name: OPENPEAK INC.,FLORIDA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KRZYZANOWSKI, PAUL;FLORES, JUSTIN;HARTER, GLENN;REEL/FRAME:016227/0289
Effective date: 20050125
|May 14, 2012||AS||Assignment|
Owner name: ID8 GROUP R2 STUDIOS, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OPENPEAK INC.;REEL/FRAME:028203/0706
Effective date: 20120123
|Jul 25, 2013||FPAY||Fee payment|
Year of fee payment: 4