Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberUS20070288277 A1
Publication typeApplication
Application numberUS 11/643,159
Publication dateDec 13, 2007
Filing dateDec 20, 2006
Priority dateDec 20, 2005
Also published asCA2634706A1, CN101496039A, EP1977359A2, EP1977359A4, US8185351, US8527320, US8799054, US20070288476, US20070294057, US20070294132, US20070294705, US20070294706, US20120290265, US20130346149, WO2007073484A2, WO2007073484A3
Publication number11643159, 643159, US 2007/0288277 A1, US 2007/288277 A1, US 20070288277 A1, US 20070288277A1, US 2007288277 A1, US 2007288277A1, US-A1-20070288277, US-A1-2007288277, US2007/0288277A1, US2007/288277A1, US20070288277 A1, US20070288277A1, US2007288277 A1, US2007288277A1
InventorsAlan Neuhauser, Jack Crystal, Eugene Flanagan
Original AssigneeNeuhauser Alan R, Crystal Jack C, Flanagan Eugene L Iii
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Methods and systems for gathering research data for media from multiple sources
US 20070288277 A1
Abstract
Methods and systems for gathering multimedia data with a Portable User Appliance (PUA) are disclosed. Audio data is received from a first source and at least one of presentation data and metadata of presentation data from a second source. First research data is produced from the audio data and second research data is produced from the at least one of the presentation data and the metadata of the presentation data.
Images(11)
Previous page
Next page
Claims(37)
1. A system implemented in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprising:
a first input operative to receive first audio data from a first source;
a second input operative to receive at least one of presentation data and metadata of presentation data from a second source;
a processor coupled with the first input and being operative to produce first research data from the first audio data and coupled with the second input and being operative to produce second research data from the at least one of presentation data and metadata of presentation data; and
storage coupled with the processor and operative to store the first research data and the second research data.
2. The system of claim 1, wherein a presentation device is coupled with the processor to receive presentation data and operative to provide a presentation to the user based on the presentation data.
3. The system of claim 1, wherein the processor is operative to execute applications serving to download audio and video data.
4. A system implemented in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprising:
a microphone operative to transduce acoustic energy to sound data; and
a processor operative to process the sound data and media data received in non-acoustic form for one of presentation to the user and communication from the PUA;
the processor being configured to gather research data from the sound data and from the media data and/or metadata of the media data.
5. The system of claim 4, wherein a communications is operative to communicate the research data to a research organization.
6. The system of claim 4, comprising a source of location data indicating a location of the PUA.
7. The system of claim 4, wherein the research data collector comprises at least one of a satellite location signal receiver, a terrestrial location signal receiver, a wireless networking device that receives location data from a network, an inertial location monitoring device and a location data producing service provided by a cellular telephone service provider.
8. The system of claim 4, wherein the source of location data comprises at least one of a device for monitoring exposure to print media, a device for determining whether the user is at home or out of home, a device for monitoring exposure to products, a device for monitoring exposure to displays, a device for monitoring presence within or near commercial establishments and a device for gathering research data.
9. The system of claim 4, comprising at least one of a motion detector, accelerometer, temperature detector, proximity detector, satellite positioning signal receiver, RFID reader, RF receiver, wireless networking transceiver, wireless device coupling transceiver, pressure detector, deformation detector, electric field sensor, magnetic field sensor, optical sensor, and electrode.
10. A system implemented in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprising:
a microphone operative to transduce acoustic energy to sound data;
a processor operative to process the sound data and media data received in non-acoustic form for at least one of presentation to the user and communication from the PUA;
storage coupled with the processor to store the sound data and the media data; and
a research data monitor coupled with the processor for gathering research data for the sound data and the media data.
11. The system of claim 10, wherein the research data monitor is affixed to an outer surface of the PUA.
12. The system of claim 10, wherein the research data monitor comprises:
a processor operative to process sound data and media data received in non-acoustic form for one of presentation to the user and communication from the PUA;
a research data collector coupled with the processor for gathering research data for the sound data and the media data; and
a communications coupled with the processor to receive the research data and operative to communicate the research data to a research organization;
13. The system of claim 12, wherein the processor comprises:
a first processing device for processing research data; and
a second processing device for exercising control over operation of the research data monitor.
14. The system of claim 12, wherein the research data collector comprises a microphone coupled with the processor for gathering research data to be communicated to a research organization.
15. The system of claim 12, wherein the research data collector comprises a keypad for enabling the user to input data.
16. The system of claim 12, wherein the research data monitor comprises an RF receiver.
17. The system of claim 12, wherein the research data monitor comprises a location data producing device for indicating a location of the monitor.
18. The system of claim 12, wherein the research data monitor comprises at least one of a device for monitoring exposure to print media, a device for determining whether the user is at home or out of home, a device for monitoring exposure to products, a device for monitoring exposure to displays, a device for monitoring presence within or near commercial establishments and a device for gathering research data.
19. The system of claim 12, wherein the research data monitor comprises at least one of a motion detector, accelerometer, temperature detector, proximity detector, satellite positioning signal receiver, RFID reader, RF receiver, wireless networking transceiver, wireless device coupling transceiver, pressure detector, deformation detector, electric field sensor, magnetic field sensor, optical sensor, and electrode.
20. The system of claim 12, wherein the research data monitor is fabricated on one of a printed circuit board and a flexible substrate.
21. The system of claim 12, further comprising a research data gathering device adapted to be carried on the person of the user and operative to gather research data.
22. The system of claim 21, wherein the research data gathering device is separate from the PUA.
23. The system of claim 21, wherein the research data gathering device is contained in the PUA.
24. The system of claim 1, wherein the PUA comprises one of a cellular telephone and a PDA.
25. The system of claim 4, wherein the PUA comprises one of a cellular telephone and a PDA.
26. The system of claim 10, wherein the PUA comprises one of a cellular telephone and a PDA.
27. A process carried out in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprising:
receiving first audio data from a first source;
receiving at least one of presentation data and metadata of presentation data from a second source;
producing first research data from the first audio data and second research data from the at least one presentation data and metadata of presentation data; and
storing the first research data and the second research data.
28. A process implemented in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprising:
transducing acoustic energy to sound data;
processing the sound data and media data received by the PUA in non-acoustic form for one of presentation to the user and communication from the PUA;
storing the sound data and the media data; and
gathering research data for the sound data and for the media data to be communicated to a research organization.
29. The process of claim 27, wherein the PUA comprises one of a cellular telephone and a PDA.
30. The process of claim 28, wherein the PUA comprises one of a cellular telephone and a PDA.
31. A method for gathering research data, comprising:
transducing acoustic energy to audio data;
receiving media data in non-acoustic form in a PUA; and
producing research data based on the audio data and based on the media data and/or metadata of the media data.
32. A system for gathering research data, comprising:
a PUA comprising a processor and first communications coupled with the processor;
the PUA being operative to receive media data in non-acoustic form via the first communications and to process the received media data for at least one of presentation to a user and communication from the PUA;
a research data gathering system coupled with or implemented by the processor and operative to gather research data based on the received media data and/or metadata of the media data; and
an acoustic transducer operative to receive acoustic energy and produce audio data therefrom;
the research data gathering system being coupled with the microphone to receive the audio data and operative to gather research data based on the audio data.
33. The system of claim 32, wherein the processor is coupled with the acoustic transducer to receive the audio data therefrom, and the research data gathering system is coupled with the processor to receive the audio data therefrom.
34. The system of claim 32, wherein the research data gathering system is coupled with the acoustic transducer to receive the audio data.
35. The system of claim 34, wherein the PUA is carried in a first housing and the research data gathering system and the acoustic transducer are carried in a second housing, and comprising second communications in the second housing coupled with the first communications to receive the media data and/or the metadata of the media data and coupled with the research data gathering system to supply the media data and/or the metadata of the media data thereto.
36. The system of claim 35, wherein the first and second communications are coupled by a wireless link.
37. The system of claim 32, wherein the research data gathering system and the acoustic transducer are implemented by the PUA.
Description
CROSS-RELATED APPLICATIONS

This application claims the benefit of U.S. provisional patent application No. 60/751,825, filed Dec. 20, 2005, in the names of Alan R. Neuhauser, Vijoy K. Gopalakrishnan, Jack C. Crystal, Jack K. Zhang, and Eugene L. Flanagan III.

BACKGROUND OF THE INVENTION

Consumers have many more options for obtaining and reproducing media now than in the past. In particular, portable devices provide multiple options for accessing and playing media, such as audio and video downloads, various types of media from web sites, and so on.

There is also a convergence of personal communications capabilities and multimedia options in a single portable device, such as a cellular telephone, a personal digital assistant, and the like. Increasingly, consumers are accessing and consuming media “on the go” and out-of-home using such portable devices, and as the quality of media presented by such devices is improved, it can be expected that such mobile consumption of media will increase.

These trends in media usage require new techniques for monitoring exposure to media, techniques that will enable data gathering encompassing various types of media and ways of presenting media to consumers.

It has been proposed to monitor exposure of consumers to audio media by incorporating monitoring software in a cellular telephone, making use of the cellular telephone's hardware, including its microphone, CPU, memory capacity and communications capabilities.

DISCLOSURE

For this application the following terms and definitions shall apply:

The term “data” as used herein means any indicia, signals, marks, symbols, domains, symbol sets, representations, and any other physical form or forms representing information, whether permanent or temporary, whether visible, audible, acoustic, electric, magnetic, electromagnetic or otherwise manifested. The term “data” as used to represent predetermined information in one physical form shall be deemed to encompass any and all representations of corresponding information in a different physical form or forms.

The terms “media data” and “media” as used herein mean data which is widely accessible, whether over-the-air, or via cable, satellite, network, internetwork (including the Internet), print, displayed, distributed on storage media, or by any other means or technique that is humanly perceptible, without regard to the form or content of such data, and including but not limited to audio, video, text, images, animations, databases, files, broadcasts, displays (including but not limited to video displays, posters and billboards), signs, signals, web pages, print media and streaming media data.

The term “presentation data” shall mean media data or content other than media data to be presented to a user.

The term “research data” as used herein means data comprising (1) data concerning usage of media, (2) data concerning exposure to media, and/or (3) market research data.

The terms “gather” and “gathering” as used herein include both directly gathering data with the use of a device as well as emitting data from a device that causes or enables another device to gather data.

The term “research operation” as used herein means an operation comprising gathering, storing and/or communicating research data.

The term “database” as used herein means an organized body of related data, regardless of the manner in which the data or the organized body thereof is represented. For example, the organized body of related data may be in the form of a table, a map, a grid, a packet, a datagram, a file, an e-mail, a message, a document, a list or in any other form.

The term “network” as used herein includes both networks and internetworks of all kinds, including the Internet, and is not limited to any particular network or internetwork.

The terms “first,” “second,” “primary,” and “secondary” are used herein to distinguish one element, set, data, object, step, process, function, action or thing from another, and are not used to designate relative position, arrangement in time or relative importance, unless otherwise stated explicitly.

The terms “coupled”, “coupled to”, and “coupled with” as used herein each mean a relationship between or among two or more devices, apparatus, files, circuits, elements, functions, operations, processes, programs, media, components, networks, systems, subsystems, and/or means, constituting any one or more of (a) a connection, whether direct or through one or more other devices, apparatus, files, circuits, elements, functions, operations, processes, programs, media, components, networks, systems, subsystems, or means, (b) a communications relationship, whether direct or through one or more other devices, apparatus, files, circuits, elements, functions, operations, processes, programs, media, components, networks, systems, subsystems, or means, and/or (c) a functional relationship in which the operation of any one or more devices, apparatus, files, circuits, elements, functions, operations, processes, programs, media, components, networks, systems, subsystems, or means depends, in whole or in part, on the operation of any one or more others thereof.

The terms “communicate”, and “communicating” as used herein include both conveying data from a source to a destination, and delivering data to a communications medium, system, channel, device, wire, cable, fiber, circuit or link to be conveyed to a destination, and the term “communication” as used herein means data so conveyed or delivered. The term “communications” as used herein includes one or more of a communications medium, system, channel, device, wire, cable, fiber, circuit and link.

The term “processor” as used herein means processing devices, apparatus, programs, circuits, components, systems and subsystems, whether implemented in hardware, software or both, and whether or not programmable. The term “processor” as used herein includes, but is not limited to computers, hardwired circuits, signal modifying devices and systems, devices and machines for controlling systems, central processing units, programmable devices, field programmable gate arrays, application specific integrated circuits, systems on a chip, systems comprised of discrete elements and circuits, state machines, virtual machines and combinations of any of the foregoing.

The terms “storage” and “data storage” as used herein mean data storage devices, apparatus, programs, circuits, components, systems, subsystems and storage media serving to retain data, whether on a temporary or permanent basis, and to provide such retained data.

The terms “panelist,” “panel member” and “participant” are interchangeably used herein to refer to a person who is, knowingly or unknowingly, participating in a study to gather information, whether by electronic, survey or other means, about that person's activity.

The term “household” as used herein is to be broadly construed to include family members, a family living at the same residence, a group of persons related or unrelated to one another living at the same residence, and a group of persons living within a common facility (of which the total number of unrelated persons does not exceed a predetermined number), such as a fraternity house, an apartment or other similar structure or arrangement.

The term “portable user appliance” (also referred to herein, for convenience, by the abbreviation “PUA”) as used herein means an electrical or non-electrical device capable of being carried by or on the person of a user or capable of being disposed on or in, or held by, a physical object (e.g., attaché, purse) capable of being carried by or on the user, and having at least one function of primary benefit to such user, including without limitation, a cellular telephone, a personal digital assistant (“PDA”), a Blackberry device, a radio, a television, a game system (e.g., a Gameboy® device), a notebook computer, a laptop computer, a GPS device, an iPod® device, a DVD player, a walkie talkie, a personal communications device, a telematics device, a remote control device, a wireless headset, a wristwatch, a portable data storage device (e.g., Thumb™ drive), a camera, a recorder, a keyless entry transmitter device, a ring, a comb, a pen, a pencil, a notebook, a wallet, a tool, an implement, a pair of glasses, an article of clothing, a belt, a belt buckle, a fob, an article of jewelry, an ornamental article, a pair of shoes or other foot garment (e.g., sandals), a jacket, and a hat, as well as any devices combining any of the foregoing or their functions.

The term “activation message” as used herein shall mean data comprising at least one of (1) an activation command for a PUA for activating a capability of the PUA to perform a research operation, (2) activation data for a PUA for enabling and/or providing a capability of the PUA to perform a research operation, (3) visual display data for a PUA including a message soliciting participation of a user of the PUA in a research operation, (4) activation request data for a PUA requesting activation, enablement or installation of a capability thereof to perform a research operation, (5) a message for a user of a PUA requesting an action thereof to activate, enable and/or install a capability of the PUA to perform a research operation, and/or providing instructions for participating in a research operation automatically by means of a PUA, (6) a message for a user of a PUA providing or offering to provide a benefit to the user in exchange for the user's participation in a research operation, and (7) a message to a PUA and/or a user of a PUA requesting communication of a participation message in response.

The term “maintenance message” as used herein shall mean data comprising at least one of (1) a test command for a PUA to control an operation thereof to test its operational status or ability to perform a research operation, (2) test data for a PUA to establish, enable or provide a capability thereof to test its operational status or ability to perform a research operation, (3) a message requesting a response from a user of a PUA identifying such user, and/or providing demographic or other user-specific data of the user, (4) a message requesting system data of the PUA, and (5) a command or request for a PUA to perform a research operation.

The term “termination message” as used herein shall mean data comprising at least one of: (1) a deactivation message for a PUA to deactivate a capability thereof to perform a research operation; (2) a deactivation message for a user of a PUA instructing them to deactivate a capability of the PUA to perform a research operation; and (3) providing a benefit to a person as a final consideration for the person's previous participation in a research operation, or notifying the person that such a benefit will be or has been provided.

The term “participation message” as used herein shall mean data comprising at least one of (1) research data gathered automatically by a PUA, (2) a message from a PUA indicating an operational status or ability thereof to perform a research operation, or providing results of a test of such operational status or ability, (3) a message from a user of a PUA concerning participation of the user in a research operation by means of a PUA, or ancillary to such participation, such as concerning a benefit provided to the user for such participation or indicating activation or deactivation of an ability of a PUA to perform a research operation, (4) a message from a user of a PUA identifying such user and/or providing demographic and/or other user-specific data of the user, (5) a message providing system data of the PUA, (6) a message from a benefit provider concerning a benefit provided or to be provided to a user of a PUA for participation in a research operation, such as a message indicating receipt of a benefit request or a termination message requesting a benefit, and (7) a message from a PUA indicating receipt thereby of an activation message, a maintenance message or a termination message.

Methods and systems are disclosed herein in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram of a PUA modified to carry out research operations;

FIG. 1A is a functional block diagram for use in explaining certain embodiments involving the use of the PUA of FIG. 1;

FIG. 2 is a block diagram of a PUA in communication with a research system;

FIG. 2A is an exploded view of a PUA with a research data monitor affixed thereto;

FIG. 2B is a block diagram illustrating the PUA of FIG. 2A coupled with the research data monitor thereof;

FIG. 2C is a block diagram of the research data monitor of FIGS. 2A and 2B;

FIG. 2D is a layout diagram of an embodiment of the research data monitor of FIGS. 2A, 2B and 2C;

FIG. 2E is a block diagram of a PUA communicating with the research data monitor of FIGS. 2A, 2B and 2C; and

FIG. 3 is a block diagram of a personal digital assistant (PDA) modified to carry out research operations.

FIG. 4 illustrates a signature extraction technique useful in certain embodiments of the present invention.

A system implemented in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprises a first input operative to receive first audio data from a first source, a second input operative to receive at least one of presentation data and metadata of presentation data from a second source, a processor coupled with the first input and being operative to produce first research data from the first audio data and coupled with the second input and being operative to produce second research data from the at least one of presentation data and metadata of presentation data, and storage coupled with the processor and operative to store the first research data and the second research data.

A system implemented in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprises a microphone operative to transduce acoustic energy to sound data, a processor operative to process the sound data and media data received in non-acoustic form for one of presentation to the user and communication from the PUA, the processor being configured to gather research data from the sound data and from the media data and/or metadata of the media data.

A system implemented in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprises a microphone operative to transduce acoustic energy to sound data, a processor operative to process the sound data and media data received in non-acoustic form for at least one of presentation to the user and communication from the PUA, storage coupled with the processor to store the sound data and the media data, and a research data monitor coupled with the processor for gathering research data for the sound data and the media data.

A process carried out in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprises receiving first audio data from a first source, receiving at least one of presentation data and metadata of presentation data from a second source, producing first research data from the first audio data and second research data from the at least one presentation data and metadata of presentation data, and storing the first research data and the second research data.

A process implemented in a PUA for gathering research data concerning exposure of a user of the PUA to data from multiple sources, comprises transducing acoustic energy to sound data, processing the sound data and media data received by the PUA in non-acoustic form for one of presentation to the user and communication from the PUA, storing the sound data and the media data, and gathering research data for the sound data and for the media data to be communicated to a research organization.

A method for gathering research data comprises transducing acoustic energy to audio data; receiving media data in non-acoustic form in a PUA; and producing research data based on the audio data and based on the media data and/or metadata of the media data.

A system for gathering research data comprises a PUA comprising a processor and first communications coupled with the processor; the PUA being operative to receive media data in non-acoustic form via the first communications and to process the received media data for at least one of presentation to a user and communication from the PUA; a research data gathering system coupled with or implemented by the processor and operative to gather research data based on the received media data and/or metadata of the media data; and an acoustic transducer operative to receive acoustic energy and produce audio data therefrom; the research data gathering system being coupled with the microphone to receive the audio data and operative to gather research data based on the audio data.

Numerous types of research operations are possible, including, without limitation, television and radio program audience measurement; exposure to advertising in various media, such as television, radio, print and outdoor advertising, among others; consumer spending habits; consumer shopping habits including the particular retail stores and other locations visited during shopping and recreational activities; travel patterns, such as the particular routes taken between home and work, and other locations; consumer attitudes, awareness and preferences; and so on. For the desired type of media and/or market research operation to be conducted, particular activity of individuals is monitored, or data concerning their attitudes, awareness and/or preferences is gathered. In certain embodiments research data relating to two or more of the foregoing are gathered, while in others only one kind of such data is gathered.

Various monitoring techniques are suitable. For example, television viewing or radio listening habits, including exposure to commercials therein, are monitored utilizing a variety of techniques. In certain techniques, acoustic energy to which an individual is exposed is monitored to produce data which identifies or characterizes a program, song, station, channel, commercial, etc. that is being watched or listened to by the individual. Where audio media includes ancillary codes that provide such information, suitable decoding techniques are employed to detect the encoded information, such as those disclosed in U.S. Pat. No. 5,450,490 and No. 5,764,763 to Jensen, et al., U.S. Pat. No. 5,579,124 to Aijala, et al., U.S. Pat. Nos. 5,574,962, 5,581,800 and 5,787,334 to Fardeau, et al., U.S. Pat. No. 6,871,180 to Neuhauser, et al., U.S. Pat. No. 6,862,355 to Kolessar, et al., U.S. Pat. No. 6,845,360 to Jensen, et al., U.S. Pat. No. 5,319,735 to Preuss et al., U.S. Pat. No. 5,687,191 to Lee, et al., U.S. Pat. No. 6,175,627 to Petrovich et al., U.S. Pat. No. 5,828,325 to Wolosewicz et al., U.S. Pat. No. 6,154,484 to Lee et al., U.S. Pat. No. 5,945,932 to Smith et al., US 2001/0053190 to Srinivasan, US 2003/0110485 to Lu, et al., U.S. Pat. No. 5,737,025 to Dougherty, et al., US 2004/0170381 to Srinivasan, and WO 06/14362 to Srinivasan, et al., all of which hereby are incorporated by reference herein.

Examples of techniques for encoding ancillary codes in audio, and for reading such codes, are provided in Bender, et al., “Techniques for Data Hiding”, IBM Systems Journal, Vol. 35, Nos. 3 & 4, 1996, which is incorporated herein in its entirety. Bender, et al. disclose a technique for encoding audio termed “phase encoding” in which segments of the audio are transformed to the frequency domain, for example, by a discrete Fourier transform (DFT), so that phase data is produced for each segment. Then the phase data is modified to encode a code symbol, such as one bit. Processing of the phase encoded audio to read the code is carried out by synchronizing with the data sequence, and detecting the phase encoded data using the known values of the segment length, the DFT points and the data interval.

Bender, et al. also describe spread spectrum encoding and decoding, of which multiple embodiments are disclosed in the above-cited Aijala, et al. U.S. Pat. No. 5,579,124.

Still another audio encoding and decoding technique described by Bender, et al. is echo data hiding in which data is embedded in a host audio signal by introducing an echo. Symbol states are represented by the values of the echo delays, and they are read by any appropriate processing that serves to evaluate the lengths and/or presence of the encoded delays.

A further technique, or category of techniques, termed “amplitude modulation” is described in R. Walker, “Audio Watermarking”, BBC Research and Development, 2004. In this category fall techniques that modify the envelope of the audio signal, for example by notching or otherwise modifying brief portions of the signal, or by subjecting the envelope to longer term modifications. Processing the audio to read the code can be achieved by detecting the transitions representing a notch or other modifications, or by accumulation or integration over a time period comparable to the duration of an encoded symbol, or by another suitable technique.

Another category of techniques identified by Walker involves transforming the audio from the time domain to some transform domain, such as a frequency domain, and then encoding by adding data or otherwise modifying the transformed audio. The domain transformation can be carried out by a Fourier, DCT, Hadamard, Wavelet or other transformation, or by digital or analog filtering. Encoding can be achieved by adding a modulated carrier or other data (such as noise, noise-like data or other symbols in the transform domain) or by modifying the transformed audio, such as by notching or altering one or more frequency bands, bins or combinations of bins, or by combining these methods. Still other related techniques modify the frequency distribution of the audio data in the transform domain to encode. Psychoacoustic masking can be employed to render the codes inaudible or to reduce their prominence. Processing to read ancillary codes in audio data encoded by techniques within this category typically involves transforming the encoded audio to the transform domain and detecting the additions or other modifications representing the codes.

A still further category of techniques identified by Walker involves modifying audio data encoded for compression (whether lossy or lossless) or other purpose, such as audio data encoded in an MP3 format or other MPEG audio format, AC-3, DTS, ATRAC, WMA, RealAudio, Ogg Vorbis, APT X100, FLAC, Shorten, Monkey's Audio, or other. Encoding involves modifications to the encoded audio data, such as modifications to coding coefficients and/or to predefined decision thresholds. Processing the audio to read the code is carried out by detecting such modifications using knowledge of predefined audio encoding parameters.

It will be appreciated that various known encoding techniques may be employed, either alone or in combination with the above-described techniques. Such known encoding techniques include, but are not limited to FSK, PSK (such as BPSK), amplitude modulation, frequency modulation and phase modulation.

In some cases a signature is extracted from transduced media data for identification by matching with reference signatures of known media data. Suitable techniques for this purpose include those disclosed in U.S. Pat. No. 5,612,729 to Ellis, et al. and in U.S. Pat. No. 4,739,398 to Thomas, et al., each of which is assigned to the assignee of the present application and both of which are incorporated herein by reference in their entireties.

Still other suitable techniques are the subject of U.S. Pat. No. 2,662,168 to Scherbatskoy, U.S. Pat. No. 3,919,479 to Moon, et al., U.S. Pat. No. 4,697,209 to Kiewit, et al., U.S. Pat. No. 4,677,466 to Lert, et al., U.S. Pat. No. 5,512,933 to Wheatley, et al., U.S. Pat. No. 4,955,070 to Welsh, et al., U.S. Pat. No. 4,918,730 to Schulze, U.S. Pat. No. 4,843,562 to Kenyon, et al., U.S. Pat. No. 4,450,551 to Kenyon, et al., U.S. Pat. No. 4,230,990 to Lert, et al., U.S. Pat. No. 5,594,934 to Lu, et al., European Published Patent Application EP 0887958 to Bichsel and PCT publication WO91/11062 to Young, et al., all of which are incorporated herein by reference in their entireties.

An advantageous signature extraction technique transforms audio data within a predetermined frequency range to the frequency domain by a transform function, such as an FFT. The FFT data from an even number of frequency bands (for example, eight, ten, sixteen or thirty two frequency bands) spanning the predetermined frequency range are used two bands at a time during successive time intervals. FIG. 4 provides an example of how pairs of the bands are selected during successive time intervals where the total number of bands used is equal to ten. The selected bands are indicated by an “X”.

When each band is selected, the energy values of the FFT bins within such band and such time interval are processed to form one bit of the signature. If there are ten FFT's for each interval of the audio signal, for example, the values of all bins of such band within the first five FFT's are summed to form a value “A” and the values of all bins of such band within the last five FFT's are summed to form a value “B”. In the case of a received broadcast audio signal, the value A is formed from portions of the audio signal that were broadcast prior to those used to form the value B.

To form a bit of the signature, the values A and B are compared. If B is greater than A, the bit is assigned a value “1” and if A is greater than or equal to B, the bit is assigned a value of “0”. Thus, during each time interval, two bits of the signature are produced.

One advantageous technique carries out either or both of code detection and signature extraction remotely from the location where the research data is gathered, as disclosed in US Published Patent Application 2003/0005430 published Jan. 2, 2003 to Ronald S. Kolessar, which is assigned to the assignee of the present application and is hereby incorporated herein by reference in its entirety.

If location tracking or exposure to outdoor advertising is carried out, then various techniques for doing so are employed. Suitable techniques for location tracking or monitoring exposure to outdoor advertising are disclosed in U.S. Pat. No. 6,958,710 in the names of Jack K. Zhang, Jack C. Crystal, and James M. Jensen, issued Oct. 25, 2005, and US Published Patent Application 2005/0035857 A1 published Feb. 17, 2005 in the names of Jack K. Zhang, Jack C. Crystal, James M. Jensen and Eugene L. Flanagan III, filed Aug. 13, 2003, all of which are assigned to the assignee of the present application and hereby incorporated by reference herein in their entireties.

Where usage of publications, such as periodicals, books, and magazines, is monitored, suitable techniques for doing so are employed, such as those disclosed in U.S. patent application Ser. No. 11/084,481 in the names of James M. Jensen, Jack C. Crystal, Alan R. Neuhauser, Jack Zhang, Daniel W. Pugh, Douglas J. Visnius, and Eugene L. Flanagan III, filed Mar. 18, 2005, which is assigned to the assignee of the present application and hereby incorporated by reference herein in its entirety.

In addition to those types of research data mentioned above and the various techniques identified for gathering such types of data, other types of research data may be gathered and other types of techniques may be employed. For example, research data relating to consumer purchasing conduct, consumer product return conduct, exposure of consumers to products and presence and/or proximity to commercial establishments may be gathered, and various techniques for doing so may be employed. Suitable techniques for gathering data concerning presence and/or proximity to commercial establishments are disclosed in US Published Patent Application 2005/0200476 A1 published Sep. 15, 2005 in the names of David Patrick Forr, James M. Jensen, and Eugene L. Flanagan III, filed Mar. 15, 2004, and in US Published Patent Application 2005/0243784 A1 published Nov. 3, 2005 in the names of Joan Fitzgerald, Jack Crystal, Alan Neuhauser, James M. Jensen, David Patrick Forr, and Eugene L. Flanagan III, filed Mar. 29, 2005. Suitable techniques for gathering data concerning exposure of consumers to products are disclosed in US Published Patent Application 2005/0203798 A1 published Sep. 15, 2005 in the names of James M. Jensen and Eugene L. Flanagan III, filed Mar. 15, 2004.

Moreover, techniques involving the active participation of the panel members may be used in research operations. For example, surveys may be employed where a panel member is asked questions utilizing the panel member's PUA after recruitment. Thus, it is to be understood that both the exemplary types of research data to be gathered discussed herein and the exemplary manners of gathering research data as discussed herein are illustrative and that other types of research data may be gathered and that other techniques for gathering research data may be employed.

Various PUA's already have capabilities sufficient to enable the implementation of the desired monitoring technique or techniques to be employed during the research operation. As an example, cellular telephones have microphones which convert acoustic energy into audio data. Various cellular telephones further have processing and storage capability.

In certain embodiments, various existing PUA's are modified merely by software and/or minor hardware changes to carry out a research operation. In certain other embodiments, PUA's are redesigned and substantially reconstructed for this purpose. In certain embodiments the PUA is coupled with a separate research data gathering system and provides operations ancillary or complementary thereto.

In certain embodiments, the PUA itself is operative to gather research data. In certain embodiments, the PUA emits data that causes another device to gather research data. Such embodiments include various embodiments disclosed in U.S. Pat. No. 6,958,710 and in U.S. patent application Ser. No. 11/084,481, referenced above. In certain embodiments, the PUA is operative both to gather research data and to emit data that causes another device to gather research data.

FIG. 1 is a block diagram of a PUA 20 (such as a cellular telephone or other data processing and communicating device) modified to carry out a research operation. The PUA 20 comprises a processor 30 that is operative to exercise overall control and to process audio and other data for transmission or reception and communications 40 coupled to the processor 30 and operative under the control of processor 30 to perform those functions required for establishing and maintaining a two-way wireless communication link with a PUA network. In certain embodiments, processor 30 also is operative to execute applications ancillary or unrelated to the conduct of PUA communications, such as applications serving to download audio and/or video data to be reproduced by PUA 20, e-mail clients and applications enabling the user to play games using the PUA 20. In certain embodiments, processor 30 comprises two or more processing devices, such as a first processing device (such as a digital signal processor) that processes audio, and a second processing device that exercises overall control over operation of the PUA 20. In certain embodiments, processor 30 employs a single processing device. In certain embodiments, some or all of the functions of processor 30 are implemented by hardwired circuitry.

PUA 20 further comprises storage 50 coupled with processor 30 and operative to store data as needed. In certain embodiments, storage 50 comprises a single storage device, while in others it comprises multiple storage devices. In certain embodiments, a single device implements certain functions of both processor 30 and storage 50.

In addition, PUA 20 comprises a microphone 60 coupled with processor 30 to transduce the user's voice to an electrical signal which it supplies to processor 30 for encoding, and a speaker and/or earphone 70 coupled with processor 30 to transduce received audio from processor 30 to an acoustic output to be heard by the user. PUA 20 also includes a user input 80 coupled with processor 30, such as a keypad, to enter telephone numbers and other control data, as well as a display 90 coupled with processor 30 to provide data visually to the user under the control of processor 30.

In certain embodiments, the PUA 20 provides additional functions and/or comprises additional elements. In certain ones of such embodiments, the PUA 20 provides e-mail, text messaging and/or web access through its wireless communications capabilities, providing access to media and other content. For example, Internet access by the PUA 20 enables access to video and/or audio content that can be reproduced by the cellular telephone for the user, such as songs, video on demand, video clips and streaming media. In certain embodiments, storage 50 stores software providing audio and/or video downloading and reproducing functionality, such as iPod® software, enabling the user to reproduce audio and/or video content downloaded from a source, such as a personal computer via communications 40 or through direct Internet access via communications 40.

To enable PUA 20 to gather research data, namely, data indicating exposure to audio such as programs, music and advertisements, in certain embodiments research software is installed in storage 50 to control processor 30 to gather such data and communicate it via communications 40 to a research organization. The research software in certain embodiments also controls processor 30 to store the data for subsequent communication.

In certain embodiments, the research software controls the processor 30 to decode ancillary codes in the transduced audio from microphone 60 using one or more of the known techniques identified hereinabove, and then to store and/or communicate the decoded data for use as research data indicating encoded audio to which the user was exposed. In certain embodiments, the research software controls the processor 30 to extract signatures from the transduced audio from microphone 60 using one or more of the known techniques identified hereinabove, and then to store and/or communicate the extracted signature data for use as research data to be matched with reference signatures representing known audio to detect the audio to which the user was exposed. In certain embodiments, the research software both decodes ancillary codes in the transduced audio and extracts signatures therefrom for identifying the audio to which the user was exposed. In certain embodiments, the research software controls the processor 30 to store samples of the transduced audio, either in compressed or uncompressed form for subsequent processing either to decode ancillary codes therein or to extract signatures therefrom. In certain ones of these embodiments, the compressed or uncompressed audio is communicated to a remote processor for decoding and/or signature extraction.

Where the PUA 20 possesses functionality to download and/or reproduce presentation data, in certain embodiments research data concerning the usage and/or exposure to such presentation data as well as audio data received acoustically by microphone 60, is gathered by PUA 20 in accordance with the technique illustrated by the functional block diagram of FIG. 1A. Storage 50 of FIG. 1 implements an audio buffer 54 for audio data gathered with the use of microphone 60. In certain ones of these embodiments storage 50 implements a buffer 56 for presentation data downloaded and/or reproduced by PUA 20 to which the user is exposed via speaker and/or earphone 70 or display 90, or by means of a device coupled with PUA 20 to receive the data therefrom to present it to a user. In some of such embodiments, the reproduced data is obtained from downloaded data, such as songs, web pages or audio/video data (e.g., movies, television programs, video clips). In some of such embodiments, the reproduced data is provided from a device such as a broadcast or satellite radio receiver of the PUA 20 (not shown for purposes of simplicity and clarity). In certain ones of these embodiments storage 50 implements a buffer 56 for metadata of presentation data reproduced by PUA 20 to which the user is exposed via speaker and/or earphone 70 or display 90, or by means of a device coupled with PUA 20 to receive the data therefrom to present it to a user. Such metadata can be, for example, a URL from which the presentation data was obtained, channel tuning data, program identification data, an identification of a prerecorded file from which the data was reproduced, or any data that identifies and/or characterizes the presentation data, or a source thereof. Where buffer 56 stores audio data, buffers 54 and 56 store their audio data (either in the time domain or the frequency domain) independently of one another. Where buffer 56 stores metadata of audio data, buffer 54 stores its audio data (either in the time domain or the frequency domain) and buffer 56 stores its metadata, each independently of the other.

Processor 30 separately produces research data 58 from the contents of each of buffers 54 and 56 which it stores in storage 50. In certain ones of these embodiments, one or both of buffers 54 and 56 is/are implemented as circular buffers storing a predetermined amount of audio data representing a most recent time interval thereof as received by microphone 60 and/or reproduced by speaker and/or earphone 70, or downloaded by PUA 20 for reproduction by a different device coupled with PUA 20. Processor 30 extracts signatures and/or decodes ancillary codes in the buffered audio data to produce research data. Where metadata is received in buffer 56, in certain embodiments the metadata is used, in whole or in part, as research data 58, or processed to produce research data 58. The research data is thus gathered representing exposure to and/or usage of audio data by the user where audio data is received in acoustic form by the PUA 20 and where presentation data is received in non-acoustic form (for example, as a cellular telephone communication, as an electrical signal via a cable from a personal computer or other device, as a broadcast or satellite signal or otherwise).

In certain embodiments, the PUA 20 is provided with a research data source 96 coupled by a wired or wireless coupling with processor 30 for use in gathering further or alternative research data to be communicated to a research organization. In certain ones of these embodiments, the research data source 96 comprises a location data producing device or function providing data indicating a location of the PUA 20. Various devices appropriate for use as source 96 include a satellite location signal receiver, a terrestrial location signal receiver, a wireless networking device that receives location data from a network, an inertial location monitoring device and a location data producing service provided by a PUA service provider. In certain embodiments, research data source 96 comprises a device or function for monitoring exposure to print media, for determining whether the user is at home or out of home, for monitoring exposure to products, exposure to displays (such as outdoor advertising), presence within or near commercial establishments, or for gathering research data (such as consumer attitude, preference or opinion data) through the administration of a survey to the user of the PUA 20. In certain embodiments, research data source 96 comprises one or more devices for receiving, sensing or detecting data useful in implementing one or more of the foregoing functions, other research data gathering functions and/or for producing data ancillary to functions of gathering, storing and/or communicating research data, such as data indicating whether the panelist has complied with predetermined rules governing the activity or an extent of such compliance. Such devices include, but are not limited to, motion detectors, accelerometers, temperature detectors, proximity detectors, satellite positioning signal receivers, RFID readers, RF receivers, wireless networking transceivers, wireless device coupling transceivers, pressure detectors, deformation detectors, electric field sensors, magnetic field sensors, optical sensors, electrodes, and the like.

FIG. 2 illustrates PUA 20 coupled by its communications 40 with communications 110 of a research system 100 comprising a microphone 120, a processor 130 coupled with microphone 120 and with communications 110 by a wired or wireless link. Research system 100 in certain embodiments comprises storage 140 coupled with processor 130.

In certain embodiments research system 100 is housed separately from PUA 20 and is physically separated therefrom, but both are carried on the person of a panelist. In certain embodiments, research system 100 is housed separately from PUA 20 but is either (1) affixed to an exterior surface thereof, (2) carried by or in a common container or carriage device with PUA 20, (3) carried by or in a cover of PUA 20 (such as a decorative “skin”), or (4) arranged to contain PUA 20. In certain embodiments, PUA 20 and research system 100 are contained by a common housing.

In certain ones of such embodiments, processor 130 of research system 100 serves to read ancillary codes and/or extract signatures from audio data transduced by the microphone 120. Certain ones of these embodiments communicate the ancillary codes that have been read and/or the signatures that have been extracted to the PUA 20 by communications 110 for storage and/or communication from the PUA.

In certain ones of these embodiments, storage 140 serves to store the ancillary codes and/or signatures for subsequent communication to the PUA 20.

In certain ones of such embodiments, research system 100 serves to store audio data transduced by the microphone 120 in storage 140, and subsequently communicates the audio data to PUA 20 via communications 110. PUA 20 processes the audio data as described hereinabove to produce research data therefrom.

In certain ones of such embodiments, research system 100 receives audio data from PUA 20 via communications 110 and processor 130 serves to produce research data from the audio data which either is stored in storage 140 and subsequently communicated to PUA 20 by communications 110 or communicated thereby without prior storage in research system 100.

In certain ones of such embodiments, processor 130 of research system 100 receives presentation data and/or metadata of the presentation data from PUA 20 via communications 110 and processes the presentation data and/or metadata to produce research data therefrom. Such presentation data and metadata is received by PUA 20 in a form other than acoustic data such as electrical or electromagnetic data. Research system 100 either stores such research data in storage 140 and subsequently communicates it to PUA 20 by communications 110, or communicates the research data to PUA 20 by communications 110 without prior storage in research system 100.

In certain embodiments of research system 100, processor 130 adds a time and/or date stamp to research data, media data, presentation data or metadata of one of the foregoing received, produced, stored or communicated thereby.

In certain ones of such embodiments, research system 100 receives audio data, presentation data and/or metadata of one of the foregoing from PUA 20 via communications 110 and stores the received data in storage 140. Subsequently, system 100 reads the stored data from storage 140 and communicates it to PUA 20 which either processes it to produce research data therefrom or communicates it to a processing facility for producing research data.

In certain ones of the foregoing embodiments, PUA 20 gathers media data research data from media data received thereby in non-acoustic form and/or metadata of such media data. PUA 20 either stores such media data research data and later communicates it to a research organization via communications 40, or communicates it without first storing it. In certain ones of such embodiments, PUA 20 receives audio data research data from system 100 produced thereby from audio data, and communicates the audio data research data to a research organization via communications 40. In certain ones of such embodiments, PUA 20 combines the audio data research data and the media data research data for communication to a research organization via communications 40.

FIG. 2A illustrates a research data monitor 72 affixed to an outer surface 21 of a PUA 20A, wherein the monitor 72 is operative in certain embodiments to gather research data and communicate it to PUA 20A. PUA 20A is illustrated in the block diagram of FIG. 2B. In certain embodiments, monitor 72 implements one or more of the research operations described above in connection with FIG. 2. As shown in FIG. 2B, PUA 20A comprises the same elements as PUA 20 of FIG. 1, except that research data source 96 is omitted from the embodiment of FIG. 2B.

Research data monitor 72 is illustrated in the block diagram of FIG. 2C. The research data monitor 72 comprises a processor 74 that is operative to exercise overall control of the monitor 72 and to process data for transmission or reception and communications 82 coupled to the processor 74 and operative under the control of processor 74 to perform those functions required for conducting communications with PUA 20A. In certain embodiments, processor 74 comprises two or more processing devices, such as a first processing device (such as a digital signal processor) that processes research data, such as audio data, and a second processing device that exercises overall control over operation of the monitor 72. In certain embodiments, processor 74 employs a single processing device. In certain embodiments, some or all of the functions of processor 74 are implemented by software, while in other embodiments, the functions of processor 74 are implemented in hardwired circuitry without the use of software.

In certain embodiments, communications 82 establishes and maintains a wireless communication link with communications 40 of PUA 20A, using a Bluetooth™ protocol, a ZigBee™ protocol, an inductive link, a capacitive link, an RF link, infrared link, or otherwise. In certain embodiments, communications 82 communicates with communications 40 using a wired link, such as a USB interface, a Firewire® interface, a connection to a plug or jack of the PUA 20A or an internal connection to PUA 20A.

Research data monitor 72 further comprises a research data source 76 coupled with processor 74. In certain embodiments, research data monitor 72 comprises a microphone that serves to transduce acoustic energy for processing by processor 74 to produce research data. In certain embodiments, research data source 76 comprises a keypad that enables the user to input data, such as channel or station data, user identification data or another kind of research data. In certain embodiments, monitor 72 comprises an RF receiver and/or infrared radiation detector. In certain embodiments, monitor 72 comprises a location data producing device or function providing data indicating a location of the monitor 72. Various devices appropriate for use as research data source 76 include a satellite location signal receiver, a terrestrial location signal receiver, a wireless networking device that receives location data from a network, an inertial location monitoring device and a location data producing service provided by a PUA service provider. In certain embodiments, monitor 76 comprises a device or function for monitoring exposure to print media, for determining whether the user is at home or out of home, for monitoring exposure to products, exposure to displays (such as outdoor advertising), presence within or near commercial establishments, or for gathering research data (such as consumer attitude, preference or opinion data) through the administration of a survey to the user of the PUA 20A. In certain embodiments, monitor 76 comprises one or more devices for receiving, sensing or detecting data useful in implementing one or more of the foregoing functions, other research data gathering functions and/or for producing data ancillary to functions of gathering, storing and/or communicating research data, such as data indicating whether the panelist has complied with predetermined rules governing the activity or an extent of such compliance. Such devices include, but are not limited to, motion detectors, accelerometers, temperature detectors, proximity detectors, satellite positioning signal receivers, RFID readers, RF receivers, wireless networking transceivers, wireless device coupling transceivers, pressure detectors, deformation detectors, electric field sensors, magnetic field sensors, optical sensors, electrodes, and the like.

Monitor 72 further comprises storage 78 coupled with processor 74 and operative to store data as needed. In certain embodiments, storage 78 comprises a single storage device, while in others it comprises multiple storage devices. In certain embodiments, a single device implements certain functions of both processor 74 and storage 78.

FIG. 2D illustrates an embodiment of research data monitor 79 fabricated on a substrate 83, such as a printed circuit board or a flexible substrate comprising paper, plastic or the like, on which certain elements of monitor 72 are printed on substrate 83. Power source 86 comprises a battery (either rechargeable or non-rechargeable) or a charge storage device such as a capacitor, printed on substrate 83. In the embodiment of FIG. 2D, communications 82 comprises an RF transceiver, such as a Bluetooth™ transceiver, a ZigBee™ transceiver or other RF transceiver. An antenna 92 is printed on substrate 83 and coupled with communications 82. It will be appreciated that monitor 72 can be fabricated to have a very thin profile and very low weight, so that it may be affixed to the enclosure of a cellular telephone, a PDA or other PUA that is carried on the person of a participant, without adding substantially to its size or weight. In certain embodiments, the monitor 72 is carried by a cover for the PUA (such as a decorative “skin”). In certain embodiments, monitor 72 is housed in or carried by a device separate from the PUA and adapted to be carried with the person of a panelist who carries the PUA.

FIG. 2E is a block diagram of a PUA comprising a personal communication device adapted to be carried on the person of a participant (such as a PDA, Blackberry® device, pager, notebook computer, walkie talkie, or the like) having a processor 94, and communications 95, user data source 96 and storage 97 coupled with processor 94. A research data gathering device 72, adapted to be carried on the person of a participant, is operative to gather research data and communicate the same wirelessly to communications 95 of the personal communication device for subsequent communication by the personal communication device to a research data processing facility. In certain embodiments, the research data gathering device 72 is separate from the personal communication device, so that it is carried by the participant separately therefrom. In certain ones of such embodiments, the device 72 is contained in a PUA such as an article of jewelry, an article of clothing, a fob, a wristwatch or other PUA. In certain ones of such embodiments, the device 72 is contained in its own enclosure and is carried on a lanyard to be worn about the participant's neck or provided with a pin, clasp or belt clip for attachment to an article of the participant's clothing.

FIG. 3 is a block diagram of a personal digital assistant (PDA) 300 modified to gather research data. The PDA comprises a processor 310 that is operative to exercise overall control and to process data for, among other purposes, transmission or reception by the PDA and communications 320 coupled to the processor 310 and operative under the control of processor 310 to perform those functions required for establishing and maintaining two-way communications over a network (not shown for purposes of simplicity and clarity).

In certain embodiments, processor 310 comprises two or more processing devices, such as a first processing device that exercises overall control over operation of the PDA 300 and a second processing device that performs certain more specific operations such as digital signal processing. In certain embodiments, processor 310 employs a single processing device. In certain embodiments, some or all of the functions of processor 310 are implemented by hardwired circuitry.

PDA 300 further comprises storage 330 coupled with processor 310 and operative to store software that runs on processor 310, as well as temporary data as needed. In certain embodiments, storage 330 comprises a single storage device, while in others it comprises multiple storage devices. In certain embodiments, a single device implements certain functions of both processor 310 and storage 330.

PDA 300 also includes a user input 340 coupled with processor 310, such as a keypad, to enter commands and data, as well as a display 350 coupled with processor 310 to provide data visually to the user under the control of processor 310.

In certain embodiments, the PDA 300 provides additional functions and/or comprises additional elements. In certain embodiments, PDA 300 provides cellular telephone functionality, and comprises a microphone 370, as well as an ability of communications 320 to communicate wirelessly with a cell of a cellular telephone network, to enable its operation as a cellular telephone. Where PDA 300 possesses cellular telephone functionality, in certain embodiments PDA 300 is employed to gather, store and/or communicate research data, such as by storing appropriate research software in storage 330 to run on processor 310.

In certain embodiments, communications 320 of PDA 300 provides wireless communications via Bluetooth protocol, ZigBee™ protocol, wireless LAN protocol, infrared data link, inductive link or the like, to a network, network host or other device, and/or through a cable to such a network, network host or other device. In such embodiments, PDA 300 is employed to gather, store and/or communicate research data, such as by storing appropriate research software in storage 330 to run on processor 310.

In certain embodiments, the PDA is provided with a research data source 360 coupled by a wired or wireless coupling with processor 310 for use in gathering further or alternative research data to be communicated to a research organization. In certain ones of these embodiments, the research data source 360 comprises a location data producing device or function providing data indicating a location of the PDA 300. Various devices appropriate for use as source 360 include a satellite location signal receiver, a terrestrial location signal receiver, a wireless networking device that receives location data from a network, an inertial location monitoring device and a location data producing service provided by a cellular telephone service provider. In certain ones of these embodiments, research data source 360 comprises a device or function for monitoring exposure to print media, for determining whether the user is at home or out of home, for monitoring exposure to products, exposure to displays (such as outdoor advertising) presence within or near commercial establishments, or for gathering research data (such as consumer attitude, preference or opinion data) through the administration of a survey to the user of the PDA 300. In certain ones of these embodiments, research data source 360 comprises one or more devices for receiving, sensing or detecting data useful in implementing one or more of the foregoing functions, other research data gathering functions and/or for producing data ancillary to functions of gathering, storing and/or communicating research data, such as data indicating whether the panelist has complied with predetermined rules governing the activity or an extent of such compliance. Such devices include, but are not limited to, motion detectors, accelerometers, temperature detectors, proximity detectors, satellite positioning signal receivers, RFID readers, RF receivers, wireless networking transceivers, wireless device coupling transceivers, pressure detectors, deformation detectors, electric field sensors, magnetic field sensors, optical sensors, electrodes, and the like.

In addition, PDA 300 comprises a microphone 370 coupled with processor 310 to transduce the user's voice to an electrical signal which it supplies to processor 310 for encoding, and a speaker and/or earphone 380 coupled with processor 310 to transduce received audio from processor 310 to an acoustic output to be heard by the user. PDA 300 also includes a user input 340 coupled with processor 310, such as a keypad, to enter telephone numbers and other control data, as well as a display 350 coupled with processor 310 to provide data visually to the user under the control of processor 310.

In addition, PDA 300 comprises a personal communication device adapted to be carried on the person of a participant having a processor 310, and communications 320, and storage 330 coupled with processor 310. A research data source 360, adapted to be carried on the person of a participant, is operative to gather research data and communicate the same wirelessly to communications 320 of the personal communication device for subsequent communication by the personal communication device to a research data processing facility. In certain embodiments, research data source 360 comprises a microphone for receiving ambient acoustic energy and producing a corresponding electrical signal that is processed either by research data source 360 to read ancillary codes therein or extract signatures therefrom, or is instead processed for doing so by processor 310. In certain embodiments, the research data source 360 is separate from the personal communication device, so that it is carried by the participant separately therefrom. In certain ones of such embodiments, the research data source 360 is contained in a PUA such as an article of jewelry, an article of clothing, a fob, a wristwatch or other PUA. In certain ones of such embodiments, the research data source 360 is contained in its own enclosure and is carried on a lanyard to be worn about the participant's neck or provided with a pin, clasp or belt clip for attachment to an article of the participant's clothing.

In certain embodiments, a presentation device 390 may be coupled with processor 310 for communicating presentation data and/or metadata. Subsequently the system reads the stored data from storage 330 and communicates it to PDA 300, via communications 320, which either processes it to produce research data therefrom or communicates it to a processing facility for producing research data. Presentation data may include data which is widely accessible over-the-air, or via cable, satellite, network, internetwork (including the Internet), print, displayed, distributed on storage media, or by any other means or technique that is humanly perceptible, without regard to the form or content of such data, and including but not limited to audio, video, text, images, animations, databases, files, broadcasts, displays (including but not limited to video displays, posters and billboards), signs, signals, web pages, print media and streaming media data.

Various illustrative PUA's are presented herein, such as cellular telephones, PDA's, portable storage devices, pens, and notebook computers. As previously discussed, however, many different types of devices, electronic and non-electronic, may be employed as a PUA in accordance with various embodiments described herein. For example, a belt buckle, ring, watch, shoe, etc., may be retrofitted with technology that implements a designated secondary function to enable the gathering of research data. Thus, the scope hereof is not limited to devices that have technical features or technical capabilities as their primary or only function.

In general, the embodiments described herein employ PUA's for the purpose of carrying out research operations, which are also the kinds of devices or articles that individuals have already freely chosen to use or carry for other purposes beneficial to them. Hence, recruited panel members are not burdened with the task of carrying around a device that they would otherwise not carry around. Moreover, in many embodiments, implementation of the research operation by the user's PUA is transparent to the user.

Although various embodiments have been described with reference to a particular arrangement of parts, features and the like, these are not intended to exhaust all possible arrangements or features, and indeed many other embodiments, modifications and variations will be ascertainable to those of skill in the art.

Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US5848396 *Apr 26, 1996Dec 8, 1998Freedom Of Information, Inc.Method and apparatus for determining behavioral profile of a computer user
US20060074883 *Oct 5, 2004Apr 6, 2006Microsoft CorporationSystems, methods, and interfaces for providing personalized search and information access
US20100115060 *Oct 23, 2009May 6, 2010Luc JuliaSystem and method for delivering content to users on a network
Non-Patent Citations
Reference
1 *Julia et al., Provisional App. 60/641,342, filed Jan. 3, 2005
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US8014726May 31, 2007Sep 6, 2011The Nielsen Company (U.S.), LlcMethod and system for collecting wireless information transparently and non-intrusively
US8181848Sep 1, 2006May 22, 2012The Nielsen Company (Us), LlcMethods and apparatus for metering printed media
US8555304Jun 18, 2012Oct 8, 2013The Nielsen Company (Us), LlcMethods and apparatus to collect audience information associated with a media presentation
US8738763Nov 6, 2007May 27, 2014The Nielsen Company (Us), LlcResearch data gathering with a portable monitor and a stationary device
US20110153391 *Dec 21, 2009Jun 23, 2011Michael TenbrockPeer-to-peer privacy panel for audience measurement
US20130132152 *May 15, 2012May 23, 2013Seema V. SrivastavaMethods and apparatus to determine media impressions
EP2235700A1 *Dec 31, 2008Oct 6, 2010Arbitron Inc.Survey data acquisition
EP2442465A2 *Dec 31, 2008Apr 18, 2012Arbitron Inc.Survey data acquisition
WO2013102194A1 *Dec 31, 2012Jul 4, 2013Arbitron, Inc.System and method for determining device compliance and recruitment
Classifications
U.S. Classification705/7.29
International ClassificationG06Q10/00, G06F17/00
Cooperative ClassificationH04L67/02, G06Q30/0208, G06Q30/0201, G06Q10/00
European ClassificationG06Q30/0208, G06Q30/0201, G06Q10/00, H04L29/08N1
Legal Events
DateCodeEventDescription
Mar 28, 2014ASAssignment
Owner name: THE NIELSEN COMPANY (US), LLC, ILLINOIS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NIELSEN AUDIO, INC.;REEL/FRAME:032554/0801
Effective date: 20140325
Free format text: CHANGE OF NAME;ASSIGNOR:ARBITRON INC.;REEL/FRAME:032554/0759
Owner name: NIELSEN AUDIO, INC., NEW YORK
Effective date: 20131011
Effective date: 20121217
Free format text: MERGER;ASSIGNOR:ARBITRON INC.;REEL/FRAME:032554/0765
Owner name: NIELSEN HOLDINGS N.V., NEW YORK
Aug 27, 2007ASAssignment
Owner name: ARBITRON INC., MARYLAND
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:NEUHAUSER, ALAN R;CRYSTAL, JACK C;FLANAGAN, EUGENE L, III;REEL/FRAME:019750/0472;SIGNING DATES FROM 20070822 TO 20070827