US 20080168055 A1
A content item may be associated with metadata comprising one or more tags. A user may indicate a relevance rating associated with a tag. The relevance rating may indicate whether the user feels the tag is relevant to a particular content item. Using a plurality of user-provided relevance ratings, a tag relevance model may be established. A tag relevance model may comprise a weighted or un-weighted average and/or median relevance rating of the tag and/or a consistency of the relevance rating. The tag relevance model may be used to order or otherwise inform search results. Tag ratings may also be used to aggregate users into groups comprising users having a similar point of view relative to one or more tag ratings. In addition, users may be grouped according to content access and/or tags rated regardless of the relevance rating applied.
1. A computer-readable medium comprising program code for causing a computer to perform a method for creating a user community consensus of the relevance of a metadata tag to a content item, the method comprising:
displaying the content item in a user interface of a computing device;
displaying the metadata tag in the user interface in connection with the content item, the metadata tag being previously assigned to the content item;
providing an input in the user interface to allow a plurality of users of the user community to rate the metadata tag for relevance as pertaining to the content item; and
storing the relevance ratings of the plurality of users.
2. The computer-readable medium of
3. The computer-readable medium of
4. The computer-readable medium of
5. The computer-readable medium of
6. The computer-readable medium of
7. The method of
8. The computer-readable medium of
9. The computer-readable medium of
10. The computer-readable medium of
11. The computer-readable medium of
12. The computer-readable medium of
13. The computer-readable medium of
14. A system for creating a user community consensus of the relevance of a metadata tag to a content item, comprising:
a server in communication with a plurality of users comprising the user community through a plurality of computing devices, wherein the server is to cause each computing device to display a content item and an associated metadata tag in a respective user interface, and wherein the server is to cause the computing devices to provide an input in the user interface to allow a one or more of the users in the user community to rate a relevance of the metadata tag to the content item; and
a storage device for storing the relevance ratings of the plurality of users.
15. The system of
16. The system of
17. The system of
18. The system of
19. The system of
20. The system of
21. The system of
22. The system of
23. The system of
24. A method for creating a user community consensus of the relevance of a metadata tag to a content item, comprising:
providing for displaying a content item in a user interface of a computing device;
providing for displaying a metadata tag in the user interface in connection with the content item, the metadata tag being previously assigned to the content item;
providing an input in the user interface to allow a plurality of users in the user community to rate the metadata tag for relevance pertaining to the content item;
storing the relevance ratings of the plurality of users;
calculating an average relevance rating value of the stored relevance ratings;
providing for displaying the average relevance rating in the user interface in connection with the metadata tag.
25. A system for creating a community rating of the relevance of a metadata tag associated with a content item, comprising:
means for displaying a content item in a user interface of a computing device;
means for displaying a metadata tag in the user interface in connection with the content item, the metadata tag being previously assigned to the content item;
means for providing an input in the user interface to allow a plurality of users of the user community to rate the metadata tag for relevance as pertaining to the content item;
means for storing the relevance ratings of the plurality of users;
means for calculating an average of the stored relevance ratings; and
means for displaying the average relevance in the user interface in connection with the metadata tag.
This application claims priority to U.S. Provisional Application No. 60/883,506 entitled RELEVANCY RATING OF TAGS filed on Jan. 4, 2007, which is hereby incorporated by reference in its entirety.
This application relates generally to systems and methods for rating various aspects of tags associated with content and, more particularly, to systems and methods for providing relevancy ratings to such tags.
The embodiments of the disclosure will be best understood by reference to the drawings, wherein like elements are designated by like numerals throughout.
The teachings of this disclosure may also be practiced in distributed computing environments, where tasks or modules are performed by remote processing devices, which are linked through a communications network, such as a Local Area Network (“LAN”), Wide Area Network (“WAN”) or the Internet. In a distributed computing environment, program modules or sub-routines may be located in both local and remote memory storage devices. Aspects of this disclosure described below may be stored or distributed on computer-readable media, including magnetic and optically readable and removable computer discs, stored as firmware in chips (e.g., EEPROM chips), as well as distributed electronically over the Internet or over other networks (including wireless networks). Those skilled in the relevant art will recognize that portions of the disclosure may reside on a server computer, while corresponding portions reside on a client computer. Data structures and transmission of data particular to aspects of the disclosure are also encompassed within the scope of this disclosure.
Turning now to
The input devices 102 may include a keyboard and/or a pointing device, such as a mouse. Other input devices are possible, such as a microphone, joystick, pen, game pad, scanner, digital camera, video camera, and the like. The data storage devices 104 may include any type of computer-readable media that can store data accessible by the computer 100, such as magnetic hard and floppy disk drives, optical disk drives, magnetic cassettes, tape drives, flash memory cards, digital video disks (DVDs), RAMs, ROMs, smart cards, etc. Indeed, any medium for storing or transmitting computer-readable instructions and data may be employed, including a connection port to or node on a network, such as a local area network (LAN), wide area network (WAN) or the Internet (not shown in
Aspects of the teachings of this disclosure may be practiced in a variety of other computing environments.
Application 204 may allow a user to access web sites or other content accessible via a Transmission Control Protocol (TCP) Internet Protocol (IP) network (i.e., a TCP/IP network). One such network is the World Wide Web or Internet. One skilled in the art, however, would recognize that the teachings of this disclosure could be practiced using any networking protocol and/or infrastructure. As such, this disclosure should not be read as limited to a TCP/IP network, the Internet, or any other particular networking protocol and/or infrastructure.
User computing devices 202 may be substantially similar to the computer described above in conjunction with
System 200 may comprise a server computer 208 communicatively coupled to network 206. Network 206 may comprise routing, addressing, and storage services to allow computing devices, such as user computing devices 202 and server computer 208 to transmit and receive data, such as web pages, text content, audio content, video content, graphic content, and/or multimedia content therebetween. Network 206 may comprise a private network and/or a virtual private network (VPN). Network 206 may comprise a client-server architecture, in which a computer, such as server 208, is dedicated to serving other client user computing devices 202, or it may have other architectures such as a peer-to-peer, in which one or more user computing devices 202 serve simultaneously as servers and clients. In addition, although
Server 208 may be communicatively coupled to network 206 by communication module 209. Communication module 209 may comprise a wired and/or wireless network 206 interface capable of communicating using a networking and/or communication protocol supported by network 206 and/or user computing devices 202.
Server 208 may comprise and/or be communicatively coupled to a data storage module 210.A. Data storage module 210.A may comprise one or more databases, XML data stores, file systems, X.509 directories, LDAP directories, and/or any other data storage and/or retrieval systems known in the art. Data storage module 210, A may comprise web pages and associated content to be transmitted to one or more of user computing devices 202 over network 206.
Server computer 208 may comprise server engine 212, content page management component 214, and data storage management module 216. Server engine 212 may perform processing and operating system level tasks including, but not limited to: managing memory access and/or persistent storage systems of server computer 208, managing connections to user computer(s) 202 over network 206, and the like. Server engine 212 may manage connections to/from user computing devices 202 using communication module 211.
Content management module 214 may create, display, and/or otherwise provide content to user computer(s) 202 over network 206. In addition, and as will be discussed below, content management component 214 may manage metadata (including tag metadata) associated with content displayed or otherwise provided to user computing devices 202. Data storage management module 216 may be configured to interface with data storage module 210.A to store, retrieve, and otherwise manage data in data storage module 210.A.
In one embodiment, server engine 212 may be configured to provide data to user computer(s) 202 according to the Hypertext Transfer Protocol (HTTP) and/or secure HTTP (HTTPS). As such, server computer 208 may provide web page content to user computer(s) 202. Although server computer 208 is described as providing data according to the HTTP and/or HTTPS standards, one skilled in the art would recognize that any data transfer protocol and/or standard could be used under the teachings of this disclosure. As such, this disclosure should not be read as limited to any particular data transfer and/or data presentation standard and/or protocol.
User computing devices 202 may access content stored on data storage module 210.A and made available by content management module 214 via a uniform resource Identifier (URI) addressing server computer 208. The URI may be formed according to RFC 1630, 1738, 2396, 2732 and/or 3986 and may comprise a domain name indicator (e.g., www.example.com) which may be resolved by a domain name server (DNS) (not shown) in network 206 into an Internet Protocol (IP) address. This IP address may allow user computer(s) 202 to address and/or route content requests through network 206 to server computer 208. The URI may further comprise a resource identifier to identify a particular content item on server computer 208 (e.g., content.html).
Responsive to receiving a URI request, server engine 212 may be configured to provide the content to a user computing device 202 comprising the content (e.g., web page) identified in the URI. Content management module 214 and data storage management module 216 may be configured to obtain and/or format the requested content to be transmitted to a user computing device 202 by server engine 212.
Server computer 208 may comprise a user management module 218. User management module 218 may access user account data store 210.B. User accounts data store 210.B may comprise one or more user accounts relating to one or more users authorized to access content on server computer 208. User account data 210.B may comprise a user name of the user, a user password, content accessed by the user, authorizations granted to the user, or the like.
Server computer 208, data storage module 210.A, and user accounts module 210.B may comprise security measures to inhibit malicious attacks thereon, and to preserve integrity of the messages and data stored therein. Such measures may include, but are not limited to: firewall systems, secure socket layer (SSL) communication, user authentication, public key infrastructure (PKI) authentication, password protection schemes, data encryption, and the like.
Turning now to
Application 305 may comprise a display 310 wherein HTML data may be rendered for presentation to a user. A content item 315 may be presented in display 310. Content item 315 may include, but is not limited to: an image, an illustration, a drawing, pointer (e.g., a link, URI, or the like), video content, Adobe™ Flash™ content, audio content (e.g., a podcast, music, or the like), text content, a game, downloadable content, a collection and/or arrangement of content items, or the like.
Display 310 may comprise interface 317. Interface 317 may provide browsing and/or searching functionality to access content on the web site. As such, interface 317 may comprise a search component (not shown) to allow a user to search for a content item 315 using one or more search terms, keywords, and/or tag. A search module of the web site and/or external search service may compare the one or more search terms to, inter alia, content metadata to determine a match.
As used herein, metadata may refer to a word or short phrase used to: describe content (e.g., an image, video, or the like); an aspect or characteristic of the content; or the like. Accordingly, metadata 320 may be used to describe a content item 315 displayed on display 310 (e.g., an image, video content, etc.).
Metadata 320 may be displayed in connection with content item 315 (e.g., in the same display 310 as content item 315) and may comprise tag metadata 330. Tag metadata 330 may comprise text descriptors associated with content item 315 to describe and/or categorize content item 315. For example, content item 315 may be a graphical depiction (e.g., digital photograph) of an object, or it may be text, audio, video, animation, or even metadata. Tag metadata 330 may be used to describe the subject matter of the content (whether image or otherwise), an image location, an emotion invoked by the image, a compositional style of the image, or the like. For instance, content item 315 may comprise a photograph of a salmon in a river. In this case, tag 332 may be “salmon” identifying the subject matter of the photograph; tag 334 may identify the river where the photo was taken (e.g., “Skeena River”); tag 336 may identify a prominent feature of the photograph (e.g., “river”); and tag 338 may indicate an aesthetic appeal of the photograph (e.g., “nature”) or a color that is prominent in the photograph (e.g. “pink”). Although
Each tag 332, 334, 336, and 338 may comprise and/or be associated with a user interface component 333, 335,337, and 339 that may be used to allow a user, whether paid or unpaid, expert or amateur, to rate a relevancy of the tag 332, 334, 336, and 338 to content item 315. Interface components 333, 335, 337, and 339 may comprise a combo box, list selector, a slider, a text entry box, or the like. Interface components 333, 335, 337, and 339 may allow a user to select one of a set of relevancy ratings to be assigned to a particular tag. For example, a combo box control may comprise text entries to rate the relevancy of a tag, such as: 1) “high,” “moderate,” and “low”; 2) “totally,” “considerably,” “somewhat,” “a bit,” ““not sure”; 3) “strong,” “reasonable,” “modest,” “Irrelevant”; (4) “0,” “1,” “2,” “3”; or the like. A user may rate a tag as having a “high” relevance if the user feels that the tag is highly relevant to the content item 315. For example, a user may feel that a “salmon” tag 332 is highly relevant to a photograph 315 of a salmon in a river. As such, the user may select a “high” entry on interface component 333. The user may feel that “river” is a poor descriptor of the content item 315 and, as such, the user may select “moderate” or “low” in interface component 335, and so on. Alternatively, the user may be allowed to enter a numeric rating of the relevancy of the tag (e.g., 10 for highly relevant and 0 for least relevant, etc.) using text entry and/or a control such as a slider control, dial, or arrow. The user may also indicate merely that the tag is or is not relevant, using a control that registers the states of “relevant” and “irrelevant,” where the choices may be such as “yes” and “no,” “thumbs-up” and “thumbs-down,” a box that is checked only if the tag is deemed relevant or helpful, a button that is clicked to indicate relevance or affirmation, or the like.
User-provided tag relevancy ratings may be stored and/or associated with tag metadata 330. In this way, the user-provided relevancy ratings themselves may comprise metadata. The tag relevancy ratings may be used to determine, on a consensus or weighted basis, a relevancy of a particular tag. The composite relevancy ratings of a tag may be referred to as a “relevance model” of the tag. The relevance model of a tag may comprise an average and/or median relevancy rating of the tag, a consistency factor of the rating (e.g., relevancy rating deviation), the number of user ratings submitted for the tag, and the like. Changes in the relevance model (ratings) measured over time may themselves be recorded as metadata.
The relevance model of a tag may be used to refine search results and/or to provide search functionality (e.g., strongly associating relevant tags with the content item), and the like. In one embodiment, the relevance model of a tag may be used to order search results. For example, if a user were to enter a search term into interface 317 (e.g., “salmon”) content items having the tag may be returned. These results may be ordered based upon the relative relevance factor and/or model associated with the tag. For example, a content item having a “salmon” tag with an average and/or mean of “high” may be ordered before a content item where the “salmon” tag is “low.” Where multiple search terms are used, a composite (and/or weighted) tag/relevancy score may be determined and used to order the search results.
A consistency level associated with the tag relevance model (e.g., the deviation) may be used to order search results. For example, users may be interested in tags having widely varying ratings. A rating having a wide divergence in relevance rating may be indicative of a controversial and/or esoteric tag that different users may view differently. A user may wish to order a search results based on the divergence of a particular tag's relevance rating.
User-provided ratings may also provide information about the user submitting the tag relevancy ratings. For instance, users may be grouped together based upon correlation between relevancy ratings for specific tags. If both users consider a particular tag (e.g., “nature,” “beautiful,” etc.) to be relevant to a particular content item, the users may be grouped together as having a similar aesthetic sense and/or taste, or this information about the users may be used as a basis for an opinion about the quality of the user's tastes, regardless of whether or not such opinion is explicitly expressed. As such, a user profile may be generated using upon one or more tag relevance ratings by the user
Even where the users' relevancy ratings differ, certain users may be grouped together based upon the content they access and rate. For instance, although the users' tag relevancy ratings differ, the certain users may submit ratings for a common set of content items. As such, even though the users' tag ratings may differ, the users may be grouped together as having a common interest in a particular type and/or style of content.
Turning now to
Application 405 may comprise a display on which a content item 415 may be presented. Content item 415 may comprise video, audio, graphic, and/or multimedia content. Display 410 may comprise an interface 417 to allow a user of application 405 to access various content items 415. As such, interface 417 may comprise a playlist browser or the like. Interface 417 may further comprise controls 419. Controls 419 may allow a user to interact with content item 415 and/or control the playback of content item 415 (e.g., play, pause, fast forward, etc.).
As discussed above, content item 415 may comprise metadata 420 associated therewith. Metadata 420 may comprise tag metadata 430, and may be displayed in connection with content item 415 on display 410. Tag metadata 430 may comprise one or more tags describing one or more aspects of content item 415. For example, if content item 415 comprises video content (e.g., a movie), tags 430 may comprise indications of the genre, style, and/or plot elements of the content, such as “action,” “romance,” and the like. Tags 430 may describe the genre of the content, such as “film noire,” “teen,” “situational comedy,” or the like. Tags 430 may also describe a location and/or focus of the content, such as “Yellowstone” (for a documentary on Yellowstone National Park), “Wyoming,” or the like. As discussed above, tags 430 may comprise any number of tags 432, 434, 446, and 448 and may refer to any aspect of content item 415.
Each tag 432, 434, 436, and 436 may comprise and/or be associated with a relevancy rating input 433, 435, 437, and 439 which may be embodied as a slider control. Slider controls 433, 435, 437, and 439 may be used to indicate a relevancy of the tag to content item 415. For example, slider controls 433 and 437 may indicate that tags 432 and 436 are of moderate relevance to content item 415. Slider control 437 may indicate that tag 438 is highly relevant to content item 415 and slider control 435 may indicate that tag 434 is a low relevance to content item 415.
Turning now to
Application 505 may comprise a display on which a content item 515 may be presented. Display 510 may further comprise an interface 517 to allow a user of application 505 to access various content items 515. As such, interface 517 may comprise a playlist browser, a navigation component, or the like. Display 510 may comprise controls 519, which may allow a user to interact with content item 515 and/or control the playback of content item 515 (e.g., play, pause, fast forward, etc.).
Display 510 may comprise metadata 520 displayed in connection with content item 515. Metadata 520 may comprise one or more metadata tags 532, 534, 536, 538 in a metadata tag list 530. As discussed above, metadata tags 532, 534, 536, and 538, may be used to describe content item 515. Each tag 532, 534, 536, and 538 may be associated with a corresponding checkbox input 533, 535, 537, and 539. Selecting checkbox input 533, 535, 537, and/or 539 may indicate that a user feels that the associated tag 532, 534, 536, and/or 538 is relevant to content item 515. The relevance of a tag may be determined by the number of users who select the corresponding tag input 533, 535, 537, and/or 539. In an alternative embodiment, checkboxes 533, 535, 537 and/or 539 may comprise a ranking input (e.g., a text selection box) to allow users to rank tags 532, 534, 536 and/or 538 in order of relevance to content item 515.
Turning now to
Application 605 may comprise a display 610 wherein a content item 615 may be presented. As discussed above, content item 615 may include, but is not limited to: an image, video content, audio content, Flash™ content, text, interactive content, downloadable content, or the like.
Display 610 may comprise interface 617, which may provide browse and/or search functionality to access various content items 615 using application 605. Display 610 may further comprise a tag input component 619. Tag input component 619 may comprise any input component known in the art including, but not limited to a text entry field, an upload component, or the like to allow a user to provide a user-submitted metadata tag to associate with (e.g., describe) content item 615.
Relevant metadata tags may be determined based upon, inter alia, the frequency a particular tag is submitted. In one embodiment, one or more relevant tags may be identified by simply counting the number of times each tag is submitted. For example, if content item 615 were to comprise a photograph of a salmon, a large number of users may submit a “salmon” tag via tag input component 619. As such, the “salmon” tag may be considered to be highly-relevant to content item 615. Tags submitted relatively infrequently (i.e., by a relatively few number of users) may be considered to be less relevant. For instance, a relatively small number of users may submit a “cute” tag for the salmon photograph 615. As such, “cute” may be deemed to be less-relevant to content item 615.
As depicted in
In one embodiment, the tags submitted by some users may be given greater weight than the tags submitted by other users. This weight may be determined by the users' past tag submissions (e.g., have submitted relevant tags in the past), an observed correlation between the users' submission and other highly weighted users' submissions, or the like.
Turning now to
Content table 710 may comprise a content identifier 710.1, user identifier 710.2, and a content reference 710.3. Content identifier 710.1 may comprise a locally and/or globally unique identifier (hereafter “identifier”) that may be used to identify content 710. As such, content identifier 710.1 may comprise an SQL “primary key.” User identifier 710.2 may identify the submitter of content 710 if such information is available and, as such, may comprise an SQL “foreign key.” For example, if a particular content item 710 comprises a photograph submitted to a photography content site, user identifier 710.2 may identify the user who submitted the photograph. Content reference 710.3 may comprise a link and/or reference to the content item. As such, content reference 710.3 may comprise a foreign key pointing to another database table (not shown), a URI where the content may be obtained, data comprising the content item (e.g., SQL blob), or the like.
Each content item 710 may be associated with a plurality of tags 720. Tag 720 may represent tag metadata associated with a content item 710. Tag 720 may comprise a tag identifier 720.1 that may identify the tag. Content identifier 720.2 may identify the content item 710 tag 720 describes. Tag data 720.3 may comprise the tag data itself (e.g., tag describing content 710).
Tag relevance model 720.4 may comprise data representing a statistical or other model of one or more tag relevancy ratings (e.g., the average relevancy rating, rating deviation, etc.). One embodiment of a tag relevance model 720.4 is described in more detail below in conjunction with
Each tag 720 entry may be associated with a plurality of tag ratings 730 each representing a user-submitted tag relevancy rating. Each tag rating 730 may comprise a rating identifier 730.1 to identify the rating 730 and a tag identifier 730.2, which may identify the subject (i.e., tag) of the tag rating 730. Additionally, tag rating 730 may comprise user identifier 730.3, which may be used to identify the user who submitted the tag rating 730.
Tag rating 730 may comprise a tag relevance rating 730.4, which may represent a relevance rating of tag 720. As discussed above, relevance rating 730.4 may comprise a textual, numerical, and/or Boolean value indicating whether the user 730.3 feels that the tag 720 (identified by tag identifier 730.2) is relevant to the content item 710 (identified by content identifier 720.2) associated with tag 720. As shown in
Turning now to
The mean μ rating relevance of a tag may be determined by assigning a numeric value to each relevancy rating, and calculating the mean per Equation 1.1:
In equation 1.1, μt may represent the mean relevancy rating of a tag t, N may be the number of relevancy ratings associated with tag t, and Ri may be a relevancy rating associated with tag t. In an alternative embodiment, the opinion of users in the user community may be weighted relative to one another. This relative weight may be referred to as a “rating weight” of a user. For instance, some users may be considered to have more experience, expertise, or the like in providing relevance ratings. As such, relevance ratings submitted by these users may be given greater weight relative to other users in the community. Alternatively, lesser weight may be given to new users or users who have provided inconsistent and/or inappropriate tag relevance ratings in the past or who in the past have submitted feedback for which there may be a perceived conflict of interest. One of skill in the art would recognize that Equation 1.1 and 1.2 (discussed below) could be modified to include such weights.
The deviation σ of a particular tag may be calculated per Equation 1.2:
In Equation 1.2, σt may represent the standard deviation of a particular tag t, N may be the number of relevancy ratings associated with tag t, Ri may be a relevancy rating associated with the tag t, and μt may be the tag mean calculated per Equation 1.1.
The mean and standard deviation may be derived from user submitted relevancy ratings using Equations 1.1 and 1.2. The relevant data may be obtained using data access techniques well known in the art. For example, where the data structures of
Although a Normal distribution is described herein, one skilled in the art would recognize that other statistical models could be used under the teachings of this disclosure including, but not limited, to: a Rayleigh distribution; chi-square distribution; Cauchy distribution; or the like. As such, this disclosure should not be read as limited to any particular statistical modeling tool and/or distribution. In addition, relevancy ratings may be modeled using other (e.g., non-statistical) modeling tools and/or techniques. As such, this disclosure should not be read as limited to any particular model type and/or modeling technique.
The mean tag relevancy rating μt may represent a “user community consensus” of the relevance of the tag t to its associated content. The standard deviation σt value may indicate the cohesiveness (i.e., consistency) of the community consensus (i.e., mean). For example, a large standard deviation σt may indicate that there is little consensus regarding the relevance of a particular tag (e.g., users may be split as to whether the tag is highly relevant or irrelevant). Conversely, a low standard deviation σt value may indicate that there is strong community consensus regarding the relevance level assigned to the tag t.
The statistical modeling information described above may be used in various ways. For example, as discussed above, the relevance model data may be used to refine search results. A user may search for content using a particular keyword tag. The corresponding search results may be ordered based upon the average relevancy rating of the tag (i.e., μt of the tag) and may be further refined based upon the consistency of that consensus (i.e., σt of the tag).
The relevance model of a tag may be used to identify tags that are effective at creating consensus among a community of users or creating divergence between members of the community. This information may be based upon, inter alia, a standard deviation σt of the relevance model.
Upon determining the mean μt and standard deviation σt of a particular tag t, a Normal probability density function of the tag t may be determined per Equation 1.3:
In Equation 1.3, p(R) may represent the probability of a particular tag rating, σt may be the mean of the tag, σt may be the standard deviation associated with the tag t, and R may be a particular tag relevancy rating.
Users may be classified depending upon how they rate a particular tag. For example, Users A and B 830 and 832 may rate tag t as less relevant than the tag relevance model mean μt 810 by substantially one standard deviation σt 820. As such, User A 830 and user B 832 may be considered to have a similar view of the relevance tag t. In contrast, User C 834 may rate tag t has more relevant than mean μt 810. As such, User C 834 may be considered to have a dissimilar view of the relevance of tag t than Users A and B 830, 832.
By processing a sufficient quantity (i.e., plurality) of tag relevance models 800, similarities between users in a user community may be established and/or modeled using statistical, Bayesian, and/or pattern based modeling techniques. Moreover, similarities between users may be established based upon which tags, and associated content, the users have rated. This may provide insight into the types and/or genre of content the users prefer. These types of users may be grouped together or assigned descriptive metadata even if their relevancy views do not coincide. For example, a User A and User B may submit tag relevancy ratings for tags associated with a common set of content items. The common content items may create “cross-over” between users A and B.
Turning now to
User grouping information may be aggregated over time as more users submit tag relevancy ratings. As users submit relevancy ratings, grouping information may be compiled. For example, groups may be formed of users submitting tag ratings within a deviation σ of one another (e.g., Users A and B may be grouped together if they rate tags similarly at least 80% of the time). Additionally, one or more groups may be formed of users submitting tag relevancy ratings for a similar set of content items (e.g., Users A and B may be grouped together if they have a content cross-over rate of 80% or higher as depicted in
Turning now to
Application 1005 may comprise a navigation toolbar 1007 to allow a user to access a content item 1015 made available via a web interface. As such, application 1005 may comprise a web browser. Application 1005 may comprise a display 1010 where content item 1015 may be presented.
Content metadata 1020 may comprise one or more tags 1030 associated with content item 1015. Each tag entry 1032, 1034, 1036 and 1038 may comprise an input component (1033, 1035, 1037, and 1039, respectively) to allow a user to rate the relevancy of the corresponding tag. Additionally, tag relevance model data about each tag 1032, 1034, 1036, and 1038 may be provided. For example, 1032.A may indicate an average relevancy rating associated with tag 1032. This information may be conveyed as a number, text, a color, or the like. Alternatively, the relevancy information may be conveyed in the formatting and/or display of tag 1032. For instance, a highly relevant tag may be presented in a larger font and/or brighter color than a less relevant tag. Similarly, tags may be ordered within tag list 1030 according to their relative relevance rating factor such that more relevant tags are presented at the top of the list. Tag information 1032.B may convey consistency information about the tag. Consistency information 1032.B may comprise information relating to how consistently users have rated the relevancy of the tag (e.g., deviation in tag rating). For example, 1032.B may indicate that most users have rated the tag at the same relevancy level (e.g., the statistical model of the tag may have a low deviation). Alternatively, 1032.B may indicate that users have differed with respect to the tag's 1032 relevance (e.g., the statistical model of the tag may have a high deviation). This information may be conveyed using textually, numerically, through color, or the like.
In addition to rating tags 1030, a user may be allowed to enter a new tag at interface 1040. As such, interface 1040 may comprise a text entry. The new tag may be associated with content item 1015 and may be displayed in tag list 1030 for rating by other users.
Display 1002 may comprise user group list 1060. User group list 1060 may comprise users who rated a tag 1032, 1034, 1036, and/or 1038 (or tag associated with other content items) similarly. As discussed above, users who similarly rate tags 1030 may share a point-of-view, aesthetic preference, or the like. As such, the user may be interested in interacting with users 1062, 1064, and/or 1066. As discussed above, user list 1050 may further comprise users who similarly rated other content items and/or accessed similar content items. In another embodiment, user list 1060 may comprise a control to add one or more of users 1062, 1064, and/or 1066 to a user group. Selecting one of users 1062, 1064, and/or 1066 may provide access to content submitted by one or more of the users, tag relevancy ratings submitted by one or more of the users, content items accessed by one or more of the users, a web log (blog) maintained by one or more of the users, or the like.
Content list 1070 may comprise content submitted by users 1062, 1064 and/or 1066 having a similar set of tags and/or tag ratings to those at 1030. Like user list 1060, content list 1070 may comprise content items 1072, 1074 the user may wish to access given the user's previous access activity and/or tag ratings. For example, if the user has rated a particular location tag (e.g., “Skeena River”) as highly relevant, one or more of content items 1072, 1074 may comprise content having the same and/or a similar tag.
The above description provides numerous specific details for a thorough understanding of the embodiments described herein. However, those of skill in the art will recognize that one or more of the specific details may be omitted, or other methods, components, or materials may be used. In some cases, operations are not shown or described in detail.
Furthermore, the described features, operations, or characteristics may be combined in any suitable manner in one or more embodiments. It will also be readily understood that the order of the steps or actions of the methods described in connection with the embodiments disclosed may be changed as would be apparent to those skilled in the art. Thus, any order in the drawings or Detailed Description is for illustrative purposes only and is not meant to imply a required order, unless specified to require an order.
Embodiments may include various steps, which may be embodied in machine-executable instructions to be executed by a general-purpose or special-purpose computer (or other electronic device). Alternatively, the steps may be performed by hardware components that include specific logic for performing the steps or by a combination of hardware, software, and/or firmware.
Embodiments may also be provided as a computer program product including a computer-readable medium having stored thereon instructions that may be used to program a computer (or other electronic device) to perform processes described herein. The computer-readable medium may include, but is not limited to, hard drives, floppy diskettes, optical disks, CD-ROMs, DVD-ROMs, ROMs, RAMs, EPROMs, EEPROMs, magnetic or optical cards, solid-state memory devices, or other types of media/machine-readable medium suitable for storing electronic instructions.
As used herein, a software module or component may include any type of computer instruction or computer executable code located within a memory device and/or transmitted as electronic signals over a system bus or wired or wireless network. A software module may, for instance, comprise one or more physical or logical blocks of computer instructions, which may be organized as a routine, program, object, component, data structure, etc., that performs one or more tasks or implements particular abstract data types.
In certain embodiments, a particular software module may comprise disparate instructions stored in different locations of a memory device, which together implement the described functionality of the module. Indeed, a module may comprise a single instruction or many instructions, and may be distributed over several different code segments, among different programs, and across several memory devices. Some embodiments may be practiced in a distributed computing environment where tasks are performed by a remote processing device linked through a communications network. In a distributed computing environment, software modules may be located in local and/or remote memory storage devices. In addition, data being tied or rendered together in a database record may be resident in the same memory device, or across several memory devices, and may be linked together in fields of a record in a database across a network.
It will be understood by those having skill in the art that many changes may be made to the details of the above-described embodiments without departing from the underlying principles of the invention. The scope of the present invention should, therefore, be determined only by the following claims.