Learning facial attributes by crowdsourcing in social media

Facial attributes such as gender, race, age, hair style, etc., carry rich information for locating designated persons and profiling the communities from image/video collections (e.g., surveillance videos or photo albums). For plentiful facial attributes in photos and videos, collecting costly manual annotations for training detectors is time-consuming. We propose an automatic facial attribute detection method by exploiting the great amount of weakly labelled photos in social media. Our work can (1) automatically extract training images from the semantic-consistent user groups and (2) filter out noisy training photos by multiple mid-level features (by voting). Moreover, we introduce a method to harvest less-biased negative data for preventing uneven distribution of certain attributes. The experiments show that our approach can automatically acquire training photos for facial attributes and is on par with that by manual annotations. Categories and Subject Descriptors I.4.9 [Computing ...

• Type: Journal
• Year: 2011
• Where: WWW
• Authors: Yan-Ying Chen, Winston H. Hsu, Hong-Yuan Mark Liao
• Keywords: Facial Attribute, Internet Technology, Manual Annotations, Photos, WWW 2011