Repository logo
 
No Thumbnail Available
Publication

A Leopard Cannot Change Its Spots: Improving Face Recognition Using 3D-based Caricatures

Use this identifier to reference this record.
Name:Description:Size:Format: 
Leopard_TIFS.pdf3.73 MBAdobe PDF Download

Advisor(s)

Abstract(s)

Caricatures refer to a representation of aperson in which the distinctive features are deliberatelyexaggerated, with several studies showing that humansperform better at recognizing people from caricaturesthan using original images. Inspired by this observa-tion, this paper introduces the first fully automatedcaricature-based face recognition approach capable ofworking with data acquired in the wild. Our approachleverages the 3D face structure from a single 2D imageand compares it to a reference model for obtaininga compact representation of face features deviations.This descriptor is subsequently deformed using a ’mea-sure locally, weight globally’ strategy to resemble thecaricature drawing process. The deformed deviationsare incorporated in the 3D model using the Laplacianmesh deformation algorithm, and the 2D face cari-cature image is obtained by projecting the deformedmodel in the original camera-view. To demonstratethe advantages of caricature-based face recognition, wetrain the VGG-Face network from scratch using eitheroriginal face images (baseline) or caricatured images,and use these models for extracting face descriptorsfrom the LFW, IJB-A and MegaFace datasets. The ex-periments show an increase in the recognition accuracywhen using caricatures rather than original images.Moreover, our approach achieves competitive resultswith state-of-the-art face recognition methods, evenwithout explicitly tuning the network for any of theevaluation sets.

Description

Keywords

Face recognition 3D caricature

Citation

Research Projects

Organizational Units

Journal Issue