Fine-grained Image Recognition via Multi-part Learning

The existing methods mainly use the attention to locate the subtle parts. However, Convolution neural networks (CNNs), which employ the cross entropy loss as the loss function, can only learn the most discrimina-tive part and ignore other meaningful regions. In this paper, a novel fine-grained image recognition method via multipart learning(MPL) is presented. Firstly, a parameter-free data augmentation method named Semantic patch Mix is proposed, which improves the networks’ generalization performance to the test distribution and ro-bustness to the sensitivity to input perturbations by exchanging the most discriminative part of the image. Sec-ondly, a parameter-free multipart adversarial erasing module is proposed, which erases the most discriminative region under the guidance of attention and Bernoulli distribution to force the network to discover other discrimi-native regions of the object. The attention guidance ensures that the erased regions are sufficiently discriminative, and the Bernoulli distribution guidance ensures that the erased regions are diverse. At last, mid-level features are incorporated to further improve performance. The proposed method is model-agonistic and thus can serve as a plug-and-play module to be applied to various backbone networks. Taking ResNet-50 as the backbone network, the classification accuracy of the proposed method on three public data sets CUB-200-2011, FGVC-Aircraft and Stanford Cars reached 89.2%, 95.5% and 94.0% respectively. Experimental results show that the proposed method, which can discover more discriminative parts, outperforms state-of the-art approaches.