Improving object recognition of CNNs with multiple queries and HMMs

László Czúni; Amr M. Nagy

doi:10.1117/12.2559393

31 January 2020 Improving object recognition of CNNs with multiple queries and HMMs

László Czúni, Amr M. Nagy

Proceedings Volume 11433, Twelfth International Conference on Machine Vision (ICMV 2019); 1143310 (2020) https://doi.org/10.1117/12.2559393
Event: Twelfth International Conference on Machine Vision, 2019, Amsterdam, Netherlands

Abstract

In our paper we combine neural networks with Hidden Markov Models for multiview object recognition. While convolutional neural networks are very efficient in object recognition there is still need for improvements in many practical cases. For example if the training is not satisfactory or the object localization is not solved with the neural network then information fusion from several images and from inertial sensors can still help a lot to improve recognition rate. In our use case we are to recognize objects from several directions with the VGG16 network. We assume that no localization of objects is possible on the images due to the lack of bounding box annotations, we have to recognize the objects even if they occupy only about 25% of the field of view. To overcome this problem we propose to use a Hidden Markov Model approach where the consecutive queries, shots taken from different viewing directions, are first evaluated with VGG16 inference and then with the Viterbi algorithm. The role of the later is to estimate the most probable sequence of poses of candidates (from the predefined 8 horizontal views in our experiments), thus we can select the most probable object. The approach, as evaluated with different number of queries over a set of 40 objects from the COIL-100 dataset, can result in significant increase of hit rate compared to one shot recognition or to combining individual shots without the HMM model.

Citation Download Citation

László Czúni and Amr M. Nagy "Improving object recognition of CNNs with multiple queries and HMMs", Proc. SPIE 11433, Twelfth International Conference on Machine Vision (ICMV 2019), 1143310 (31 January 2020); https://doi.org/10.1117/12.2559393

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Object recognition

Cameras

3D modeling

Neural networks

Eye models

Information fusion

Data modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years