Automatic Annotation of Images using Ensembles of Trees for Hierarchical Multi-label Classification
published: March 26, 2010, recorded: March 2010, views: 4187
Report a problem or upload filesIf you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
This research presents a large scale system for detection of visual concepts and annotation of images. The system is composed of two parts: feature extraction and classification/ annotation. The feature extraction part provides global and local descriptions of the images in the form of numerical vectors. Using these numerical descriptions, we train a classifier, a predictive clustering tree (PCT), to produce annotations for unseen images. PCTs are able to handle target concepts that are organized in a hierarchy, i.e., perform hierarchical multi-label classification. To improve the classification performance, we construct ensembles (bags and random forests) of PCTs.
We evaluate our system on two different databases: IRMA database which contains medical images and the image database from the ImageCLEF@ICPR 2010 photo annotation task which contains general images. The extensive experiments conducted on the benchmark databases show that our system has very high predictive performance and can be easily scaled to large amounts of visual concepts and data. In addition, our approach is very general: it can be easily extended with new feature extraction methods, and it can thus be easily applied to other domains, types of images and other classification schemes. Furthermore, it can handle arbitrarily sized hierarchies organized as trees or directed acyclic graphs.
Download slides: solomon_dimitrovski_aai_01.pdf (1.5 MB)
Download slides: solomon_dimitrovski_aai_01.ppt (9.4 MB)
Link this pageWould you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !