[BibTeX] [RIS]
Pairwise Learning of Multilabel Classifications with Perceptrons
Type of publication: Techreport
Citation: jf:TUD-KE-2007-05
Number: TUD-KE-2007-05
Year: 2007
Institution: TU Darmstadt, Knowledge Engineering Group
URL: http://www.ke.tu-darmstadt.de/publications/reports/tud-ke-2007-05.pdf
Abstract: Multiclass Multilabel Perceptrons (MMP) are an efficient incremental algorithm for training a team of perceptrons for a multilabel prediction task. The key idea is to train one binary classifier per label, as is typically done for addressing multilabel problems, but to make the training signal dependent on the performance of the whole ensemble. In this paper, we propose an alternative approach that is based on a pairwise approach, i.e., we incrementally train a perceptron for each pair of classes. An evaluation on the Reuters 2000 (RCV1) data shows that our multilabel pairwise perceptron (MLPP) algorithm yields substantial improvements over MMP in terms of ranking quality and overfitting resistance, while maintaining its efficiency. Despite the quadratic increase in the number of perceptrons that have to be trained, the increase in computational complexity is bounded by the average number of labels per training example.
Keywords:
Authors Loza Mencía, Eneldo
Fürnkranz, Johannes
Attachments
  • tud-ke-2007-05.pdf
Topics