logo Idiap Research Institute        
 [BibTeX] [Marc21]
A Probabilistic Interpretation of SVMs with an Application to Unbalanced Classification
Type of publication: Idiap-RR
Citation: grandvalet:rr05-26
Number: Idiap-RR-26-2005
Year: 2005
Institution: IDIAP
Note: Published in Advances in Neural Information Processing Systems, {NIPS} 15, 2005
Abstract: In this paper, we show that the hinge loss can be interpreted as the neg-log-likelihood of a semi-parametric model of posterior probabilities. From this point of view, SVMs represent the parametric component of a semi-parametric model fitted by a maximum a posteriori estimation procedure. This connection enables to derive a mapping from SVM scores to estimated posterior probabilities. Unlike previous proposals, the suggested mapping is interval-valued, providing a set of posterior probabilities compatible with each SVM score. This framework offers a new way to adapt the SVM optimization problem when decisions result in unequal losses. Experiments on an unbalanced classification loss show improvements over state-of-the-art procedures.
Userfields: ipdmembership={learning},
Keywords:
Projects Idiap
Authors Grandvalet, Yves
MariƩthoz, Johnny
Bengio, Samy
Crossref by grandvalet:nips:2005
Added by: [UNK]
Total mark: 0
Attachments
  • grandvalet-idiap-rr-05-26.pdf
  • grandvalet-idiap-rr-05-26.ps.gz
Notes