Learning to Filter Object Detections
2017
Conference Paper
ps
Most object detection systems consist of three stages. First, a set of individual hypotheses for object locations is generated using a proposal generating algorithm. Second, a classifier scores every generated hypothesis independently to obtain a multi-class prediction. Finally, all scored hypotheses are filtered via a non-differentiable and decoupled non-maximum suppression (NMS) post-processing step. In this paper, we propose a filtering network (FNet), a method which replaces NMS with a differentiable neural network that allows joint reasoning and re-scoring of the generated set of hypotheses per image. This formulation enables end-to-end training of the full object detection pipeline. First, we demonstrate that FNet, a feed-forward network architecture, is able to mimic NMS decisions, despite the sequential nature of NMS. We further analyze NMS failures and propose a loss formulation that is better aligned with the mean average precision (mAP) evaluation metric. We evaluate FNet on several standard detection datasets. Results surpass standard NMS on highly occluded settings of a synthetic overlapping MNIST dataset and show competitive behavior on PascalVOC2007 and KITTI detection benchmarks.
Author(s): | Prokudin, Sergey and Kappler, Daniel and Nowozin, Sebastian and Gehler, Peter |
Book Title: | Pattern Recognition: 39th German Conference, GCPR 2017, Basel, Switzerland, September 12–15, 2017, Proceedings |
Pages: | 52--62 |
Year: | 2017 |
Publisher: | Springer International Publishing |
Department(s): | Perceiving Systems |
Research Project(s): |
Efficient and Scalable Inference
|
Bibtex Type: | Conference Paper (inproceedings) |
Paper Type: | Conference |
DOI: | 10.1007/978-3-319-66709-6_5 |
Address: | Cham |
URL: | https://doi.org/10.1007/978-3-319-66709-6_5 |
Attachments: |
Paper
|
BibTex @inproceedings{Prokudin2017, title = {Learning to Filter Object Detections}, author = {Prokudin, Sergey and Kappler, Daniel and Nowozin, Sebastian and Gehler, Peter}, booktitle = {Pattern Recognition: 39th German Conference, GCPR 2017, Basel, Switzerland, September 12--15, 2017, Proceedings}, pages = {52--62}, publisher = {Springer International Publishing}, address = {Cham}, year = {2017}, doi = {10.1007/978-3-319-66709-6_5}, url = {https://doi.org/10.1007/978-3-319-66709-6_5} } |