Computer Science > Neural and Evolutionary Computing
arXiv:1610.02136 (cs)
[Submitted on 7 Oct 2016 (v1), last revised 3 Oct 2018 (this version, v3)]
Title:A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
View a PDF of the paper titled A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks, by Dan Hendrycks and Kevin Gimpel
View PDF
Abstract:We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater maximum softmax probabilities than erroneously classified and out-of-distribution examples, allowing for their detection. We assess performance by defining several tasks in computer vision, natural language processing, and automatic speech recognition, showing the effectiveness of this baseline across all. We then show the baseline can sometimes be surpassed, demonstrating the room for future research on these underexplored detection tasks.
| Comments: | Published as a conference paper at ICLR 2017. 1 Figure in 1 Appendix. Minor changes from the previous version |
| Subjects: | Neural and Evolutionary Computing (cs.NE); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG) |
| Cite as: | arXiv:1610.02136 [cs.NE] |
| (or arXiv:1610.02136v3 [cs.NE] for this version) | |
| https://doi.org/10.48550/arXiv.1610.02136
arXiv-issued DOI via DataCite
|
|
| Journal reference: | International Conference on Learning Representations 2017 |
Submission history
From: Dan Hendrycks [view email][v1] Fri, 7 Oct 2016 04:06:01 UTC (55 KB)
[v2] Thu, 23 Mar 2017 18:11:25 UTC (59 KB)
[v3] Wed, 3 Oct 2018 07:32:57 UTC (119 KB)
Full-text links:
Access Paper:
- View PDF
- TeX Source
View a PDF of the paper titled A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks, by Dan Hendrycks and Kevin Gimpel
Current browse context:
cs.NE
References & Citations
Loading...
BibTeX formatted citation
Data provided by:
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.