Movatterモバイル変換

Conference on Neural Information Processing Systems

From Wikipedia, the free encyclopedia

Machine-learning and computational-neuroscience conference

Conference on Neural Information Processing Systems

Abbreviation	NeurIPS (formerly NIPS)
Discipline	Machine learning,statistics,artificial intelligence,computational neuroscience
Publication details
History	1987–present
Frequency	Annual
Website	neurips.cc

TheConference and Workshop on Neural Information Processing Systems (abbreviated asNeurIPS and formerlyNIPS) is amachine learning andcomputational neuroscience conference held every December. Along withICLR andICML, it is one of the three primary conferences of high impact inmachine learning andartificial intelligence research.^[1]

The conference is currently a double-track meeting (single-track until 2015) that includes invited talks as well as oral and poster presentations of refereed papers, followed by parallel-track workshops that up to 2013 were held at ski resorts.

History

[edit]

Machine learning anddata mining
Part of a series on
Paradigms Supervised learning Unsupervised learning Semi-supervised learning Self-supervised learning Reinforcement learning Meta-learning Online learning Batch learning Curriculum learning Rule-based learning Neuro-symbolic AI Neuromorphic engineering Quantum machine learning
Problems Classification Generative modeling Regression Clustering Dimensionality reduction Density estimation Anomaly detection Data cleaning AutoML Association rules Semantic analysis Structured prediction Feature engineering Feature learning Learning to rank Grammar induction Ontology learning Multimodal learning
Supervised learning (classification • regression) Apprenticeship learning Decision trees Ensembles Bagging Boosting Random forest k-NN Linear regression Naive Bayes Artificial neural networks Logistic regression Perceptron Relevance vector machine (RVM) Support vector machine (SVM)
Clustering BIRCH CURE Hierarchical k-means Fuzzy Expectation–maximization (EM) DBSCAN OPTICS Mean shift
Dimensionality reduction Factor analysis CCA ICA LDA NMF PCA PGD t-SNE SDL
Structured prediction Graphical models Bayes net Conditional random field Hidden Markov
Anomaly detection RANSAC k-NN Local outlier factor Isolation forest
Neural networks Autoencoder Deep learning Feedforward neural network Recurrent neural network LSTM GRU ESN reservoir computing Boltzmann machine Restricted GAN Diffusion model SOM Convolutional neural network U-Net LeNet AlexNet DeepDream Neural field Neural radiance field Physics-informed neural networks Transformer Vision Mamba Spiking neural network Memtransistor Electrochemical RAM (ECRAM)
Reinforcement learning Q-learning Policy gradient SARSA Temporal difference (TD) Multi-agent Self-play
Learning with humans Active learning Crowdsourcing Human-in-the-loop Mechanistic interpretability RLHF
Model diagnostics Coefficient of determination Confusion matrix Learning curve ROC curve
Mathematical foundations Kernel machines Bias–variance tradeoff Computational learning theory Empirical risk minimization Occam learning PAC learning Statistical learning VC theory Topological deep learning
Journals and conferences AAAI ECML PKDD NeurIPS ICML ICLR IJCAI ML JMLR
Related articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline of machine learning
v t e

The NeurIPS meeting was first proposed in 1986 at the annual invitation-only Snowbird Meeting onNeural Networks for Computing organized byThe California Institute of Technology andBell Laboratories. NeurIPS was designed as a complementary open interdisciplinary meeting for researchers exploringbiological and artificialNeural Networks. Reflecting this multidisciplinary approach, NeurIPS began in 1987 with information theoristEd Posner as the conference president and learning theoristYaser Abu-Mostafa as program chairman.^[2] Research presented in the early NeurIPS meetings included a wide range of topics from efforts to solve purely engineering problems to the use of computer models as a tool for understanding biological nervous systems. Since then, the biological and artificial systems research streams have diverged, and recent NeurIPS proceedings have been dominated by papers onmachine learning,artificial intelligence andstatistics.

From 1987 until 2000 NeurIPS was held inDenver, United States. Since then, the conference was held inVancouver, Canada (2001–2010),Granada, Spain (2011), andLake Tahoe, United States (2012–2013). In 2014 and 2015, the conference was held inMontreal, Canada, in Barcelona, Spain in 2016, in Long Beach, United States in 2017, in Montreal, Canada in 2018 and Vancouver, Canada in 2019. Reflecting its origins atSnowbird, Utah, the meeting was accompanied by workshops organized at a nearby ski resort up until 2013, when it outgrew ski resorts.

The first NeurIPS Conference was sponsored by theIEEE.^[3] The following NeurIPS Conferences have been organized by the NeurIPS Foundation, established byEd Posner.Terrence Sejnowski has been the president of the NeurIPS Foundation since Posner's death in 1993. The board of trustees consists of previous general chairs of the NeurIPS Conference.^[4]

The firstproceedings was published in book form by theAmerican Institute of Physics in 1987, and was entitledNeural Information Processing Systems,^[5] then theproceedings from the following conferences have been published byMorgan Kaufmann (1988–1993),MIT Press (1994–2004) and Curran Associates (2005–present) under the nameAdvances in Neural Information Processing Systems.

The conference was originally abbreviated as "NIPS". By 2018 a few commentators were criticizing the abbreviation as encouraging sexism^{[clarification needed]} due to its association with the wordnipples, and as being aslur against Japanese. The board changed the abbreviation to "NeurIPS" in November 2018.^[6]

Topics

[edit]

Judea Pearl at his poster at the 2013 Conference on Neural Information Processing Systems

Along with machine learning and neuroscience, other fields represented at NeurIPS includecognitive science,psychology,computer vision, statisticallinguistics, andinformation theory. Over the years, NeurIPS became a premier conference on machine learning and although the 'Neural' in the NeurIPS acronym had become something of a historical relic, the resurgence ofdeep learning^[7] in neural networks since 2012, fueled by faster computers and big data, has led to achievements inspeech recognition,object recognition in images,image captioning, language translation and world championship performance in the game of Go, based on neural architectures inspired by the hierarchy of areas in the visual cortex (ConvNet) and reinforcement learning inspired by the basal ganglia (Temporal difference learning).

Notable affinity groups have emerged from the NeurIPS conference and displayed diversity, includingBlack in AI (in 2017),Queer in AI (in 2016), and others.^[8]^[9]

Named lectures

[edit]

In addition to invited talks and symposia, NeurIPS also organizes two named lectureships to recognize distinguished researchers. The NeurIPS Board introduced the Posner Lectureship in honor of NeurIPS founderEd Posner; two Posner Lectures were given each year up to 2015.^[10] Past lecturers have included:

2010 –Josh Tenenbaum andMichael I. Jordan
2011 –Rich Sutton andBernhard Schölkopf
2012 –Thomas Dietterich andTerry Sejnowski
2013 –Daphne Koller andPeter Dayan
2014 –Michael Kearns andJohn Hopfield
2015 –Zoubin Ghahramani andVladimir Vapnik
2016 –Yann LeCun
2017 –John Platt
2018 –Joëlle Pineau
2019 –Yoshua Bengio
2020 –Christopher Bishop
2021 –Peter Bartlett

In 2015, the NeurIPS Board introduced the Breiman Lectureship to highlight work in statistics relevant to conference topics. The lectureship was named for statisticianLeo Breiman, who served on the NeurIPS Board from 1994 to 2005.^[11] Past lecturers have included:

NIPS experiment

[edit]

In NIPS 2014, the program chairs duplicated 10% of all submissions and sent them through separate reviewers to evaluate randomness in the reviewing process.^[12] Several researchers interpreted the result.^[13]^[14] Regarding whether the decision in NIPS is completely random or not,John Langford writes: "Clearly not—a purely random decision would have arbitrariness of ~78%. It is, however, quite notable that 60% is much closer to 78% than 0%." He concludes that the result of the reviewing process is mostly arbitrary.^[15]

Locations

[edit]

1987–2000:Denver,Colorado, United States
2001–2010:Vancouver,British Columbia, Canada
2011:Granada, Spain
2012 & 2013:Stateline,Nevada, United States
2014 & 2015:Montréal,Quebec, Canada
2016:Barcelona, Spain^[16]
2017:Long Beach,California, United States^[17]
2018:Montréal,Quebec, Canada^[18]
2019:Vancouver,British Columbia, Canada^[19]
2020:Vancouver,British Columbia, Canada^[19] (virtual conference)
2021: Virtual conference
2022 & 2023:New Orleans,Louisiana, United States^[20]^[21]
2024:Vancouver,British Columbia, Canada
2025:San Diego,California, United States

Notes

[edit]

^"Artificial Intelligence - Google Scholar Metrics".scholar.google.es. Retrieved2024-07-10.
^The first NeurIPS
^Sponsors of the first NeurIPS
^"2024 Board".
^The first NeurIPS Proceedings
^Else, Holly (19 November 2018)."AI conference widely known as 'NIPS' changes its controversial acronym".Nature News.doi:10.1038/d41586-018-07476-w. Retrieved17 February 2021.
^The Deep Learning Revolution. MIT Press. October 2018.ISBN 9780262038034. Retrieved30 April 2020.
^"How one conference embraced diversity".Nature.564 (7735):161–162. 2018-12-12.doi:10.1038/d41586-018-07718-x.PMID 31123357.S2CID 54481549.
^"Why you can't just take pictures at the Queer in AI workshop at NeurIPS".VentureBeat. 2019-12-10. Retrieved2021-12-22.
^"24th Annual Conference on Neural Information Processing Systems (NIPS), Vancouver 2010 - VideoLectures - VideoLectures.NET".videolectures.net. Retrieved17 July 2017.
^NIPS 2015 Conference(PDF). Neural Information Processing Systems Foundation. 7 December 2015. p. 10. Retrieved17 July 2017.
^Lawrence, Neil (2014-12-16)."The NIPS Experiment".Inverse Probability. Archived fromthe original on 2015-04-03. Retrieved2015-03-31.
^Fortnow, Lance (2014-12-18)."The NIPS Experiment".Computational Complexity. Retrieved2015-03-31.
^Hardt, Moritz (2014-12-15)."The NIPS Experiment".Moody Rd. Retrieved2015-03-31.
^Langford, John (2015-03-09)."The NIPS Experiment".Communications of the ACM. Retrieved2015-03-31.
^Nips.cc - 2016 Conference
^Nips.cc - 2017 Conference
^Nips.cc - 2018 Conference
^^a ^b"Vancouver Named NeurIPS 2019 & 2020 Host as Visa Issues Continue to Plague the AI Conference". 5 December 2018.
^Nips.cc - 2022 Conference
^"NeurIPS | 2023".

External links

[edit]

v t e Differentiable computing
General	Differentiable programming Information geometry Statistical manifold Automatic differentiation Neuromorphic computing Pattern recognition Ricci calculus Computational learning theory Inductive bias
Hardware	IPU TPU VPU Memristor SpiNNaker
Software libraries	TensorFlow PyTorch Keras scikit-learn Theano JAX Flux.jl MindSpore
Portals Computer programming Technology