Machine Learning

Authors and titles for November 2015

arXiv:1511.00146 [pdf, other]

Title: Faster Stochastic Variational Inference using Proximal-Gradient Methods with General Divergence Functions

Mohammad Emtiyaz Khan, Reza Babanezhad, Wu Lin, Mark Schmidt, Masashi Sugiyama

Comments: Published in UAI 2016. We have made the following change in this revision: instead of expressing convergence rate results in terms of the iterate difference, we state them in terms of the iterate distance divided by the step-size (a measure of first-order optimality). We also removed some claims about the performance with a fixed step size

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

arXiv:1511.00152 [pdf, other]

Title: Preconditioned Data Sparsification for Big Data with Applications to PCA and K-means

Farhad Pourkamali-Anaraki, Stephen Becker

Comments: 28 pages, 10 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.00158 [pdf, other]

Title: Prediction of Dynamical time Series Using Kernel Based Regression and Smooth Splines

Raymundo Navarrete, Divakar Viswanath

Comments: minor changes

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.00573 [pdf, other]

Title: From random walks to distances on unweighted graphs

Tatsunori B. Hashimoto, Yi Sun, Tommi S. Jaakkola

Comments: To appear in NIPS 2015

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Social and Information Networks (cs.SI)

arXiv:1511.00830 [pdf, other]

Title: The Variational Fair Autoencoder

Christos Louizos, Kevin Swersky, Yujia Li, Max Welling, Richard Zemel

Comments: Fixed typo in eq. 3 and 4

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.00831 [pdf, other]

Title: PCA-Based Out-of-Sample Extension for Dimensionality Reduction

Yariv Aizenbud, Amit Bermanis, Amir Averbuch

Subjects: Machine Learning (stat.ML)

arXiv:1511.01214 [pdf, other]

Title: Quantification of observed prior and likelihood information in parametric Bayesian modeling

Giri Gopalan

Comments: Abbreviated and edited conference version

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Applications (stat.AP); Methodology (stat.ME)

arXiv:1511.01281 [pdf, other]

Title: Co-Clustering Network-Constrained Trajectory Data

Mohamed Khalil El Mahrsi (LTCI, SAMM), Romain Guigourès (SAMM), Fabrice Rossi (SAMM), Marc Boullé

Journal-ref: Advances in Knowledge Discovery and Management, 615, Springer International Publishing, pp.19-32, 2015, Studies in Computational Intelligence, 978-3-319-23750-3

Subjects: Machine Learning (stat.ML); Databases (cs.DB); Machine Learning (cs.LG)

arXiv:1511.01284 [pdf, other]

Title: Lasso based feature selection for malaria risk exposure prediction

Bienvenue Kouwayè (SAMM), Noël Fonton, Fabrice Rossi (SAMM)

Comments: in Petra Perner. Machine Learning and Data Mining in Pattern Recognition, Jul 2015, Hamburg, Germany. Ibai publishing, 2015, Machine Learning and Data Mining in Pattern Recognition (proceedings of 11th International Conference, MLDM 2015)

Subjects: Machine Learning (stat.ML)

arXiv:1511.01289 [pdf, other]

Title: Data-Driven Learning of a Union of Sparsifying Transforms Model for Blind Compressed Sensing

Saiprasad Ravishankar, Yoram Bresler

Comments: Appears in IEEE Transactions on Computational Imaging, 2016

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.01304 [pdf, other]

Title: Dictionary descent in optimization

Vladimir Temlyakov

Comments: arXiv admin note: text overlap with arXiv:1206.0392

Subjects: Machine Learning (stat.ML); Numerical Analysis (math.NA)

arXiv:1511.01419 [pdf, other]

Title: Train and Test Tightness of LP Relaxations in Structured Prediction

Ofer Meshi, Mehrdad Mahdavi, Adrian Weller, David Sontag

Comments: To appear in ICML 2016

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

arXiv:1511.01844 [pdf, other]

Title: A note on the evaluation of generative models

Lucas Theis, Aäron van den Oord, Matthias Bethge

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.01853 [pdf, other]

Title: A Sparse Linear Model and Significance Test for Individual Consumption Prediction

Pan Li, Baosen Zhang, Yang Weng, Ram Rajagopal

Comments: 36 pages, 7 figures

Subjects: Machine Learning (stat.ML); Systems and Control (eess.SY); Optimization and Control (math.OC)

arXiv:1511.01987 [pdf, other]

Title: Neutralized Empirical Risk Minimization with Generalization Neutrality Bound

Kazuto Fukuchi, Jun Sakuma

Comments: 27 pages, 6 figures

Subjects: Machine Learning (stat.ML)

arXiv:1511.02025 [pdf, other]

Title: Finding structure in data using multivariate tree boosting

Patrick J. Miller, Gitta H. Lubke, Daniel B. McArtor, C. S. Bergeman

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.02124 [pdf, other]

Title: Barrier Frank-Wolfe for Marginal Inference

Rahul G. Krishnan, Simon Lacoste-Julien, David Sontag

Comments: 25 pages, 12 figures, To appear in Neural Information Processing Systems (NIPS) 2015, Corrected reference and cleaned up bibliography

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

arXiv:1511.02176 [pdf, other]

Title: Optimal Non-Asymptotic Lower Bound on the Minimax Regret of Learning with Expert Advice

Francesco Orabona, David Pal

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.02187 [pdf, other]

Title: Streaming regularization parameter selection via stochastic gradient descent

Ricardo Pio Monti, Romy Lorenz, Robert Leech, Christoforos Anagnostopoulos, Giovanni Montana

Comments: Paper withdrawn as it is no longer up to date

Subjects: Machine Learning (stat.ML)

arXiv:1511.02199 [pdf, other]

Title: The Poisson Gamma Belief Network

Mingyuan Zhou, Yulai Cong, Bo Chen

Comments: Neural Information Processing Systems (NIPS2015)

Subjects: Machine Learning (stat.ML); Methodology (stat.ME)

arXiv:1511.02386 [pdf, other]

Title: Hierarchical Variational Models

Rajesh Ranganath, Dustin Tran, David M. Blei

Comments: Appears in International Conference on Machine Learning, 2016

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

arXiv:1511.02543 [pdf, other]

Title: Sandwiching the marginal likelihood using bidirectional Monte Carlo

Roger B. Grosse, Zoubin Ghahramani, Ryan P. Adams

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

arXiv:1511.02722 [pdf, other]

Title: Learning Instrumental Variables with Non-Gaussianity Assumptions: Theoretical Limitations and Practical Algorithms

Ricardo Silva, Shohei Shimizu

Comments: 12 pages, 4 figures

Subjects: Machine Learning (stat.ML)

arXiv:1511.02729 [pdf, other]

Title: PAC-Bayesian High Dimensional Bipartite Ranking

Benjamin Guedj, Sylvain Robbiano

Journal-ref: Journal of Statistical Planning and Inference (2018), vol. 196, 70--86

Subjects: Machine Learning (stat.ML); Statistics Theory (math.ST)

arXiv:1511.02796 [pdf, other]

Title: Bayesian Inference in Cumulative Distribution Fields

Ricardo Silva

Comments: 14 pages, 4 figures. Presented at the 12th Brazilian Meeting on Bayesian Statistics

Subjects: Machine Learning (stat.ML); Methodology (stat.ME)

arXiv:1511.02821 [pdf, other]

Title: Partial Membership Latent Dirichlet Allocation

Chao Chen, Alina Zare, J. Tory Cobb

Comments: cut to 6 pages, add sunset results

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV)

arXiv:1511.03243 [pdf, other]

Title: Black-box $α$-divergence Minimization

José Miguel Hernández-Lobato, Yingzhen Li, Mark Rowland, Daniel Hernández-Lobato, Thang Bui, Richard E. Turner

Comments: Accepted at ICML 2016. The first version (v1) was presented at NIPS workshops on Advances in Approximate Bayesian Inference and Black Box Learning and Inference

Subjects: Machine Learning (stat.ML)

arXiv:1511.03249 [pdf, other]

Title: Stochastic Expectation Propagation for Large Scale Gaussian Process Classification

Daniel Hernández-Lobato, José Miguel Hernández-Lobato, Yingzhen Li, Thang Bui, Richard E. Turner

Subjects: Machine Learning (stat.ML)

arXiv:1511.03260 [pdf, other]

Title: A Hierarchical Spectral Method for Extreme Classification

Paul Mineiro, Nikos Karampatziakis

Comments: Reference implementation available at this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.03299 [pdf, other]

Title: Anchored Discrete Factor Analysis

Yoni Halpern, Steven Horng, David Sontag

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.03405 [pdf, other]

Title: Training Deep Gaussian Processes using Stochastic Expectation Propagation and Probabilistic Backpropagation

Thang D. Bui, José Miguel Hernández-Lobato, Yingzhen Li, Daniel Hernández-Lobato, Richard E. Turner

Comments: accepted to Workshop on Advances in Approximate Bayesian Inference, NIPS 2015

Subjects: Machine Learning (stat.ML)

arXiv:1511.03570 [pdf, other]

Title: Dimension of Marginals of Kronecker Product Models

Guido Montufar, Jason Morton

Comments: 27 pages, 2 figures

Subjects: Machine Learning (stat.ML); Neural and Evolutionary Computing (cs.NE); Algebraic Geometry (math.AG); Combinatorics (math.CO); Probability (math.PR)

arXiv:1511.03643 [pdf, other]

Title: Unifying distillation and privileged information

David Lopez-Paz, Léon Bottou, Bernhard Schölkopf, Vladimir Vapnik

Journal-ref: Proceedings of the International Conference on Learning Representations (2016) 1-10

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.03688 [pdf, other]

Title: Online Principal Component Analysis in High Dimension: Which Algorithm to Choose?

Hervé Cardot, David Degras

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

arXiv:1511.03760 [pdf, other]

Title: Random Multi-Constraint Projection: Stochastic Gradient Methods for Convex Optimization with Many Constraints

Mengdi Wang, Yichen Chen, Jialin Liu, Yuantao Gu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

arXiv:1511.03947 [pdf, other]

Title: Bayesian Analysis of Dynamic Linear Topic Models

Chris Glynn, Surya T. Tokdar, David L. Banks, Brian Howard

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

arXiv:1511.03990 [pdf, other]

Title: Automatic Inference of the Quantile Parameter

Karthikeyan Natesan Ramamurthy, Aleksandr Y. Aravkin, Jayaraman J. Thiagarajan

Comments: 8 pages

Subjects: Machine Learning (stat.ML)

arXiv:1511.04150 [pdf, other]

Title: Deep Mean Maps

Junier B. Oliva, Danica J. Sutherland, Barnabás Póczos, Jeff Schneider

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

arXiv:1511.04156 [pdf, other]

Title: Neuroprosthetic decoder training as imitation learning

Josh Merel, David Carlson, Liam Paninski, John P. Cunningham

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

arXiv:1511.04157 [pdf, other]

Title: $k$-means: Fighting against Degeneracy in Sequential Monte Carlo with an Application to Tracking

Kai Fan, Katherine Heller

Subjects: Machine Learning (stat.ML)

arXiv:1511.04211 [pdf, other]

Title: Active Contextual Entropy Search

Jan Hendrik Metzen

Comments: Corrected title of reference #19

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.04383 [pdf, other]

Title: Handling Class Imbalance in Link Prediction using Learning to Rank Techniques

Bopeng Li, Sougata Chaudhuri, Ambuj Tewari

Comments: The paper has been withdrawn due to a baseline implementation error in experiments

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

arXiv:1511.04402 [pdf, other]

Title: Lass-0: sparse non-convex regression by local search

William Herlands, Maria De-Arteaga, Daniel Neill, Artur Dubrawski

Comments: 8 pages, 1 figure. NIPS 2015 Workshop of Optimization (OPT2015)

Subjects: Machine Learning (stat.ML)

arXiv:1511.04408 [pdf, other]

Title: Scalable Gaussian Processes for Characterizing Multidimensional Change Surfaces

William Herlands, Andrew Wilson, Hannes Nickisch, Seth Flaxman, Daniel Neill, Wilbert van Panhuis, Eric Xing

Comments: 18 pages, 8 figures

Subjects: Machine Learning (stat.ML)

arXiv:1511.04514 [pdf, other]

Title: Sparse Nonlinear Regression: Parameter Estimation and Asymptotic Inference

Zhuoran Yang, Zhaoran Wang, Han Liu, Yonina C. Eldar, Tong Zhang

Comments: 32 pages, 2 figures, 1 table

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC)

arXiv:1511.04581 [pdf, other]

Title: A Test of Relative Similarity For Model Selection in Generative Models

Wacha Bounliphone, Eugene Belilovsky, Matthew B. Blaschko, Ioannis Antonoglou, Arthur Gretton

Comments: International Conference on Learning Representations 2016

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.04776 [pdf, other]

Title: Mixtures of Sparse Autoregressive Networks

Marc Goessling, Yali Amit

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:1511.04780 [pdf, other]

Title: Causal interpretation rules for encoding and decoding models in neuroimaging

Sebastian Weichwald, Timm Meyer, Ozan Özdenizci, Bernhard Schölkopf, Tonio Ball, Moritz Grosse-Wentrup

Comments: accepted manuscript

Journal-ref: NeuroImage, 110:48-59, 2015

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC); Applications (stat.AP)

arXiv:1511.04817 [pdf, other]

Title: Probabilistic Segmentation via Total Variation Regularization

Matt Wytock, J. Zico Kolter

Subjects: Machine Learning (stat.ML)

arXiv:1511.04898 [pdf, other]

Title: Fast clustering for scalable statistical analysis on structured images

Bertrand Thirion (PARIETAL), Andrés Hoyos-Idrobo (NEUROSPIN, PARIETAL), Jonas Kahn (LPP), Gael Varoquaux (NEUROSPIN, PARIETAL)

Comments: ICML Workshop on Statistics, Machine Learning and Neuroscience (Stamlins 2015), Jul 2015, Lille, France

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV)