Sanjiv Kumar
PhD (2005; Robotics, SCS, CMU)
Google Fellow, VP
Research Scientist
76, Ninth Ave
New York, NY 10011, USA
email: sanjivk AT google.com
Research Interests
Large Scale Machine Learning, Artificial Intelligence, Health AI, Computer Vision, Robotics
Teaching
EECS6898: Large-Scale Machine Learning, Fall 2010, Columbia University, New York, NY.
Tutorials
Approximate Nearest Neighbor Search (Trees and Hashes): Part-I, Part-II.
Fast Matrix Decomposition: Part-I, Part-II.
Recent
Publications [ All Publications ]
.
V. Nagarajan, A. K. Menon, S. Bhojanapalli, H. Mobahi, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2023.
.
Z. Yang, M. Lukasik, V. Nagarajan, Z. Li, A. S. Rawat, M. Zaheer, A. K. Menon, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2023.
.
P. Sun, D. Simcha, D. Dopson, R. Guo, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2023.
.
W. Jitkrittum, N. Gupta, A. K. Menon,
H. Narasimhan A. S. Rawat, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2023.
.
S. J. Reddi, S. Miryoosefi, S. Karp, S. Krishnan, S. Kale, S. Kim, and S. Kumar
International Conference on Machine Learning (ICML), 2023.
.
Z. Li, C. You, S. Bhojanapalli, D. Li, A. S. Rawat,
S. J. Reddi, K. Ye, F. Chern, F. Yu, R. Guo, and S. Kumar
International Conference on Learning Representations (ICLR), 2023.
.
P. Sun, R. Guo, and S. Kumar
International Conference on Learning Representations (ICLR), 2023.
.
G. Citovsky, G. DeSalvo, S. Kumar, S. Ramalingam, A. Rostamizadeh, and Y. Wang
International Conference on Learning Representations (ICLR), 2023.
.
S. Si, A. S. Rawat, C.-J. Hsieh and S. Kumar
International Conference on Learning Representations (ICLR), 2023.
.
H. Harutyunyan, A. S. Rawat, A. K. Menon, S. Kim, and S. Kumar
International Conference on Learning Representations (ICLR), 2023.
.
M. Zaheer, A. S. Rawat, S. Kim, C. You, H. Jain, A. Veit, R. Fergus, and S. Kumar
International Conference on Learning Representations (ICLR), 2023.
.
Z. Li, R. Guo, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2022.
.
H. Narasimhan, W. Jitkrittum, A. K. Menon, A. S. Rawat, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2022.
.
F. Chern, B. Hechtman, A. Davis, R. Guo, D. Majnemer, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2022.
.
A. K. Menon, S. Jayasumana, A. S. Rawat, S. Kim, S. J. Reddi, and S. Kumar
International Conference on Machine Learning (ICML), 2022.
.
Z. Li, S. Bhojanapalli, M. Zaheer, S. J. Reddi and S. Kumar
International Conference on Machine Learning (ICML), 2022.
.
E. M. Lindgren, S. J, Reddi, R. Guo and S. Kumar
Neural Information Processing Systems (NeurIPS), 2021.
.
G. Citovsky, G. DeSalvo, C. Gentile, L. Karydas,
A. Rajagopalan, A. Rostamizadeh and S. Kumar
Neural Information Processing Systems (NeurIPS), 2021.
.
A. K. Menon, A. S. Rawat, S. J. Reddi, S. Kim, and S. Kumar
International Conference on Machine Learning (ICML), 2021.
.
A. S. Rawat, A. K. Menon, W. Jitkrittum, S. Jayasumana, F. X. Yu, S. J. Reddi, and S. Kumar
International Conference on Machine Learning (ICML), 2021.
.
S. J. Reddi, R. K. Pasumarthi, A. K. Menon, A. S. Rawat, F. Yu, S. Kim, A. Veit, and S. Kumar
International Conference on Artificial Intelligence and Statistics (AISTATS) 2021.
.
A. K. Menon, A. S. Rawat, and S. Kumar
International Conference on Learning Representations (ICLR), 2021.
.
S. J. Reddi, Z. Charles, M. Zaheer, Z. Garrett, K. Rush, J. Konecný, S. Kumar, and H. B. McMahan
International Conference on Learning Representations (ICLR), 2021.
.
A. K. Menon, S. Jayasumana, A. S. Rawat, H. Jain
A. Veit and S. Kumar
International Conference on Learning Representations (ICLR), 2021.
.
C.-Y. Hsieh, C.-K. Yeh, X. Liu, P. Ravikumar,
S. Kim, S. Kumar, and C.-J. Hsieh
International Conference on Learning Representations (ICLR), 2021.
.
J. Zhang, A. K. Menon, A. Veit, S. Bhojanapalli, S. Kumar, and S. Sra
International Conference on Learning Representations (ICLR), 2021.
.
C. Yun, Y.-W. Chang, S. Bhojanapalli, A. S. Rawat, S. Reddi, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2020.
.
J. Zhang, S. P. Karimireddy, A. Veit, S. Kim, S. Reddi, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2020.
.
M. Weber, M. Zaheer, A. S. Rawat, A. Menon, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2020.
.
Y. Liu, A. T. Suresh, F. Yu, S. Kumar, and M. Riley
Neural Information Processing Systems (NeurIPS), 2020.
.
H. Chen, S. Si, Y. Li, C. Chelba,
S. Kumar, D. Boning, and C.-J. Hsieh
Neural Information Processing Systems (NeurIPS), 2020.
.
S. Bhojanapalli, C. Yun, A. S. Rawat, S. Reddi, and S. Kumar
International Conference on Machine Learning (ICML), 2020.
.
M. Lukasik, S. Bhojanapalli, A. K. Menon, and S. Kumar
International Conference on Machine Learning (ICML), 2020.
.
R. Guo, P. Sun, E. Lindgren, Q. Geng, D. Simcha, F. Chern and S. Kumar
International Conference on Machine Learning (ICML), 2020.
.
F. X. Yu, A. S. Rawat, A. K. Menon, and S. Kumar
International Conference on Machine Learning (ICML), 2020.
.
Y. You, J. Li, S. Reddi, J. Hseu, S. Kumar, S. Bhojanapalli, X. Song, J. Demmel, K. Keutzer, and C.-J. Hsieh
International Conference on Learning Representations (ICLR), 2020.
.
C. Yun, S. Bhojanapalli, A. S. Rawat, S. J. Reddi, and S. Kumar
International Conference on Learning Representations (ICLR), 2020.
.
A. K. Menon, A. S. Rawat, S. J. Reddi, and S. Kumar
International Conference on Learning Representations (ICLR), 2020.
.
W.-C. Chang, F. Yu, Y.-W. Chang, and S. Kumar
International Conference on Learning Representations (ICLR), 2020.
.
Y. Ruan, Y. Xiong, S. Reddi, S. Kumar,
C.-J. Hsieh
International Conference on Learning Representations (ICLR), 2020.
.
C.-J. Hsieh, Q. Cao, S. Kumar, S. Si, T. Xiao, and X. Liu
International Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
.
A. K. Menon, A. S. Rawat, S. J. Reddi, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2019.
.
C. Guo, A. Mousavi, X. Wu, D. Holtmann-Rice, S. Kale, S. Reddi and S. Kumar
Neural Information Processing Systems (NeurIPS), 2019.
.
A. S. Rawat, J. Chen, F. Yu, A. T. Suresh, and S. Kumar
Neural Information Processing Systems (NeurIPS), 2019.
.
M. Staib, S. Reddi, S. Kale, S. Kumar, and S. Sra
International Conference on Machine Learning (ICML), 2019.
.
S. Wu, A. G. Dimakis, S. Sanghavi, F. X. Yu, D. Holtmann-Rice, D. Storcheus, A. Rostamizadeh, and S. Kumar
International Conference on Machine Learning (ICML), 2019.
.
P.-H. (Patrick) Chen, S. Si, S. Kumar, Y. Li, and C.-J. Hsieh
International Conference on Learning Representations (ICLR), 2019.
.
S. Reddi, S. Kale, F. X. Yu, D. Holtmann-Rice, J. chen and S. Kumar
International Conference on Artificial Intelligence and Statistics (AISTATS), 2019.
.
Q. Geng, W. Ding, R. Guo, and S. Kumar
International Conference on Artificial Intelligence and Statistics (AISTATS), 2019.
.
S. Reddi, M. Zaheer, D. Sachan, S. Kale, and S. Kumar
Neural Information Processing Systems (NIPS), 2018.
.
N. Agarwal, A. T. Suresh, F. X. Yu, S. Kumar, and H. B. McMahan
Neural Information Processing Systems (NIPS), 2018.
.
Ian E. H. Yen, S. Kale, F. X. Yu, D. Holtmann-Rice, S. Kumar, P. Ravikumar
International Conference on Machine Learning (ICML), 2018.
.
S. Reddi, S. Kale, S. Kumar [best paper award]
International Conference on Learning Representations (ICLR), 2018.
.
S. Si, S. Kumar, Y. Li
arXiv:1802.07887, 2018.
.
X. Wu, R. Guo, A. T. Suresh, S. Kumar, D. Holtmann-Rice, D. Simcha, F. X. Yu
Neural Information Processing Systems (NIPS), 2017.
.
B. Dai, R. Guo, S. Kumar, N. He, L. Song
International Conference on Machine Learning (ICML), 2017.
.
A. T. Suresh, F. X. Yu, S. Kumar, H. B. McMahan
International Conference on Machine Learning (ICML), 2017.
.
X. Zhang, F. X. Yu, S. Kumar, S. F. Chang
International Conference on Computer Vision (ICCV), 2017.
.
K. Zhong, R. Guo, S. Kumar, B. Yan, D. Simcha, I. S. Dhillon
International Conference on Artificial Intelligence and Statistics (AISTATS), 2017.
.
F. X. Yu, A. T. Suresh, K. Choromanski, D. Holtmann-Rice, S. Kumar
Neural Information Processing Systems (NIPS), 2016.
.
A. Choromanska, K. Choromanski, M. Bojarski, T. Jebara, S. Kumar, Y. LeCun
International Conference on Machine Learning (ICML), 2016.
.
R. Guo, S. Kumar, K. Choromanski, and D. Simcha
International Conference on Artificial Intelligence and Statistics (AISTATS), 2016.
Previous Arxiv version: arXiv:1509.01469, 2015. [pdf]
.
J. Wang, W. Liu, S. Kumar, S. F. Chang
Proceedings of the IEEE, Volume: 104, Issue: 1 , Jan. 2016.
.
J. Pennington, F. X. Yu, S. Kumar
Neural Information Processing Systems (NIPS), 2015.
.
V. Sindhwani, T. Sainath, S. Kumar
Neural Information Processing Systems (NIPS), 2015.
.
X. Zhang, F. X. Yu, Ruiqi Guo, S. Kumar, S. Wang, S.-F. Chang
International Conference on Computer Vision (ICCV), 2015.
.
Y. Cheng, F. X. Yu, R. S. Feris, S. Kumar,
A. Choudhary, and S. F. Chang
International Conference on Computer Vision (ICCV), 2015.
Previous arXiv version: arXiv:1502.03436v1, 2015. [pdf]
.
K. Choromanski, S. Kumar, and X. Liu
arXiv:1506.03425v1, 2015.
.
F. X. Yu, S. Kumar,
H. Rowley, and S. F. Chang
arXiv:1503.03893v1, 2015.
.
F. X. Yu, Y. Gong, and S. Kumar
Book Chapter, Multimedia Data Mining and Analytics, 2015.
.
W. Liu, C. Mu, S. Kumar,
and S. F. Chang
Neural Information Processing Systems (NIPS), 2014.
Supplementary material can be found here.
.
F. X. Yu, S. Kumar, Y. Gong,
and S. F. Chang
International Conference on Machine Learning (ICML), 2014.
Matlab code can be found here.
.
F. X. Yu, D. Liu, S. Kumar, T. Jebara,
and S. F. Chang
International Conference on Machine Learning (ICML), 2013.
The supplementary file with additional proofs and experiments is here.
.
Y. Gong, S. Kumar, H. Rowley,
and S. Lazebnik
IEEE Computer Vision and Pattern Recognition (CVPR), 2013.
.
A. Talwalkar, S. Kumar, M. Mohri
and H. Rowley
Journal of Machine Learning Research (JMLR), 2013.
.
Y. Gong, S. Kumar, V. Verma,
and S. Lazebnik
Advances in Neural Information Processing Systems (NIPS), 2012.
.
J. He, S. Kumar,
and S. F. Chang
International Conference on Machine Learning (ICML), 2012.
The supplementary file containing all the proofs is here.
NOTE: This is a slightly edited version of what is in the ICML proceedings.
.
W. Liu, J. Wang, Y. Mu, S. Kumar,
and S. F. Chang
International Conference on Machine Learning (ICML), 2012.
The supplementary file containing extended proofs and results is here.
.
J. Wang, S. Kumar,
and S. F. Chang
IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2012.
.
S. Kumar, M. Mohri
and A. Talwalkar
Journal of Machine Learning Research (JMLR), 2012.
.
W. Liu, J. Wang, S. Kumar,
and S. F. Chang
International Conference on
Machine Learning (ICML), 2011.
.
A. Talwalkar, S. Kumar, M. Mohri
and H. Rowley
Book chapter in Manifold Learning Theory and Applications. Editors: Y. Ma and Y. Fu. CRC Press, 2011.
.
S. Kumar,
M. Mohri and A. Talwalkar
Book chapter in Ensemble Machine Learning: Theory and Applications, Springer, 2011.
Modified to correct an error in the computational complexity analysis. April 2011.
.
A. Makadia, V. Pavlovic and S. Kumar
International Journal on Computer Vision (IJCV), 2010.
.
J. Wang, S. Kumar,
and S. F. Chang
International Conference on
Machine Learning (ICML), 2010.
.
Z. Wang, M. Zhao, Y. Song, S. Kumar and B. Li
IEEE Computer Vision and Pattern Recognition (CVPR), 2010.
.
J. Wang, S. Kumar,
and S. F. Chang
IEEE Computer Vision and Pattern Recognition (CVPR), 2010.
Typo in Eq (21) corrected. June 2010.
.
S. Kumar
Book chapter in Computer Vision: Detection, Recognition and Reconstruction, Springer, 2010.
Eds. R. Cipolla, S. Battiato, and G. M. Farinella.
.
S. Kumar,
M. Mohri and A. Talwalkar
Neural Information Processing Systems
(NIPS), 2009.
Modified to correct an error in the computational complexity analysis. April 2011.
.
S. Kumar,
M. Mohri and A. Talwalkar
International Conference on
Machine Learning (ICML), 2009.
.
S. Kumar,
M. Mohri and A. Talwalkar
Twelfth International Conference on
Artificial Intelligence and Statistics (AISTATS), 2009.
.
A. Makadia,
V. Pavlovic and S. Kumar
European Conference on Computer Vision (ECCV), 2008.
.
A. Talwalkar, S. Kumar and
H. A. Rowley
IEEE Computer Vision and Pattern Recognition (CVPR), 2008.
.
M. Kim,
S. Kumar, V. Pavlovic and
H. A. Rowley
IEEE Computer Vision and Pattern Recognition (CVPR), 2008.
.
S. Kumar and
H. A. Rowley
IEEE International Conference on Computer
Vision (ICCV), 2007.
Some additional results and parts of the
video and retrieval datasets used in this work can be seen here.
·
S. Kumar and M. Hebert
International Journal of Computer Vision
(IJCV), 68(2), 179-201, 2006.
·
S. Kumar,
J. August and M. Hebert
This paper is an extended and revised version of the earlier
work presented in Snowbird Learning Workshop, 2004.
·
S. Kumar
Revised October 2005.
·
S.
Kumar and M. Hebert
A Hierarchical Field Framework for Unified
Context-Based Classification
IEEE International Conference on Computer
Vision (ICCV), 2005.
Revised October 2005.
·
C. Rother, S. Kumar, V.
Kolmogorov and A. Blake
IEEE International Conference on Computer Vision and
Pattern Recognition (CVPR), June, 2005.
[pdf]
·
S. Kumar and M. Hebert
Snowbird Learning Workshop, Utah, 2004.
The synthetic dataset used for learning and inference
experiments can be obtained from here.
·
S. Kumar and M. Hebert
Snowbird Learning Workshop, Utah, 2004.
[pdf]
·
S. Kumar and M. Hebert
The binary denoising synthetic dataset used for
training and testing can be obtained from here.
·
B. Nabbe, S. Kumar, and
M. Hebert
In
Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems
(IROS), October 2004.
·
S.
Kumar and M. Hebert
Discriminative Random Fields: A Discriminative
Framework for Contextual Interaction in Classification
IEEE International Conference on Computer Vision
(ICCV), 2003.
·
S. Kumar and M. Hebert
Man-Made Structure Detection in Natural Images using
a Causal Multiscale Random Field
IEEE International Conference on Computer Vision and
Pattern Recognition (CVPR), 2003.
Some more example results
and comparisons.
The structure detection database used for training
and testing can be obtained from here.
·
S. Kumar, A. C. Loui,
and M. Hebert
An Observation-Constrained Generative Approach for
Probabilistic Classification of Image Regions
Image and Vision Computing, 21,
pp. 87-97, 2003.
A shorter version of this paper
appeared in the following workshop:
·
S. Kumar, A. C. Loui,
and M. Hebert
Probabilistic Classification of Image Regions using
an Observation-Constrained Generative Approach
ECCV Workshop on Generative Models
based Vision (GMBV), 2002.