Harit Vishwakarma

Harit Vishwakarma

CS PhD Student at UW Madison
hvishwakarma@cs.wisc.edu
Madison, WI
About Me

I am a Computer Science PhD student at the University of Wisconsin-Madison. I am grateful to have Prof. Frederic Sala and Prof. Ramya Korlakai Vinayak as my advisors. My research interests are broadly in foundations of machine learning, statistics and applications. Before coming to Madison I was at IBM Research, Bangalore for 3 years, where I worked on knowledge graphs, reasoning and information retrieval. I spent two wonderful years at the IISc, Bangalore to obtain a masters in CS, where I was fortunate to work with Prof. Chiranjib Bhattacharyya on temporal point processes and group inducing regularizers. I was a software engineer at Ittiam Systems, Bangalore for a couple of years where we built a media transcoding service. Before that I grew up playing cricket in a village in Bundelkhand, India and graduated from SGSITS, Indore with B.E. in computer science. For more details you can checkout my CV.

Research Interests
"Trying to make sense of the world a bit at a time."

  • I am interested in machine learning and statistics, with a focus on understanding fundamental principles and developing theoretically grounded solutions (a.k.a "practical theory"). My current interests revolve around, learning with less labeled data [auto-labeling, weak supervision], uncertainty quantification and calibration, and statistical inference/safe anytime valid inference (SAVI) [adaptive OOD detection].
  • I gravitate towards efficient organization and retrieval of information and love building efficient+elegant systems in general. I have delved into reasoning and knowledge graph embeddings [quantum embeddings], and information retrieval. I am exploring Foundation models/LLMs as they provide a more unified and promising solution to these problems.
  • I am also enthusiastic about optimzation and game theory [parameter markets, federated learning].
News

  • [01/24] Paper with Lin and Ramya on OOD Detection with FPR control got accepted in AISTATS 2024!
  • [11/23] Presented our work on auto-labeling in MLOPT Idea Seminar.   [Slides].
  • [10/23] Presented our work on Taming False Positives in Out of Distribution Detection at IFDS Seminar.
  • [09/23] Two papers accepted in NeurIPS!
  • [07/23] Presented our work on auto-labeling and OOD detection in DMLR and AI-HCI workshops @ ICML'23.
  • [06/23] New blog post on aggregating LLM or foundation model objects using weak supervision.

Checkout my work with amazing collaborators. I'd love to know any feedback you might have on any of these works. Always open to chat and collaborate! so feel free to reach out :)
Conference Publications

Pearls from Pebbles: Improved Confidence Functions for Auto-labeling
Harit Vishwakarma, Yi Chen, Sui Jiet Tay, Srinath Namburi, Frederic Sala, Ramya Korlakai Vinayak
Under Review, 2024

OTTER: Improving Zero-Shot Classification via Optimal Transport
Changho Shin, Jitian Zhao, Sonia Cromp, Harit Vishwakarma, Frederic Sala
Under Review, 2024

Taming False Positives in Out-of-Distribution Detection with Human Feedback
Harit Vishwakarma, Heguang Lin, Ramya Korlakai Vinayak
International Conference on Artificial Intelligence and Statistics (AISTATS), 2024

Promises and Pitfalls of Threshold-based Auto-labeling
Harit Vishwakarma, Heguang Lin, Frederic Sala, Ramya Korlakai Vinayak
Neural Information Processing Systems (NeurIPS), 2023 (Spotlight)

Train 'n Trade: Foundations of Parameter Markets
Tzu-Heng Huang, Harit Vishwakarma, Frederic Sala
Neural Information Processing Systems (NeurIPS), 2023

Lifting Weak Supervision To Structured Prediction
Harit Vishwakarma, Nicholas Roberts, Frederic Sala
Neural Information Processing Systems (NeurIPS), 2022

Universalizing Weak Supervision
Changho Shin, Winfred Li, Harit Vishwakarma, Nicholas Roberts, Frederic Sala
International Conference on Learning Representations (ICLR), 2022

Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient
Ankit Pensia, Shashank Rajput, Alliot Nagle, Harit Vishwakarma, Dimitris Papailiopoulos
Neural Information Processing Systems (NeurIPS), 2020 (Spotlight)

Attack of the Tails: Yes, You Really can Backdoor Federated Learning
H. Wang, K. Sreenivasan, S. Rajput, H. Vishwakarma, S. Agarwal, J. Sohn, K. Lee, D. Papailiopoulos
Neural Information Processing Systems (NeurIPS), 2020

Quantum Embedding of Knowledge for Reasoning
D. Garg, S. Ikbal, S. K Srivastava, H. Vishwakarma, H. Karnam, L. V. Subramaniam
Neural Information Processing Systems (NeurIPS), 2019

Know Thy Neighbors, and More! Studying the Role of Context in Entity Recommendation
Sumit Bhatia, Harit Vishwakarma
ACM Conference on HyperText and Social Media (HT), 2018 (Best Paper Nominee)

Workshop Publications

ScriptoriumWS: A Code Generation Assistant for Weak Supervision
Tzu-Heng Huang, Catherine Cao, Spencer Schoenberg, Harit Vishwakarma, Nicholas Roberts, Frederic Sala
Deep Learning for Code (DL4C) Workshop at ICLR, 2023

An End-to-end Machine Learning Pipeline that Ensures Fairness Policies
S. Shaikh, H. Vishwakarma, S. Mehta, K. R. Varshney, K. N. Ramamurthy, D. Wei
Bloomberg Data for Good Exchange, 2017

Service

Served as a reviewer for,

  • Neural Information Processing Systems (NeurIPS)
    2021, 2022, 2023.
    Top Reviewer (~ top 8%) for NeurIPS 2022.
  • International Conference on Machine Learning (ICML)
    2022, 2023, 2024.
  • International Conference on Learning Representations (ICLR)
    2021, 2022, 2023, 2024.
  • International Conference on Artificial Intelligence and Statistics (AISTATS)
    2024.
  • Transactions on Machine Learning Research Journal (TMLR) Since 2022.

Teaching

  • I was TA for,
      1. CS 761, advanced course on Mathematical Foundations of ML, Instructor Prof. Rob Nowak, [Spring, 22]. I helped with homeworks, exams, held office hours and gave a lecture on uniform convergence results for finite hypothesis class.
      2. CS 760, grad level intro to ML course, Instructor Prof. Fred Sala, [Fall, 21 ]. I helped with homeworks, exams and held office hours.
  • In general, I enjoy teaching and mentoring. I have taught students at various levels in my village during my high school, partly to support my education and with the hope to inspire the otherwise disinterested kids. It has also been a yardstick to measure my own understanding. ( Feynman's quote "If you want to master something, teach it."). My biggest success has been teaching and mentoring my younger brother from the elementary school till the college, who is now a much better software engineer than me.
Miscellaneous

  • I enjoy sports/athletic activities, particularly enjoy playing cricket, badminton, racquetball and biking, running.
  • I like reading Indian philosophy and Hindi poetry (e.g. Kabir), it gives me useful point of views/tools and has been a source of peace and strength in tough times :).