For open positions, see Jobs.

  • We have multiple openings for students interns and short-term research assistants (after BTech) to work with us on audio LLMs and diffusion models. More details here.
  • We have an opening for postdoc on adaptation of regression models over graphs. Candidates with strong background in machine learning are welcome to apply.

About

The Machine Analysis of Data for Human Audition and Visualization (MADHAV) Lab is a research group in the Department of Electrical Engineering at the Indian Institute of Technology Kanpur set up and led by Prof. Vipul Arora.

Our group’s research interests lie at the intersection of the theory and application of machine learning - with a focus on applications in Audio and Physics. Our group focuses in the following areas:

  • Human Machine Learning
    • Efficient data labeling
    • Data efficient learning and adaptation
  • Generative Machine learning
    • Normalizing flows, adversarial learning, diffusion models
    • Sampling methods: Monte Carlo, application in Physics (lattice QCD and statistical physics)
  • Audio signal processing
    • Audio LLMs: textless speech tokenization and fast search
    • Music analysis
    • Speech recognition
  • Other applications
    • Image generation
    • Sensor calibration

News

  • Mar 2024: Prof. Arora gave a talk on "Human machine learning for Searching Big Audio Data" at NIT Calicut.
  • Feb 2024: Prof. Arora gave a keynote talk on "Human-machine learning" at ICMLA conference at Chitkara University.
  • Dec 2023: WiSSAP 2023 school (AI for Music) concluded successfully. Videos and slides are here.
  • Dec 2023: One paper on acoustic event detection using ontology-informed constraints accepted at the ICASSP 2024. Congratulations Akshay and Sayeedul!
  • August 2023: We are organizing the 16th Winter School on Speech and Audio Processing 2023 (AI for Music) at IIT Kanpur. Register now
  • July 2023: A new research project started with Monotype LLC. Positions open for students.
  • June 2023: Patent Granted on A Sensor System to read MIDI from Indian Harmoniums. Congratulations Suraj!
  • May 2023: One paper on acoustic word embeddings accepted at the INTERSPEECH' 23. Congratulations Adhiraj!
  • Feb 2023: Three papers accepted at the ICASSP' 23. Congratulations Sumit, Anup and Akshay!
  • Jan 2023: One paper on normalizing flows for lattice field theory accepted at the Physical Review D journal. Congratulations Ankur!
  • Jan 2023: One paper on audio representation learning accepted at the ICLR' 23. Congratulations Adhiraj!
  • Jan 2023: Kavya and Prof. Arora delivered a tutorial on Meta Learning at the CODS-COMAD' 23 at IIT Bombay. Video
  • Dec 2022: One paper on generative learning for lattice Gross-Neveu model accepted at the Scipost Physics Core journal. Congratulations Ankur!
  • Oct 2022: Prof. Arora delivered a talk on Model Adaptation for Learning from Small Data at C4DM, Queen Mary University of London.
  • July 2022: One paper on Audio Fingerprinting accepted at the ISMIR' 22. Congratulations Anup!