Muhammad Umar Farooq

Doctoral researcher, Artificial Intelligence (AI)


I am a doctoral student at the Department of Computer Science, University of Sheffield (UK) since 2021. I am working on multilingual speech recognition systems at the LivePerson Centre for Speech and Language Technologies (SLT) under the supervision of Prof. Thomas Hain. My PhD research revolves around cross-lingual acoustic-phonetic similarities. Being part of the LivePerson Centre, I am also associated with Speech and Hearing (SPANDH), and Machine Intelligence for Natural Interfaces (MINI) research groups.

Alongside my PhD, I have also developed a short course on ‘Unsupervised Machine Learning’ for non-experts as a ‘Training Assiatnt’ at the University of Sheffield. I am also delivering sessions on Python programming to non-experts (faculty members and PhD students from social science departments). I have also worked as a Graduate Teaching Assistant (GTA) for various modules at the University of Sheffield. I have assisted module leaders for various modules including ‘Machine Learning and Adaptive Intelligence’ and ‘Data Science with Python’. Please visit the teaching page for details.

Before enrolling for my Ph.D., I have worked as a pre-doc research intern at Institute of Formal and Applied Linguistics (UFAL), Charles University, Prague. I primarily worked on speech-related components of the EU Horizon 2020 project European Live Translator (ELITR) supervised by Dr. Ondrej Bojar.

Prior to that, I worked as a speech processing Research Officer at Center for Language Engineering (CLE), University of Engineering and Technology (UET), Lahore. I joined CLE during my senior year as a speech scientist to develop low-resource language technologies under the supervision of Dr. Sarmad Hussain. I received my M.Sc. and B.Sc. Electrical Engineering degrees from UET, Lahore in 2019 and 2017 respectively.

Selected Publications

  1. Progressive Unsupervised Domain Adaptation for ASR Using Ensemble Models and Multi-stage Training
    Rehan Ahmad, Muhammad Umar Farooq, and Thomas Hain
    In IEEE ICASSP, 2024
  2. MUST: A Multilingual Student-Teacher Learning Approach for Low-Resource Speech Recognition
    Muhammad Umar Farooq, Rehan Ahmad, and Thomas Hain
    In IEEE ASRU, 2023
  3. Learning Cross-lingual Mappings for Data Augmentation to Improve Low-Resource Speech Recognition
    Muhammad Umar Farooq, and Thomas Hain
    In Proc. INTERSPEECH, 2023
  4. Towards Domain Generalisation in ASR with Elitist Sampling and Ensemble Knowledge Distillation
    Rehan Ahmad, Md Asif Jalal, Muhammad Umar Farooq, and 2 more authors
    In IEEE ICASSP, 2023
  5. Investigating the Impact of Crosslingual Acoustic-Phonetic Similarities on Multilingual Speech Recognition
    Muhammad Umar Farooq, and Thomas Hain
    In Proc. Interspeech, 2022
  6. Non-Linear Pairwise Language Mappings for Low-Resource Multilingual Acoustic Model Fusion
    Muhammad Umar Farooq, Darshan Adiga Haniya Narayana, and Thomas Hain
    In Proc. Interspeech, 2022
  7. Improving Large Vocabulary Urdu Speech Recognition System Using Deep Neural Networks
    Muhammad Umar Farooq, Farah Adeeba, Sahar Rauf, and 1 more author
    In Proc. Interspeech 2019, 2019