About me

I am now a postdoctoral research fellow in School. Computer Science Engineering at Nanyang Technological Univerisity supervised by Assoc. Prof. Eng Siong Chng. My research interests lie in speech signal processing with machine learning, especially speech and language recognition.

Education

  • 2018.08 - 2023.6, Ph.D., Speech and Language recognition, Nanyang Technological University, Singapore.
    Supervisor: Assoc. Prof. Andy W.H. Khong (School of EEE, Nanyang Technological University)
    Co-supervisor: Dr. Leibny Paola Garcia-Perera (CLSP, HLT-COE, The Johns Hopkins University)
    During my Ph.D., I was also working tightly with Prof. Sanjeev Khudanpur, Prof. Suzy J. Styles, and Prof. Eng Siong Chng.
  • 2017.08-2018.07, MS.C., Computer Control and Engineering, Nanyang Technological University, Singapore.
  • 2012.09-2016.07, B.S. Communication Engineering, Harbin Institute of Technology, Harbin, China.

Publications

  Conference

  1. MERLIon CCS Challenge: A English-Mandarin code-switching child-directed speech corpus for language identification and diarization.
    Victoria Y.H. Chua*, Hexin Liu*, Leibny Paola Garcia-Perera, Fei Ting Woon, Jinyi Wong, Xiangyu Zhang, Sanjeev Khudanpur, Andy W.H. Khong, Justin Dauwels, Suzy J. Styles.
    Proc. Interspeech 2023. (Oral Presentation) [pdf]
  2. Investigating model performance in language identification: beyond simple error statistics.
    Suzy J Styles, Victoria Y.H. Chua, Fei Ting Woon, Hexin Liu, Leibny Paola Garcia Perera, Sanjeev Khudanpur, Andy W.H. Khong, Justin Dauwels.
    Proc. Interspeech 2023. (Oral Presentation) [pdf]
  3. Self-supervised Learning Representation based Accent Recognition with Persistent Accent Memory.
    Rui Li, Zhiwei Xie, Haihua Xu, Yizhou Peng, Hexin Liu, Hao Huang, Eng Siong Chng.
    Proc. Interspeech 2023. [pdf]
  4. Reducing Language Confusion for Code-Switching Speech Recognition with Token-Level Language Diarization.
    Hexin Liu, Haihua Xu, Leibny Paola Garcia-Perera, Andy W.H. Khong, Yi He, Sanjeev Khudanpur.
    Proc. ICASSP 2023. [pdf]
  5. PQLM - Multilingual Decentralized Portable Quantum Language Model.
    Shuyue Stella Li, Xiangyu Zhang, Shu Zhou, Hongchao Shu, Ruixing Liang, Hexin Liu, Leibny Paola Garcia-Perera.
    Proc. ICASSP 2023. [pdf]
  6. PHO-LID: A Unified Model Incorporating Acoustic-Phonetic and Phonotactic Information for Language Identification.
    Hexin Liu, Leibny Paola Garcia-Perera, Andy W.H. Khong, Suzy J. Styles, Sanjeev Khudanpur.
    Proc. Interspeech 2022. (Oral Presentation) [pdf]
  7. Enhancing Language Identification using Dual-mode Model with Knowledge Distillation.
    Hexin Liu, Leibny Paola Garcia Perera, Andy WH Khong, Justin Dauwels, Suzy J Styles, Sanjeev Khudanpur.
    Proc. Odyssey Speaker Lang. Recognit. Workshop 2022. [pdf]
  8. End-to-end language diarization for bilingual code-switching speech.
    Hexin Liu, Leibny Paola Garcia-Perera, Xinyi Zhang, Justin Dauwels, Andy W.H. Khong, Sanjeev Khudanpur, Suzy J. Styles.
    Proc. Interspeech 2021. [pdf]

  Journal

  1. Efficient self-supervised learning representations for spoken language identification.
    Hexin Liu, Leibny Paola Garcia-Perera, Andy W.H. Khong, Eng Siong Chng, Suzy J. Styles, Sanjeev Khudanpur.
    IEEE Journal of Selected Topics in Signal Processing. 2022 [pdf]

Academic Activities

  Reviewer

    I served as a reviewer for conferences and journals including Interspeech, IEEE ICASSP, IEEE ASRU, IEEE SLT, and IEEE SPL, TASLP, etc.

  Session Chair and others

  1. Interspeech 2023 session chair
  2. Mentor of Hackthon session in IEEE SLT 2022

Work experiences

  • 2022.08 - 2023.01, Research intern, Bytedance AI Lab, Singapore.
  • 2023.04 - 2023.08, Research associate, Nanyang Technological University, Delta-NTU Corp. Lab, Singapore.
  • 2023.08 - present, Research fellow, Nanyang Technological University, Speech Lab, Singapore.

Contact

Email: hexin.liu@ntu.edu.sg