Haohe Liu 刘濠赫 (Leo)

Email: haohe.liu AT surrey dot ac dot uk

Shot at Longmen Grottoes in China

I’m Haohe Liu, a Ph.D. student at the Centre for Vision Speech and Signal Processing (CVSSP), University of Surrey. My research includes topics related to speech, music, and general audio. I am fortunate to be advised by Prof. Mark D. Plumbley, co-supervised by Prof. Wenwu Wang. And I’m lucky to be jointly funded by BBC R&D and the Doctoral College. Most of my studies are open-sourced.

I will attend ICASSP 2024, April 13 to April 20 in Korea, Seoul. Looking forward to meeting & chatting with you there!

Research highlights

My research includes tasks related to the audio generative model, audio source separation, audio quality enhancement, and audio recognition. Appeared in conferences such as ICML, AAAI, NeurIPS, INTERSPEECH, and ICASSP.

Highlighted research performed as the first author:

State-of-the-art text-to-audio generation model: AudioLDM and AudioLDM2.
State-of-the-art audio super-resolution model on any audio type and any sampling rate: AudioSR.
First text-to-speech model that achieves on par CMOS with human recording: NaturalSpeech.
Restore the quality of human speech signal regardless of how the signal is degraded: VoiceFixer.
The music source separation system that achieves leading performance on Music Demixing Challenge 2021: CWS-PResUNet.
State-of-the-art speech super-resolution model: NVSR.
A module that makes the temporal-resolution of the spectrogram differentiable for efficient audio classification: DiffRes.
Few-shot bioacoustic detection: The 2nd ranking system in the DCASE 2022 Challenge Task 5.

Please refer to my Google Scholar Page for the full publication list:

Education Experience

Centre for Vision, Speech and Signal Processing @ University of Surrey, UK, 01/2022 - 01/2025
– PhD in Vision, Speech and Signal Processing; Main advisor: Prof. Mark D. Plumbley
– With a studentship from the CVSSP and the EPSRC Grant EP/T019751/1 AI for Sound

School of Computer Science @ Northwestern Polytechnical University, China, 09/2016 - 07/2020
– Bachelor of Engineering, Outstanding graduate, Computer Science and Technology; Advisor: Prof. Lei Xie
– GPA: 3.8/4.0 (Top 5%)

Competitions

First place, DCASE Challenge Task 7:Foley Sound Synthesis, 2022
Yi Yuan, Haohe Liu, Xubo Liu, Xiyuan Kang, Mark D.Plumbley, Wenwu Wang
[Paper] [Demo] [Code] [leaderboard]

Second place, DCASE Challenge Task 5:Few-shot Bioacoustic Event Detection, 2022
Haohe Liu, Xubo Liu, Xinhao Mei, Qiuqiang Kong, Wenwu Wang, Mark D. Plumbley
[Paper] [Code] [leaderboard]

Second place on vocal score and fifth place on overall score, ISMIR Music Demixing Challenge, 2021
Haohe Liu and Qiuqiang Kong and Jiafeng Liu
[Paper] [Code] [Challenge details] [leaderboard]

Second place, DCASE Challenge Task 6B: Language-Based Audio Retrieval, 2022
Xinhao Mei, Xubo Liu, Haohe Liu, Jianyuan Sun, Mark D. Plumbley, Wenwu Wang
[Report] [Challenge details]

Third place, DCASE Challenge Task 6A: Automated Audio Captioning, 2022
Xinhao Mei, Xubo Liu, Haohe Liu, Jianyuan Sun, Mark D. Plumbley, Wenwu Wang
[Report] [Challenge details]

Honors & Awards

Scholarships

Doctoral College Scholarship, tuition waiver with stipend, University of Surrey
Outstanding Graduate Students, Northwestern Polytechnical University, 2020-2021
WuYaJun third class scholarship, 2019
National Scholarship, Northwestern Polytechnical University (top 1.5%), 2017 and 2018, two consecutive years
First-class Scholarship, Northwestern Polytechnical University (top 14.7%), 2016 to 2019, three consecutive years
Gratitude to Scientists of Modern Times National Scholarship (top 0.5%), 2018

Selected Awards

First Prize in the 2018 China’s National Robot Competition
Honorable Mention in the 2018 Mathematical Contest in Modeling
Second Prize in the 2018 National Marine Vehicle Competition
First Prize in 2018 Shaanxi Province Mathematical Contest in Modeling
First Prize in the 8th NWPU Intelligent Vehicle Competition
First Prize in 2018 NWPU C Language Programming competition
First Prize in the 2017 NWPU Mathematical Contest in Modeling

Qualifications

China Conservatory of Music - Piano Program - Level Ten (highest)
TOEFL: 108 (R: 29, L:27, S: 25, W:27; 2019/02)
GRE: 322 (V:152, Q:170, W:3.5)
DET: 130 (Literacy: 135, Comprehension: 135, Conversation:110, Production: 110)

Teaching Assistance

EEE3008 Fundamentals of DSP, University of Surrey, 2022/23 Semester 1
EEE1033 Computer and Digital Logic, University of Surrey, 2022/23 Semester 1
EEEM068 Applied Machine Learning, University of Surrey, 2022/23 Semester 2

Tweets by LiuHaohe