Publications & Manuscripts

* Equivalent contribution, † Corresponding author

Preprints

SignLLM: Sign Language Production Large Language Models
Sen Fang, Lei Wang, Ce Zheng, Chunyu Sui, Mingyu Zhao, Yapeng Tian, Chen Chen^†
arXiv:2405.10718
[Paper] [Project Website] [Prompt2Sign Dataset]

Echotune: A Modular Extractor Leveraging the Variable-Length Nature of Speech in ASR Tasks
Sizhou Chen, Songyang Gao, Sen Fang
arXiv:2309.07765
[Paper]

Bridging the Gap between Text, Audio, Image, and Any Sequence: A Novel Approach using Gloss-based Annotation
Sen Fang, Sizhou Chen^*, Yalin Feng, Xiaofeng Zhang, Teik Toe Teoh^†
Preprint'24
[Paper] [Local-PDF]

SignDiff: Diffusion Models for American Sign Language Production
Sen Fang, Chunyu Sui^*, Yanghao Zhou, Xuedong Zhang, Hongbin Zhong, Minyu Zhao, Yapeng Tian^†, Chen Chen^†
arXiv:2308.16082
[Paper] [Project Page] [Preprocessed Data]

Publications

UniBriVL: Robust Universal Representation and Generation of Audio Driven Diffusion Models
Sen Fang, Bowen Gao, Yangjian Wu, Teik Toe Teoh^†
EMNLPw'23
[Paper] [Code]

Exploring Efficient-Tuned Learning Audio Representation Method from BriVL
Sen Fang, Yangjian Wu, Bowen Gao, Jingwen Cai, Teik Toe Teoh^†
ICONIP'23
[Paper] [arXiv] [PPT]