Task-Adaptive Tokenization: Enhancing Long-Form Text Generation Efficacy in Mental Health and Beyond
Published in EMNLP2023 Main Conference, 2024
This paper proposed a method to build a better tokenizer for downstream task.
Recommended citation: Liu, Siyang, Naihao Deng, Sahand Sabour, Yilin Jia, Minlie Huang and Rada Mihalcea. “Task-Adaptive Tokenization: Enhancing Long-Form Text Generation Efficacy in Mental Health and Beyond.” (2023). https://arxiv.org/abs/2310.05317