ISTD PhD Oral Defence Seminar by Zeng Guangtao – Language models are foundational to modern artificial intelligence, but their development is often constrained by challenges in efficiency, controllability, and reasoning. In this thesis, we aim to address these limitations by introducing advanced paradigms at both the pre-training and post-training stages.