Ting Hua
I’m an Assistant Research Professor at the University of Notre Dame. My research is driven by several questions:
- Reasoning and LLM architecture: Can LLMs evolve by themselves? What are the learning dynamics between data and model capabilities? Beyond transformers, are there better architectures?
- Efficient learning: Can small models achieve comparable performance with large models? How can we train models continually without forgetting? Can we achieve effective adaptation with fewer trainable parameters?
- LLM evaluation and explanation: How do we reliably evaluate LLMs, and how can we explain their behavior?
- Interdisciplinary AI applications: Can LLMs accelerate scientific discovery (drug design, computational chemistry)? How can AI enhance teaching and learning? How can AI address social challenges and support vulnerable populations?
Previously, I was a research scientist at Samsung Research America, where I worked on model compression and continual learning with applications in natural language understanding (NLU) and automatic speech recognition (ASR). I received my PhD from Virginia Tech, focusing on probabilistic graphical models and its application on social events detection.
LLM Compression
Develop dimension-independent structural pruning methods for large language models (NeurIPS2024). Create adaptive rank selection techniques for low-rank approximations (NAACL2024). Design numerical optimization approaches for weighted low-rank estimation (EMNLP2022). Pioneer weighted factorization methods for language model compression (ICLR2022). Design automatic mixed-precision quantization search methods for BERT (IJCAI2021).
Efficient Architectures
Create tiny transformers with shared dictionaries (ICLR2022). Develop lightweight multi-modal detectors (CVPR2022).
Continual Learning
Develop continual customization methods for text-to-image diffusion models with C-LoRA (TMLR2024). Create hyperparameter-free continuous learning approaches for domain classification in natural language understanding (NAACL2021).
Security & Privacy
Design black-box trojan prompt attacks for large language models to understand and improve model security (NeurIPS2023).
Social Event Detection
Develop automatic event detection systems from social media data. Create methods for beating traditional news sources using social media. Design spatio-temporal event detection algorithms for real-time social media analysis.
Social Media Analysis
Unify societal pattern recognition into probabilistic modeling frameworks. Create social influence detection methods. Develop topical modeling approaches for social data.