Ting Hua

prof_pic.png

I’m an Assistant Research Professor at the University of Notre Dame. My research is driven by several questions:

  • Reasoning and LLM architecture: Can LLMs evolve by themselves? What are the learning dynamics between data and model capabilities? Beyond transformers, are there better architectures?
  • Efficient learning: Can small models achieve comparable performance with large models? How can we train models continually without forgetting? Can we achieve effective adaptation with fewer trainable parameters?
  • LLM evaluation and explanation: How do we reliably evaluate LLMs, and how can we explain their behavior?
  • Interdisciplinary AI applications: Can LLMs accelerate scientific discovery (drug design, computational chemistry)? How can AI enhance teaching and learning? How can AI address social challenges and support vulnerable populations?

Previously, I was a research scientist at Samsung Research America, where I worked on model compression and continual learning with applications in natural language understanding (NLU) and automatic speech recognition (ASR). I received my PhD from Virginia Tech, focusing on probabilistic graphical models and its application on social events detection.

LLM Compression

Develop dimension-independent structural pruning methods for large language models (NeurIPS2024). Create adaptive rank selection techniques for low-rank approximations (NAACL2024). Design numerical optimization approaches for weighted low-rank estimation (EMNLP2022). Pioneer weighted factorization methods for language model compression (ICLR2022). Design automatic mixed-precision quantization search methods for BERT (IJCAI2021).

Efficient Architectures

Create tiny transformers with shared dictionaries (ICLR2022). Develop lightweight multi-modal detectors (CVPR2022).

Continual Learning

Develop continual customization methods for text-to-image diffusion models with C-LoRA (TMLR2024). Create hyperparameter-free continuous learning approaches for domain classification in natural language understanding (NAACL2021).

Security & Privacy

Design black-box trojan prompt attacks for large language models to understand and improve model security (NeurIPS2023).

Social Event Detection

Develop automatic event detection systems from social media data. Create methods for beating traditional news sources using social media. Design spatio-temporal event detection algorithms for real-time social media analysis.

Social Media Analysis

Unify societal pattern recognition into probabilistic modeling frameworks. Create social influence detection methods. Develop topical modeling approaches for social data.