Research
My research spans multiple areas of AI and machine learning, organized by focus areas.
Model Compression & Efficiency
Develop dimension-independent structural pruning methods for large language models. Create adaptive rank selection techniques for low-rank approximations. Design numerical optimization approaches for weighted low-rank estimation. Pioneer weighted factorization methods for language model compression.
Efficient Architectures
Create tiny transformers with shared dictionaries. Develop lightweight multi-modal detectors. Design automatic mixed-precision quantization search methods for BERT.
Social Event Detection
Develop automatic event detection systems from social media data. Create methods for beating traditional news sources using social media. Design spatio-temporal event detection algorithms for real-time social media analysis.
Social Media Analysis
Unify societal pattern recognition into probabilistic modeling frameworks. Create social influence detection methods. Develop topical modeling approaches for social data.
Continual Model Adaptation
Develop continual customization methods for text-to-image diffusion models with C-LoRA. Create hyperparameter-free continuous learning approaches for domain classification in natural language understanding.
Advanced Security Methods
Design black-box trojan prompt attacks for large language models to understand and improve model security.