I am a AI engineer mainly researching about computer vision. Recently researching Diffusion Models, Large Language Models and theirs Quantization methods too.
For me, Development does not happen just in computer. Development means All actions that present a solution when a problem is given, and if the real action is more appropriate than the code, I prefer to adopt it.
- Train/Inference speed optimization for big-models(exllama, Stable Diffusion, vllm, etc)
- Finetuning LLMs(full-finetuning, LoRA, QLoRA)
- Large model Quantization into 4bit(GPTQ, AWQ)
- Few-data learning using CrossValidation & Stacking Ensemble
- MoE (Mixture of Experts)
- More Interests sorted by category
Web CV last updated: 2024.05 Web Portfolio last updated: 2024.05
- E-mail: [email protected]
- LinkedIn: https://www.linkedin.com/in/hyeongmin-moon-09aaa3164/