Knowledge Distillation of Black-Box Large Language Models
knowledge distillationblack-box large language modelsproxy modelefficient knowledge transferLLMsgenerative AI
Author: babelfish
Date: 6/28/2026
Article Summary:
A novel method, Proxy-KD, is introduced to facilitate the efficient transfer of knowledge from black-box large language models (LLMs) to smaller models, surpassing traditional white-box KD techniques.