超要約:企業のsLLM(小型LLM)を強化するDACP(ドメイン適応型事前学習)技術の研究だよ!
✨ ギャル的キラキラポイント ✨
● 企業向けsLLMの性能を爆上げ⤴️、コストも抑えれるって神✨ ● 色んな分野(TelcoとかFinance)に特化したsLLMが作れちゃう💖 ● AI技術が、色んなビジネスをさらにアゲアゲ⤴️にするってこと💋
詳細解説いくね!
続きは「らくらく論文」アプリで
The emergence of open-source large language models (LLMs) has expanded opportunities for enterprise applications; however, many organizations still lack the infrastructure to deploy and maintain large-scale models. As a result, small LLMs (sLLMs) have become a practical alternative despite inherent performance limitations. While Domain Adaptive Continual Pretraining (DACP) has been explored for domain adaptation, its utility in commercial settings remains under-examined. In this study, we validate the effectiveness of a DACP-based recipe across diverse foundation models and service domains, producing DACP-applied sLLMs (ixi-GEN). Through extensive experiments and real-world evaluations, we demonstrate that ixi-GEN models achieve substantial gains in target-domain performance while preserving general capabilities, offering a cost-efficient and scalable solution for enterprise-level deployment.