タイトル & 超要約(15字以内) CERBERUSでコードのエラーを爆速検出!🚀
ギャル的キラキラポイント✨ ● コードを実行しなくてもエラー見つけちゃう神機能!✨ ● LLM(大規模言語モデル)を賢く使って効率UP⤴️ ● 不完全なコードにも対応できるって、マジ神じゃん?😍
詳細解説
リアルでの使いみちアイデア💡
続きは「らくらく論文」アプリで
In several software development scenarios, it is desirable to detect runtime errors and exceptions in code snippets without actual execution. A typical example is to detect runtime exceptions in online code snippets before integrating them into a codebase. In this paper, we propose Cerberus, a novel predictive, execution-free coverage-guided testing framework. Cerberus uses LLMs to generate the inputs that trigger runtime errors and to perform code coverage prediction and error detection without code execution. With a two-phase feedback loop, Cerberus first aims to both increasing code coverage and detecting runtime errors, then shifts to focus only detecting runtime errors when the coverage reaches 100% or its maximum, enabling it to perform better than prompting the LLMs for both purposes. Our empirical evaluation demonstrates that Cerberus performs better than conventional and learning-based testing frameworks for (in)complete code snippets by generating high-coverage test cases more efficiently, leading to the discovery of more runtime errors.