Neural Translation of Input Specifications into Formal Grammars for Test Case Generation
Keywords: formal grammar, automated test case generation, semi-supervised learning
Abstract: Test cases are crucial for ensuring the program's correctness and evaluating performance in programming.
The high diversity of test cases within constraints is necessary
to distinguish between correct and incorrect answers.
Automated source code generation is currently a popular area
due to the inefficiency of manually generating test cases.
Recent attempts involve generating conditional cases from problem descriptions
using deep-learning models that learn from source code.
However, this task requires a combination of complex skills
such as extracting syntactic and logical constraints for a given test case from a problem,
and generating test cases that satisfy the constraints.
In this work, we introduce a modified context-free grammar
that explicitly represents the syntactical and logical constraints embedded within programming problems.
Our innovative framework for automated test case generation separates restriction extraction
from test case generation, simplifying the task for the model.
Our experimental results show that, compared to current methods,
our framework produces test cases that are more precise and effective.
All the codes in this paper are available in https://anonymous.4open.science/r/neural_translation_for_test_case_generation.
Primary Area: generative models
Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Submission Guidelines: I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2024/AuthorGuide.
Anonymous Url: I certify that there is no URL (e.g., github page) that could be used to find authors' identity.
No Acknowledgement Section: I certify that there is no acknowledgement section in this submission for double blind review.
Submission Number: 5201
Loading