Test optimization problems such as test case selection and test case minimization are long-standing combinatorial optimization challenges in software testing. Ising-based computing offers a new way to formulate and solve such problems by representing them through Ising models and executing them with different solver paradigms.
IsingBench provides an open-source environment for studying this direction systematically. It brings together benchmark datasets, Ising formulations, configurable solvers, and result analysis in a unified workflow, enabling researchers to evaluate Ising-based test optimization methods under consistent experimental settings.
The framework is accompanied by IsingTester, which supports the end-to-end process of encoding test optimization problems into Ising representations, executing selected solvers, and decoding the resulting solutions back into optimized test suites.
The demonstration shows how IsingBench supports an end-to-end test optimization workflow, from selecting a benchmark problem and solver configuration to executing the optimization and inspecting the resulting solution and analysis.
View on GitHubExplore our foundational research and related publications
Y. Yang, M. Zhang, and T. Yue, “Ising-based Test Optimization and Benchmarking,” 2026 IEEE International Conference on Software Testing, Verification and Validation (ICST), 2026, pp. 314–318.
View Publication