Preferences


westurner
ScholarlyArticle: "Mutation-Guided LLM-based Test Generation at Meta" (2025) https://arxiv.org/abs/2501.12862v1
nadis OP
Good call, thanks for linking the research paper directly here.
westurner
Can this unit test generation capability be connected to the models listed on the SWE-bench [Multimodal] leaderboard?
ai-christianson
I'm currently working on running an agent through SWE-Bench (RA.Aid).

What do you mean by connecting the test generation capability to it?

Do you mean generating new eval test cases? I think it could potentially have a use there.

westurner
To resolve an [SWE bench] Issue, write tests for the issue and relevant or adjacent code in different commits, w/ FB ACH

This item has no comments currently.