Pinned Loading

1. CodeClash-ai/CodeClash CodeClash-ai/CodeClash Public

   Benchmarking Goal-Oriented Software Engineering

   Python 108 13

2. SWE-agent/SWE-agent SWE-agent/SWE-agent Public

   SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

   Python 18.5k 2k

3. SWE-bench/SWE-bench SWE-bench/SWE-bench Public

   SWE-bench: Can Language Models Resolve Real-world Github Issues?

   Python 4.3k 757

4. SWE-bench/SWE-smith SWE-bench/SWE-smith Public

   [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents

   Python 553 105

5. princeton-nlp/WebShop princeton-nlp/WebShop Public

   [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents

   Python 478 94

6. princeton-nlp/intercode princeton-nlp/intercode Public

   [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898

   Python 240 49