-
Notifications
You must be signed in to change notification settings - Fork 326
Build Repair Agent: initial evaluation harness #5762
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
evgenyrp
wants to merge
20
commits into
mozilla:master
Choose a base branch
from
evgenyrp:build_repair_agent
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+1,723
−0
Open
Changes from all commits
Commits
Show all changes
20 commits
Select commit
Hold shift + click to select a range
22a1ab5
Add a dataset notebook
evgenyrp 77aeb2e
Add JetBrains IDE
evgenyrp 7a95a7f
Initial implementation
evgenyrp a1af703
Prevent data contamination
evgenyrp 305d7c9
Adjust agent configuration and add logs
evgenyrp 5cb55a5
Improve tracing
evgenyrp 79871bc
Add eval mode
evgenyrp 19addba
Fix local building
evgenyrp 7a32858
Improve cost tracing
evgenyrp 6e497df
Think more on analysis
evgenyrp 2fa7c62
Increase parallelizm
evgenyrp 2f2832e
Use default system prompt
evgenyrp 983643e
Update Weave
evgenyrp 1cf9351
Fix dataset
evgenyrp ffe5685
Log errors in weave
evgenyrp 915a2b8
Make logging less verbose
evgenyrp ab4fce1
Support multiple trials
evgenyrp 955e048
Fix scoring
evgenyrp 33dc52c
Add docker compose
evgenyrp 2a26a6c
Change todo
evgenyrp File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -49,3 +49,6 @@ node_modules/ | |
| *.log | ||
| # Desktop Service Store | ||
| *.DS_Store | ||
|
|
||
| # JetBrains IDEs | ||
| .idea | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| # -*- coding: utf-8 -*- | ||
| # This Source Code Form is subject to the terms of the Mozilla Public | ||
| # License, v. 2.0. If a copy of the MPL was not distributed with this file, | ||
| # You can obtain one at http://mozilla.org/MPL/2.0/. | ||
|
|
||
| from bugbug.tools.build_repair.agent import AgentResponse, BuildFailure, BuildRepairTool | ||
|
|
||
| __all__ = ["AgentResponse", "BuildFailure", "BuildRepairTool"] | ||
|
Comment on lines
+6
to
+8
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This is not needed since we already import from the submodules directly. |
||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This one falls a bit outside our scope, but I think the cleanest solution here is a user-scoped global gitignore file — that way it applies across all your repos without any per-project configuration.
I personally keep a
~/.gitignore_globalwith entries like:Just don't forget to register it with Git:
git config --global core.excludesfile ~/.gitignore_global