Skip to content

Latest commit

 

History

History
80 lines (57 loc) · 2.48 KB

data.md

File metadata and controls

80 lines (57 loc) · 2.48 KB

Downloading Data Using BugBug

BugBug relies on various types of data, such as bugs, commits, issues, and crash reports, to build its models. Although all this data is publicly available through different APIs, retrieving it every time we train a model is not an efficient solution. Hence, a copy of the data is saved as downloadable compressed files through a simple API.

Note: You can use the data outside this project by using BugBug as a dependency (pip install bugbug).

Bugzilla Bugs

from bugbug import bugzilla, db

# Downland the latest version if the data set if it is not already downloaded
db.download(bugzilla.BUGS_DB)

# Iterate over all bugs in the dataset
for bug in bugzilla.get_bugs():
    # This is the same as if you retrieved the bug through Bugzilla REST API:
    # https://bmo.readthedocs.io/en/latest/api/core/v1/bug.html
    print(bug["id"])

Uplift Data

Here is an example of how to extract uplift requests and approvals from Bugzilla bug histories:

from bugbug import bugzilla, db

db.download(bugzilla.BUGS_DB)

for bug in bugzilla.get_bugs():
    for history in bug["history"]:
        for change in history["changes"]:
            if change["added"].startswith("approval-mozilla"):
                uplift_tags = change["added"].split(", ")
                for uplift_tag in uplift_tags:
                    release_channel = uplift_tag[len("approval-mozilla-") : -1]
                    if uplift_tag.endswith("?"):
                        print(
                            f"Uplift: Requested \tBug {bug['id']}\t{history['when']} \t{release_channel}"
                        )
                    elif uplift_tag.endswith("+"):
                        print(
                            f"Uplift: Approved  \tBug {bug['id']}\t{history['when']} \t{release_channel}"
                        )

Phabricator Revisions

from bugbug import phabricator, db

db.download(phabricator.REVISIONS_DB)

for revision in phabricator.get_revisions():
    # The revision here combines the results retrieved from two API endpoints:
    # https://phabricator.services.mozilla.com/conduit/method/differential.revision.search/
    # https://phabricator.services.mozilla.com/conduit/method/transaction.search/
    print(revision["id"])

Repository Commits

from bugbug import repository, db

db.download(repository.COMMITS_DB)

for commit in repository.get_commits():
    print(commit["node"])

Github Issues

TODO

Mozilla Crash Reports

TODO