Skip to content

Conversation

@ziadhany
Copy link
Collaborator

@ziadhany ziadhany commented Jan 2, 2026

@ziadhany
Copy link
Collaborator Author

ziadhany commented Jan 2, 2026

Importing data using suse_importer_v2
INFO 2026-02-10 12:52:26.366512 UTC Pipeline [SUSESeverityScoreImporterPipeline] starting
INFO 2026-02-10 12:52:26.366639 UTC Step [fetch_advisories] starting
INFO 2026-02-10 12:52:30.495460 UTC Step [fetch_advisories] completed in 4 seconds
INFO 2026-02-10 12:52:30.495616 UTC Step [collect_and_store_advisories] starting
INFO 2026-02-10 12:52:30.497622 UTC Collecting 26,711 advisories
INFO 2026-02-10 12:52:44.024158 UTC Progress: 10% (2672/26711) ETA: 122 seconds (2.0 minutes)
INFO 2026-02-10 12:52:56.370294 UTC Progress: 20% (5343/26711) ETA: 103 seconds (1.7 minutes)
INFO 2026-02-10 12:53:08.111605 UTC Progress: 30% (8014/26711) ETA: 88 seconds (1.5 minutes)
INFO 2026-02-10 12:53:19.189288 UTC Progress: 40% (10685/26711) ETA: 73 seconds (1.2 minutes)
INFO 2026-02-10 12:53:31.039377 UTC Progress: 50% (13356/26711) ETA: 61 seconds (1.0 minutes)
INFO 2026-02-10 12:53:43.186634 UTC Progress: 60% (16027/26711) ETA: 48 seconds
INFO 2026-02-10 12:53:54.838398 UTC Progress: 70% (18698/26711) ETA: 36 seconds
INFO 2026-02-10 12:54:07.006100 UTC Progress: 80% (21369/26711) ETA: 24 seconds
INFO 2026-02-10 12:54:20.273048 UTC Progress: 90% (24040/26711) ETA: 12 seconds
INFO 2026-02-10 12:54:33.370725 UTC Progress: 100% (26711/26711)
INFO 2026-02-10 12:54:33.377970 UTC Successfully collected 26,711 advisories
INFO 2026-02-10 12:54:33.378110 UTC Step [collect_and_store_advisories] completed in 123 seconds (2.0 minutes)
INFO 2026-02-10 12:54:33.378172 UTC Pipeline completed in 127 seconds (2.1 minutes)

Process finished with exit code 0

from vulnerabilities.models import AdvisoryV2
from django.db.models import Count
duplicates = (
    AdvisoryV2.objects
    .values('avid')
    .annotate(count=Count('id'))
    .filter(count__gt=1)
)
len(duplicates)
Out[2]: 0
AdvisoryV2.objects.count()
Out[3]: 2833

aliases=[],
summary="",
severities=severities,
references_v2=[ReferenceV2(reference_id=cve_id, url=self.url)],
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@TG1999 We can’t create an advisory without a summary, affected_packages, or references, so we should at least include a reference.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ziadhany we should change this logic then, severities are also a good data point to capture, so if an advisory have a severity we should be able to create it.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay, I will create an issue for that.

@ziadhany ziadhany requested a review from TG1999 January 2, 2026 18:57
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Copy link
Contributor

@TG1999 TG1999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants