Skip to content

Crash in generate-data.py does not fail the Taskcluster task #117

Description

@suhaibmujahid

The expected behaviour for a task with a crashing script is to fail. A notification could be triggered instead of failing silently.

https://community-tc.services.mozilla.com/tasks/SHRtIibsSBquyfqYef9rkQ/runs/0/logs/public/logs/live.log:

Traceback (most recent call last):
  File "/stab-crashes/generate-data.py", line 352, in <module>
    stats = get(
            ^^^^
  File "/stab-crashes/generate-data.py", line 272, in get
    k: v for k, v in Bugzilla.follow_dup(duplicate_ids).items() if v is not None
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/libmozdata/bugzilla.py", line 312, in follow_dup
    bz.get_data().wait_bugs()
  File "/usr/local/lib/python3.12/site-packages/libmozdata/bugzilla.py", line 191, in wait_bugs
    r.result()
  File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 59, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/requests/sessions.py", line 710, in send
    r = dispatch_hook("response", hooks, r, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/requests/hooks.py", line 30, in dispatch_hook
    _hook_data = hook(hook_data, **kwargs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/libmozdata/bugzilla.py", line 567, in __bugs_cb
    res.raise_for_status()
  File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: https://bugzilla.mozilla.org/rest/bug?id=1869503&include_fields=id&include_fields=resolution&include_fields=dupe_of
Enumerating objects: 8, done.
Counting objects:  12% (1/8)
Counting objects:  25% (2/8)
Counting objects:  37% (3/8)
Counting objects:  50% (4/8)
Counting objects:  62% (5/8)
Counting objects:  75% (6/8)
Counting objects:  87% (7/8)
Counting objects: 100% (8/8)
Counting objects: 100% (8/8), done.
Delta compression using up to 4 threads
Compressing objects:  16% (1/6)
Compressing objects:  33% (2/6)
Compressing objects:  50% (3/6)
Compressing objects:  66% (4/6)
Compressing objects:  83% (5/6)
Compressing objects: 100% (6/6)
Compressing objects: 100% (6/6), done.
Writing objects:  16% (1/6)
Writing objects:  33% (2/6)
Writing objects:  66% (4/6)
Writing objects:  83% (5/6)
Writing objects: 100% (6/6)
Writing objects: 100% (6/6), 43.85 KiB | 4.87 MiB/s, done.
Total 6 (delta 3), reused 0 (delta 0), pack-reused 0 (from 0)
remote: Resolving deltas:   0% (0/3)�[K
remote: Resolving deltas:  33% (1/3)�[K
remote: Resolving deltas:  66% (2/3)�[K
remote: Resolving deltas: 100% (3/3)�[K
remote: Resolving deltas: 100% (3/3), completed with 1 local object.�[K
remote: 
remote: GitHub found 1 vulnerability on mozilla/stab-crashes's default branch (1 moderate). To find out more, visit:�[K
remote:      https://github.com/mozilla/stab-crashes/security/dependabot/1�[K
remote: 
To github.com:mozilla/stab-crashes.git
   42faed19..278cecc3  gh-pages -> gh-pages
[taskcluster 2026-01-12T00:15:26.266Z]                        Exit Code: 0
[taskcluster 2026-01-12T00:15:26.266Z]                        User Time: 26.556ms
[taskcluster 2026-01-12T00:15:26.266Z]                      Kernel Time: 31.614ms
[taskcluster 2026-01-12T00:15:26.266Z]                        Wall Time: 11m52.110030454s
[taskcluster 2026-01-12T00:15:26.266Z]  Average Available System Memory: 14.21 GiB
[taskcluster 2026-01-12T00:15:26.266Z]       Average System Memory Used: 1.40 GiB
[taskcluster 2026-01-12T00:15:26.266Z]          Peak System Memory Used: 1.61 GiB
[taskcluster 2026-01-12T00:15:26.266Z]              Total System Memory: 15.62 GiB
[taskcluster 2026-01-12T00:15:26.266Z]                           Result: SUCCEEDED
[taskcluster 2026-01-12T00:15:26.266Z] === Task Finished ===
[taskcluster 2026-01-12T00:15:26.266Z] Task Duration: 11m52.110919409s

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Fields

    Priority

    None yet

    Effort

    None yet

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions