Skip to content

Azure DevOps is down - all CI jobs failing #69374

Closed

Description

@jkotas

Log:

error : (NETCORE_ENGINEERING_TELEMETRY=Helix) System.Net.Http.HttpRequestException: Request to https://dev.azure.com/dnceng/public/_apis/test/Runs/47600964/results?api-version=5.1-preview.6 returned failed status 503 Service Unavailable
{"$id":"1","innerException":null,"message":"TF10216: Azure DevOps services are currently unavailable. Try again later. Activity Id: 78014780-2f16-4321-822b-32c980bee1f8","typeName":"Microsoft.VisualStudio.Services.CircuitBreaker.CircuitBreakerShortCircuitException, Microsoft.VisualStudio.Services.Common","typeKey":"CircuitBreakerShortCircuitException","errorCode":0,"eventId":3000}

{
  "errorMessage" : "Microsoft.VisualStudio.Services.CircuitBreaker.CircuitBreakerShortCircuitException"
}

Report

Build Definition Step Name Console log
1776808 dotnet/runtime Send tests to Helix (Unix) Log
1776846 dotnet/runtime Send to Helix Log
1776944 dotnet/runtime Send to Helix Log
1776886 dotnet/runtime Send to Helix Log
1776865 dotnet/runtime Send to Helix Log
1776869 dotnet/runtime Send tests to Helix (Unix) Log

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 6

Activity

  1. ghost added
    untriagedNew issue has not been triaged by the area owner
    on May 15, 2022
  2. jkotas commented on May 15, 2022

    @jkotas
    MemberAuthor

    cc @dotnet/dncenghot

  3. jkotas commented on May 15, 2022

    @jkotas
    MemberAuthor

    Examples of affected PR: #69363, #69373

  4. premun commented on May 16, 2022

    @premun
    Member

    Thanks for the links, I will have a look at the builds in more detail.

    I can see there was a high amount of these errors over the weekend and they seem to have reduced back again:
    image

    The status pages of Azure/Azure DevOps claim there was no outage so I will see if we need to open an incident with them.

  5. premun commented on May 16, 2022

    @premun
    Member

    I have opened dotnet/arcade#9372 to track this and we will open an IcM with Azure DevOps

  6. hoyosjs commented on Jun 16, 2022

    @hoyosjs
    Member

    Closing this as the incident was closed.

  7. ghost removed
    untriagedNew issue has not been triaged by the area owner
    on Jun 16, 2022
  8. ghost locked as resolved and limited conversation to collaborators on Jul 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions