Uploaded image for project: 'DC/OS'
  1. DC/OS
  2. DCOS_OSS-4139

Metronome UI showing loading bubble after cluster restart.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: High
    • Resolution: Cannot Reproduce
    • Affects Version/s: DC/OS 1.11.3
    • Fix Version/s: None
    • Component/s: metronome
    • Labels:

      Description

      We had a power failure over the weekend on our dev cluster. The cluster was brought backup... When looking at the metronome UI we got the loading bubble.

      Running journalctl -u dcos-metronome -f shows one node trying to reconcile...

      Sep 17 19:29:06 dcos-dev-v-master-0003.raange.core metronome[3994]: [info] d.m.s.i.ReconciliationActor - Entered Loading state
      Sep 17 19:29:06 dcos-dev-v-master-0003.raange.core metronome[3994]: [info] d.m.s.i.ReconciliationActor - Performing implicit reconciliation
      Sep 17 19:30:06 dcos-dev-v-master-0003.raange.core metronome[3994]: [info] d.m.s.i.ReconciliationActor - state timeout while reconciling. Considering as finished.

      It should be noted there was some I.P route issues with the nodes. We spoke with Deepak Goel, restarting the dcos-net component fixed the networking problems.

      All component are showing as healthy includding metronome itself.

      But so far restarting dcos-metronome is a no go, the UI bubble persists.

        Attachments

          Activity

            People

            • Assignee:
              johnsmith John Smith
              Reporter:
              johnsmith John Smith
              Team:
              Orchestration Team
              Watchers:
              John Smith, Matthias Eichstedt
            • Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: