TestUpgrade.test_app_dns_survive fails every time the upgrade test runs and it has for quite a while. See any build of the upgrade script. E.G. https://teamcity.mesosphere.io/viewLog.html?buildId=673347&tab=buildResultsDiv&buildTypeId=ClosedSource_Dcos_IntegrationTests_CloudIntegrationTests_UpgradeTest
What is the action on this? Muting this is ridiculous when there is no fix in flight. We will just keep getting confusion and disillusion if we have test suites that fail like this.
My immediate action will be to xfail this test in pytest as that is the appropriate state. What is the specific criteria for this test to pass? Why can the current failure be muted?