Uploaded image for project: 'Marathon'
  1. Marathon
  2. MARATHON-8327

StackOverflow exception during root group update

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Low
    • Resolution: Cannot Reproduce
    • Affects Version/s: Marathon 1.6.322
    • Fix Version/s: DC/OS 1.12.0
    • Component/s: Deployments
    • Labels:

      Description

      This error appears after a week or so of the marathon cluster running and will not stop until the master Marathon service is restarted. I have not been able to track down what is causing it yet but wanted to see if the team has experienced this before.

       

      [2018-07-23 20:41:43,836] INFO 10.144.231.110 - marathon [23/Jul/2018:20:41:43 +0000] "PUT //mesos-master-spark-a001.krxd.net:5080/v2/apps//pixel-stream-processor-driver?force=True HTTP/1.1" 500 25 "-" "python-requests/2.12.4"  (mesosphere.chaos.http.ChaosRequestLog:qtp1852194933-4709)
      
      [2018-07-23 20:41:49,092] INFO 10.218.220.184 - marathon [23/Jul/2018:20:41:49 +0000] "GET //mesos-master-spark-a001.krxd.net:5080/v2/apps//pixel-stream-processor-driver HTTP/1.1" 200 1373 "-" "python-requests/2.12.4"  (mesosphere.chaos.http.ChaosRequestLog:qtp1852194933-54)
      
      [2018-07-23 20:41:49,112] INFO Upgrade root group version:2018-07-23T20:41:49.112Z with force:true (mesosphere.marathon.core.group.impl.GroupManagerImpl:group-manager-module-thread-2)
      
      [2018-07-23 20:41:49,117] WARN Deployment failed for change: 2018-07-23T20:41:49.112Z (mesosphere.marathon.core.group.impl.GroupManagerImpl:group-manager-module-thread-2)
      
      java.util.concurrent.ExecutionException: Boxed Error
      
      at scala.concurrent.impl.Promise$.resolver(Promise.scala:83)
      
      at scala.concurrent.impl.Promise$.scala$concurrent$impl$Promise$$resolveTry(Promise.scala:75)
      
      at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:280)
      
      at scala.concurrent.Promise.complete(Promise.scala:49)
      
      at scala.concurrent.Promise.complete$(Promise.scala:48)
      
      at scala.concurrent.impl.Promise$DefaultPromise.complete(Promise.scala:183)
      
      at mesosphere.marathon.core.group.impl.GroupManagerImpl$stateMachine$macro$585$1.apply(GroupManagerImpl.scala:116)
      
      at mesosphere.marathon.core.group.impl.GroupManagerImpl$stateMachine$macro$585$1.apply$mcV$sp(GroupManagerImpl.scala:116)
      
      at mesosphere.marathon.core.group.impl.GroupManagerImpl$stateMachine$macro$585$1.apply(GroupManagerImpl.scala:116)
      
      at mesosphere.marathon.core.group.impl.GroupManagerImpl$stateMachine$macro$585$1.apply(GroupManagerImpl.scala:116)
      
      at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:655)
      
      at scala.util.Success.$anonfun$map$1(Try.scala:251)
      
      at scala.util.Success.map(Try.scala:209)
      
      at scala.concurrent.Future.$anonfun$map$1(Future.scala:289)
      
      at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
      
      at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
      
      at scala.concurrent.impl.CallbackRunnable.run_aroundBody0(Promise.scala:60)
      
      at scala.concurrent.impl.CallbackRunnable$AjcClosure1.run(Promise.scala:1)
      
      at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
      
      at kamon.scala.instrumentation.FutureInstrumentation.$anonfun$aroundExecution$1(FutureInstrumentation.scala:45)
      
      at kamon.trace.Tracer$.withContext(TracerModule.scala:58)
      
      at kamon.scala.instrumentation.FutureInstrumentation.aroundExecution(FutureInstrumentation.scala:45)
      
      at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:59)
      
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      
      at java.lang.Thread.run(Thread.java:748)
      
      Caused by: java.lang.StackOverflowError: null
      
      at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:788)
      
      at scala.collection.MapLike$MappedValues.foreach(MapLike.scala:253)
      
      at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:788)
      
      at scala.collection.MapLike$MappedValues.foreach(MapLike.scala:253)
      

        Attachments

          Activity

            People

            • Assignee:
              adukhovniy Aleksey Dukhovniy
              Reporter:
              dpricha89 dpricha89
              Team:
              Orchestration Team
              Watchers:
              Aleksey Dukhovniy, dpricha89, Ioannis Charalampidis, Matthias Eichstedt
            • Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: