Uploaded image for project: 'Marathon'
  1. Marathon
  2. MARATHON-4136

Lanch app with persistent local volume failed

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Medium
    • Resolution: Cannot Reproduce
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Storage Volumes
    • Labels:

      Description

      Config for marathon and mesos:
      java -jar ./bin/../target/scala-2.11/marathon-assembly-1.1.1.jar --master zk://162.3.140.200:2181/mesos --zk zk://162.3.140.200:2181/marathon --enable_features external_volumes --mesos_role *,other
      mesos-master --ip=162.3.140.200 --work_dir=/var/lib/mesos --zk=zk://162.3.140.200:2181/mesos --quorum=1 --log_dir=/var/log/mesos/
      mesos-slave --ip=162.3.140.201 --work_dir=/var/lib/mesos --master=162.3.140.200:5050 --containerizers=docker,mesos --log_dir=/var/log/mesos/ --docker=/usr/bin/docker --executor_registration_timeout=5mins --isolation=filesystem/linux,docker/volume --resources=cpus:4;mem:4096;disk:8192;cpus(ads):4;mem(ads):4096;disk(ads):4096

      App definition is from Marathon docs.
      `{
      "id": "/postgres",
      "cpus": 1,
      "instances": 1,
      "mem": 512,
      "container": {
      "type": "DOCKER",
      "volumes": [
      {
      "containerPath": "pgdata",
      "mode": "RW",
      "persistent":

      { "size": 100 }

      }
      ],
      "docker": {
      "image": "postgres:latest",
      "network": "BRIDGE",
      "portMappings": [

      { "containerPort": 5432, "hostPort": 0, "protocol": "tcp", "name": "postgres" }

      ]
      }
      },
      "env":

      { "POSTGRES_PASSWORD": "password", "PGDATA": "pgdata" }

      ,
      "residency":

      { "taskLostBehavior": "WAIT_FOREVER" }

      ,
      "upgradeStrategy":

      { "maximumOverCapacity": 0, "minimumHealthCapacity": 0 }

      }`

      LOG:
      `[2016-09-05 08:49:26,253] INFO Deployment acknowledged. Waiting to get processed:
      DeploymentPlan 2016-09-05T00:49:26.162Z
      step 1:

      • Start(App(/postgres, image="postgres:latest")), instances=0)
        step 2:
      • Scale(App(/postgres, image="postgres:latest")), instances=1)
        (mesosphere.marathon.state.GroupManager:ForkJoinPool-2-worker-1)
        [2016-09-05 08:49:26,255] INFO Request ReserveAndCreateVolumes for task 'postgres.983b7163-7302-11e6-acbc-c6a3bece2b78', version '2016-09-05T00:49:26.162Z'. 1 tasksToLaunch, 0 in flight, 0 confirmed. not backing off (mesosphere.marathon.core.launchqueue.impl.AppTaskLauncherActor:marathon-akka.actor.default-dispatcher-10)
        [2016-09-05 08:49:26,255] INFO 162.3.111.178 - - [05/Sep/2016:00:49:26 +0000] "POST //162.3.140.200:8080/v2/apps HTTP/1.1" 201 1170 "http://162.3.140.200:8080/ui/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.22 Safari/537.36 SE 2.X MetaSr 1.0" 10 (mesosphere.chaos.http.ChaosRequestLog$$EnhancerByGuice$$62554978:qtp1534888240-39)
        [2016-09-05 08:49:26,256] INFO Finished processing dc3aa009-d93d-49a5-a21d-ce3ee544f303-O3369. Matched 0 ops after 1 passes. cpus() 4.0; mem() 4096.0; disk() 8182.0; ports() 31000->31024,31026->31227,31229->32000 left. (mesosphere.marathon.core.matcher.manager.impl.OfferMatcherManagerActor:marathon-akka.actor.default-dispatcher-15)
        [2016-09-05 08:49:26,256] INFO Finished processing dc3aa009-d93d-49a5-a21d-ce3ee544f303-O3370. Matched 1 ops after 2 passes. cpus() 4.0; mem() 7786.0; disk() 12428.0; ports() 31000->31262,31264->31302,31305->31822,31824->31999 left. (mesosphere.marathon.core.matcher.manager.impl.OfferMatcherManagerActor:marathon-akka.actor.default-dispatcher-15)
        [2016-09-05 08:49:26,256] INFO Processing Reserve(Reserved(task [postgres.983b7163-7302-11e6-acbc-c6a3bece2b78],AgentInfo(162.3.140.202,Some(dc3aa009-d93d-49a5-a21d-ce3ee544f303-S0),Buffer()),Reservation(List(LocalVolume postgres#pgdataMGI-983b7162-7302-11e6-acbc-c6a3bece2b78),New(Some(Timeout(2016-09-05T00:49:26.254Z,2016-09-05T00:49:46.254Z,ReservationTimeout)))))) for task [postgres.983b7163-7302-11e6-acbc-c6a3bece2b78|mesosphere.marathon.core.launcher.impl.OfferProcessorImpl:ForkJoinPool-2-worker-9]
        [2016-09-05 08:49:26,262] INFO receiveTaskUpdate: updating status of task [postgres.983b7163-7302-11e6-acbc-c6a3bece2b78|mesosphere.marathon.core.launchqueue.impl.AppTaskLauncherActor:marathon-akka.actor.default-dispatcher-15]
        [2016-09-05 08:49:26,265] INFO Task launch for 'task [postgres.983b7163-7302-11e6-acbc-c6a3bece2b78]' was accepted. 1 tasksToLaunch, 0 in flight, 0 confirmed. instance count delta 1. not backing off (mesosphere.marathon.core.launchqueue.impl.AppTaskLauncherActor:marathon-akka.actor.default-dispatcher-6)
        [2016-09-05 08:49:26,773] INFO Finished processing dc3aa009-d93d-49a5-a21d-ce3ee544f303-O3371. Matched 0 ops after 1 passes. cpus() 4.0; mem() 7786.0; disk() 12428.0; ports() 31000->31262,31264->31302,31305->31822,31824->31999 left. (mesosphere.marathon.core.matcher.manager.impl.OfferMatcherManagerActor:marathon-akka.actor.default-dispatcher-6)
        [2016-09-05 08:49:26,950] INFO 162.3.116.10 - - [05/Sep/2016:00:49:26 +0000] "GET //162.3.140.200:8080/v2/queue HTTP/1.1" 200 1222 "http://162.3.140.200:8080/ui/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36" (mesosphere.chaos.http.ChaosRequestLog$$EnhancerByGuice$$62554978:qtp1534888240-37)
        `

      According to the above config and log, is some error in configuration with Mesos and Marathon?

        Attachments

          Activity

            People

            • Assignee:
              tharper Tim Harper
              Reporter:
              GitHub_drngsl drngsl (Inactive)
              Team:
              Orchestration Team
              Watchers:
            • Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: