Uploaded image for project: 'Marathon'
  1. Marathon
  2. MARATHON-4055

option to allow marathon to launch/stop tasks on slave in parallel to improve Docker integration

    Details

    • Type: Task
    • Status: Resolved
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      Hi,

      Marathon is starting/stopping tasks on slaves in serial. This is not ideal for launching lightweight Docker containers. It ends up taking almost 60 seconds to launch 10 containers which if launched in parallel would like take less then <10 seconds. Also, the 6 seconds to start a docker container is suspicious. They launch in less then 1 second when done manually.

      I tested starting 10 containers on a slave and they had the following start times in seconds:
      1,7,12,18,23,29,35,40,46,52 etc.

      5472ce303424 scivm/scientific-python-2.7:latest /usr/bin/supervisord 10 seconds ago Up 9 seconds 0.0.0.0:31012->8888/tcp, 22/tcp furious_wright

      991550b65821 scivm/scientific-python-2.7:latest /usr/bin/supervisord 16 seconds ago Up 15 seconds 0.0.0.0:31020->8888/tcp, 22/tcp kickass_franklin

      4eb86a81c0f4 scivm/scientific-python-2.7:latest /usr/bin/supervisord 21 seconds ago Up 20 seconds 0.0.0.0:31022->8888/tcp, 22/tcp focused_bohr

      aa343d797e32 scivm/scientific-python-2.7:latest /usr/bin/supervisord 27 seconds ago Up 26 seconds 0.0.0.0:31156->8888/tcp, 22/tcp berserk_mclean

      c40145cb3b0f scivm/scientific-python-2.7:latest /usr/bin/supervisord 32 seconds ago Up 31 seconds 0.0.0.0:31635->8888/tcp, 22/tcp berserk_thompson

      5cc0d81a6ec1 scivm/scientific-python-2.7:latest /usr/bin/supervisord 38 seconds ago Up 38 seconds 0.0.0.0:31116->8888/tcp, 22/tcp sad_davinci

      fa2fc55f303f scivm/scientific-python-2.7:latest /usr/bin/supervisord 44 seconds ago Up 43 seconds 0.0.0.0:31009->8888/tcp, 22/tcp furious_franklin

      45bf7beb1ea5 scivm/scientific-python-2.7:latest /usr/bin/supervisord 49 seconds ago Up 48 seconds 0.0.0.0:31098->8888/tcp, 22/tcp hungry_albattani

      df8779b6f721 scivm/scientific-python-2.7:latest /usr/bin/supervisord 55 seconds ago Up 54 seconds 0.0.0.0:31667->8888/tcp, 22/tcp drunk_mclean

      f3419635b590 scivm/scientific-python-2.7:latest /usr/bin/supervisord About a minute ago Up About a minute 0.0.0.0:31642->8888/tcp, 22/tcp tender_pasteur

      Thanks,
      Mike

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              GitHub_scivm Science VM (Inactive)
              Team:
              Orchestration Team
              Watchers:
            • Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: