Run benchmarks in less than 30 minutes. The current benchmarks take too long.
• Figure out where time is spent in the Jenkins job and speed it up (eg by caching the builds)
• Use tags in DataDog to indicate the branch of the job.
• Reduce benchmark to pure Python code.
• Pipe events to a file and do analysis offline. This point needs some debate.
• Maybe import perf driver parts used into shakedown.benchmark.