They fail with

  Waiting for system status:               An error occurred building
  AMI for loadtest edx edxapp.  The Exception was IndexError('list index
  out of range',)

I'm guessing that it is this list index lookup, but seems likely.  Hard
to test as it requires AWS slowness.