This will make it consistent with how we pack and unpack the
virtualenv (in terms of directory structure).