More accurately represent serialized catalog data. Also switch to using Faker.

ECOM-4422

Remove program certification view from the support app

Visually indicate fields in new post form are required (TNL-6364)

This functionality hasn't been used since it was introduced. It is superseded by the backpopulate_program_credentials management command. This is another commit in a series removing use of the old programs service from edx-platform.

ECOM-4422

Disable student state writes for crawlers.

Fix pep8 violation

Bumps the xblock-poll version to v1.2.5

Updated Docker Devstack settings

Fixes https://github.com/edx/devstack/issues/47

Fix program credential backpopulation command

This command was updated to request programs from the catalog, but it wasn't changed to deal with the new response structure. I'm updating all code in the LMS to deal with catalog service responses separately.

ECOM-6900.

Bumps django-storage-swift to 1.2.15

ECOM-6634

Updated edx-rest-api-client to 1.7.1

Added user tracking id to profile scope in oauth2 handler.

https://github.com/edx/edx-rest-api-client/compare/1.6.0...1.7.1

ECOM-6634

Log course on no-retry update_course_in_cache errors

We've already been ignoring the param for a long time. This just
removes it entirely.

edx-i18n-tools is on PyPI, get it from there.

Try pip 9.0.1 and setuptools 34.0.2

add task id to logging and log database exceptions for TNL-6332

for TNL-6332, TNL-6373

Create infrastructure for reapplying tasks

When crawlers like edX-downloader make requests on courseware, they are
often concurrently loading many units in the same sequence. This causes
contention for the rows in courseware_studentmodule that store the
student's state for various XBlocks/XModules, most notably for the
sequence, chapter, and course -- all of which record and update user
position information when loaded.

It would be nice if we could actually remove these writes altogether
and come up with a cleaner way of keeping track of the user's position.
In general, GETs should be side-effect free. However, any such change
would break backwards compatibility, and would require close
coordination with research teams to make sure they weren't negatively
affected.

This commit identifies crawlers by user agent (CrawlersConfig model),
and blocks student state writes if a crawler is detected. FieldDataCache
writes simply become no-ops. It doesn't actually alter the rendering
of the courseware in any way -- the main impact is that the blocks
won't record your most recent position, which is meaningless for
crawlers anyway.

This can also be used as a building block for other policy we want to
define around crawlers. We just have to be mindful that this only works
with "nice" crawlers who are honest in their user agents, and that
significantly more sophisticated (and costly) measures would be
necessary to prevent crawlers that try to be even trivially sneaky.

[PERF-403]

and removes the -e from the install, as per the requirements rules.

Corrected OAuth URL for Docker-base devstack

Disable changes to course code in re-run form

and cleaning up tasks that have been resolved.

TNL-6252

Print the paver output for python cyclomatic complexity to console.

ECOM-6898

Disable (make read-only) the field for course code in the re-run form.  This will prevent creation of course runs with a different course code in the course key that are intended to stand for the same course in a program, which presents problems for the course catalog mapping process.

With 2.0.1, and setuptools 34.0.2, errors happen like:

File "/edx/app/edxapp/venvs/edxapp-sandbox/local/lib/python2.7/site-packages/packaging/requirements.py", line 59, in <module>
    MARKER_EXPR = originalTextFor(MARKER_EXPR())("marker")
TypeError: __call__() takes exactly 2 arguments (1 given)

(cherry picked from commit 73519b35)