- 23 Apr, 2018 3 commits
-
-
Exclude unloadable files at rsync time
brianhw committed -
Changed video-timeline workflow to use user_id instead of username.
Hassan committed -
Hassan Javeed committed
-
- 21 Apr, 2018 1 commit
-
-
Brian Wilson committed
-
- 18 Apr, 2018 2 commits
-
-
Copy mysql database to bigquery dataset
brianhw committed -
* Don't include files starting with underscore. * Switch away from dynamic dependencies for BQ load. * Delete marker table on overwrite, at initialization. * Add flag to skip clear_marker calls on overwrite. * Add filtering parameter: exclude_field list. * Always pass column names to sqoop. * Add table-level descriptions. * Add warehouse_subdirectory. * Handle tinyint(N) where N>1, and output BIT as a STRING. * Add comment on how blobs-to-BYTES doesn't work. * Add basic unit tests.
Brian Wilson committed
-
- 10 Apr, 2018 1 commit
-
-
Create an empty 'course_program_metadata' table for insights.
Hassan committed
-
- 09 Apr, 2018 1 commit
-
-
Hassan Javeed committed
-
- 22 Mar, 2018 1 commit
-
-
Don't include DownstreamMixin in "Table" Tasks.
brianhw committed
-
- 21 Mar, 2018 1 commit
-
-
And also remove from "Partition" tasks that don't need it. Goal is to be able to specify overwrite_n_days on the command-line, and not require it to have to be in config files.
Brian Wilson committed
-
- 20 Mar, 2018 2 commits
-
-
Update args in running-tasks doc to use hyphens.
brianhw committed -
Brian Wilson committed
-
- 19 Mar, 2018 2 commits
-
-
Make interval_start optional
brianhw committed -
Make it required only when interval is not specified.
Brian Wilson committed
-
- 01 Mar, 2018 1 commit
-
-
Delete manifest file on overwrite.
brianhw committed
-
- 28 Feb, 2018 1 commit
-
-
Implement for module engagement to begin with, since its ModuleEngagementDataTask class will often have the same parameters (i.e. the given day to calculate), and therefore uses the same manifest file when being rerun.
Brian Wilson committed
-
- 22 Feb, 2018 2 commits
- 21 Feb, 2018 1 commit
-
-
Fix basic quality so it passes.
Brian Wilson committed
-
- 16 Feb, 2018 1 commit
-
-
Jillian Vogel committed
-
- 15 Feb, 2018 4 commits
-
-
ENT-777 Pipeline tasks to import enterprise enrollment data
Brittney Exline committed -
Brittney Exline committed
-
Brittney Exline committed
-
to better reflect that parameter's type. Also moves the partition_value testing into test_course_list, since this is where the TimestampPartitionMixin lives.
Jillian Vogel committed
-
- 14 Feb, 2018 2 commits
-
-
Use Luigi return codes.
brianhw committed -
Brian Wilson committed
-
- 09 Feb, 2018 1 commit
-
-
Update Acceptence tests for data czar export key changes
Brian Beggs committed
-
- 05 Feb, 2018 1 commit
-
-
Brian Beggs committed
-
- 02 Feb, 2018 1 commit
-
-
Doc for JSON list input and incremental video.
brianhw committed
-
- 31 Jan, 2018 1 commit
-
-
Brian Wilson committed
-
- 29 Jan, 2018 2 commits
- 25 Jan, 2018 2 commits
-
-
Brian Wilson committed
-
If Boto is passed "validate=True", it will require an additional permission to be present when asked to list all of the keys in the bucket. We want to minimize the set of required permissions so we get a reference to the bucket without validating that it exists. It should only require PutObject and PutObjectAcl permissions in order to write to the target bucket. This is particularly the case with answer-distribution, which writes out to a bucket that is used by LMS for course downloads.
Brian Wilson committed
-
- 24 Jan, 2018 2 commits
-
-
Upgrade to fork of Luigi 2.7.
brianhw committed -
Brian Wilson committed
-
- 08 Jan, 2018 3 commits
-
-
Andrew Zafft committed
-
Hive partition overwrite by default
Andrew Zafft committed -
Andrew Zafft committed
-
- 28 Dec, 2017 1 commit
-
-
Generate the Hive Table but not Table Data
Andrew Zafft committed
-