Skip to content

E
edx-analytics-pipeline
Commit ba890d35 by Hassan Javeed
Options

Added tasks to load warehouse data into BigQueryy.

parent 51635e58
Showing with 2 additions and 0 deletions
requirements/default.txt
...@@ -30,6 +30,7 @@ user-agents==0.3.2 # MIT ...@@ -30,6 +30,7 @@ user-agents==0.3.2 # MIT
vertica-python==0.6.11 # MIT vertica-python==0.6.11 # MIT
yarn-api-client==0.2.3 # BSD yarn-api-client==0.2.3 # BSD
git+https://github.com/HassanJaveed84/google-cloud-python.git@b225462292114c3e557cc84bd82277cfeefbc878#egg=google-cloud-python&subdirectory=bigquery
git+https://github.com/edx/luigi.git@a73700ca51685974220ef6069d2f078312055444#egg=luigi # Apache License 2.0 git+https://github.com/edx/luigi.git@a73700ca51685974220ef6069d2f078312055444#egg=luigi # Apache License 2.0
git+https://github.com/edx/pyinstrument.git@a35ff76df4c3d5ff9a2876d859303e33d895e78f#egg=pyinstrument # BSD git+https://github.com/edx/pyinstrument.git@a35ff76df4c3d5ff9a2876d859303e33d895e78f#egg=pyinstrument # BSD
......
setup.cfg
...@@ -33,6 +33,7 @@ edx.analytics.tasks = ...@@ -33,6 +33,7 @@ edx.analytics.tasks =
# common # common
sqoop-import = edx.analytics.tasks.common.sqoop:SqoopImportFromMysql sqoop-import = edx.analytics.tasks.common.sqoop:SqoopImportFromMysql
insert-into-table = edx.analytics.tasks.common.mysql_load:MysqlInsertTask insert-into-table = edx.analytics.tasks.common.mysql_load:MysqlInsertTask
bigquery-load = edx.analytics.tasks.common.bigquery_load:BigQueryLoadTask
# insights # insights
answer-dist = edx.analytics.tasks.insights.answer_dist:AnswerDistributionPerCourse answer-dist = edx.analytics.tasks.insights.answer_dist:AnswerDistributionPerCourse
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment