Developer-AD / SBDL Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Spark Bulk Data Load. This is a data engineering project. Ingest the data from Hive tables present in the Master Data Management Platform and do the all processing in spark.

0 stars 0 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
__pycache__		__pycache__
conf		conf
lib		lib
test_data		test_data
Jenkinsfile		Jenkinsfile
Pipfile		Pipfile
Pipfile.lock		Pipfile.lock
README.md		README.md
log4j.properties		log4j.properties
main.py		main.py
sbdl_main.py		sbdl_main.py
sbdl_submit.sh		sbdl_submit.sh
test_nutter_sbdl.py		test_nutter_sbdl.py
test_pytest_sbdl.py		test_pytest_sbdl.py

Repository files navigation

SBDL

About

Spark Bulk Data Load. This is a data engineering project. Ingest the data from Hive tables present in the Master Data Management Platform and do the all processing in spark.

jenkins spark data-engineering data-processing hive-table

Readme

Activity

0 stars

1 watching

0 forks

Report repository