Job Description

The candidate is expected to code, conduct code reviews, and test framework as needed, along with participating in application architecture and design and other phases of the automation.

Responsibilities
? Design & Develop new automation framework for ETL processing
? Support existing framework and become technical point of contact for all related teams.
? Enhance existing ETL automation framework as per user requirements
? Performance tuning of spark, snowflake ETL jobs

Required Skills
? Must be strong in UNIX Shell, Python scripting knowledge
? Must be strong in Spark
? Must have strong knowledge of SQL
? Hands-on knowledge on how HDFS/Hive/Impala/Spark works
? Should have working knowledge of Github, DevOps, CICD/ Enterprise code management tools
? Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor.
? Good to have working experience on snowflake & any data integration tool i.e. informatica cloud

Primary skills
? Apache Hadoop
? Apache Spark
? Unix Shell scripting
? Python
? SQL

Good to have skills:
? Snowflake/Azure/AWS any cloud
? IDMC/any ETL tool