In-depth knowledge and experience with Azure cloud technologies and HDInsight
Working knowledge on Hadoop and HQL
Strong experience in scripting (BASH, Python) and building required automation (using standard technologies such as Docker and Jenkins).
Knowledge of Enterprise Batch Scheduler (eg CAWA).
Working knowledge of Multi-tier architectures: load balancers, caching, web servers, application servers, and databases.
Experience with various virtualization technologies and multi-tenant, private, and hybrid cloud environments.
Experience documenting and maintaining configuration and process information.
Work collaboratively with other team members to foster an environment of respect, open communication, and cross-functional expertise.
Capabilities & Requirements:
Bachelor’s Degree in Computer Science or related field with 6-10 years relevant experience and at a minimum of 2-3 years of experience in HDInsight and Hadoop.
Demonstrated proficiency with SQL, scripting (BASH, Python)
Demonstrated ability to quickly learn new programming languages and tools.
Demonstrate problem-solving, analytical abilities, and self-motivation.
Strong verbal and written communication skills and an ability to work in a team environment
Should be a good team player.
Optional Preferred Skills:
Develop ADF pipelines.
Experience in Python or equivalent object-oriented programming language.