Role : Senior Data Engineer

 4 - 6 Year

Job Description

Mandatory Skills:
Overall 4-6 years of experience into Data Engineering.
Strong understanding & familiarity with all Azure / Bigdata Ecosystem components.
In depth knowledge and understanding of Apache Kafka to handle streaming data.
In depth knowledge and hands on experience of Azure Data bricks / spark, Spark streaming and its
various core components like GraphX, MLLib.
Design and develop data ingestion programs to process large data sets in Batch mode using python,
Databricks, and Spark.
Strong understanding of underlying Azure Architectural concepts and distributed computing paradigms.
Hands-on programming experience in Python & OOPs Concepts.
Hands on experience with major components like Airflow / Nifi / ADF.
Experience working with SQL (mySQL/Postgres/SQL Server), NoSQL (cassandra/Mongo/Cosmos DB) &
Graph databases (Neo4j).
Advanced working SQL knowledge to create complex queries.
Hands On experience on visualization tools like Grafana / kibana / Power BI.
Good understanding of Linux commands, shell scripting and monitoring Linux based production machines.
Experience working on Azure Cloud services IaaS, PaaS.
Hands on Experience in working on Microsoft Azure Services like ADLS, Event Hubs, scale sets, Load
Balancers, Azure Functions, Logic Apps, Azure Data Factory etc.
Should have worked on various Bigdata file formats like Avro, ORC, Parquet, Nested Json.
Experience of data migration and deployment from On-Prem to Cloud environment and vice-versa.
Individual Contributor.
Problem solving skills.

Salary :   Not Disclosed by Recruiter

Industry :   IT Software - Other

Functional Area :   IT Software - Other

Role Category :   Computer/IT

Employment Type :   Full-Time

Education / Qualification :   B.E/B.Tech