Tech Mahindra Recruitment 2021 – Azure Data Engineer

Sr. Software Engineer

 

 

Required skills:

¿ Strong Experience in design and development in Azure Datalake solutions
¿ Strong experience in SQL analytic queries
¿ Strong experience in designing data distributions strategy
¿ Design a partition strategy for efficient analytical workloads
¿ Designing incremental data load
¿ Designing metastores in Azure SQL/Synapse and Azure Databricks
¿ Strong experience in Data transformations using Apache Spark, T SQL, Data factory, Encode and decode data, Data Exploratory analysis
¿ Strong experience in batch loads using Data Factory, Data lake, Spark, Function Apps
¿ Strong experience in Python, Java
¿ Strong experience in Data streaming components like Azure Event hubs, Kafka etc.
¿ Strong experience in developing application in Azure Databricks

Tools:

Azure Data Factory
Azure Databricks
Azure Storage Accounts
Azure Function Apps
Azure SQL and Azure Synapse
Azure Event Hubs, Stream Analytics and Kafka
Java or Python
Apache Spark and Spark Streaming

Roles & Responsibilities:

¿ Design and develop data pipelines using Azure Data Factory to various components like Azure SQL/Synapse or storage accounts.
¿ Design and develop full load and incremental loads using ADF to Azure SQL/Synapse
¿ Develop real time data processing applications using Azure Event Hubs, Kafka and Azure Stream analytics
¿ Connect to different source systems and collect the data in scheduled time and process them using different components like Azure Data bricks, Function Apps etc., and distribute it to the downstream applications or downstream locations like Azure SQL/Synapse, Amazon S3/RedShift etc.
¿ Data cleansing and pruning with python libraries like Pandas, Numpy etc.
¿ Develop cost effective, serverless applications using Azure Function apps (Java, Python or any supported language) to process and transform data

Level of experience: Overall experience 5 to 8 years with minimum of 3 years in required skills.

Skill Set: WINDOWS AZURE PAAS

Location: CHENNAI

Job Expiry Date: 04/06/2021

 

Apply for the Job

Leave a Reply

Your email address will not be published. Required fields are marked *

%d bloggers like this: