Data Engineer

Job Description

Who are we looking for:

Role: Data Engineer - Azure Synapse Analytics Specialist

Experience: 7+ years

Location: Noida/Pune

Job Overview:

We are seeking a Senior Data Engineer with a minimum of 7+ years of relevant industry experience to join our dynamic and innovative team. The ideal candidate will play a crucial role in designing, implementing, and maintaining data solutions that enable effective data management, analytics, and reporting. You will collaborate closely with cross-functional teams to understand business requirements and translate them into scalable data solutions using Azure Synapse Analytics and other relevant technologies. Also, modernize the existing data pipelines from SSIS to Azure Synapse Analytics.

Key Responsibilities:

• Building Data Pipelines: Design, develop, and maintain data pipelines and ETL processes using Azure Synapse data pipelines and modernize existing SQL Server Integration Services (SSIS) to ensure efficient data ingestion, transformation, and loading.

• Data Modeling: Build and manage data models, including dimensional modeling, to support reporting and analytics requirements.

• DevOps: Implement CI/CD pipelines and automation scripts for deploying, testing, and monitoring data solutions in collaboration with the DevOps team.

• Security and Compliance: Ensure data security, integrity, and compliance with regulatory standards by implementing appropriate access controls and encryption mechanisms.

• Performance Optimization: Perform performance tuning and optimization of data solutions to meet SLAs and scalability requirements.

• Communication: Effectively communicate complex findings and insights to both technical and non-technical stakeholders. Prepare and deliver presentations to convey the value of data science initiatives.

• Stay Current: Stay updated with the latest advancements in Azure Synapse Analytics, SQL Server, and other relevant technologies, and provide recommendations for adopting new tools and techniques.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

• 7+ years of experience working as a Data Engineer or similar role.

• Proficiency in programming languages such as Python, and SQL.

• Hands-on experience with Azure Synapse Analytics, including Azure SQL Data Warehouse and Azure Data Lake Storage.

• Proficiency in SQL programming and database design principles, with expertise in SQL Server ANSI-SQL and T-SQL.

• Strong understanding of ETL processes and tools, especially SQL Server Integration Services (SSIS).

• Experience in developing and maintaining interactive reports and dashboards using SQL Server Reporting Services (SSRS).

• Familiarity with Continuous Integration/Continuous Deployment (CI/CD) practices and tools, such as Azure DevOps or Jenkins.

• Excellent problem-solving skills and ability to troubleshoot complex data issues.

• Strong communication skills with the ability to explain complex concepts to both technical and non-technical audiences.

• Azure certifications (e.g., Azure Data Engineer Associate) are a plus.