Delivery Centric is seeking an experienced Data Engineer / Senior Data Lead with strong expertise in Azure Data Factory (ADF), Databricks, Power BI, and modern data engineering practices. This role focuses on designing, building, and maintaining scalable data pipelines, supporting enterprise data warehousing systems, and delivering high-quality analytics solutions. The ideal candidate will have strong hands-on experience in ETL development, cloud data platforms, and performance optimization, along with excellent stakeholder engagement skills.
Key Responsibilities
- Design, develop, and manage scalable data pipelines and ETL processes using Azure Data Factory (ADF).
- Build and maintain data flows, integration workflows, and data ingestion processes across cloud environments.
- Develop and enhance existing data warehouse systems to improve performance, scalability, and reliability.
- Work with Databricks to process and transform large datasets using PySpark and distributed computing frameworks.
- Develop Python and PySpark scripts for data processing, automation, and transformation requirements.
- Create and optimize SQL queries, including joins, subqueries, and performance tuning for efficient data processing.
- Design and develop interactive dashboards and reports using Power BI.
- Support production ETL jobs, ensuring smooth execution, monitoring, and issue resolution.
- Modify and enhance existing codebases based on evolving business requirements.
- Collaborate with business stakeholders and technical teams to deliver data-driven solutions.
- Ensure data quality, integrity, and adherence to data warehousing standards.
Qualifications
- 7 to 10 years of hands-on experience in data engineering or related roles.
- Strong expertise in Azure Data Factory (ADF) for building and managing ETL pipelines.
- Hands-on experience with Databricks for data processing and transformation.
- Proficiency in Power BI for creating dashboards and reports.
- Strong experience in SQL, including joins, subqueries, and performance optimization.
- Solid understanding of data warehouse concepts and ETL methodologies.
- Hands-on experience in Python and PySpark for data engineering tasks.
- Experience supporting and maintaining production ETL applications.
- Strong analytical, troubleshooting, and debugging skills.
- Excellent communication and client interaction skills.
- Ability to work independently and adapt to new technologies.
Preferred Skills
- Azure Data Engineer Associate (DP-203) certification.
- Databricks Certified Data Engineer Associate certification.
- Experience in the Transport domain or similar large-scale data environments.
- Exposure to enterprise data migration or modernization projects.
- Strong understanding of data modeling and analytics best practices.
At Delivery Centric, you will contribute to building modern cloud-based data platforms that enable advanced analytics and business intelligence. You will work in a collaborative environment alongside data engineers, analysts, and cloud specialists, delivering scalable and high-performance data solutions that drive strategic decision-making.