Data Engineer Lead

EXL

Company: EXL
Salary: Not Mentioned
Location: Bangalore Urban, Karnataka, IN
Experience: Senior Level
Qualification: Not Mentioned

Overview AI Summary

This Lead Data Engineer position at EXL in Bangalore is ideal for an experienced professional who excels in both technical data engineering and team leadership. The role involves overseeing the entire lifecycle of data platforms and web-based data solutions, combining hands-on expertise with strategic delivery ownership. The successful candidate will lead a diverse team of data, DevOps, and full-stack engineers, driving best practices in coding, architecture, and deployment. You will be instrumental in translating business requirements into technical solutions, collaborating with architects, and ensuring project delivery excellence in a client-facing environment. A strong background in Python, SQL, AWS (S3, EMR, Glue, Lambda, Redshift), PySpark, and modern data architecture is essential. This opportunity is perfect for a leader passionate about building scalable data systems and fostering team growth. It offers a chance to make a significant impact on enterprise-scale projects, optimize complex data workflows, and shape the future of data-driven applications within a global delivery model.

Job Description

Overview

EXL is seeking a Delivery Lead to spearhead the comprehensive delivery of data platforms and advanced web-based data solutions. This pivotal role necessitates a blend of hands-on data engineering proficiency, robust delivery ownership, and effective people leadership. The successful candidate will manage a cross-functional team of 7-9 engineers, including Data Engineers, DevOps Engineers, and Full-Stack Developers, while collaborating closely with onshore Solution Architects and serving as the primary liaison between business stakeholders and technical execution.

Key Responsibilities

Lead the end-to-end delivery of data engineering initiatives and data-driven web solutions.
Architect, construct, and maintain scalable and reliable data pipelines and overall data architectures.
Offer hands-on technical guidance and strategic architectural oversight as required.
Ensure optimal performance, data quality, reliability, and scalability across all data systems.
Champion best practices in coding standards, testing methodologies, documentation, deployment processes, and system monitoring.
Mentor and manage a team of 7-9 engineers, facilitating task planning, sprint execution, performance reviews, and fostering efficient collaboration.
Engage with business stakeholders to accurately translate requirements into viable technical solutions.
Coordinate with Onshore Solution Architects to align on solution design and delivery strategies.
Act as the main point of contact for project delivery status, risk management, and dependency tracking.
Contribute to engagement planning, establishing delivery commitments, and managing execution timelines.
Work with DevOps teams to implement robust CI/CD pipelines and automation strategies.
Optimize workflows for cost-efficiency, performance, and operational excellence.
Support deployments utilizing containerized and cloud-native technologies.

Required Skills

Proficiency in Python and SQL, with significant hands-on coding experience.
Demonstrated experience in designing and building complex data pipelines and data platforms.
Expertise in Teradata SQL, including strong query optimization abilities.
Hands-on experience with PySpark for large-scale data processing tasks.
Comprehensive understanding of ETL/ELT concepts and data warehousing principles.
Experience with AWS cloud services, specifically S3, EMR, Glue, Lambda, and Redshift.
Familiarity with DevOps practices and CI/CD tools.
Knowledge of Docker and Kubernetes for containerization and orchestration.
Experience supporting and delivering data-driven web applications.
Exposure to modern data architecture patterns such as lakehouse, microservices, and event-driven systems.
Prior experience working in global delivery models involving onshore/offshore coordination.
Track record of delivering enterprise-scale data platforms or advanced analytics solutions.
Comfortable managing delivery in fast-paced, client-facing engagement environments, particularly with large datasets, performance optimization challenges, and multi-stakeholder contexts.

Additional Information

This role involves direct interaction with business stakeholders, Onshore Solutions Architects, product owners, and client representatives. The team size is projected at 7-9 engineers, with potential for expansion. This position offers a dynamic mix of delivery leadership, technical oversight, and people management responsibilities.