Lead Data Engineer

Tech Lead - Data Engineer

We are seeking a highly skilled and hands-on Technical Lead to drive the design, delivery, and operational excellence of our next-generation Air Traffic Management (ATM) platform . This cloud-native platform is built for advanced data and analytics workloads. The Tech Lead will serve as the bridge between solution architecture, project delivery, and engineering execution. In addition to guiding a team of engineers, you will personally contribute to designing, coding, reviewing, and troubleshooting complex data solutions on AWS and Databricks , ensuring alignment with architectural standards, project timelines, and business objectives.

Technical Leadership & Delivery

• Lead a team of data engineers and developers in designing and delivering end-to-end data pipelines (batch, streaming, event-driven).
• Actively write, review, and optimize code in Python/Scala, Spark, and SQL for Databricks and AWS-based solutions.
• Translate architectural blueprints into actionable engineering tasks and contribute directly to their implementation .
• Troubleshoot and resolve complex issues in production environments, ensuring reliability and uptime.
• Ensure solutions meet requirements for performance, security, governance, and compliance in aviation domain contexts.
• Oversee code quality, CI/CD workflows, observability, and DevOps best practices.

Collaboration & Stakeholder Management

• Partner with the Solution Architect to validate and refine solution designs, building hands-on prototypes/POCs where required.
• Work with the PM to align delivery milestones, manage dependencies, and escalate risks.
• Collaborate closely with domain experts, data scientists, and external vendors to integrate analytics and AI/Gen AI use cases into production.

Innovation & Continuous Improvement

• Introduce modern practices in data engineering, MLOps, and automation to enhance productivity and platform maturity.
• Proactively identify bottlenecks in pipelines, infrastructure, and delivery processes, and drive technical solutions directly .
• Mentor team members while also leading by example with hands-on contributions .

Education : Bachelors or Masters degree in Computer Science, Data Science, Data Engineering, Information Systems, or related discipline.

Experience :

• 7+ years in data engineering, cloud-native solutions, or related technical delivery roles.
• 3+ years in a technical leadership or team lead role, balancing leadership with active technical contribution .
• Strong hands-on experience with AWS cloud services (particularly for data engineering) and Databricks (Delta Lake, Spark, Unity Catalog etc.).
• Proven track record in delivering secure, regulated-domain platforms (aviation, finance, or public sector preferred).
• Familiarity with Agile/Scrum delivery and cross-functional team collaboration.

Preferred Qualifications

• Experience with AWS Databricks, Delta Lake, Live Data Streaming and medallion architecture.
• Exposure to AI/Gen AI concepts or intelligent agent-based architectures.
• Familiarity with aviation data standards (e.g., ADS-B, ARINC 424, flight schedules) or willingness to learn.
• AWS Certifications in Data Analytics, Big Data, or Machine Learning.
• Experience with real-time data processing and high-volume systems.

Information :

• Company : Avensys Consulting
• Position : Lead Data Engineer
• Location : Singapore
• Country : SG