Lead Data Engineer (Leadership, Python, SQL)

freeC's Client

Role Purpose

Responsible for guiding and leading a team of data engineers, ensuring the efficient implementation of advanced solutions in data movement and transformation. Work closely with data architecture to understand and align the strategic and operational objectives of large-scale Oil & Gas (O&G) operations and the Engineering, Procurement, Construction, and Installation (EPCI) phase, promoting innovation and continuous development of the team and data analytics solutions.

Accountabilities

1. Key Accountabilities

• Lead and support the work of the data engineering team, including but not limited to, problem definition, sizing the impact of the potential use case, data architecture and engineering work, budgeting for solutions, and so on.
• Manage code conflicts, promoting collaboration among team members to resolve discrepancies and ensure the integrity of the developed code.
• Investigate potential technical debt, identifying areas that require improvements in the framework, and propose innovative solutions to optimize performance and work quality.
• Use agile practices and data engineering technologies to rapidly develop innovative and efficient solutions, deploying regular releases and creating appropriate documentation in the field of data engineering.
• Use DevOps practices to automate the development process, improving the efficiency of activities and reducing human errors, allowing for agility and increased team productivity.
• Identify and report data issues found in pipelines, effectively collaborating in diagnosing and resolving the issues, in order to ensure the quality and reliability of the information generated.
• Act as a facilitator in communication between different entities and professionals involved in the project, promoting a collaborative and dynamic environment, and ensuring that information is shared in a clear and efficient manner.

2. Secondary/Shared Accountabilities

• Champion a culture of data engineering excellence, promoting best practices and continuous improvement within the team.
• Lead knowledge sharing, training, and change management initiatives related to data engineering.
• Represent the data engineering function in cross-departmental and strategic initiatives, ensuring alignment with organizational goals.
• Participate in agile ceremonies, including sprint planning, reviews, and retrospectives.
• Carry out any additional tasks assigned by the project lead.

Job requirements

1. Educational Qualification

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field is expected.

2. Certifications

Microsoft / AWS / GCP certifications are a competitive edge, such as:

• Microsoft Azure Data Engineer Associate (DP-203)
• Microsoft Azure Solutions Architect Expert (AZ-305)
• Microsoft Certified: Azure DevOps Engineer Expert (AZ-400)

3. Relevant Experience

• 8+ years of total IT experience, preferably in the field of data engineering, with at least 5 years in a technical leadership or lead-engineer role.
• 5+ years designing and operating enterprise-scale data platforms and data warehouses (Synapse, Databricks, or equivalent).
• 3+ years of experience developing large-scale data processing solutions with Spark (PySpark/Scala) and building performant ETL/ELT pipelines.
• 3+ years of experience creating, deploying, and operating containerized data workloads with Docker and Kubernetes.
• 3+ years implementing CI/CD for data workloads and infrastructure (Azure DevOps, GitHub Actions, Jenkins).
• 3+ years working with infrastructure-as-code tools (Terraform or Bicep) and automated release practices for data pipelines and platform components.
• Strong programming skills in Python, PySpark, and SQL; 4+ years scripting and automation experience using Bash, Python, or similar.
• Experience implementing monitoring, alerting, SLAs, and incident response for data pipelines and platform services.
• Proven track record leading and mentoring engineers, performing architecture and code reviews, resolving technical conflicts, and driving best practices across multi-site or cross-country teams.
• Experience with data quality frameworks, lineage, metadata management, and collaboration with Data Governance to meet privacy and compliance requirements.
• Demonstrable outcomes in platform stability, performance, or cost optimization (for example: reduced pipeline failures, lower cost-per-query, faster ingestion time).

Why you'll love working here

• Join a team of 50+ brilliant Software Engineers, Product Owners, Data Engineers and UI/UX designers.  
• Experience a culture where communication and teamwork are paramount; everyone's voice is heard and valued. 
• Benefit from our high standards in software engineering practices!
• Work alongside our top-notch software engineers, pushing yourself to the next level: we only hire the best developers we can find! 
• Enjoy a rare opportunity to be part of a "start-up" tech team within a large, stable multinational company, experiencing the best of both worlds! 
• Explore and work with a wide spectrum of cutting-edge technologies in development frameworks, cloud solutions, data engineering, and artificial intelligence.

Benefits:

• Monthly wage: 90,000,000 - 100,000,000 vnd gross
• 13th month salary for every 12 months of employment
• Annual salary review (every July, depending on Group’s financial status in the year).
• Performance bonus (every March, depending on Group’s financial situation in the year)
• 16 days of annual leave for 1st one year of service and to be increased following number of years of service with company.
• Coverage of Medical treatment expenses as per Company’s Healthcare plan
• Personal accident & term‐life insurance for self and immediate family member (legal spouse/children)
• Premium annual medical check‐up program
• Working equipment: new laptop and software included