Principle Data Engineer

freeC's Client

• Design, develop, and manage cross-company data infrastructure.
• Oversee data integration and pipeline processes.
• Consolidate data from various internal products, services, and CRM tools into a centralized data lake.
• Efficiently distribute data from the data lake to analytics and machine learning platforms.
• Build and maintain data analysis infrastructure.
• Optimize data warehouse (DWH) performance.
• Ensure data accuracy, security, and quality.

Requirements: At least 8 years of experience in Data Engineering or a similar role.

Must-Have:

1. AI Software Development:

• Hands-on experience in AI algorithm development or a deep understanding of its foundations.
• Experience in building APIs and deploying them as internet services.
• Skilled in operating and manipulating API services using appropriate software.
• Capable of controlling and fine-tuning AI accuracy through effective data operation.

2. Data Engineering:

• Data Warehousing & ETL Processes
• Cloud Platforms: AWS, Azure, GCP (AWS preferred)
• Programming & Query Languages: Python, SQL
• Big Data Technologies: Hadoop, Spark, Kafka
• Data Modeling, Data Quality, and Data Security
• Version Control: Git

3. Tools & Technologies:

• Infrastructure Management: Terraform
• CI/CD Pipelines: GitHub Actions
• Monitoring & Logging: Datadog, Cloud Monitoring, CloudWatch
• Project Management: JIRA Cloud, Miro
• Documentation: Kibela, Google Workspace
• Spark: 2-3 years of experience
• Airflow: 1 year (as a user, not an administrator)

4. Cloud Architecture:

• Practical experience in developing systems using cloud services on AWS, GCP, or Azure (AWS preferred).
• Strong understanding of cloud service components from an architectural perspective, including capabilities, functionalities, and key considerations.
• Ability to design and integrate systems with proper security measures.

Nice-to-Have:

• Strong communication skills and an open mindset.
• Proficiency in English (listening, speaking, reading, and writing).

• Full salary during the probationary period
• Performance and salary review: twice/ a year in June and December
• 13th-month salary
• Monthly and biannual Recognition Awards
• An annual health check is provided
• Various insurances, including Social, Health, and Unemployment Insurance, are applied during the probation period. 
• Private health and accident insurance are also included, with additional benefits for family members at the Managing level.
• The hybrid working model allows for 3 days of remote work and 2 days in the office, with flexible start times.
• The facility is well-equipped, providing items such as a MacBook Pro and additional monitors. 
• Employees are entitled to 16-24 paid days off, with extra paternity leave days available.
• The company sponsors foreign language and international technology-related certifications.
• Annual company trips, quarterly team-building activities, and recreational clubs such as billiards and running.
• Employees have access to external and internal training courses, soft-skill workshops, and tech seminars.