Bukit Merah - Data Engineer

We are seeking a skilled Data Engineer or Software Engineer with a strong background in Python to develop and maintain robust data pipelines. This role requires hands-on experience in testing, a solid grasp of DevOps and Agile practices, and the ability to collaborate across teams to deliver high-quality data solutions.

Key Responsibilities:

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Ensure code quality and reliability through unit and integration testing.
• Collaborate with data teams to gather requirements and automate deployment and monitoring.
• Optimize data storage, troubleshoot issues, and enhance system performance.
• Follow DevOps and Agile practices in daily operations.

Requirements:

• Degree in Computer Science, Information Technology, or a related field.
• Minimum 5 years of relevant experience in software or data engineering.
• Proficiency in Python and strong understanding of testing methodologies.
• Familiarity with DevOps practices and Agile development.
• Strong problem-solving, analytical, and software engineering skills.
• Effective communication and teamwork skills.

Nice to Have:

• Experience with AWS and Kubernetes (K8s).
• Familiarity with data platforms like Snowflake, Apache Spark, or Hive.
• Experience with orchestration tools such as Apache Airflow, Dagster, or Prefect.
• Understanding of GitHub workflows and monitoring tools like Datadog.

Company EA License: 11C4879