Data Engineer (Python, Scala) - Toa Payoh
Your new company
A public firm is looking for an experienced Data Engineer to join their team.
Your new role- Architect, build, and monitor ingestion pipelines to collect, clean, merge, and harmonize data from various sources, ensuring optimal performance and uptime.
- Construct, test, and update reusable data models while designing secure mechanisms for end users and systems to access data in the data warehouse.
- Collaborate on data governance policies, maintain a data catalog, implement data quality checks, and enforce security best practices like access control and encryption.
- Research and develop new technologies and processes to enhance data infrastructure, ensuring continuous improvement in efficiency and reliability.
- Strong foundation in system design, data structures, algorithms, data modeling, storage, and access, with experience in architecting data and IT systems.
- Skilled in cloud platforms (AWS, Azure, Google Cloud), distributed data technologies (Spark, Hadoop), and orchestration frameworks (Airflow, Azure Data Factory).
- Proficient in Python, Java, Scala, SQL, and familiar with CI/CD pipelines, DevOps tools (Docker, Git, Terraform), and infrastructure automation.
- Experienced in batch and real-time data pipelines, Databricks, and implementing security, quality, and governance processes, including familiarity with government data policies.
What you'll get in return
In return, you'll be part of an organization that values its employees. You’ll be rewarded with:
- Structured career growth and plenty of developmental opportunities
- Hybrid and stable working environment
What you need to do now
If you're interested in this role, click 'apply now' or for more information and a confidential discussion on this role or to find out about more opportunities in Technology, contact Yuki Cheung or email yuki.cheung@hays.com.sg. Referrals are welcome.
At Hays, we value diversity and are passionate about placing people in a role where they can flourish and succeed. We actively encourage people from diverse backgrounds to apply.
EA Reg Number: R22110258 | EA License Number: 07C3924 | Company Registration No: 200609504D