Data Analyst - Big Data & Cloud Platforms - Choa Chu Kang

We are seeking a passionate and experienced Data Analyst to join our team in delivering cutting-edge data solutions for enterprise clients. The successful candidate will be responsible for designing, building, and optimizing scalable data pipelines, implementing ETL frameworks, and contributing to enterprise-wide data management strategies across cloud platforms.

Key Responsibilities:

• Design and implement robust data pipelines and ETL workflows using Apache Spark, Python, and Scala.
• Lead performance optimization efforts for large-scale batch and real-time data processing.
• Integrate and manage data from multiple enterprise systems including SAP ECC, MDG, Dynamics 365, and various flat file sources.
• Develop and maintain scalable solutions on Google Cloud Platform (GCP) and Amazon Web Services (AWS).
• Build data quality validation frameworks using tools like Great Expectations integrated with BigQuery.
• Work collaboratively with cross-functional teams to ensure data reliability, consistency, and availability.
• Orchestrate complex workflows using Apache Airflow or Cloud Composer.
• Conduct performance tuning, troubleshooting, and documentation for production-grade data systems.

Requirements:

• Bachelor’s degree in Electronics, Computer Science, Engineering, Information Technology, Science or a related field.
• Minimum 3 years of experience in big data roles.
• Strong experience with Apache Spark, Hadoop ecosystem, Hive, and related tools.
• Proficiency in Python and Scala.
• Hands-on experience with Google Cloud (BigQuery, Cloud Composer) and/or AWS.
• Strong SQL skills and experience with relational and distributed databases.
• Experience with data quality frameworks such as Great Expectations.
• Excellent problem-solving skills and ability to work independently and in a team.

Nice to Have:

• Experience in data harmonization across enterprise systems.
• Exposure to data governance practices.
• Google Cloud Professional Data Engineer certification or equivalent.