Data engineer
Singapore River
about the company:
show more
A established global financial institution with a strong presence in the investment banking sector. The organization prides itself on a collaborative and high-performance culture that encourages professional growth and innovation.
about the job:As a Senior Data Engineer, you will play a critical role in designing, building, and optimizing the organization’s enterprise data architecture. You will be responsible for developing scalable data pipelines and ensuring the seamless integration of complex data streams across hybrid environments.
key responsibilities include:
- Design, build, and maintain robust ETL/ELT data pipelines to ingest and transform large-scale data into modern data warehouses and data marts.
- Create and implement end-to-end automation frameworks using scripting tools and enterprise scheduling platforms to streamline data operations.
- Analyze and tune highly complex data applications and queries to maximize processing efficiency and minimize resource consumption.
- Develop and configure custom Change Data Capture (CDC) mechanisms to process source system logs (including ERP systems) for downstream data ingestion.
- Deploy and manage Master Data Management (MDM) solutions, establishing data validation rules and workflow approvals to maintain high data quality.
- Experience in data engineering, specifically in designing and managing enterprise data warehouse (EDW) environments.
- Deep expertise in traditional ETL development tools (such as Informatica PowerCenter) combined with advanced data warehousing platforms (such as Teradata, including BTEQ and Teradata SQL).
- Hands-on experience with big data and distributed processing technologies (e.g., Apache Spark, Hive, Impala, Trino/Presto, Iceberg, Kafka, or Flink).
- Proficient in shell scripting and database automation frameworks (e.g., GCFR); knowledge of object-oriented programming (such as Java) for custom tool/framework building is highly advantageous.
- Familiarity with data security, access control frameworks (e.g., Ranger, Atlas), and Master Data Management implementation.
show more
- skills
- qualifications
- education
Bachelor Degree
share this job.
NTT SINGAPORE PTE. LTD.Bukit Merah, 2 km from Singapore River
We are seeking a passionate Big Data engineer to join our Global Data Platform team.
KEY FEATURES OF THE POSITION
• Drive development projects for big data platforms.
• Understand system and functional requirements and translate them...
Saksoft Pte LimitedBukit Merah, 2 km from Singapore River
Strong hands‑on experience with the ETL(Informatica Power Center) and Teradata based ETL development, similarly Hadoop ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, Nifi, Flink etc.,), and data pipeline orchestration.
• Create EDW...
HORIZON SOFTWARE PTE. LTD.Toa Payoh, 5 km from Singapore River
ob Summary
We are looking for a highly skilled Data Engineer with strong experience in designing, developing, and maintaining scalable data pipelines and modern data platforms. The candidate should have expertise in big data technologies, cloud...