Data Engineer (AI & Data)

apartmentToppan Ecquaria placeToa Payoh scheduleFull-time calendar_month 

Data Engineer (AI & Data)

Responsibilities:

  • Design and implement robust, scalable data pipelines and architectures to support data ingestion, processing, and storage. Including performance optimizations for data modeling and ingestion
  • Develop and optimize complex SQL queries and stored procedures for data extraction, transformation, and analysis.
  • Model data to meet different use cases for applications and automate data workflows.
  • Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
  • Lead the integration of data from various sources into data lakes and warehouses, ensuring data quality and consistency.
  • Monitor and troubleshoot data pipelines and workflows to ensure optimal performance and reliability.
  • Communicate with and support data users
  • Document data processes, data models, and architectural designs to ensure knowledge sharing and compliance with best practices.

Prerequisites:

  • Experience: Minimum 1 year in data engineering fields with system integration, and at least 1 year in system integration and implementation in cloud/web-based environments.
  • Proven Solutions: Demonstrated experience in providing effective, working solutions and implementations, particularly in cloud-based environments.

Technical Skills:

  • Solid understanding of ETL processes, data warehousing concepts, and data modeling best practices.
  • Proficiency in Databricks, Azure Data lake, PowerBI, Tableau and related data processing and visualisation software.
  • Familiarity with Windows, Linux, AWS and/or Azure platforms.
  • Strong programming skills in languages such as Python and R is a must
  • Experience in data processing frameworks (e.g., Apache Spark, Apache Flink)
  • Experience in using AI tools for data pipelines

Preferred Exposure:

  • Experience with Data Integration and ETL Pipelines, Data Warehousing and BI reporting projects.
  • Experience with Singapore Government Projects will be an added advantage
apartmentRANDSTAD PTE. LIMITEDplaceToa Payoh
phase out vendors that aren't adding value. skills and experience required Minimum 5+ years of hands-on data engineering experience. Deep expertise in the AWS ecosystem, specifically AWS Glue, Redshift, S3, and Lambda. Solid understanding of data lake...
local_fire_departmentUrgent

Data Centre Operations Engineer

apartmentSingapore TelecommunicationsplaceChoa Chu Kang, 12 km from Toa Payoh
troubleshooting in collaboration with remote engineering teams. Requirements  •  Diploma in Mechanical Engineering, Electrical Engineering, Building Services, or a related discipline.  •  Broad understanding of data centre electrical and mechanical infrastructure...
electric_boltImmediate start

Data Engineer Intern

apartmentBRIGHT POINT CAPITAL PTE. LTD.placeToa Payoh
International Trading is a Singapore collective investment fund that invests and trades in listed financial instruments to achieve high risk-adjusted returns. Job Summary We are looking for a Data Engineer Intern to support our data-related tasks, including...