Data Engineer (AI & Data)
Toppan Ecquaria Toa Payoh Full-time
Data Engineer (AI & Data)
Responsibilities:
- Design and implement robust, scalable data pipelines and architectures to support data ingestion, processing, and storage. Including performance optimizations for data modeling and ingestion
- Develop and optimize complex SQL queries and stored procedures for data extraction, transformation, and analysis.
- Model data to meet different use cases for applications and automate data workflows.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Lead the integration of data from various sources into data lakes and warehouses, ensuring data quality and consistency.
- Monitor and troubleshoot data pipelines and workflows to ensure optimal performance and reliability.
- Communicate with and support data users
- Document data processes, data models, and architectural designs to ensure knowledge sharing and compliance with best practices.
Prerequisites:
- Experience: Minimum 1 year in data engineering fields with system integration, and at least 1 year in system integration and implementation in cloud/web-based environments.
- Proven Solutions: Demonstrated experience in providing effective, working solutions and implementations, particularly in cloud-based environments.
Technical Skills:
- Solid understanding of ETL processes, data warehousing concepts, and data modeling best practices.
- Proficiency in Databricks, Azure Data lake, PowerBI, Tableau and related data processing and visualisation software.
- Familiarity with Windows, Linux, AWS and/or Azure platforms.
- Strong programming skills in languages such as Python and R is a must
- Experience in data processing frameworks (e.g., Apache Spark, Apache Flink)
- Experience in using AI tools for data pipelines
Preferred Exposure:
- Experience with Data Integration and ETL Pipelines, Data Warehousing and BI reporting projects.
- Experience with Singapore Government Projects will be an added advantage
RANDSTAD PTE. LIMITEDToa Payoh
phase out vendors that aren't adding value.
skills and experience required
Minimum 5+ years of hands-on data engineering experience. Deep expertise in the AWS ecosystem, specifically AWS Glue, Redshift, S3, and Lambda.
Solid understanding of data lake...
Singapore TelecommunicationsChoa Chu Kang, 12 km from Toa Payoh
troubleshooting in collaboration with remote engineering teams.
Requirements
• Diploma in Mechanical Engineering, Electrical Engineering, Building Services, or a related discipline.
• Broad understanding of data centre electrical and mechanical infrastructure...
BRIGHT POINT CAPITAL PTE. LTD.Toa Payoh
International Trading is a Singapore collective investment fund that invests and trades in listed financial instruments to achieve high risk-adjusted returns.
Job Summary
We are looking for a Data Engineer Intern to support our data-related tasks, including...