Data Engineer – Cloud & Big Data Platforms - Bukit Merah
KRYJAS PRIVATE LIMITED Bukit Merah
Key Responsibilities
Kafka, PySpark, AWS S3, Cloudera, and Azure Synapse
Data security/governance tools: Apache Ranger, Collibra, Protegrity
DevOps and orchestration: Azure DevOps, Airflow, Control-M
- Architect and implement scalable ETL/ELT data pipelines across cloud and hybrid environments using Azure Data Factory, Databricks, PySpark, and Kafka
- Build and maintain data lakes and lakehouse architectures aligned with enterprise security and governance requirements
- Ensure secure data processing using tools like Apache Ranger, Protegrity, and Collibra
- Support federated querying and metadata management through Trino, Starburst, and EDC tools
- Lead CI/CD automation for data workflows using Azure DevOps, Git, and related DevOps practices
- Act as SME for L2/L3 support, performance tuning, and audit readiness in production environments
- Collaborate with analytics, ML, and compliance teams to deliver ML-ready, governed datasets
- Minimum 8 years of relevant experience in data engineering
- At least 5 years working with data platforms in banking/regulated environments
- Deep technical expertise with:
Kafka, PySpark, AWS S3, Cloudera, and Azure Synapse
Data security/governance tools: Apache Ranger, Collibra, Protegrity
DevOps and orchestration: Azure DevOps, Airflow, Control-M
Programming & querying: Python, SQL, Trino/Presto
MFT ENERGY PTE. LTD.Bukit Merah
Join a world of energy as MFT Energy's new Lead Data Engineer in Singapore
At MFT Energy, we trade energy, gas, and environmentals to make markets efficient and to facilitate the green transition. As Lead Data Engineer for MFT Energy, you'll create...
Singapore TelecommunicationsJurong West, 15 km from Bukit Merah
Passionate about making a real impact? Join our team at Nxera to unfold the new era! Be at the forefront of the data centre (DC) industry with a unique focus on sustainability, connectivity and AI which sets us apart as the next generation DC...
FLINTEX CONSULTING PTE. LTD.Bukit Merah
Data engineer (Azure) – Synapse and Pyspark, Python, Datawarehouse and Azure Data Explorer, Azure Devops
Job Scope
• Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration
• Implement...