Bukit Merah - Data Engineer

Role Overview:

We are looking for a skilled Remote Fabric Data Engineer to support our ongoing data platform migration and transformation efforts. This role focuses on migrating existing Databricks workloads into Microsoft Fabric, implementing efficient transformation logic, and ensuring complete lineage documentation and performance optimization.

Key Responsibilities:

• Migrate existing Databricks Silver/Gold layer SQL transformations into Microsoft Fabric SQL and Dataflows.
• Design and implement transformation logic, including deduplication, joins, field mappings, and business rules in Fabric Dataflows.
• Develop dimensional data models with surrogate key generation, row-level security (RLS) attributes, and role-based filtering.
• Build and maintain metadata lineage pipelines to track data flow across the lifecycle — from source systems through transformation to target layers.
• Tune performance of Fabric solutions by applying partitioning strategies, indexing, and aggregations where applicable.
• Produce clear, concise documentation including:
• Dataflow structures and logic
• Dimensional model definitions
• End-to-end lineage path summaries for audit and traceability

Qualifications:

• Diploma or Degree in Information Technology, Computer Science, or related field.
• Any other related certifications

Experience and Skills:

• Strong experience in Microsoft Fabric (Dataflows, Pipelines, Fabric SQL, and Lakehouses).
• Prior hands-on experience migrating Databricks SQL logic or similar workloads into Microsoft environments.
• Solid understanding of data modeling, data warehousing, and ETL/ELT transformations.
• Proficiency in performance tuning and working with large-scale data systems using partitioning and indexing.
• Experience with metadata management, data lineage, and documentation practices.
• Comfortable working in a fully remote setting with distributed teams.
• Excellent written communication skills to produce technical documentation and collaborate asynchronously.