Data Engineer

THE ROLE: Data Engineer

The role will work closely with the Registrar Office's Data and Reporting team, while remaining under IT's purview for platform operations and data engineering.

Key Responsibilities:

• Design, build, and maintain bronze, silver, and gold layer data models in Databricks, following medallion architecture principles.
• Manage and optimize ETL pipelines using Fivetran, ensuring accurate and timely ingestion from diverse data sources.
• Develop scalable and reusable data models using star schema and other dimensional modeling techniques to support BI and analytics.
• Support data visualization and dashboarding efforts through integration with Power BI, Tableau, and other tools.
• Administer and optimize MySQL databases and structured queries for high performance.
• Apply data quality checks, ensure governance, and enforce policies for data security and privacy
• Leverage Databricks AutoML, and support machine learning or predictive analytics use cases in collaboration with the data science or analytics teams.
• Work with stakeholders to define data requirements and deliver robust data infrastructure to support enterprise reporting and operational intelligence.
• Maintain documentation for data flows, models, and platform architecture.

Qualifications

Essential:

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• Minimum 3 years of experience in data engineering or related technical roles.
• Proven experience in:
• Building data pipelines and models in Databricks, including bronze, silver, gold layers
• Fivetran (or similar ETL tools)
• Dimensional modeling, especially star schemas
• MySQL, SQL scripting, and Python/PySpark
• Power BI and/or Tableau
• Strong understanding of data lakehouse, data warehousing, and cloud-native architectures.
• Solid grasp of data governance, security, and compliance standards.

Desirable:

• Experience with Databricks AutoML or machine learning workflows for predictive analytics.
• Exposure to CI/CD for data pipelines and version control with Git.
• Familiarity with data integrations involving CRM/SIS or RESTful APIs.
• Experience working in education technology or public sector data environments.

• Working Hours: Monday to Friday, 9am to 6pm.
• Work Arrangements: Hybrid (Blend of in-office and remote work)
• Location: Wilkie Edge