Big data developer

A established global financial institution with a strong presence in the investment banking sector. The organization prides itself on a collaborative and high-performance culture that encourages professional growth and innovation.

In this role, you will function as a Techno-Functional Developer within the data technology division. You will collaborate with cross-functional infrastructure and engineering teams to design, build, and deploy secure, scalable data processing pipelines.

Key responsibilities include:

• Design and execute high-performance Big Data solutions using a Python-based technology stack.
• Integrate complex systems and manage data pipelines utilizing Cloudera platforms (CDP/CDSW).
• Own the end-to-end documentation for system designs, builds, and implementations.
• Liaise closely with business users and key stakeholders to analyze requirements, propose functional solutions, and manage project expectations.
• Troubleshoot technical issues, optimize ETL processes, and drive automation across data formats.

• Proficiency in Python web-application frameworks (such as Django) alongside SQL, PySpark, and foundational knowledge of Java or Scala.
• Solid architecture comprehension of Hadoop, Hive, and Spark.
• Hands-on experience with Cloudera Data Platform (CDP) and Cloudera Data Science Workbench (CDSW), including security/access control configuration via Ranger or Atlas.
• Experience in Red Hat Linux environments, shell scripting, and infrastructure automation.
• Familiarity with data formats (Parquet, ORC, JSON) and setting up robust ETL pipelines.
• A background working within the financial services sector, with exposure to global markets products, market data analytics, or pricing risk factors is highly advantageous.
• Experience utilizing Cloudera Manager for monitoring Hadoop services or handling foundational Hadoop administration (Impala, Kafka, Zookeeper) is a plus.
• Excellent interpersonal and communication abilities to collaborate effectively in a team environment.
• A relevant tertiary qualification (e.g., Bachelor’s Degree in Computer Science, Information Technology, or a related field) with a proven track record of relevant, hands-on experience in data solution development.

• skills

• qualifications

• education

Bachelor Degree

share this job.