Data Engineer

We are looking for a passionate Data Engineer To develop and optimise data and analytics architecture, as well as optimising data flow and collection to deliver integrated and quality business information and reporting solutions.

This is a 6 month contract with a view to extend. Hybrid model (Macquarie Park).

  • Develop, test and maintain data and analytics architecture, including databases and large-scale processing systems, for optimal extraction, transformation and upload of data from multiple sources and different technologies.
  • Work with the stakeholders to support their data infrastructure requirements and assist with resolving technical issues.
  • Write, test and validate data transformation and ETL routines within SQL, Python, Airflow.
  • Experience in pipeline scalability, through services such as Kubernetes.
  • Deploy models into production using CI/CD pipelines.
  • Reverse and forward engineer data assets.
  • Build data acquisition, ingestion pipeline, and data lake capbability.
  • Recommend improvements to data reliability, efficiency, and

quality, and provide high quality data assets for enterprise use.

  • Identify, design and implement process improvement to automate

processes, optimise data delivery, and achieve infrastructure

efficiency and scalability.

  • Collate, process, transform, and model raw data from multiple

sources, and utilise different data sourcing, integration and

modelling techniques.

  • Pilot, demonstrate and evaluate userability of new technologies

and systems,

  • Design and update user guides, technical specifications and

process clow documents for all applications and tools.

  • Be the subject matter expert for key source system tables and data

engineering tools.

  • Comply with relevant EEO and WHS regulations.
  • Perform any other duties as required and as appropriate for the

incumbent’s HEW level.

If interested, please send resumes .

Upload your CV/resume or any other relevant file. Max. file size: 64 MB.