Data Engineer

  • Job Ref.No: 01154138
  • Budget:
  • Timeline: to be confirmed later
  • Closing on: 28/07/2020
  • Country: Singapore

Job Description

Part-timers & Freelancers are Welcome to apply this Full time position

- Build ingest pipelines to collect, clean, harmonise, merge and consolidate data sources

- Design and build API gateways to expose data to systems via secure means

- Integrate and collate data sources with data systems, with compliance to data security and organisational governance standards

- Collaborate with product managers, software engineers, data analysts and data scientists to build scalable and data-driven products
Job Requirement

+ Good understanding of system design, data structure and algorithms, data modelling, data access and data storage

+ Ability to write SQL for databases like Postgres, MongoDB, neo4j

+ Proficient in programming languages like R, Python and/or Go

+ Familiar with regular expressions and scripting languages like bash, korn, awk

+ Prior experience with data engineering tools and frameworks like Airflow, Kafka, Hadoop, Spark, Kubernetes

+ Comfortable with DevOps tools like Docker, Git, Terraform

+ Familiar with building and using CI/CD pipelines for platform development

+ Understand LDAP, OAuth, API gateways

+ Able to show some work using cloud technologies like Azure, AWS and Google Cloud

+ Working-level understanding of machine learning is an added advantage

+ Prior experience in designing, building and maintaining batch and real-time data pipelines is an added advantage

+ Applicants without experience are welcome to apply

Please DO NOT provide your credit card details when applying for jobs.
Applicants are advised not to pay any upfront payment or any registration fee for the purpose of applying jobs.
This ad was registered on 28/06/2020 at does not charge any fee or take any commission for finding and applying jobs.
Something suspicious? Report this job

Job Views