Sword Health

Senior Data Engineer (Portugal-based Remote/Hybrid)

Job Description

Posted on: 
October 23, 2024

What you'll be doing:

  • Design, build and maintain ETL/ELT data pipeline that ingests data from multiple sources with different technologies (MySQL, BigQuery, Cloud Storage, CSV, FHIR, JSON, etc.);
  • Architect and maintain Sword’s (complex) data warehouse; We own lots of different types of data;
  • Work with complex data architectures, like Kappa and lambda architectures. You’ll have the opportunity to work with batch and/or streaming processes;
  • Have the opportunity to work with some of the most exciting and newest technologies in the data field;
  • Work closely with our Algorithms and AI teams, supporting their needs for data and pipelines.
  • What you need to have:

  • Strong experience with Python programming language;
  • Previous experience in Software Engineering is considered;
  • Very high level of SQL and data modelling expertise;
  • Knowledge about other database types, like NoSQL databases is considered;
  • Experience in cloud-based architectures, such as GCP and AWS;
  • Experience with orchestration frameworks like Apache Airflow;
  • Proactivity and capability of proposing improvements to the team, being technical improvements or processual improvements.
  • What we would love to see:

  • Knowledge of Data Governance;
  • Experience with Modern Data Stack such as DBT, Bigquery;
  • Experience with Kafka Ecosystem. E.g. Kafka, Kafka Connect, Schema Registry and others;
  • Experience with IaC (Terraform), Containerization (Docker, Kubernetes) and CI/CD;
  • Capable of Zooming out and being able to propose changes to data architecture.
  • To ensure you feel good solving a big Human problem, we offer:

  • A stimulating, fast-paced environment with lots of room for creativity;
  • A bright future at a promising high-tech startup company;
  • Career development and growth, with a competitive salary;
  • The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare;
  • A flexible environment where you can control your hours (remotely) with unlimited vacation; 
  • Access to our health and well-being program (digital therapist sessions);
  • Remote or Hybrid work policy (Portugal only);
  • To get to know more about our Tech Stack, check here.