- We're using technologies like Python, Terraform, Kubernetes and Pub/Sub to run event-based data pipelines, processing millions of new data points every day on the Google Cloud Platform.
- We're rolling out new features multiple times a day through fully automated Infrastructure as Code and CI/CD pipelines, including code reviews and automated tests.
- We take responsibility for the full DevOps cycle, but thanks to managed cloud services and automation, we spend most of our time actually working on new features and architecture optimisations.
- Completed degree in computer science or related subject
- Min. 4 years of experience in data engineering (setting up & operating data pipelines in big data/analytics environments)
- Min. 2 years of experience with one or more of the major cloud providers (ideally GCP)
- Experience in software development with Python, knowledge of tools such as Jupyter, VS Code, PyCharm, git, virtual environments, CLI
- Knowledge of automated testing, CI/CD, build pipelines, monitoring
- Confident application of DevOps/SRE principles
- Experience with technologies such as Kubernetes/OpenShift, Docker, SQL/NoSQL databases,messaging, Airflow, Apache Beam
- Knowledge of event driven architectures beneficial
Senior Data Engineer @ AVIATAR - España - Lufthansa Group
Descripción
What does your next dream challenge look like? How about working with aircraft data on a state of the art, cloud native technology stack, powering predictive maintenance analytics?
Tasks
We're looking for someone to join our team of data engineers, developing new data pipelines and scaling the existing ones for a growing number of customers and use cases.
And if this sounds like an exciting environment to work in, we haven't even mentioned benefits like standby flying for your work/life balance yet. Let's talk
Requirements
The ideal Senior Data Engineer @ AVIATAR must fulfill the following requirements:
*CV/Resume & Cover Letter required
*Must possess a legal work permit in Spain
*Company will not provide relocation assistance