About the Role
We are seeking a skilled Software Engineer to join our Data Infrastructure & Acquisition team in Berlin, Germany. You will be responsible for designing, building, and maintaining robust and scalable data pipelines and infrastructure that power our analytics and machine learning initiatives. This involves working with large datasets, distributed systems, and cloud platforms (AWS).
Your Responsibilities
- Design, develop, and optimize data infrastructure components.
- Build and maintain reliable and scalable ETL processes.
- Ensure high data quality and consistency across all data sources.
- Collaborate with data scientists and analytics engineers to understand data needs.
- Implement monitoring and alerting for data pipelines.
- Contribute to the architectural decisions of our data platform.
Requirements
- Strong experience in Software Engineering, specifically within data-intensive environments.
- Proficiency in Python and SQL.
- Experience with distributed data processing frameworks like Apache Spark.
- Familiarity with cloud platforms, preferably AWS.
- Knowledge of message queuing systems (e.g., Kafka) and workflow orchestrators (e.g., Apache Airflow).
- Understanding of data warehousing concepts and best practices.
- Experience with large-scale data acquisition and management.
- Excellent problem-solving skills and attention to detail.
What We Offer
- An exciting role in a growing international team.
- Opportunities for professional development and learning.
- A vibrant work environment in the heart of Berlin.