Build the future you want

Join the companies disrupting their industries
76
companies
259
Jobs

Senior Data Engineer (f/m/x)

LiveEO

LiveEO

Data Science
Berlin, Germany
Posted on Apr 10, 2024
Build the Market Leader in Satellite Analytics with us at LiveEO
At LiveEO, we combine Space Technology with AI to solve problems here on Earth. Our satellite-based monitoring solutions help Infrastructure operators and industrial companies to make their operations more ecological, safer, and more efficient. We are a rapidly growing, venture capital-backed company at the forefront of an emerging industry. Our team is as global as the satellite data we process and the customers we serve - together, we are building something big.
Your challenge
  • Design, implement, and maintain efficient, reliable data pipelines to process and distribute large volumes of satellite imagery and related data.
  • Employ event-based computing and serverless architectures using to ensure scalable and responsive data processing.
  • Work with management engines such as Airflow or Prefect to orchestrate and automate data workflows.
  • Manage and optimize relational databases, ensuring data integrity and performance (experience with PostgreSQL, Snowflake preferred).
  • Collaborate with cross-functional teams to identify and implement data processing and automation solutions that enhance our product offerings.
  • Drive continuous improvement initiatives in data infrastructure and automation, ensuring best practices in DevOps and infrastructure management.
  • Become a key expert for Data Engineering and Automation best practices in the company.
  • Refactor, redesign, rebuild existing services.
  • Align with other software, data, machine learning and infrastructure experts in the company and influence the evolution of our tech stack.
  • Mentor more junior and software engineers and review their MRs.
Your profile
  • Experience with Python or another major programming language, with a strong emphasis on writing clean, efficient, and maintainable code.
  • Solid experience in designing, automating, implementing, and maintaining ETL pipelines.
  • Hands-on experience with services for event-based computing and serverless architectures.
  • Familiarity with workflow management engines like Airflow or Prefect to manage data workflows efficiently.
  • Knowledge of parallel computing, including concurrent programming and performance optimization, to handle high-volume data processing tasks.
  • Experience in QA automation, preferably with tools like Great Expectation, to ensure the quality and reliability of data pipelines.
  • Experience in processing and analyzing image data, particularly satellite imagery.
  • Familiarity with geospatial data processing tools and techniques, such as PostGIS and Cloud Optimized GeoTIFFs (COGs).
  • Proficiency in Kubernetes for container orchestration and Kafka or Apache Spark for real-time data processing and streaming
  • Proficiency in managing relational databases (e.g., PostgreSQL, Snowflake), with a strong understanding of database design and query optimization.
Your Benefits
  • The opportunity to create a product that can improve business processes and lives across the globe.
  • Flexible working hours and hybrid work model - we trust our employees to get their work done while maintaining a healthy work-life balance
  • We empower employees to drive their own career development, take initiative and have the freedom to be creative and bold
  • Not an overtime culture - we take care that overtime is done only as a necessity and always offset with time off and rest
  • Variety of team building opportunities - from jogging groups, team sports, bouldering and picnics
  • A collaborative and learning environment - frequent internal workshops, knowledge sharing sessions, journal clubs and hackathons
  • Potential to participate in the employee stock option program.
  • Office located in the center of Berlin Kreuzberg
  • BVG subsidy
About us
LiveEO is a well funded startup founded in 2018 and based in Berlin. Our primary service is modelling risk to our customers’ assets and infrastructure from vegetation, ground deformation and change detection. We currently have around 100 employees from all over the world with a variety of backgrounds