Build the future you want

Join the companies disrupting their industries

Principal Data Engineer



Data Science
Belfast, UK
Posted on Tuesday, May 14, 2024

Are you ready to lead the design and implementation of a best-in-class data platform on AWS? Do you have a deep understanding of data engineering principles and a passion for creating scalable, efficient, and secure data solutions? If you're seeking a challenging and rewarding role, join Cloudsmith as our Principal Data Engineer!

We help our customers manage and secure their software supply chain, and improve their developer experience. We are by developers, for developers. Our culture operates with openness and transparency, driven by our ambition to build a great company. We enjoy working with great people and customers. We learn, support one another, and we’re growing. Now is a great time to join us.

The Opportunity that lies ahead

As Principal Data Engineer, you will be instrumental in designing and building our new data platform. This platform is critical to our business strategy and will serve as the backbone for providing insights to customers to help improve their software supply chain, and serve as the foundation for AI-powered features that leverage our large amounts of static and event data across all of our customers’ build usage

Your Role:

  • Design and Development: Spearhead the design and development of our new data platform. Your expertise will guide the architecture, data modelling, and implementation of scalable, maintainable and efficient data pipelines.
  • Collaborate with Cross-Functional Teams: Work closely with data engineers, software engineers, and business stakeholders to ensure the platform meets business needs and integrates seamlessly with other systems.
  • Innovation and Continuous Improvement: Stay abreast of the latest developments in data engineering and AWS technologies. Drive innovation and continuous improvement in our data practices.
  • Data Governance and Security: Help establish and maintain data governance practices, ensuring data security, quality, and compliance.
  • Mentoring and Leadership: Mentor junior data engineers and promote a culture of learning and excellence within the team.

Required Skills and Experience:

  • Extensive Experience in Data Engineering: Proven track record in designing and building large-scale data platforms, particularly on AWS.
  • Expertise in AWS Services: Deep knowledge of AWS services related to data engineering (e.g., Redshift, S3, Glue, Lambda, Kinesis).
  • Strong Programming Skills: Proficiency in languages like Python, SQL, and experience with data pipeline tools.
  • Data Modeling and Warehousing: Expertise in data modeling techniques and experience with data warehousing solutions.
  • Excellent Problem-Solving Skills: Ability to tackle complex challenges and provide efficient, innovative solutions.
  • Leadership and Communication: Strong leadership skills with the ability to communicate effectively across various levels of the organization.

Technology Stack

We are cloud-native, born in AWS, and embrace their services across our platform. Our technology stack includes Python, Django, ECS, Kinesis, Cloudfront, Flink, Elasticsearch, Lambda, Amazon MQ, Terraform, and Postgres.


  • Competitive salary and equity package.
  • Comprehensive health, dental, and vision insurance.
  • Generous annual leave and flexible working policies.
  • Budget for professional development, conferences, and training.
  • Opportunity to work in a dynamic, innovative, and supportive environment.

Health and Wellness

Regardless of your location, we deeply care about the health and wellness of our staff and their families; a sustainable pace is important to us. In addition to generous annual leave (PTO), we offer parental leave and health benefits that can cover you and your dependents up to 100%. We also offer flexible family-friendly working policies.

Personal Growth

You will have an enormous scope to learn new skills alongside your colleagues, and your continued professional development is essential to us because it's important to you. We will support you with budgets for equipment, training, books, conferences, travel, and certifications. The more powerful you become, the better for all of us.

Hybrid Work

Cloudsmith is based in Belfast, and we use out HQ regularly for activities like bi-weekly development review sessions and operations team in-office days. We also hold all-hands offsites in Belfast a few times per year, with guest speakers and team activities. On a day-to-day basis, most Cloudsmithers work remotely, so we really rely on our online collaboration tools! Note that this role is open only to candidates who have the right to work in the UK or Ireland without requiring sponsorship.

Join Us:

If you're excited about shaping the future of data engineering at Cloudsmith, we would love to hear from you. Apply now and take the first step towards a rewarding and challenging career with a growing Irish business.

Cloudsmith is an equal opportunities employer committed to diversity and inclusion - we welcome applications from all suitably qualified candidates.

NB Applicants will be scanned and shortlisted via our trusted recruitment partner NineDots