Data Engineer (Next Generation Data Platform) at Compare the Market

  • UK Only
  • Compare the Market
Job Description:

A little about the team

At CTM our Data Engineering team is at the heart of everything that we do. The team manages and works on multiple streams and projects that have a high impact and importance for the business. This role will sit within our Next Generation Data Platform (NGDP) team and focus on building the next generation data platform for CTM, acting as an enabler to build a more Unified Customer Vison. There’s no legacy code here, and as a Data Engineer in our team, you will be driving the development of quality solutions for our customers and be proactive in adopting and championing best practices.

You’ll make a real impact by taking an active role in the team’s agile practices, technical decision making and development, generating value and continuously striving to improve the quality and reliability of our data.

What we want to see from you:

  • A passion for data. You don’t already need to be a data engineer, but as this role would involve building strong, robust pipelines to ingest data from a variety of sources with a focus on real-time streaming (we process millions of events a day and deal with 100 TBs of data here) we’d like to see a demonstrable interest in the data challenges we have.
  • A willingness to come up with new ideas, experiment, fail, learn and develop - and share that knowledge with peers across the wider team
  • Proven industry experience in a JVM language. We use Java for most of our services, but Scala and Python experience could also be valuable
  • Experienced with one or two of the following: Kafka, Spark, AWS, Docker, Terraform, Kubernetes, stream processing technologies (e.g., Kinesis, Kafka Streams)
  • Demonstrable experience in modern software engineering principles (Agile, CI/CD, TDD/BDD)
  • Self-motivated and active learner, keeping up to date with industry knowledge and keen to learn new languages and tools
  • Customer focused, you never lose sight of the big picture
  • Great communicator, you're able to articulate your thoughts to the wider team and influence discussions

Diversity and Inclusion

We're a diverse community of dedicated, innovative and talented professionals. With an inclusive and open workplace, we encourage our people to create and share ideas – supporting their growth and celebrating their uniqueness.

We are committed to offering equal chances to you throughout the application process, so if you require any special adjustments to be made, please let us know. We will work with you to make any appropriate arrangements.

Company Benefits

  • Flexible working
  • Hybrid working culture (mixture of remote and state of the art office spaces)
  • Brilliant office space made for collaboration and agile working
  • Competitive salaries based on experience, expertise and qualifications
  • Bonus scheme
  • Contributory pension scheme
  • Wellbeing programme focused on physical, emotional and financial wellbeing
  • Private health care
  • Free fruit in our offices
  • An onsite gym at our headquarters in Peterborough - and a gym discount scheme for - those based in London
  • Season ticket loan and cycle to work schemes
  • Plus, loads more through our flexible benefits hub

Interview Process

  • Telephone call
  • Final Interview with case study/ tech test

Other Jobs in Data Scientist