Data Engineer - London

Data Engineer – AWS, Python, Spark & AI

Check out the role overview below If you are confident you have got the right skills and experience, apply today.

Salary: £60,000–£75,000, dependent on experience

Location: London - Three days in the office and two from home

Job reference: J13171

Build the data platform powering a new generation of AI-driven consumer intelligence. You’ll work at the intersection of AWS, large-scale behavioural data and agentic AI, creating scalable pipelines and data products that turn ethically sourced, consented consumer data into meaningful insights.

Joining a collaborative, scaling technology company, you’ll have the freedom to experiment with cutting-edge tools, broaden your experience and make a visible impact on the platform from day one.

The team uses Claude extensively to support development, debugging, testing and documentation. You’ll combine AI-assisted development with strong Python, SQL and Spark fundamentals to produce reliable, well-tested solutions.

What you’ll be doing

• Designing, building and optimising scalable AWS data pipelines and ETL/ELT processes
• Developing data solutions using Python, SQL and Spark
• Processing large and complex behavioural datasets
• Improving data quality, reliability, performance and monitoring
• Using Claude and other AI-assisted development tools to support delivery
• Collaborating with engineers, analysts and data scientists
• Identifying opportunities to automate and improve data workflows
• Contributing ideas as the platform and its data products continue to evolve

What we’re looking for

• Hands-on data engineering experience using Python and SQL
• Practical Spark or PySpark experience
• Experience building production data pipelines using AWS data services
• A good understanding of scalable ETL/ELT design and data quality
• Experience using Claude or another AI-assisted development tool, with the ability to review and validate generated code
• Strong communication skills and an interest in working within a small, collaborative team

This is an opportunity to work with cutting-edge data and AI technology, take ownership beyond one narrow area and help shape a platform as the business grows.

Applicants must already have the right to work in the UK, as sponsorship is not available for this position.

Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme. xwzovoh

Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: