Data Engineer

Salary: £70,000 – 70,000 per year

Requirements:

• We require active Enhanced DV Clearance (West).
• We require willingness to work full time on site in Gloucester when needed.
• We require experience with Apache Kafka.
• We require experience with Apache NiFi.
• We require experience with SQL and NoSQL databases, such as MongoDB.
• We require experience with ETL processing languages such as Groovy, Python, or Java.
• We require experience in data pipelines, ETL processing, and data integration.

Responsibilities:

• We develop mission-critical data solutions and manage pipelines that turn diverse data sources into valuable insights for our National Security customers.
• We collaborate with clients to solve complex challenges using distributed computing techniques for large-scale, real-time, and unstructured data.
• We design and develop data pipelines, including ingestion, orchestration, and ETL processing.
• We ensure data consistency, quality, and security across all processes.
• We create and maintain database schemas and data models.
• We integrate and enrich data from diverse sources while maintaining data integrity.
• We maintain and enhance architectural components such as Data Ingest and Data Stores.
• We troubleshoot and diagnose issues within integrated and enriched data systems.
• We collaborate with the scrum team to break down user requirements into epics and stories.
• We write clean, secure, and reusable code using a test-driven development approach.
• We monitor system performance and implement updates to maintain optimal operation.

Technologies:

• AI
• Cloud
• DevOps
• ETL
• Groovy
• Java
• Kafka
• MongoDB
• NoSQL
• Python
• SQL
• Security

More:

We are a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. We work with cutting-edge technologies across AI and Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. We have long-term contracts secured across the latest customer framework and are set for significant growth. The role is based in Gloucester with hybrid working where possible, and we offer a competitive salary depending on experience.

Benefits:

• a 6% bonus
• 25 days holiday
• a clearance bonus

last updated 40 week of 2026

#J-18808-Ljbffr…