As the Data Engineer, you'll be at the forefront of building data pipelines, integrating systems, and working closely with various teams to ensure that data flows smoothly, enabling accurate forecasting and planning. If you're passionate about driving data transformation within a fast-paced, FMCG environment, this is the perfect opportunity to make a significant impact.
Key Responsibilities
Data Ingestion & Integration
Source System Integration:
Connect and extract data from ERP systems (SAP, Oracle), CRM systems (Salesforce), POS systems, and external market data sources.
Data Pipeline Development:
Build and maintain robust ETL/ELT pipelines to feed data into the Demand Planning platform (e.g., SAP IBP, o9, Kinaxis, Blue Yonder).
Automation:
Ensure automated and scheduled data loads for consistency and reliability.
Data Preparation & Transformation
Data Cleaning & Harmonization:
Standardize and cleanse data to resolve issues like mismatched SKUs, calendar alignment, and missing values.
Master Data Alignment:
Work with product, customer, and location data to ensure consistency across systems.
Business Logic Implementation:
Apply transformations such as currency conversion, unit of measure standardization, and outlier treatment.
Data Modeling & Storage
Schema Design:
Design efficient schemas for storing sales, forecasts, inventory, and promotional data.
Time Series Data:
Organize data to support time-based forecasting models (e.g., weekly/monthly levels).
Performance Optimization:
Optimize queries and data structures for real-time performance.
Support for Forecasting Models & Analytics
Data Provisioning:
Provide clean, structured datasets for statistical or machine learning forecasting models.
Collaboration with Data Scientists:
Partner with analytics teams to ensure data is model-ready.
Version Control:
Manage multiple forecast versions for analysis and comparison.
Testing, Validation & Quality Control
Data Validation:
Ensure data is complete, accurate, and up-to-date through validation routines and reconciliation with source systems.
Error Monitoring:
Implement monitoring for data loads, ensuring any issues are logged and addressed promptly.
Audit Trail:
Ensure full traceability of data from source to consumption.
Knowledge, Skills and Experience
Essential Experience & Skills:
5+ years' experience in a data engineering role, preferably within mid-to-large enterprises (FMCG or manufacturing background is a plus).
Expertise in cloud technologies (Azure preferred, AWS/GCP also considered).
Proven hands-on experience with:
+ Data lakehouse architectures (e.g., Delta Lake, Snowflake)
+ ETL/ELT tools (e.g., dbt, Azure Data Factory, Airflow, Informatica, Talend)
+ SQL and programming languages (Python, Spark)
+ Real-time data streaming (e.g., Kafka, Azure Event Hub)
+ Integration with Planning Tools (ERP, REST/SOAP APIs)
+ Data Quality Tools (Great Expectations, dbt tests)
+ Familiarity with analytics platforms such as Power BI
+ Knowledge of DevOps, CI/CD, and infrastructure-as-code principles for data pipelines
What We Offer:
Salary:
40,000 - 45,000 + Benefits
Hybrid Working:
Flexibility to work from home with occasional travel to the office or other UK sites.
Growth Opportunity:
An initial 12-month contract with the potential to transition to a permanent position based on performance.
Collaborative Culture:
Work with a dynamic, cross-functional team within a leading food business.
About The Compleat Food Group
We are a forward-thinking company focused on innovation and sustainable practices in the food industry. Join us to contribute to exciting transformation projects and play a key role in shaping the future of our demand planning and data infrastructure.
What You'll Get in Return
Flexible hybrid working with a home base
Travel to UK sites as part of a collaborative, people-first business
Opportunity to make a tangible impact in a business investing in transformation
Competitive salary, benefits, and the potential to move into a permanent role
Why Join Us?
At The Compleat Food Group we're on a mission to create tasty food that's better for people and the planet -- we call it
'Food to Feel Good'
.
We pride ourselves on being a business that gives equal emphasis to
HOW
we operate as well as the financial results we achieve.
Our
5,500 (and growing)
fantastic people make this possible. They are passionate about creating delicious products for UK consumers, leading retailers, and our exciting, market-leading brands, including
Wall's Pastry, Vadasz, Squeaky Bean
, and
Unearthed
.
Benefits to Include:
33 Days annual leave
2 Employee Volunteering Days per year
Online and High-street retailer discount scheme
Employee well-being and community support groups
Informal and Formal training opportunities with personalised online LMS platform
Charity Initiatives and Team events
24/7 Access to Grocery Aid (Free Financial, Emotional and Practical Support)
Physical Wellbeing Benefits - Free on demand exercise hub and various gym discounts.
Online Wellbeing benefits
Free Financial wellbeing - mortgage calculators, budget tools, financial aid tools
Holiday Discounts via Online Retail Discount
The Compleat Food Group are proud to have built an inclusive and respectful culture where our colleagues feel safe, supported and valued. A place where they can bring their whole selves to work to achieve exceptional results and thrive. We continue to attract diverse talent into our teams, because we know greater diversity leads to exceptional results and provides a better working life. That's why we're committed to ensuring Fairness, Equity, Inclusivity, and Respect in all that we do.
Recruitment Agencies We have an active and trusted Preferred Supplier List to assist us if required. We do not acknowledge any speculative CVs or unsolicited candidate introductions from agencies.
Beware of fraud agents! do not pay money to get a job
MNCJobs.co.uk will not be responsible for any payment made to a third-party. All Terms of Use are applicable.