Senior Data Engineer (Remote - Europe)
Visa sponsorship is not available. A data and infrastructure team is building a platform that pulls information from many external sources and turns it into reliable, current business intelligence. The senior engineer will take ownership of the platform end to end, covering architecture, data ingestion and day-to-day production operations.
What you'll do
- Design a multi-source platform that handles concurrent ingestion, event-driven processing and orchestrated batch workflows.
- Build dependable intake pipelines from provider APIs, webhooks, files and web scraping, including rate limiting and strong failure handling.
- Schedule and orchestrate workflows and historical backfills using tools such as Airflow, Dagster or Prefect.
- Develop event-driven components using messaging and task queues, with retries, dead-letter queues and controlled replay.
- Store raw payloads in cloud storage and transform them with dbt into raw, standardized and curated layers.
- Implement idempotent upserts, data contracts, automated validation, pipeline tests and freshness and failure monitoring.
What you need
- At least 5 years building and running production data platforms, including multi-source ingestion and ownership from design through ongoing operation.
- Production experience with workflow orchestration, including dependencies, retries and recovery; Airflow preferred.
- Hands-on production experience with dbt and Google Cloud Platform.
- Strong Python (async HTTP and concurrent processing) and strong SQL/PostgreSQL skills, including modeling, query tuning and incremental loading.
- Experience with event-driven systems, queues, data contracts, retention policies, testing and monitoring.
- Valuable extras: building platforms from scratch, web scraping, entity resolution, company data enrichment, LLM-based extraction, or startup/small-team experience.
Applicants must be based in: United Kingdom, Germany, France, Netherlands, Spain, Portugal, Poland, Ireland, Italy, Belgium.
How to apply
Get the free i'llTip app to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.
Apply on i'llTipPrefer the website? Continue on illtip.comOr get the app: Android · iPhone
🔔 Get new jobs like this first: join Tech & AI Jobs on Telegram · or get personal job alerts
More Data Analysis/Entry jobs
Clinical Technical Support and Data Migration Specialist
This remote role suits someone with a clinical or rehabilitation background who enjoys helping customers with software and working with data. It sits within a business-to-business software company serving healthcare and …
Data Analyst
This is a remote contract role for a Data Analyst, open to candidates anywhere in the world. It suits someone who enjoys working with data, values accuracy, and can explain findings in clear, everyday language. The post …
Data Entry Officer (Procurement)
This is an onsite full-time role in Lagos for a detail-focused person who enjoys keeping business records accurate and well organised. It suits someone who is comfortable working with spreadsheets and enterprise systems …
Senior Data Integration Engineer (Remote - US only)
A small engineering team in the logistics technology space is building a data integration platform for temperature-controlled shipping. The work centres on making shipment, device and customer order data reliable and act…
E-commerce Data & Catalog Specialist
A remote contract role supporting the training of AI systems through structured e-commerce data. The work centres on building and refining realistic product catalogues, taxonomies and shopping scenarios that help models …
Related job searches
Remote Data Engineer JobsData Engineer jobsSenior jobsWork From Home jobs