Senior Data Engineer (Remote - US only)

Applicants must be based in the US. New York-based candidates are welcome, but NY residency is not required. A data and infrastructure team at a company that builds a platform to combine information from many sources into reliable, up-to-date business intelligence. You will take ownership of the platform from design through production operations, supplying trusted data to downstream products. The role suits an engineer who wants broad responsibility in a small, fast-moving group.

What you'll do

• Design and build a multi-source data platform supporting concurrent ingestion, event-driven processing, and scheduled batch workflows.
• Ingest data from APIs, webhooks, files, and web sources while respecting rate limits and handling failures robustly.
• Run scheduled pipelines and historical backfills using orchestration tools such as Airflow, Dagster, or Prefect.
• Build event-driven pipelines with message queues or task queues, including retries, dead-letter handling, and controlled replay.
• Store raw payloads in Google Cloud Storage and model data with dbt across raw, standardized, and curated layers.
• Implement idempotent upserts, data contracts, validation, pipeline tests, retention policies, and freshness and failure monitoring.

What you need

• At least 5 years building and operating production data platforms that draw on multiple sources, including architecture through deployment and ongoing operations.
• Production experience with workflow orchestration, including dependencies, retries, and failure recovery. Airflow experience is preferred.
• Hands-on production experience with dbt and Google Cloud Platform.
• Strong Python skills, including asynchronous HTTP and concurrent processing (asyncio, aiohttp, HTTPX or similar).
• Strong SQL and PostgreSQL skills, including data modeling, query optimization, and incremental loading.
• Useful extras: web scraping, entity resolution, data enrichment, BigQuery, Dataform, LLM-based extraction, and experience building platforms from scratch.

Applicants must be based in: United States.

How to apply

Get the free i'llTip app to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.

Prefer the website? Continue on illtip.comOr get the app: Android · iPhone

🔔 Get new jobs like this first: join i'llTip Jobs on Telegram · or get personal job alerts