Senior Data Engineer (Remote - US only)

New York-based candidates are welcome, but New York residence is not required. Visa sponsorship is not available. A data infrastructure and analytics team is building a platform that gathers information from many different sources and turns it into dependable, up-to-date business intelligence. The successful candidate will take ownership of the platform from initial architecture and data ingestion through to day-to-day production operations. The team is small and works hands-on across the full data lifecycle.

What you'll do

• Design and build a multi-source data platform that supports concurrent ingestion, event-driven processing, and orchestrated batch workflows.
• Ingest data from provider APIs, webhooks, files, and web scraping, applying rate limits and strong failure handling.
• Run scheduled pipelines and historical backfills using an orchestrator such as Airflow, Dagster, or Prefect.
• Build event-driven pipelines with message queues or task queues, including retries, dead-letter queues, and controlled replay.
• Store raw payloads in Google Cloud Storage and transform them with dbt into raw, standardized, and curated layers. Design and tune PostgreSQL schemas and loading patterns, and add LLM-based structured extraction and enrichment where useful.

What you need

• At least 5 years of experience building and operating production data platforms that pull from multiple sources, from architecture through ongoing operations.
• Production experience with workflow orchestration, including dependencies, retries, and failure recovery. Airflow experience is preferred.
• Hands-on production experience with dbt and Google Cloud Platform.
• Strong Python skills, including asynchronous HTTP and concurrency (asyncio, aiohttp, HTTPX, or similar), and strong SQL and PostgreSQL skills including data modeling, query tuning, and incremental loading.
• Experience with idempotent upserts, data contracts, automated validation, pipeline testing, and freshness monitoring. Web scraping, entity resolution, BigQuery, or Dataform experience is a plus.

Applicants must be based in: United States.

How to apply

Get the free i'llTip app to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.

Prefer the website? Continue on illtip.comOr get the app: Android · iPhone

🔔 Get new jobs like this first: join i'llTip Jobs on Telegram · or get personal job alerts