Lead Data Engineer

This is a remote role in the United States for a senior data engineer who can also guide a team. It sits within a technology organisation that works with government clients to modernise how public-sector data is used in support of national defence objectives. The work combines hands-on pipeline engineering with mentorship, requirements work with stakeholders, and clear technical documentation. It suits experienced engineers who enjoy building reliable, scalable data platforms and helping others grow, and who are comfortable working in secure, government-facing environments that require U.S. citizenship and an active Secret clearance.

What you'll do

• Provide day-to-day task prioritisation and technical direction to engineers, including code reviews and mentoring in Python and SQL
• Translate complex mission requirements from government stakeholders into technical specifications, interface designs and data models
• Design, build and optimise ETL/ELT data workflows on Databricks, and maintain existing Python and SQL codebases
• Diagnose pipeline bottlenecks and data quality issues, and implement automated fixes to improve reliability
• Work with product owners, data scientists and analysts, and take part in sprint coordination
• Create and maintain pipeline architecture and configuration documentation

What you need

• U.S. citizenship with a current, active U.S. Government Secret clearance
• At least 8 years of professional data engineering experience building enterprise-scale data platforms and pipelines
• Proven hands-on experience designing and optimising data transformation workflows in Databricks
• Advanced modular, object-oriented Python/PySpark skills and extensive experience tuning complex SQL
• Demonstrated experience mentoring engineers and performing code reviews
• Experience building dashboards and reports with modern data visualisation tools

How to apply

Sign up free on i'llTip to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.