Senior Data Engineer

We’re partnering with a leading client to find a Senior Data Engineer to join their team. You’ll keep the data pipelines and cloud services behind a production forecasting platform running smoothly, so business customers get accurate forecasts on time. This role blends hands-on data engineering with production support, so you’ll follow a problem from source data all the way to the customer and fix it for good. If you enjoy building pipelines and tracing a failure to its root cause, this one is for you.

For a complete understanding of this opportunity, and what will be required to be a successful applicant, read on.
What You’ll OwnYou’ll have the opportunity to design, build, and optimize ETL/ELT (extract, transform, load) pipelines that bring telemetry, weather, market, and operational data together from APIs (application programming interfaces), databases, flat files, SFTP (secure file transfer protocol), and cloud storage.You’ll create reusable Python and SQL (Structured Query Language) processing frameworks that replace manual and hard-coded workflows.You’ll strengthen pipeline monitoring, logging, validation, and failure recovery, and add data-quality and reconciliation checks.You’ll partner with data scientists to deliver clean, timely data for model training and daily production forecasts.You’ll troubleshoot production issues across data, databases, and AWS (Amazon Web Services) resources like S3, Lambda, ECS, EC2, and CloudWatch, and support deployments, incident response, and root-cause analysis.You’ll document dependencies and recovery steps, and cross-train with the team so critical systems always have solid backup coverage.
What You BringMust-havesYou’ll draw on your experience building and supporting enterprise ETL/ELT or data integration pipelines in production, including troubleshooting failed jobs.You’ll put your advanced SQL skills (PostgreSQL, Oracle, SQL Server, or similar) and Python proficiency to work on data processing, automation, and integrations.You’ll apply your hands-on AWS or comparable cloud experience, along with Git source control and solid logging, monitoring, and root-cause analysis practices.Nice-to-havesYou’ll bring extra value if you know AWS Step Functions, PostgreSQL/Aurora, Redshift, Databricks, or Spark/PySpark.You’ll stand out if you’ve supported CI/CD (continuous integration and continuous delivery) pipelines or administered SFTP services and SSH (Secure Shell) keys.You’ll fit right in if you’ve built forecasting or machine-learning data pipelines, or worked in Agile teams using Jira and Confluence.
What We OfferOn-site role in the Palm Beach County area. Contract position (W2 or 1099)12-month contract with renewalsBroad ownership across data, cloud, and delivery, so you grow beyond a single toolDay-to-day collaboration with data scientists on production forecasting models
About the TeamYou’ll join a forecasting team that is growing its data engineering capacity and making its platform more resilient. The team values engineers who document clearly, share knowledge, and learn unfamiliar systems quickly. xzbcwsv You’ll own real production systems, not just tickets.