Senior Data Engineer
Wise Skulls · New York, New York, United States
FULL TIMEpermanent
Job Description
Hiring: Lead Data Engineer - Databricks
Do not wait to apply after reading this description a high application volume is expected for this opportunity.
Important
Visa: USC and GC onlyLocation: Manhattan, New York (Onsite)
JD:
Role OverviewClient is seeking a Lead Data Engineer with deep hands-on expertise in Databricks, SQL, Python, andPySpark to design, develop, and optimize scalable data engineering solutions.This role offers an opportunity to work on enterprise-scale data platforms supporting analytics, digitalproducts, and emerging AI use cases. The candidate will drive Databricks engineering best practices,solve challenging technical problems, and provide technical leadership across multiple initiatives.
Key Responsibilities
Design and develop scalable data pipelines on Databricks, following Medallion Architecture.Build and optimize data ingestion, transformation, and orchestration workflows for batch andincremental processing.Optimize data processing workloads, SQL queries, and compute configurations for performanceand cost efficiency.Ensure data quality, observability, lineage, and reliability across production pipelines, includingtroubleshooting complex issues.Provide hands-on technical leadership through solution design, code reviews, reusableengineering patterns, and mentoring other engineers.
Required Qualifications
6+ years of Data Engineering experience, with substantial hands-on experience deliveringproduction solutions on Databricks.Strong proficiency in SQL, Python, and PySpark, including distributed data processing andperformance optimization.Strong understanding of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, andworkflow orchestration.Familiarity with Git, CI/CD, and production deployment practices.Strong troubleshooting, problem-solving, and communication skills.
Preferred Qualifications
Databricks Certified Data Engineer Associate or Professional certification.Experience working with AWS cloud services, particularly S3 and cloud-based data integrations.Experience with advanced ingestion patterns such as Auto Loader, Structured Streaming, orChange Data Capture (CDC).Familiarity with Databricks Asset Bundles or Apache Airflow.Experience with large-scale media datasets: streaming, clickstream, or advertising data.
Interested? xzbcwsv Apply now or DM us to explore this opportunity! You can share resumes at
Do not wait to apply after reading this description a high application volume is expected for this opportunity.
Important
Visa: USC and GC onlyLocation: Manhattan, New York (Onsite)
JD:
Role OverviewClient is seeking a Lead Data Engineer with deep hands-on expertise in Databricks, SQL, Python, andPySpark to design, develop, and optimize scalable data engineering solutions.This role offers an opportunity to work on enterprise-scale data platforms supporting analytics, digitalproducts, and emerging AI use cases. The candidate will drive Databricks engineering best practices,solve challenging technical problems, and provide technical leadership across multiple initiatives.
Key Responsibilities
Design and develop scalable data pipelines on Databricks, following Medallion Architecture.Build and optimize data ingestion, transformation, and orchestration workflows for batch andincremental processing.Optimize data processing workloads, SQL queries, and compute configurations for performanceand cost efficiency.Ensure data quality, observability, lineage, and reliability across production pipelines, includingtroubleshooting complex issues.Provide hands-on technical leadership through solution design, code reviews, reusableengineering patterns, and mentoring other engineers.
Required Qualifications
6+ years of Data Engineering experience, with substantial hands-on experience deliveringproduction solutions on Databricks.Strong proficiency in SQL, Python, and PySpark, including distributed data processing andperformance optimization.Strong understanding of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, andworkflow orchestration.Familiarity with Git, CI/CD, and production deployment practices.Strong troubleshooting, problem-solving, and communication skills.
Preferred Qualifications
Databricks Certified Data Engineer Associate or Professional certification.Experience working with AWS cloud services, particularly S3 and cloud-based data integrations.Experience with advanced ingestion patterns such as Auto Loader, Structured Streaming, orChange Data Capture (CDC).Familiarity with Databricks Asset Bundles or Apache Airflow.Experience with large-scale media datasets: streaming, clickstream, or advertising data.
Interested? xzbcwsv Apply now or DM us to explore this opportunity! You can share resumes at
Details
| Company | Wise Skulls |
| Location | New York, New York, United States |
| Type | FULL TIME |
| Niche | hr |
| Experience | permanent |