Senior Technology Architect_ Databricks
Infosys Technologies · Greater London, England, United Kingdom
FULL TIME
Job Description
b Overview /b p As a Senior Databricks Architect, you will design and operate scalable data pipelines and products to support a modern data mesh. You will help integrate legacy systems with cloud-native platforms, enabling analytics and self-serve insights across domains. You’ll work on batch and streaming data assets, using Databricks and a medallion data architecture to deliver reusable data products. This role focuses on data quality, governance, and cross-functional collaboration to drive data-driven outcomes. You will join a global, innovation-driven organization delivering cloud-enabled analytics at scale. /p b Pay / Benefits /b ul li Competitive compensation including bonus /li /ul b Responsibilities /b ul li Build and maintain batch and streaming data pipelines from legacy DB2 and on-prem SQL Server to an AWS-based data lake /li li Implement real-time ingestion using Confluent Kafka and land data in Amazon S3 /li li Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold) /li li Design and deliver high-quality, reusable data products aligned to data mesh principles /li li Ensure data quality, reliability, security, and governance across pipelines /li li Collaborate with domain teams, platform teams, and stakeholders to enable self-serve analytics and consumption /li /ul b Key requirements /b ul li Databricks (Spark, PySpark/SQL) expert /li li Streaming technologies, especially Kafka/Confluent Kafka /li li Experience integrating legacy data sources such as DB2 and SQL Server /li li Working knowledge of AWS data services, especially S3 /li li Understanding of data product thinking, data mesh concepts, and modern data engineering best practices /li /ul ul li High analytical skills /li li Initiative and flexibility /li li High customer orientation /li li Databricks (Spark, PySpark/SQL) /li li Confluent Kafka /li li DB2 (mainframe) /li /ul
Details
| Company | Infosys Technologies |
| Location | Greater London, England, United Kingdom |
| Type | FULL TIME |
| Niche | general |
