Senior Data Engineer - Azure Databricks

Role details

Job Title: Senior Data Engineer - Azure Databricks Key Skills: Azure Databricks, DBT, Snowflake, Python, SQL, Terraform Experience: 5+ YOE. Location: Costa Rica, Peru, Colombia, and Bolivia. Mode: Remote. We at Coforge are hiring Senior Data Engineer - Azure Databricks (#22146) with the following skill set. Key Responsibilities · Own the end-to-end delivery of data pipelines and data products from design through deployment and production support. · Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python. · Support and execute large-scale data migrations from Snowflake (AWS) to Azure Databricks. · Build and manage infrastructure-as-code solutions using Terraform. · Ensure seamless integration across enterprise data platforms and environments. · Implement data quality frameworks, testing, and validation processes. · Enable observability through monitoring, logging, and alerting solutions. · Contribute to the design of scalable data architectures aligned with Lakehouse principles. · Monitor and support production environments, ensuring performance and reliability. · Collaborate with cross-functional teams and mentor junior engineers through best practices and code reviews. Required Skills & Qualifications · 5 to 8+ years of experience in Data Engineering within enterprise-scale environments. · Strong hands-on expertise with Azure Databricks, DBT, and Snowflake. · Strong proficiency in Python and SQL. · Proven experience building and managing large-scale data pipelines and transformations. · Experience working with high-volume datasets and complex data models. · Solid understanding of data modeling, ETL/ELT frameworks, distributed systems, and Lakehouse architectures. · Experience with Terraform and Infrastructure as Code (IaC) principles. · Strong experience with CI/CD pipelines and Git-based version control. · Experience supporting production systems, including monitoring, alerting, and incident resolution. · Knowledge of data quality, testing, and observability frameworks. · Excellent analytical, problem-solving, and communication skills. Preferred Skills · Experience in insurance or financial services environments. · Experience with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables. · Knowledge of security, compliance, and data protection standards in regulated industries. · Experience with cloud cost optimization and performance tuning. · Exposure to multi-cloud or hybrid architectures. Posted On: 14-08-2026 At Coforge, we hire professionals based solely on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.