Spark-Scala, Databricks

Join a collaborative engineering team where you’ll turn raw, complex data into trusted insights that power real business decisions. In this role, you’ll work hands-on with Spark-Scala and Databricks to build scalable data pipelines, optimize distributed processing, and help teams deliver reliable datasets for analytics and downstream applications. You’ll partner closely with data engineers, analysts, and stakeholders to understand requirements, translate them into robust ETL solutions, and continuously improve performance and quality. If you enjoy solving data challenges, learning modern cloud data practices, and taking ownership from development through production support, this is a great opportunity to grow your impact while working in a supportive, high-accountability culture. Technical Requirements: Primary skills:Technology->Big Data - Data Processing->Spark Technology->Data Engineering->Databricks Technology->Functional Programming->Scala Responsibilities: Key Responsibilities: Data Engineering & ETL Development • Design, develop, and maintain ETL pipelines using Spark-Scala on Databricks for batch and incremental processing. • Implement data transformations, joins, aggregations, and validations to ensure accurate and consistent outputs. • Build reusable Spark components and follow best practices for modular, maintainable code. Performance, Reliability & Operations • Tune Spark jobs (partitioning, caching, shuffle optimization) to improve performance and cost efficiency. • Monitor job execution, troubleshoot failures, and provide timely production support with root-cause analysis. • Implement logging, error handling, and data quality checks to improve pipeline reliability. Collaboration & Delivery • Work with cross-functional teams to gather requirements and translate them into technical solutions. • Participate in code reviews, documentation, and knowledge sharing to uplift team standards. • Support release cycles by validating outputs, ensuring backward compatibility, and maintaining deployment readiness. Preferred Skills: Technology->Big Data - Data Processing->Spark,Technology->Functional Programming->Scala,Technology->Data Engineering->Databricks