CF CloudFrame Job Scanner Open Dashboard →
Verified Active Opening

Databricks

Infosys • Bangalore, India

Job Description

Join a collaborative data engineering team where your work directly powers analytics, reporting, and data-driven decisions. In this role, you’ll help design and build reliable data pipelines on Databricks, transforming raw data into trusted, high-quality datasets that teams can confidently use. You’ll partner closely with stakeholders to understand data needs, improve performance, and ensure smooth end-to-end delivery—from ingestion to transformation and validation. If you enjoy solving real-world data challenges, optimizing distributed processing, and continuously improving how data platforms operate, this opportunity will help you grow your technical depth while contributing to impactful outcomes. You’ll work in an environment that values ownership, learning, and practical innovation—where clean engineering and teamwork go hand in hand. Technical Requirements: • Primary skills:Technology->Data Engineering->Databricks Responsibilities: Key Responsibilities: • Develop and maintain scalable ETL pipelines using Databricks and PySpark to process large datasets efficiently. • Implement data transformations, cleansing, and enrichment logic aligned to business and analytics requirements. • Optimize Spark jobs for performance and cost by tuning partitions, caching, and cluster configurations where applicable. • Build reusable notebooks/jobs and support scheduling/orchestration of workloads within the Databricks environment. • Perform data validation, reconciliation, and quality checks to ensure accuracy and reliability of curated datasets. • Troubleshoot pipeline failures, analyze logs, and resolve issues to maintain stable production operations. • Collaborate with cross-functional teams to gather requirements, provide estimates, and deliver enhancements iteratively. • Maintain clear technical documentation for pipelines, transformations, and operational runbooks. Preferred Skills: Technology->Data Engineering->Databricks

Job Reference ID: CF-128385 • Posted on CloudFrame Job Scanner