Pyspark developer

Pyspark Expertise • Expert proficiency in Pyspark • Ability to design and implement efficient data processing workflows • Experience with Pyspark SQL and DataFrames • Good exposure to Big Data architectures and good understanding of Big Data eco system • Experience with some framework building experience on Hadoop • Good with DB knowledge with SQL tuning experience. • Good to have experience with Python, APIs and exposure to Kafka. Technical Requirements: Pyspark, Bigdata, Spark, Python, Databricks, AWS Responsibilities: • Team Management: Lead and manage a team of technical professionals – Data Engineer and Application Developers, ensuring effective collaboration and productivity. • Client Interaction: Serve as the primary point of contact for clients, understanding their needs and ensuring successful project delivery. • Status Reporting: Prepare and present detailed status reports on ongoing projects to stakeholders, highlighting progress, risks, and mitigation plans. • Issue Resolution: Proactively identify and resolve any technical challenges or roadblocks faced by the team, ensuring smooth project execution. • Project Management: Oversee the entire project lifecycle, from planning to execution, ensuring timely delivery within scope and budget. Preferred Skills: Technology->Big Data - Data Processing->PySpark