Pyspark Developer

• Utilize knowledge of applications development procedures and concepts to identify and define necessary system enhancements
• Consult with users, clients, and other technology groups on issues and recommend programming solutions
• Apply fundamental knowledge of programming languages for design specifications
• Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
• Serve as advisor or coach to new or lower level analysts

• 4-8 years relevant experience in Data Analytics OR Big Data
• Hands on experience over SQL, Python, Pyspark, with Spark components
• 2-4 years of experience as Big Data Engineer to develop, optimize, and manage large-scale data processing systems and analytics platforms
• 4 years of experience in distributed data processing & near real-time data analytics using PySpark
• ETL Experience preferred over Abinitio
• Strong understanding of PySpark execution plans, partitioning & optimization techniques

ETL Experience over Abinitio

• Programs and services for physical and mental well-being including access to telehealth options, health advocates, confidential counseling
• Financial well-being programs and help planning for the future
• Access to learning and development resources to help broaden and deepen skills and knowledge