This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are looking for an experienced Software Engineer III to join our team in Alpharetta, GA. In this role, you will play a critical part in supporting and developing a Databricks-based data platform, focusing on creating scalable and efficient solutions during the development phase. This is a long-term contract position, requiring in-office work three to four days per week.
Job Responsibility:
Develop and support Databricks notebooks, jobs, and workflows
Write, optimize, and maintain PySpark and Python code for data processing
Help design scalable, reliable, and efficient data pipelines
Apply Spark best practices (partitioning, caching, joins, file sizing)
Work with Delta Lake tables and data models
Perform data validation and quality checks during development
Support cluster configuration and sizing for development workloads
Identify performance bottlenecks early and recommend improvements
Collaborate with Data Engineers to ensure solutions are production-ready
Document development standards, patterns, and best practices
Requirements:
Bachelor's degree required (Master's preferred)
3+ years of hands-on experience with: Databricks and Apache Spark
PySpark and Spark fundamentals
Delta Lake
Spark execution concepts (jobs, stages, tasks)
Strong Python development skills
Experience writing clean, modular, reusable code
Experience with version control using Git
Familiarity with Databricks Repos or similar workflows
Ability to perform basic testing and validation of data pipelines
Nice to have:
Experience working in Microsoft Azure
Familiarity with: Azure Databricks
Azure Data Lake Storage (ADLS)
Azure Blob Storage
Basic understanding of cloud cost awareness and resource usage
Experience with Spark SQL
Exposure to CI/CD pipelines for data platforms
Knowledge of Infrastructure as Code (Terraform, ARM)
Familiarity with Azure Monitor or Log Analytics
Interest in evolving development work toward production reliability