CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Software Engineer (Databricks/Data Platform)

United States, Alpharetta Contract work · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

We are looking for an experienced Software Engineer III to join our team in Alpharetta, GA. In this role, you will play a critical part in supporting and developing a Databricks-based data platform, focusing on creating scalable and efficient solutions during the development phase. This is a long-term contract position, requiring in-office work three to four days per week.

Job Responsibility

  • Develop and support Databricks notebooks, jobs, and workflows
  • Write, optimize, and maintain PySpark and Python code for data processing
  • Help design scalable, reliable, and efficient data pipelines
  • Apply Spark best practices (partitioning, caching, joins, file sizing)
  • Work with Delta Lake tables and data models
  • Perform data validation and quality checks during development
  • Support cluster configuration and sizing for development workloads
  • Identify performance bottlenecks early and recommend improvements
  • Collaborate with Data Engineers to ensure solutions are production-ready
  • Document development standards, patterns, and best practices

Requirements

  • Bachelor's degree required (Master's preferred)
  • 3+ years of hands-on experience with: Databricks and Apache Spark
  • PySpark and Spark fundamentals
  • Delta Lake
  • Spark execution concepts (jobs, stages, tasks)
  • Strong Python development skills
  • Experience writing clean, modular, reusable code
  • Experience with version control using Git
  • Familiarity with Databricks Repos or similar workflows
  • Ability to perform basic testing and validation of data pipelines

Nice to have

  • Experience working in Microsoft Azure
  • Familiarity with: Azure Databricks
  • Azure Data Lake Storage (ADLS)
  • Azure Blob Storage
  • Basic understanding of cloud cost awareness and resource usage
  • Experience with Spark SQL
  • Exposure to CI/CD pipelines for data platforms
  • Knowledge of Infrastructure as Code (Terraform, ARM)
  • Familiarity with Azure Monitor or Log Analytics
  • Interest in evolving development work toward production reliability

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer (Databricks/Data Platform)

8 matching positions

Lead Python Full Stack Data Engineer

We are assembling an A-team of highly skilled, autonomous, and visionary enginee...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of progressive, hands-on experience as a Senior/Lead Data Engineer
  • Expert-level proficiency in Python
  • Deep expertise in developing highly optimized, scalable, and production-grade PySpark applications
  • Deep architectural understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming, Spark MLlib)
  • Advanced proficiency with Hive for enterprise data warehousing
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Master-level proficiency in SQL, complex query optimization, and advanced data warehousing concepts
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase)
  • Expert-level experience with Apache Kafka
Job Responsibility
Job Responsibility
  • Lead and Architect end-to-end data solutions
  • Drive Strategic Initiatives within small, co-located squads
  • Act as a Player/Coach
  • Design, Develop, and Optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques
  • Architect and Implement sophisticated data storage solutions leveraging a diverse set of big data technologies
  • Champion Data Modeling and Governance
  • Strategically Engage with data consumers, data scientists, and business stakeholders
  • Lead the Implementation of real-time data streaming and complex event-driven architectures
  • Enforce and Evolve Best Practices in data engineering and software development
  • Exhibit High Autonomy and Agency
  • Fulltime
Read More
Arrow Right

Python Full Stack Data Engineer - Assistant Vice President

We are assembling an A-team of highly skilled, autonomous, and AI-first engineer...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 4+ years of progressive, hands-on experience as a Data Engineer, with a proven track record of delivering complex, large-scale data solutions
  • Expert-level proficiency in Python, with deep expertise in developing highly optimized, scalable, and production-grade PySpark applications for mission-critical data processing
  • Deep understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming)
  • Advanced proficiency with Hive for enterprise data warehousing, including optimization techniques for large and complex queries
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Proficiency in SQL, complex query optimization, and advanced data warehousing concepts (e.g., dimensional modeling, data vault, data lakes)
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase) and understanding of their architectural trade-offs
  • Expert-level experience with Apache Kafka, including design and implementation of high-throughput, low-latency real-time data pipelines and event-driven architectures
  • Extensive experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift/Kinesis, Azure Databricks/Data Factory/Synapse/Event Hubs, GCP Dataflow/Dataproc/BigQuery/Pub/Sub), including cloud-native architectural patterns
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of full-stack data solutions, ensuring optimal performance, scalability, data quality, security, and compliance across the data lifecycle
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering an environment of high communication and minimal coordination overhead, to deliver impactful data products
  • Develop, maintain, and optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques for large-scale datasets
  • Implement sophisticated data storage solutions leveraging a diverse set of big data technologies including Hive, distributed file systems (e.g., HDFS, S3), and enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB)
  • Design and implement scalable data models and schemas that support advanced analytics, machine learning, and critical reporting needs, ensuring data integrity, accessibility, and discoverability
  • Engage effectively with data consumers, data scientists, and business stakeholders to deeply understand their requirements, translating them into robust data solutions and providing expert guidance on data utilization and interpretation
  • Implement real-time data streaming and complex event-driven architectures using technologies like Apache Kafka, ensuring low-latency data availability for critical business functions
  • Adhere to and contribute to best practices in data engineering and software development, participating in rigorous code reviews, implementing comprehensive automated testing strategies, and supporting robust CI/CD pipelines within a DevOps culture
  • Exhibit High Autonomy and Agency, taking ownership of technical challenges, making well-reasoned architectural decisions, and proactively identifying and implementing continuous improvements across the data landscape
  • Innovate with AI-Powered Development, actively leveraging, integrating, and contributing to AI coding tools (e.g., internal Citi AI tools, Copilot, Claude Code, Codex, Antigravity) to significantly enhance productivity, code quality, and development velocity, and inspiring others to do the same
  • Fulltime
Read More
Arrow Right

Pyspark Big Data Senior Developer - Vice President

We are building an A-team of highly skilled and autonomous engineers, and we are...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of extensive, hands-on experience as a Senior Big Data Developer, with a strong emphasis on PySpark and the Apache Spark ecosystem, operating as a player/coach
  • Expert proficiency in Python, with a proven track record of developing robust, scalable, and high-performance PySpark applications for large-scale data processing
  • Deep understanding and extensive hands-on experience with Apache Spark (Spark Core, Spark SQL, Spark Streaming) and its ecosystem
  • Experience with distributed computing frameworks such as Hadoop (HDFS, YARN)
  • Expert proficiency in SQL and extensive experience with data warehousing concepts and technologies (e.g., Hive, Snowflake, Redshift, Databricks SQL)
  • Proven experience with various data storage formats (e.g., Parquet, ORC, Avro) and data lake solutions (e.g., Delta Lake, Iceberg)
  • Experience with NoSQL databases (e.g., MongoDB, Cassandra, HBase) is a significant plus
  • Strong experience with Apache Kafka for building real-time data pipelines and event-driven architectures
  • Demonstrated experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift, Azure Databricks/Data Factory/Synapse, GCP Dataflow/Dataproc/BigQuery) is highly desirable
  • Proven effectiveness with AI coding tools (e.g., Claude Code, Codex, Antigravity) is a mandatory requirement
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of robust big data solutions, ensuring optimal performance, scalability, data quality, and security
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering high communication and low coordination overhead, to translate complex business requirements into technical specifications for big data processing and analytical solutions
  • Act as a player/coach within the team, mentoring junior members and leading by example in the development of efficient and innovative big data architectures
  • Design, develop, and optimize large-scale data pipelines using PySpark for data ingestion, transformation, and aggregation, always with an eye towards efficiency and domain relevance
  • Implement and manage real-time data streaming and event-driven architectures using technologies like Apache Kafka
  • Design and implement sophisticated data warehousing solutions and dimensional models for efficient data storage and retrieval, ensuring alignment with business needs
  • Work with various distributed data storage technologies, including distributed file systems (e.g., HDFS, S3) and NoSQL databases (e.g., MongoDB, Cassandra), selecting the right tool for the right problem
  • Implement efficient data processing and storage strategies to optimize the performance and scalability of big data applications, with a strong focus on the 'why' behind the technology choices
  • Champion best practices in software development, including rigorous code reviews, implementing comprehensive testing, and supporting continuous integration and continuous deployment (CI/CD) pipelines
  • Demonstrate high autonomy and agency in driving projects forward, making informed decisions, and proactively identifying areas for improvement
  • Fulltime
Read More
Arrow Right
New

Licensed Practical Nurse (LPN) Weekend Baylor Program

Rosewood Rehabilitation & Nursing Center is seeking a compassionate and dedicate...
Location
Location
United States , Schuylkill Haven
Salary
Salary:
36.00 - 37.50 USD / Hour
rosewoodrehab.org Logo
Rosewood Rehabilitation & Nursing Center
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Current LPN licensure in the state of Pennsylvania
  • Prior experience in a healthcare setting
  • previous experience in long-term care or rehabilitation setting a plus
  • Strong communication and interpersonal skills
  • ability to work effectively with patients, families, and healthcare team members
Job Responsibility
Job Responsibility
  • Provide direct patient care, including administering medications
  • Monitor and report changes in patient condition to the registered nurse or physician
  • Collaborate with the interdisciplinary team to develop and implement individualized patient care plans
  • Maintain accurate and detailed records of patient care and treatments
  • Participate in quality improvement initiatives to optimize patient outcomes and satisfaction
  • Foster a positive and respectful environment that promotes patient-centered care
What we offer
What we offer
  • Competitive salary and benefits package
  • Flexible scheduling options and a positive work environment
  • Opportunities for professional growth and development
  • A chance to make a meaningful difference in the lives of our residents
Read More
Arrow Right
New

Facilities Planner

Location
Location
United States , Groton
Salary
Salary:
70000.00 - 80000.00 USD / Year
amentum.com Logo
Amentum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or demonstrated equivalent
  • Three years of experience in business administration, technical operations, or a related technical role in facility management, maintenance planning, Operations, engineering, or construction environment
  • Maintenance trades and system knowledge (electrical, HVAC, plumbing)
  • Demonstrated experience in a high visibility customer service role with multiple customer streams
  • Strong written and oral communication skills and ability to work in a team environment
  • Ability to obtain site specific security access including all applicable background checks
  • Ability to work overtime, holidays, various shifts, weekends, and alternative work schedules
  • Ability to obtain an appropriate driver's license issued by the State Department of Motor Vehicles, as requested
  • Must be a United States citizen or Permanent Resident
  • This position does not include sponsorship for United States work authorization
Job Responsibility
Job Responsibility
  • Maintain professional and customer-oriented relationships with team members, internal and external customers and service providers, and building occupants
  • Provide logistical coordination with other facility partners, such as the science lines, projects group, and asset management
  • Walk down and investigate systems to determine impacts to end users
  • Submit site wide communications through customer share point site
  • Partner with business customers to reconcile vendor conflicts, coordinating corrective actions until resolution is complete
  • Maintain proficiency in CMMS work order system to update equipment history and access material inventory management system
  • Schedule work with Service departments, print appropriate work orders when scheduled, track and report on the completion of work
  • Estimate work order completion times and compare to actual performance
  • Comply with all company policies and procedures and adhere to company standards
  • Perform other job-related duties and special projects as requested
What we offer
What we offer
  • Health, dental, and vision insurance
  • Paid time off and holidays
  • Retirement benefits (including 401(k) matching)
  • Educational reimbursement
  • Parental leave
  • Employee stock purchase plan
  • Tax-saving options
  • Disability and life insurance
  • Pet insurance
  • Fulltime
Read More
Arrow Right
New

Sales Assistant / Driver

At Crown Paints, our Sales Assistants are the heartbeat of the store — helping c...
Location
Location
United Kingdom , Charlton
Salary
Salary:
12.71 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A friendly, confident approach with customers
  • Strong communication skills
  • Retail or sales experience (helpful but not essential)
  • Attention to detail and safe working practices
  • Full driving licence
Job Responsibility
Job Responsibility
  • Delivering brilliant customer service in store and over the phone
  • Mixing and tinting paint to customer requirements
  • Driving the store van to deliver stock locally
  • Processing sales and handling POS transactions
  • Supporting stock control, deliveries and store standards
  • Building relationships with customers and opening new trade accounts
What we offer
What we offer
  • Up to 25% quarterly performance bonus
  • 36 days holiday (including bank holidays + Christmas closure)
  • Generous pension with company match
  • Employee Assistance Programme (24/7 support)
  • Health, dental and optical benefits
  • Cycle to Work scheme
  • Retail and leisure discounts
  • No nights. No Sundays.
  • Ongoing training and development
  • Parttime
Read More
Arrow Right
New

Certified Nursing Assistant (CNA)

Certified Nursing Assistant (CNA) $3750 Sign On Bonus!! Pick Up Shift Bonus!! ...
Location
Location
United States , Schuylkill Haven
Salary
Salary:
19.00 - 21.47 USD / Hour
rosewoodrehab.org Logo
Rosewood Rehabilitation & Nursing Center
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Current CNA certification in the state of Pennsylvania
  • High school diploma or equivalent required
  • Prior experience as a CNA (new graduates welcome to apply!)
  • Ability to work effectively in a fast-paced environment with minimal supervision
  • Strong communication and interpersonal skills
Job Responsibility
Job Responsibility
  • Provide direct patient care under the supervision of licensed nursing staff, including vital sign monitoring, feeding, bathing, and personal care
  • Assist with daily living activities, such as dressing, grooming, and ambulating patients
  • Maintain accurate and up-to-date records of patient care and condition
  • Collaborate with interdisciplinary care teams to develop and implement individualized care plans
  • Participate in quality improvement initiatives to enhance patient outcomes and satisfaction
What we offer
What we offer
  • $3750 Sign On Bonus!!
  • Pick Up Shift Bonus!!
  • Competitive salary
  • Same Day Pay!
  • Opportunities for professional growth and development
  • Collaborative and supportive work environment
  • Comprehensive benefits package
Read More
Arrow Right
New

Production Operative

We are seeking a dedicated Production Operative to join our team at Harlow Timbe...
Location
Location
United Kingdom , Burton upon Trent
Salary
Salary:
Not provided
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Previous experience in a manufacturing or production environment is preferred
  • Ability to read and interpret technical drawings and blueprints
  • Strong attention to detail and commitment to quality
  • Excellent teamwork and communication skills
  • Basic knowledge of health and safety regulations
Job Responsibility
Job Responsibility
  • Ensuring that all Profile trusses are complete correctly
  • Controlled and monitored with paperwork
  • Ensuring weekly delivery dates and requirements are achieved as planned with the Production Manager and Supervisor
  • Be involved in daily/weekly production meetings
  • Following and adhering to Health & Safety requirements for the business
  • The monitoring and maintenance of equipment with the Supervisor is maintained
  • Ensuring that the Production Team for each station has work and products set out to manufacture
  • Working on your own within a team to meet a production schedule
What we offer
What we offer
  • Life assurance cover
  • Access to 24/7 online GP
  • 10% Discount across Harlow Bros. Branches
  • Employee Assistance Programme
  • Extras retail discounts & Byond Card
  • Employee Referral Scheme
  • In House Training and Recognised Qualifications
  • Fulltime
Read More
Arrow Right