CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Software Engineer (Databricks/Data Platform)

United States, Alpharetta Contract work · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

We are looking for an experienced Software Engineer III to join our team in Alpharetta, GA. In this role, you will play a critical part in supporting and developing a Databricks-based data platform, focusing on creating scalable and efficient solutions during the development phase. This is a long-term contract position, requiring in-office work three to four days per week.

Job Responsibility

  • Develop and support Databricks notebooks, jobs, and workflows
  • Write, optimize, and maintain PySpark and Python code for data processing
  • Help design scalable, reliable, and efficient data pipelines
  • Apply Spark best practices (partitioning, caching, joins, file sizing)
  • Work with Delta Lake tables and data models
  • Perform data validation and quality checks during development
  • Support cluster configuration and sizing for development workloads
  • Identify performance bottlenecks early and recommend improvements
  • Collaborate with Data Engineers to ensure solutions are production-ready
  • Document development standards, patterns, and best practices

Requirements

  • Bachelor's degree required (Master's preferred)
  • 3+ years of hands-on experience with: Databricks and Apache Spark
  • PySpark and Spark fundamentals
  • Delta Lake
  • Spark execution concepts (jobs, stages, tasks)
  • Strong Python development skills
  • Experience writing clean, modular, reusable code
  • Experience with version control using Git
  • Familiarity with Databricks Repos or similar workflows
  • Ability to perform basic testing and validation of data pipelines

Nice to have

  • Experience working in Microsoft Azure
  • Familiarity with: Azure Databricks
  • Azure Data Lake Storage (ADLS)
  • Azure Blob Storage
  • Basic understanding of cloud cost awareness and resource usage
  • Experience with Spark SQL
  • Exposure to CI/CD pipelines for data platforms
  • Knowledge of Infrastructure as Code (Terraform, ARM)
  • Familiarity with Azure Monitor or Log Analytics
  • Interest in evolving development work toward production reliability

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer (Databricks/Data Platform)

8 matching positions

Lead Python Full Stack Data Engineer

We are assembling an A-team of highly skilled, autonomous, and visionary enginee...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of progressive, hands-on experience as a Senior/Lead Data Engineer
  • Expert-level proficiency in Python
  • Deep expertise in developing highly optimized, scalable, and production-grade PySpark applications
  • Deep architectural understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming, Spark MLlib)
  • Advanced proficiency with Hive for enterprise data warehousing
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Master-level proficiency in SQL, complex query optimization, and advanced data warehousing concepts
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase)
  • Expert-level experience with Apache Kafka
Job Responsibility
Job Responsibility
  • Lead and Architect end-to-end data solutions
  • Drive Strategic Initiatives within small, co-located squads
  • Act as a Player/Coach
  • Design, Develop, and Optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques
  • Architect and Implement sophisticated data storage solutions leveraging a diverse set of big data technologies
  • Champion Data Modeling and Governance
  • Strategically Engage with data consumers, data scientists, and business stakeholders
  • Lead the Implementation of real-time data streaming and complex event-driven architectures
  • Enforce and Evolve Best Practices in data engineering and software development
  • Exhibit High Autonomy and Agency
  • Fulltime
Read More
Arrow Right

Python Full Stack Data Engineer - Assistant Vice President

We are assembling an A-team of highly skilled, autonomous, and AI-first engineer...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 4+ years of progressive, hands-on experience as a Data Engineer, with a proven track record of delivering complex, large-scale data solutions
  • Expert-level proficiency in Python, with deep expertise in developing highly optimized, scalable, and production-grade PySpark applications for mission-critical data processing
  • Deep understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming)
  • Advanced proficiency with Hive for enterprise data warehousing, including optimization techniques for large and complex queries
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Proficiency in SQL, complex query optimization, and advanced data warehousing concepts (e.g., dimensional modeling, data vault, data lakes)
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase) and understanding of their architectural trade-offs
  • Expert-level experience with Apache Kafka, including design and implementation of high-throughput, low-latency real-time data pipelines and event-driven architectures
  • Extensive experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift/Kinesis, Azure Databricks/Data Factory/Synapse/Event Hubs, GCP Dataflow/Dataproc/BigQuery/Pub/Sub), including cloud-native architectural patterns
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of full-stack data solutions, ensuring optimal performance, scalability, data quality, security, and compliance across the data lifecycle
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering an environment of high communication and minimal coordination overhead, to deliver impactful data products
  • Develop, maintain, and optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques for large-scale datasets
  • Implement sophisticated data storage solutions leveraging a diverse set of big data technologies including Hive, distributed file systems (e.g., HDFS, S3), and enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB)
  • Design and implement scalable data models and schemas that support advanced analytics, machine learning, and critical reporting needs, ensuring data integrity, accessibility, and discoverability
  • Engage effectively with data consumers, data scientists, and business stakeholders to deeply understand their requirements, translating them into robust data solutions and providing expert guidance on data utilization and interpretation
  • Implement real-time data streaming and complex event-driven architectures using technologies like Apache Kafka, ensuring low-latency data availability for critical business functions
  • Adhere to and contribute to best practices in data engineering and software development, participating in rigorous code reviews, implementing comprehensive automated testing strategies, and supporting robust CI/CD pipelines within a DevOps culture
  • Exhibit High Autonomy and Agency, taking ownership of technical challenges, making well-reasoned architectural decisions, and proactively identifying and implementing continuous improvements across the data landscape
  • Innovate with AI-Powered Development, actively leveraging, integrating, and contributing to AI coding tools (e.g., internal Citi AI tools, Copilot, Claude Code, Codex, Antigravity) to significantly enhance productivity, code quality, and development velocity, and inspiring others to do the same
  • Fulltime
Read More
Arrow Right

Pyspark Big Data Senior Developer - Vice President

We are building an A-team of highly skilled and autonomous engineers, and we are...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of extensive, hands-on experience as a Senior Big Data Developer, with a strong emphasis on PySpark and the Apache Spark ecosystem, operating as a player/coach
  • Expert proficiency in Python, with a proven track record of developing robust, scalable, and high-performance PySpark applications for large-scale data processing
  • Deep understanding and extensive hands-on experience with Apache Spark (Spark Core, Spark SQL, Spark Streaming) and its ecosystem
  • Experience with distributed computing frameworks such as Hadoop (HDFS, YARN)
  • Expert proficiency in SQL and extensive experience with data warehousing concepts and technologies (e.g., Hive, Snowflake, Redshift, Databricks SQL)
  • Proven experience with various data storage formats (e.g., Parquet, ORC, Avro) and data lake solutions (e.g., Delta Lake, Iceberg)
  • Experience with NoSQL databases (e.g., MongoDB, Cassandra, HBase) is a significant plus
  • Strong experience with Apache Kafka for building real-time data pipelines and event-driven architectures
  • Demonstrated experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift, Azure Databricks/Data Factory/Synapse, GCP Dataflow/Dataproc/BigQuery) is highly desirable
  • Proven effectiveness with AI coding tools (e.g., Claude Code, Codex, Antigravity) is a mandatory requirement
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of robust big data solutions, ensuring optimal performance, scalability, data quality, and security
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering high communication and low coordination overhead, to translate complex business requirements into technical specifications for big data processing and analytical solutions
  • Act as a player/coach within the team, mentoring junior members and leading by example in the development of efficient and innovative big data architectures
  • Design, develop, and optimize large-scale data pipelines using PySpark for data ingestion, transformation, and aggregation, always with an eye towards efficiency and domain relevance
  • Implement and manage real-time data streaming and event-driven architectures using technologies like Apache Kafka
  • Design and implement sophisticated data warehousing solutions and dimensional models for efficient data storage and retrieval, ensuring alignment with business needs
  • Work with various distributed data storage technologies, including distributed file systems (e.g., HDFS, S3) and NoSQL databases (e.g., MongoDB, Cassandra), selecting the right tool for the right problem
  • Implement efficient data processing and storage strategies to optimize the performance and scalability of big data applications, with a strong focus on the 'why' behind the technology choices
  • Champion best practices in software development, including rigorous code reviews, implementing comprehensive testing, and supporting continuous integration and continuous deployment (CI/CD) pipelines
  • Demonstrate high autonomy and agency in driving projects forward, making informed decisions, and proactively identifying areas for improvement
  • Fulltime
Read More
Arrow Right
New

Lpn's For All Shifts

Sapphire Rehabilitation at Goshen, a premier long term skilled nursing facility ...
Location
Location
United States , Goshen
Salary
Salary:
32.24 - 35.82 USD / Hour
goshencare.com Logo
Sapphire Nursing and Rehab of Goshen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Completion of an educational program and NYS licensure as a LPN
  • Prior experience in a long term skilled nursing facility is a plus
Job Responsibility
Job Responsibility
  • Delivers nursing care in structured & routine situations
  • Administers and records medications and treatments as assigned
  • Prepares for and assists Nurses and others with diagnostic procedures and treatments
  • Reinforces, supports and provides health care instructions to patients and their families
  • Participates with other team members in planning, implementing and evaluating nursing care and other patient activities
  • Assists in the admission, transfer and discharge of patients
  • Observes and reports patients’ vital signs, symptoms and general condition to the appropriate individuals(s)
  • Records on patient charts observation of patients responses to nursing care rendered
  • Maintains environmental conditions conducive to the comfort and safety of patients
  • Assists with unit management and/or assumes charge of unit as assigned
What we offer
What we offer
  • Competitive Salary
  • Full Benefits Package
  • Paid time Off
  • Opportunities for Professional Growth
  • $750.00 signing bonus for this position (paid in quarterly installments at the end of initial 90 day probationary period)
  • Fulltime
Read More
Arrow Right
New

Kitchen Porter

We're currently recruiting a dedicated Kitchen Porter to help ensure the smooth ...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
14forty.co.uk Logo
14forty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Be adaptable and easily embrace changing priorities
  • Be a brilliant communicator and easily build relationships
  • Have experience delivering high quality customer care
  • Take initiative and make decisions that are right for our customers
  • Possess the ability to work under pressure
  • Demonstrate exceptional timekeeping and reliability
Job Responsibility
Job Responsibility
  • Ensure the kitchen is kept to a high standard of cleanliness
  • Assisting, when required, with the loading or unloading of deliveries & supply vehicles
  • Following food hygiene, and Health & Safety guidelines in line with training which is provided
  • Parttime
Read More
Arrow Right
New

Support Worker

Support Worker (Driver preferred) – Maghull, Merseyside – 16 & 25 hours per week...
Location
Location
United Kingdom , Maghull
Salary
Salary:
26485.00 GBP / Year ▼
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Flexible with working patterns including early & late shifts, weekends, long days, bank holidays & Christmas, sleep-ins and potentially waking night shifts
  • Background or understanding of supporting autistic people (preferred but not required)
  • Basic IT skills
  • Driver preferred
Job Responsibility
Job Responsibility
  • Develop a trusting and respectful rapport with people with autism
  • Support with personal care while promoting and encouraging independence
  • Provide quality support personalised to individual health and well-being needs
  • Promote community engagement
  • Enable people with autism to be part of their local community
What we offer
What we offer
  • Career progression opportunities
  • Full initial training and ongoing development programme
  • Pension Scheme
  • Support to obtain Diploma Level 2 qualification
  • Generous annual holiday entitlement rising with years’ service
  • Enhanced DBS paid for
  • Free Employee Assistance Programme
  • Long service entitlements
  • Work Pension Scheme
  • Monthly staff cash prize draw
  • Parttime
Read More
Arrow Right
New

Clinical Research Assistant

The Yu laboratory is seeking a clinical research assistant I to assist with cutt...
Location
Location
United States , Boston
Salary
Salary:
41246.40 - 61339.20 USD / Year
childrenshospital.org Logo
Boston Children's Hospital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree
  • Strong communication skills to effectively communicate with families/parents/study participants to explain the study, recruit and schedule, and provide them with accurate information
  • Good analytical skills to collect information from diverse sources
  • Well-developed writing skills and the ability to work independently are also needed
  • Experience with human subject clinical trials is a plus
  • Successful candidates will be highly collaborative, passionate about innovative medicine, self-motivated, organized, and have good people skills
  • Minimum of a 2-year commitment required
Job Responsibility
Job Responsibility
  • Assisting with protocol and consent development under supervision, coordinating the activities of daily operations of clinical research studies
  • Organizing and scheduling study participants for study visits or procedures
  • Communicating schedule of study events with research families and serve as liaison to the families/patients in the research studies, conducted at both on-site and off-site locations, guiding and advising them throughout each phase of the study
  • Assisting the PI during patient visits
  • Collecting study specimens at the bedside and operating room and delivering or shipping to appropriate locations
  • Maintaining regulatory and subject binders, case report forms, and other study documents
  • Writing study submissions to the Internal Review Board (IRB), U.S. Food and Drug Administration (FDA),and Data Safety Monitoring Committee (DSMC), including amendments and reportable events
  • Maintaining patient sample organization and inventory
  • Create and prepare data collection statistical reports and analytical summaries for distribution to the study research team for review and analysis
  • May write articles and summaries of studies for submission
What we offer
What we offer
  • flexible schedules
  • affordable health, vision and dental insurance
  • child care and student loan subsidies
  • generous levels of time off
  • 403(b) Retirement Savings plan
  • Pension
  • Tuition and certain License and Certification Reimbursement
  • cell phone plan discounts
  • discounted rates on T-passes
  • Fulltime
Read More
Arrow Right
New

Barista

We're currently recruiting a driven Barista to help us create beautifully crafte...
Location
Location
Ireland , Dublin
Salary
Salary:
15.00 EUR / Hour
14forty.co.uk Logo
14forty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Be a brilliant communicator and easily build relationships
  • Have previous experience in customer service
  • Strive for excellence in an eager and motivated manner
  • Take initiative and make decisions that are right for our customers
  • Have Hands-on experience with brewing equipment
  • Possess the ability to work under pressure
  • Demonstrate exceptional timekeeping and reliability
Job Responsibility
Job Responsibility
  • Preparing perfectly blended drinks and serving high-quality food that delights our customers
  • Keeping the bar area clean
  • Receiving and processing payments (cash and credit cards)
  • Being an enthusiastic team player and excellent communicator
  • Maintaining stock of clean mugs and plates
  • Learning about brewing methods, beverage blends, food preparation and presentation techniques
  • Check if brewing equipment operates properly and report any maintenance needs
  • Representing Compass Group Ireland and maintaining a positive brand image
  • Complying with Food Handling & Hygiene standards
  • Complying with Health & Safety regulations
  • Fulltime
Read More
Arrow Right