CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Software Engineer (Databricks/Data Platform)

United States, Alpharetta Contract work · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

We are looking for an experienced Software Engineer III to join our team in Alpharetta, GA. In this role, you will play a critical part in supporting and developing a Databricks-based data platform, focusing on creating scalable and efficient solutions during the development phase. This is a long-term contract position, requiring in-office work three to four days per week.

Job Responsibility

  • Develop and support Databricks notebooks, jobs, and workflows
  • Write, optimize, and maintain PySpark and Python code for data processing
  • Help design scalable, reliable, and efficient data pipelines
  • Apply Spark best practices (partitioning, caching, joins, file sizing)
  • Work with Delta Lake tables and data models
  • Perform data validation and quality checks during development
  • Support cluster configuration and sizing for development workloads
  • Identify performance bottlenecks early and recommend improvements
  • Collaborate with Data Engineers to ensure solutions are production-ready
  • Document development standards, patterns, and best practices

Requirements

  • Bachelor's degree required (Master's preferred)
  • 3+ years of hands-on experience with: Databricks and Apache Spark
  • PySpark and Spark fundamentals
  • Delta Lake
  • Spark execution concepts (jobs, stages, tasks)
  • Strong Python development skills
  • Experience writing clean, modular, reusable code
  • Experience with version control using Git
  • Familiarity with Databricks Repos or similar workflows
  • Ability to perform basic testing and validation of data pipelines

Nice to have

  • Experience working in Microsoft Azure
  • Familiarity with: Azure Databricks
  • Azure Data Lake Storage (ADLS)
  • Azure Blob Storage
  • Basic understanding of cloud cost awareness and resource usage
  • Experience with Spark SQL
  • Exposure to CI/CD pipelines for data platforms
  • Knowledge of Infrastructure as Code (Terraform, ARM)
  • Familiarity with Azure Monitor or Log Analytics
  • Interest in evolving development work toward production reliability

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer (Databricks/Data Platform)

8 matching positions

Lead Python Full Stack Data Engineer

We are assembling an A-team of highly skilled, autonomous, and visionary enginee...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of progressive, hands-on experience as a Senior/Lead Data Engineer
  • Expert-level proficiency in Python
  • Deep expertise in developing highly optimized, scalable, and production-grade PySpark applications
  • Deep architectural understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming, Spark MLlib)
  • Advanced proficiency with Hive for enterprise data warehousing
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Master-level proficiency in SQL, complex query optimization, and advanced data warehousing concepts
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase)
  • Expert-level experience with Apache Kafka
Job Responsibility
Job Responsibility
  • Lead and Architect end-to-end data solutions
  • Drive Strategic Initiatives within small, co-located squads
  • Act as a Player/Coach
  • Design, Develop, and Optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques
  • Architect and Implement sophisticated data storage solutions leveraging a diverse set of big data technologies
  • Champion Data Modeling and Governance
  • Strategically Engage with data consumers, data scientists, and business stakeholders
  • Lead the Implementation of real-time data streaming and complex event-driven architectures
  • Enforce and Evolve Best Practices in data engineering and software development
  • Exhibit High Autonomy and Agency
  • Fulltime
Read More
Arrow Right

Python Full Stack Data Engineer - Assistant Vice President

We are assembling an A-team of highly skilled, autonomous, and AI-first engineer...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: 4+ years of progressive, hands-on experience as a Data Engineer, with a proven track record of delivering complex, large-scale data solutions
  • Expert-level proficiency in Python, with deep expertise in developing highly optimized, scalable, and production-grade PySpark applications for mission-critical data processing
  • Deep understanding and extensive hands-on experience with the entire Apache Spark ecosystem (Spark Core, Spark SQL, Spark Streaming)
  • Advanced proficiency with Hive for enterprise data warehousing, including optimization techniques for large and complex queries
  • Expert knowledge of distributed computing fundamentals, HDFS, and other components of the Hadoop ecosystem
  • Proficiency in SQL, complex query optimization, and advanced data warehousing concepts (e.g., dimensional modeling, data vault, data lakes)
  • Extensive experience with various data storage formats (e.g., Parquet, ORC, Avro) and leading data lake solutions (e.g., Delta Lake, Iceberg)
  • Proven experience with enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB, HBase) and understanding of their architectural trade-offs
  • Expert-level experience with Apache Kafka, including design and implementation of high-throughput, low-latency real-time data pipelines and event-driven architectures
  • Extensive experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift/Kinesis, Azure Databricks/Data Factory/Synapse/Event Hubs, GCP Dataflow/Dataproc/BigQuery/Pub/Sub), including cloud-native architectural patterns
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of full-stack data solutions, ensuring optimal performance, scalability, data quality, security, and compliance across the data lifecycle
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering an environment of high communication and minimal coordination overhead, to deliver impactful data products
  • Develop, maintain, and optimize highly efficient and resilient data ingestion, processing, and transformation pipelines using advanced Python and PySpark techniques for large-scale datasets
  • Implement sophisticated data storage solutions leveraging a diverse set of big data technologies including Hive, distributed file systems (e.g., HDFS, S3), and enterprise-grade NoSQL databases (e.g., Cassandra, MongoDB)
  • Design and implement scalable data models and schemas that support advanced analytics, machine learning, and critical reporting needs, ensuring data integrity, accessibility, and discoverability
  • Engage effectively with data consumers, data scientists, and business stakeholders to deeply understand their requirements, translating them into robust data solutions and providing expert guidance on data utilization and interpretation
  • Implement real-time data streaming and complex event-driven architectures using technologies like Apache Kafka, ensuring low-latency data availability for critical business functions
  • Adhere to and contribute to best practices in data engineering and software development, participating in rigorous code reviews, implementing comprehensive automated testing strategies, and supporting robust CI/CD pipelines within a DevOps culture
  • Exhibit High Autonomy and Agency, taking ownership of technical challenges, making well-reasoned architectural decisions, and proactively identifying and implementing continuous improvements across the data landscape
  • Innovate with AI-Powered Development, actively leveraging, integrating, and contributing to AI coding tools (e.g., internal Citi AI tools, Copilot, Claude Code, Codex, Antigravity) to significantly enhance productivity, code quality, and development velocity, and inspiring others to do the same
  • Fulltime
Read More
Arrow Right

Pyspark Big Data Senior Developer - Vice President

We are building an A-team of highly skilled and autonomous engineers, and we are...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of extensive, hands-on experience as a Senior Big Data Developer, with a strong emphasis on PySpark and the Apache Spark ecosystem, operating as a player/coach
  • Expert proficiency in Python, with a proven track record of developing robust, scalable, and high-performance PySpark applications for large-scale data processing
  • Deep understanding and extensive hands-on experience with Apache Spark (Spark Core, Spark SQL, Spark Streaming) and its ecosystem
  • Experience with distributed computing frameworks such as Hadoop (HDFS, YARN)
  • Expert proficiency in SQL and extensive experience with data warehousing concepts and technologies (e.g., Hive, Snowflake, Redshift, Databricks SQL)
  • Proven experience with various data storage formats (e.g., Parquet, ORC, Avro) and data lake solutions (e.g., Delta Lake, Iceberg)
  • Experience with NoSQL databases (e.g., MongoDB, Cassandra, HBase) is a significant plus
  • Strong experience with Apache Kafka for building real-time data pipelines and event-driven architectures
  • Demonstrated experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift, Azure Databricks/Data Factory/Synapse, GCP Dataflow/Dataproc/BigQuery) is highly desirable
  • Proven effectiveness with AI coding tools (e.g., Claude Code, Codex, Antigravity) is a mandatory requirement
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of robust big data solutions, ensuring optimal performance, scalability, data quality, and security
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering high communication and low coordination overhead, to translate complex business requirements into technical specifications for big data processing and analytical solutions
  • Act as a player/coach within the team, mentoring junior members and leading by example in the development of efficient and innovative big data architectures
  • Design, develop, and optimize large-scale data pipelines using PySpark for data ingestion, transformation, and aggregation, always with an eye towards efficiency and domain relevance
  • Implement and manage real-time data streaming and event-driven architectures using technologies like Apache Kafka
  • Design and implement sophisticated data warehousing solutions and dimensional models for efficient data storage and retrieval, ensuring alignment with business needs
  • Work with various distributed data storage technologies, including distributed file systems (e.g., HDFS, S3) and NoSQL databases (e.g., MongoDB, Cassandra), selecting the right tool for the right problem
  • Implement efficient data processing and storage strategies to optimize the performance and scalability of big data applications, with a strong focus on the 'why' behind the technology choices
  • Champion best practices in software development, including rigorous code reviews, implementing comprehensive testing, and supporting continuous integration and continuous deployment (CI/CD) pipelines
  • Demonstrate high autonomy and agency in driving projects forward, making informed decisions, and proactively identifying areas for improvement
  • Fulltime
Read More
Arrow Right
New

Relationship Banker

Wells Fargo is seeking a Relationship Banker (SAFE) to join our National Branch ...
Location
Location
United States , Bozeman
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
July 08, 2026
Flip Icon
Requirements
Requirements
  • 2+ years of customer service experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 1+ year of assessing and meeting the needs of customers or helping with issue resolution, demonstrated through work or military experience
  • 1+ year of building and maintaining effective relationships with customers and partners
Job Responsibility
Job Responsibility
  • Proactively acquire, manage, and grow a portfolio of consumer and business customer relationships
  • Lead discovery‑driven conversations to understand customer goals and deliver tailored banking and credit strategies that strengthen relationships, increase retention, and drive balanced growth across deposits, lending, and investments
  • Partner with a team of professionals across Wealth, Home Lending, and Business Banking to deliver integrated solutions by coordinating warm introductions, setting clear expectations, and taking personal ownership to convert qualified opportunities into closed outcomes
  • Champion digital adoption by educating customers on self-service and mobile banking options to elevate satisfaction, engagement, and service efficiency
  • Resolve account inquiries and service requests within authorized limits, documenting actions and setting follow-up plans that reinforce trust and ease
  • Demonstrate risk excellence through accurate documentation, sound judgment, timely issue escalation, and adherence to policies and regulations to support strong control outcomes
  • Fulltime
Read More
Arrow Right
New

Mortgage Retail Sales Consultant (SAFE)

Wells Fargo is seeking a Mortgage Retail Sales Consultant (SAFE) in Consumer Len...
Location
Location
United States , Baltimore
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
July 07, 2026
Flip Icon
Requirements
Requirements
  • 2+ years of Mortgage Retail Sales experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, or education
  • Basic Microsoft Office skills
  • Experience with retail residential mortgage, purchase fundings over the past 12 months referred primarily from established, local or external sources
  • Experience with educating clients on various mortgage programs
  • Excellent verbal, written, and interpersonal communication skills
  • Mortgage industry experience
  • Knowledge and understanding of sales prospecting and generating referrals
  • Experience developing and cultivating professional relationships
  • Bilingual speaking proficiency in Spanish/English
  • Customer service experience
Job Responsibility
Job Responsibility
  • Participate in soliciting residential mortgages from various sources
  • Produce high quality loans which are compliant and provide excellent customer service
  • Build relationships with realtors, builders, financial professionals, bank stores, past customers, and other non-traditional sources
  • Develop and maintain a high degree of visibility for Wells Fargo Home Mortgage in the marketplace
  • stay informed of mortgage industry trends and developments in the assigned market
  • Present recommendations for producing loans and exercise some independent judgment while developing understanding of and adherence to Mortgage Retail Sales functional area, policies, procedures, compliance requirements, and generating loans
  • Understand real estate appraisals, title reports, and real estate transactions
  • Receive customer applications, quote the rate and points, and complete follow-up activities with the registration lock-in
  • analyze and offer mortgage loan products based on client needs
  • Review and analyze low to moderately complex financial and credit data
What we offer
What we offer
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right
New

Animal Control Officer

The purpose of this position is to enforce all relevant state statutes and town ...
Location
Location
United States , Templeton
Salary
Salary:
20.00 USD / Hour
mma.org Logo
Massachusetts Municipal Association
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must maintain confidentiality in all aspects of client, staff, and agency information
Job Responsibility
Job Responsibility
  • Enforce all relevant state statutes and town bylaws as they relate to the control and regulation of animals
  • Ensure the safe return, care and handling of all residential animals
  • Provide protection to the residents of Templeton from annoyance, intimidation, irritation, and injury from animals
  • Act as the Animal Inspector for the town
  • Be on-call during evening, weekend, and holiday hours
What we offer
What we offer
  • $25 stipend for every eight hours on-call
  • straight pay in one-hour increments when calls are answered
  • Parttime
Read More
Arrow Right
New

Full-Time Building Commissioner

The town of Douglas is seeking qualified applicants for the full-time position o...
Location
Location
United States , Douglas
Salary
Salary:
82244.00 - 89234.00 USD / Year
mma.org Logo
Massachusetts Municipal Association
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • thorough knowledge of construction trades with at least five years of experience in supervision of building construction or design
  • Experience as a building commissioner or local inspector preferred
  • Knowledge of general requirements of building construction, fire prevention, light, ventilation and safe egress
  • Knowledge of regulations including the State Building Code, State Sanitary Code and local zoning by-laws
  • Must have ability to attend evening meetings with various town boards
  • Acts as town's ADA Coordinator
  • Must possess state supervisory construction license, certification as Building Commissioner, or able to attain certification within 12 months
  • Fulltime
Read More
Arrow Right
New

Procurement Expert

Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.edp.com Logo
EDP
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in Management, Finance, Economics, Engineering, or a related field
  • 5–6 years of relevant experience in procurement, project management, consulting, or strategic initiatives, preferably within the energy, infrastructure, or industrial sectors
  • Strong knowledge of procurement practices and experience applying PMO and project management methodologies
  • Proven ability to structure complex topics, manage multiple stakeholders, and drive projects from strategy through execution
  • Strong analytical, problem-solving, communication, and presentation skills
  • Advanced proficiency in Microsoft Excel and PowerPoint
  • Fluent in English, both written and spoken
  • additional languages are a plus
  • Proactive, collaborative, and results-driven mindset, with a strong sense of ownership, accountability, and integrity
  • Resilient and adaptable professional, capable of thriving in a fast-paced and dynamic environment
Job Responsibility
Job Responsibility
  • Lead and support transversal strategic projects across Procurement and other business areas
  • Drive the planning, governance, execution, and monitoring of initiatives through a structured PMO approach
  • Coordinate with senior stakeholders across regions and functions, facilitating alignment, decision-making, and successful project delivery
  • Develop strategic insights, analyses, and executive-level materials to support business decisions and leadership communication
  • Support procurement governance forums, ensuring consistency, transparency, and effective follow-up of key decisions
  • Identify and implement continuous improvement opportunities, including process optimization and digital transformation initiatives
  • Contribute to the evolution of procurement strategy, capabilities, and operating models
  • Ensure project milestones, risks, dependencies, and deliverables are effectively managed and communicated
What we offer
What we offer
  • Opportunities for professional growth through internal mobility and career development
  • Challenging projects that foster learning and continuous improvement
  • A collaborative, diverse, and innovative working environment
  • Autonomy and accountability to make an impact through your role
  • Flexible and hybrid working models that support wellbeing and safety
  • Fulltime
Read More
Arrow Right