CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Sr. AWS Data Engineer

United States, Atlanta · Job Posted April 10, 2026
Apply Position
Job Link Share

Job Description

We are looking for a Data Operations Engineer to support and oversee the automated data‑pipeline environment built on AWS. This position bridges data engineering and customer operations, ensuring that incoming datasets are processed accurately, consistently, and securely within established ingestion and transformation frameworks. Key responsibilities include monitoring automated workflows, troubleshooting processing failures, validating data quality, and helping onboard new customers by aligning their data formats to a standardized internal model.

Job Responsibility

  • Monitor automated batch and streaming data pipelines in AWS
  • Identify, troubleshoot, and resolve data processing failures
  • Investigate file‑level errors, schema mismatches, and transformation issues
  • Perform root‑cause analysis and document resolutions
  • Ensure data integrity, completeness, and timeliness across environments
  • Escalate architectural or systemic issues to the Data Engineering team
  • Collaborate directly with customers to understand their file formats and data structures
  • Create and maintain mapping templates to align customer data to a normalized data model
  • Validate sample files and run tests on ingestion workflows
  • Configure ingestion parameters within predefined frameworks
  • Support customer go‑live processes and initial data processing cycles
  • Write SQL queries to validate data accuracy and research anomalies
  • Develop lightweight Python scripts for validation, transformation checks, or automation tasks
  • Improve monitoring processes, internal documentation, and operational playbooks
  • Work with engineering teams to strengthen platform reliability and observability
  • Communicate clearly with customers regarding file issues or data discrepancies
  • Partner with internal teams including Data Engineering, Product, and Support
  • Provide feedback to enhance scalability, resilience, and overall platform performance

Requirements

  • 6–10 years of experience in data operations, data engineering, or data support roles
  • Experience with ETL/ELT orchestration tools
  • Hands‑on experience with AWS services such as S3, Glue, Lambda, CloudWatch, Redshift, or similar
  • Strong SQL skills (joins, aggregations, troubleshooting data discrepancies)
  • Working knowledge of Python for scripting and data validation
  • Experience troubleshooting automated data pipelines
  • Familiarity with structured and semi‑structured data formats (CSV, JSON, Parquet)
  • Strong analytical and problem‑solving skills
  • Comfortable interacting with customers in technical discussions
  • Experience working in a healthcare or pharmaceutical environment

Nice to have

  • Experience working within a data lake or data‑warehouse architecture
  • Familiarity with data catalogs or governance frameworks
  • Understanding of data normalization and schema design
  • Experience working in a SaaS environment

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Sr. AWS Data Engineer

8 matching positions

Sr. Data Engineer - Snowflake

Data Ideology is seeking a Sr. Snowflake Data Engineer to join our growing team ...
Location
Location
Salary
Salary:
Not provided
dataideology.com Logo
Data Ideology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in data engineering, data warehousing, or data architecture
  • 3+ years of hands-on Snowflake experience (performance tuning, data sharing, Snowpark, Snowpipe, etc.)
  • Strong SQL and Python skills, with production experience using dbt
  • Familiarity with cloud platforms (AWS, Azure, or GCP) and modern data tooling (Airflow, Fivetran, Power BI, Looker, Informatica, etc.)
  • Prior experience in a consulting or client-facing delivery role
  • Excellent communication skills, with the ability to collaborate across technical and business stakeholders
  • SnowPro Core Certification required (or willingness to obtain upon hire)
  • advanced Snowflake certifications preferred
Job Responsibility
Job Responsibility
  • Design and build scalable, secure, and cost-effective data solutions in Snowflake
  • Develop and optimize data pipelines using tools such as dbt, Python, CloverDX, and cloud-native services
  • Participate in discovery sessions with clients to gather requirements and translate them into solution designs and project plans
  • Collaborate with engagement managers and account teams to help scope work and provide technical input for Statements of Work (SOWs)
  • Serve as a Snowflake subject matter expert, guiding best practices in performance tuning, cost optimization, access control, and workload management
  • Lead modernization and migration initiatives to move clients from legacy systems into Snowflake
  • Integrate Snowflake with BI tools, governance platforms, and AI/ML frameworks
  • Contribute to internal accelerators, frameworks, and proofs of concept
  • Mentor junior engineers and support knowledge sharing across the team
What we offer
What we offer
  • Flexible Time Off Policy
  • Eligibility for Health Benefits
  • Retirement Plan with Company Match
  • Training and Certification Reimbursement
  • Utilization Based Incentive Program
  • Commission Incentive Program
  • Referral Bonuses
  • Work from Home
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

(Locals or Nearby resources only). You will work with technologies that include ...
Location
Location
United States , Glendale
Salary
Salary:
Not provided
enormousenterprise.com Logo
Enormous Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of data engineering experience developing large data pipelines
  • Proficiency in at least one major programming language (e.g. Python, Java, Scala)
  • Hands-on production environment experience with distributed processing systems such as Spark
  • Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, Big Query)
  • Experience in developing APIs with GraphQL
  • Advance understanding of OLTP vs OLAP environments
  • Candidates must work W2, no Corp 2 Corp
  • US Citizen, Green Card Holder, H4-EAD, TN-Visa
  • Airflow
Job Responsibility
Job Responsibility
  • Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines
  • Build and maintain APIs to expose data to downstream applications
  • Develop real-time streaming data pipelines
  • Collaborate with product managers, architects, and other engineers to drive the success of the Core Data platform
  • Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and more
  • Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)
What we offer
What we offer
  • 3 levels of medical insurance for you and your family
  • Dental insurance for you and your family
  • 401k
  • Overtime
  • Sick leave policy: accrue 1 hour for every 30 hours worked up to 48 hours
Read More
Arrow Right

Sr Data Engineer

Resource Informatics Group, Inc. is actively seeking a skilled Senior Data Engin...
Location
Location
United States , Irving
Salary
Salary:
Not provided
rigusinc.com Logo
Resource Informatics Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related fields
  • Strong expertise in data engineering and cloud-based solutions
  • 6+ years of experience in data engineering, architecture, and implementation of large-scale data solutions
  • Proficiency in designing and implementing data models, data structures, and algorithms
  • Advanced knowledge of SQL and NoSQL databases
  • Demonstrated expertise in optimizing data pipelines and improving data reliability, efficiency, and quality
  • Excellent problem-solving capabilities with a keen attention to detail
  • Strong communication and collaboration skills, with the ability to work effectively across diverse teams
  • Relevant certifications in cloud technologies (Azure, AWS, or GCP) advantageous
  • Master’s in Data Science or Computer Science or foreign equivalent, plus 6+ years of experience, OR Bachelor’s in Computer Science, Information Technology, or Electronics and Communication Engineering or foreign equivalent
Job Responsibility
Job Responsibility
  • Develop and execute ETL processes for data extraction, transformation, and loading into warehouses and data lakes
  • Architect data warehousing solutions using Azure Synapse Analytics for efficient querying and reporting
  • Optimize query performance, data processing speed, and resource utilization within Azure environments
  • Construct seamless data pipelines across Azure services utilizing Azure Data Factory, Databricks, and SQL Server Integration Services
  • Collaborate with stakeholders, including data scientists and analysts, to understand data requirements and deliver effective solutions
  • Manage large data volumes leveraging the Hadoop ecosystem for diverse source collection and loading
  • Design, maintain, and optimize data processing jobs using Hadoop MapReduce, Spark, and Hive, with coding in Java or Python for custom applications
  • Monitor job and cluster performance using tools like Ambari and custom monitoring scripts, scaling and maintaining Hadoop clusters and Azure data services
  • Ensure adherence to data security measures and governance standards
  • Integrate cross-cloud data with AWS and GCP services
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer

We are looking for a Sr. Data Engineer to join our team.
Location
Location
Salary
Salary:
Not provided
bostondatapro.com Logo
Boston Data Pro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineering: 8 years (Preferred)
  • Data Programming languages: 5 years (Preferred)
  • Data Developers: 5 years (Preferred)
Job Responsibility
Job Responsibility
  • Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction
  • Ensures quality of technical solutions as data moves across multiple zones and environments
  • Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions
  • Ensures managed analytic assets to support the company’s strategic goals by creating and verifying data acquisition requirements and strategy
  • Develops, constructs, tests, and maintains architectures
  • Aligns architecture with business requirements and use programming language and tools
  • Identifies ways to improve data reliability, efficiency, and quality
  • Conducts research for industry and business questions
  • Deploys sophisticated analytics programs, machine learning, and statistical methods to efficiently implement solutions
  • Prepares data for predictive and prescriptive modeling and find hidden patterns using data
Read More
Arrow Right

Senior Data Engineer

Our Data Engineering Team is comprised of data experts. We build world-class dat...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A BS in Computer Science or equivalent experience with 5+ years of professional experience as a Sr. Data Engineer or in a similar role
  • Strong programming skills using Python
  • Working knowledge of relational databases and query authoring (SQL)
  • Experience designing data models for optimal storage and retrieval to meet product and business requirements
  • Experience building scalable data pipelines using Spark (SparkSQL) with Airflow scheduler/executor framework or similar scheduling tools
  • Experience working with AWS data services or similar Apache projects (Spark, Flink, Hive, and Kafka)
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
  • Well versed in modern software development practices (Agile, TDD, CICD)
Job Responsibility
Job Responsibility
  • You'll partner with the product analytics and data scientist team to build the data solutions that allow them to obtain more insights from our data and use that to support important business decisions
  • You'll work with different stakeholders to understand their needs and architect/build the data models, data acquisition/ingestion processes and data applications to address those requirements
  • You'll add new sources, code business rules, and produce new metrics that support the product analysts and data scientists
  • You'll be the data domain expert who understand all the nitty-gritty of our products
  • You'll own a problem end-to-end
  • You'll improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
Read More
Arrow Right

Sr. Cloud Engineer

Sr. Cloud Engineer to design and develop enterprise software applications and pl...
Location
Location
United States , Woonsocket
Salary
Salary:
147680.00 - 180000.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree (or foreign equivalent) in Computer Science, Computer Engineering, Information Technology, Engineering, or a related field
  • 5 years of progressive, postbaccalaureate experience in the job offered or related occupation
  • 5 years of experience in XML, JSON, HTML, CCC and JavaScript
  • 5 years of experience analyzing large data sets from multiple data sources in healthcare, business, or retail sector
  • 5 years of experience with SAS or SQL programming languages
  • 5 years of experience designing and optimizing queries to build data pipelines
  • 5 years of experience with cloud technologies: Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP)
  • 5 years of domain support for healthcare or retail organization
  • 5 years of experience with large-scale applications development, data science, or data analytics projects
  • 5 years of experience designing data models and solutions for analytical and reporting use cases
Job Responsibility
Job Responsibility
  • Design and develop enterprise software applications and platforms
  • Develop software solutions to meet business requirements and manage project execution to ensure adherence to schedule and scope
  • Determine feasibility of solutions design and prepare technical design documentation
  • Plan stages of application development to improve functionality and features with a focus on performance, reliability, and maintainability
  • Write and review high quality code and perform unit and/or automation testing
  • Confer with project personnel to identify and resolve problems
  • Monitor progress milestones and deliverables
  • Support applications, systems, and databases used to process prescriptions, claims, and related healthcare activities
  • Collaborate with cross-functional teams on applications development, technical requirements, code review, project deliverables, quality assurance, and software development best practices
  • Mentor junior team members
What we offer
What we offer
  • Bonus, commission or short-term incentive program
  • Equity award program
  • Medical, dental, and vision benefits
  • 401(k) retirement savings plan
  • Employee Stock Purchase Plan
  • Fully-paid term life insurance plan
  • Short-term and long term disability benefits
  • Well-being programs
  • Education assistance
  • Free development courses
  • Fulltime
Read More
Arrow Right

Sr. Staff Software Engineer - Advanced Analytics Platform

At DISQO, we’re redefining how companies turn data into decisions. Our mission i...
Location
Location
United States , Los Angeles, Glendale
Salary
Salary:
200000.00 - 240000.00 USD / Year
disqo.com Logo
DISQO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of professional software engineering experience
  • 5+ years architecting or building high-performance data systems or analytics platforms
  • 3+ years of product Rust experience
  • Deep expertise in Rust and strong experience in Java
  • Proven track record building large-scale data analytics or OLAP systems from the ground up
  • Deep understanding of columnar data engines, vectorized execution, and query/dataframe optimization
  • Hands-on experience with performance engineering, profiling, and hardware-aware optimization
  • Strong expertise with AWS - designing, deploying, and optimizing large-scale data and compute systems in the cloud
  • A systems-thinking mindset
  • Thrives in a fast-moving, startup environment
Job Responsibility
Job Responsibility
  • Architect and deliver a high-performance Advanced Analytics Engine
  • Design and build an Agentic AI system that leverages this Advanced Analytics Engine
  • Partner with product, engineering and data teams to power agentic AI analytics systems
  • Profile, benchmark, and optimize Rust components
  • Leverage AWS cloud services to architect scalable, reliable, and cost-efficient analytics infrastructure
  • Shape the evolution of DISQO’s broader data platform and its integration across our product ecosystem
  • Mentor and guide engineers
  • Contribute to open-source or internal frameworks that advance analytical systems and distributed computation
What we offer
What we offer
  • 100% covered Medical/Dental/Vision for employee
  • Equity
  • 401K
  • Generous PTO policy
  • Flexible workplace policy
  • Team offsites, social events & happy hours
  • Life Insurance
  • Health FSA
  • Commuter FSA (for hybrid employees)
  • Catered lunch and fully stocked kitchen
  • Fulltime
Read More
Arrow Right

Sr. Principal Engineer, Interact Analytics Experiences

We’re looking for a Principal Engineer to lead Highspot’s Analytics Platform cap...
Location
Location
United States , Seattle
Salary
Salary:
277391.00 - 342391.00 USD / Year
highspot.com Logo
Highspot
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven Experience – 10+ years in software engineering with deep experience in analytics platforms, query engines, OLAP databases, and frontend analytics frameworks
  • Expertise in Analytics & Query Processing – Strong hands-on knowledge of OLAP databases, query transpilation, analytics frameworks, and frontend-driven analytics experiences
  • Expertise in Frontend Analytics & Component Architecture – Experience designing and developing reusable, performant, and scalable frontend components for interactive analytics experiences. Deep understanding of modern frontend frameworks, component-based architecture, and state management patterns to enable dynamic, data-rich visualizations
  • Architectural Leadership – Experience designing and implementing scalable analytics-serving platforms and interactive query experiences with frontend and backend considerations
  • Strong Programming and Data Skills – Proficiency in SQL, TypeScript, React, and modern transpilation techniques, with a solid understanding of query optimization, frontend component reusability, and performance tuning
  • Cloud-Native & Infrastructure Knowledge – Familiarity with AWS, Kubernetes, and Terraform/Pulumi, with a focus on analytics services and frontend scalability
  • Technical Leadership – Proven ability to drive cross-functional technical initiatives and influence platform decisions across both backend and frontend architectures
  • Analytical Mindset – Passion for solving complex problems in interactive analytics, frontend visualization, query processing, and composable reporting frameworks
  • High Standards for Reliability and Performance – Commitment to ensuring high query performance, frontend responsiveness, availability, and data accuracy
Job Responsibility
Job Responsibility
  • Architect and Scale the Analytics Platform – Design and evolve the key parts of our system including database/query optimizations, backend scalability, and frontend framework improvements to support self-serve analytics and real-time insights
  • Lead Frontend and Backend Analytics Excellence – Ensure the Analytics Platform provides a scalable, efficient, and well-governed foundation for serving analytical queries and reports while advancing the frontend component architecture to support interactive analytics experiences
  • Own End-to-End Analytics Flow – Guide the transformation, querying, and visualization of analytics data, optimizing for performance, usability, and seamless integration across backend and frontend systems
  • Evolve Role-Based Access Control (RBAC) for Data Governance – Enhance our RBAC framework to ensure the right people have access to the data they need while maintaining security, compliance, and performance across the Analytics Platform
  • Enable Advanced Visualization & Reporting – Partner with Product and Engineering teams to evolve and optimize our ad-hoc data visualization and reporting framework, ensuring robust composable components with efficient state management and interaction logic
  • Drive Best Practices and Technical Standards – Establish and evangelize patterns for query optimization, schema evolution, frontend component reusability, and analytics-driven UI design
  • Lead and Mentor – Act as a technical leader and mentor for engineers across the team, providing deep technical guidance on analytics, query performance, frontend development, and reporting challenges
  • Cross-Team Collaboration – Partner with engineering teams across product, backend, frontend, Data-Platform and AI/ML to ensure a seamless, high-performing analytics experience
  • Operational Excellence – Define and drive SLA, availability, and performance objectives, ensuring the Analytics Platform meets the needs of our Analytics and Insights vision
What we offer
What we offer
  • Comprehensive medical, dental, vision, disability, and life benefits
  • Health Savings Account (HSA) with employer contribution
  • 401(k) Matching with immediate vesting on employer match
  • Flexible PTO
  • 8 paid holidays and 5 paid days for Annual Holiday Week
  • Quarterly Recharge Fridays (paid days off for mental health recharge)
  • 18 weeks paid parental leave
  • Access to Coaches and Therapists through Modern Health
  • 2 volunteer days per year
  • Commuting benefits
  • Fulltime
Read More
Arrow Right