CrawlJobs Logo

Aws Data Engineer (Cloud Data Platform & Pipeline Specialist)

United States, Atlanta Employment contract · Job Posted May 28, 2026
Apply Position
Job Link Share

Job Description

Design, develop, and maintain scalable cloud-based data pipelines using AWS services such as Glue, EMR, S3, RDS, DataSync, and DMS. Build and optimize batch and streaming data orchestration workflows to support enterprise data platforms. Lead large-scale data migration efforts, including legacy-to-cloud transformations and replication strategies. Perform data modeling, transformation, and reconciliation to ensure high-quality, consistent datasets across systems. Implement secure data access patterns following least-privilege principles for pipelines and datasets. Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions. Establish robust data validation, reconciliation, and audit mechanisms to meet regulatory and reporting requirements. Troubleshoot and optimize performance of ETL/ELT pipelines and data workflows in AWS environments. Support governance, compliance, and audit readiness for data platforms in regulated environments (finance/reporting).

Job Responsibility

  • Design, develop, and maintain scalable cloud-based data pipelines using AWS services such as Glue, EMR, S3, RDS, DataSync, and DMS
  • Build and optimize batch and streaming data orchestration workflows to support enterprise data platforms
  • Lead large-scale data migration efforts, including legacy-to-cloud transformations and replication strategies
  • Perform data modeling, transformation, and reconciliation to ensure high-quality, consistent datasets across systems
  • Implement secure data access patterns following least-privilege principles for pipelines and datasets
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions
  • Establish robust data validation, reconciliation, and audit mechanisms to meet regulatory and reporting requirements
  • Troubleshoot and optimize performance of ETL/ELT pipelines and data workflows in AWS environments
  • Support governance, compliance, and audit readiness for data platforms in regulated environments (finance/reporting)

Requirements

  • 5+ years of experience in data engineering, with strong hands-on expertise in AWS data services (Glue, EMR, S3, RDS, DataSync, DMS)
  • 5+ years of Proven experience building and managing data pipelines (batch and streaming) in cloud environments
  • 5+ years of Strong experience in data migration, transformation frameworks, and large-scale data replication
  • 5+ years of Deep understanding of data modeling, data transformation, and reconciliation techniques
  • 5+ years of Experience designing and implementing secure data access and governance (least privilege principles)
  • 5+ years of Hands-on experience with data validation, auditing, and reconciliation processes
  • Familiarity with regulatory or finance data environments and reporting workloads
  • 5+ years of Strong problem-solving skills and ability to work in a collaborative, fast-paced environment
  • AWS data services
  • data pipelines
  • data migration
  • data modeling
  • data validation
  • data governance

Nice to have

  • Experience with real-time/streaming technologies (e.g., Kafka, Kinesis)
  • Exposure to data warehousing platforms (Redshift, Snowflake, etc.)
  • Experience with infrastructure-as-code (Terraform, CloudFormation)
  • Knowledge of DevOps practices and CI/CD for data pipelines
  • Prior experience working in regulated industries (Financial Services, Healthcare, etc.)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Aws Data Engineer (Cloud Data Platform & Pipeline Specialist)

8 matching positions

Public Cloud Platform Engineer

Citi’s Operations & Technology organization (O&T) is driving an innovative Cloud...
Location
Location
Poland , Warsaw
Salary
Salary:
241750.00 - 411650.00 PLN / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Developer experience across multiple languages – Java, Python etc.
  • Cloud platforms, more than once cloud AWS, GCP or Azure
  • Has built CICD / SDLC pipelines for example Terraform and Harness
  • Performed as tech lead within a specialist domain eg tech lead for container or data platforms
  • 5+ years of application architecture and modernization (cloud native)
  • 5+ years of messaging, data, analytics, api, service and data mesh
  • Experience of working in regulator governed industries, good overall understanding of compliance and security controls
  • Enabled application teams to transform working practice and adopt devop culture
  • Able to deliver detailed design and other associated documentation
  • Excellent stake holder engagement skills, able to identify value opportunities
Job Responsibility
Job Responsibility
  • Implement cloud architecture (on AWS, GCP and Azure) that enables the infrastructure (compute, database network, storage, observability) required for application hosting in public cloud using Citi’s engineering processes and best practices, with particular emphasis on automation and security by design
What we offer
What we offer
  • Private Medical Care Program
  • Life Insurance Program
  • Pension Plan contribution (PPE Program)
  • Employee Assistance Program
  • Paid Parental Leave Program (maternity and paternity leave)
  • Sport Card
  • Holidays Allowance
  • Sport and team recreation activities
  • Special offers and discounts for employees
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Ecom Data Engineer Specialist

PepsiCo operates in an environment undergoing immense and rapid change. Big data...
Location
Location
United States , Purchase, New York
Salary
Salary:
64900.00 - 132550.00 USD / Year
pepsico.com Logo
Pepsico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of overall technology experience that includes at least 3+ years of hands-on software development, data engineering, and systems architecture
  • 3+ years of experience in SQL optimization and performance tuning
  • Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
  • Experience with data profiling and data quality tools like Apache Griffin, Deequ, or Great Expectations
  • Current skills in the following technologies: Python
  • Orchestration platforms: Airflow, Luigi, Databricks, or similar
  • Relational databases: Postgres, MySQL, or equivalents
  • MPP data systems: Snowflake, Redshift, Synapse, or similar
  • Cloud platforms: AWS, Azure, or similar
Job Responsibility
Job Responsibility
  • Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability, and ongoing metrics
  • Ensure that we build high-quality software by reviewing peer code check-ins
  • Define best practices for product development, engineering, and coding as part of a world-class engineering team
  • Collaborate in architecture discussions and architectural decision-making that is part of continually improving and expanding these platforms
  • Lead feature development in collaboration with other engineers
  • validate requirements/stories, assess current system capabilities, and decompose feature requirements into engineering tasks
  • Focus on delivering high-quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with other engineers
  • Develop software in short iterations to quickly add business value
  • Introduce new tools/practices to improve data and code quality
  • this includes researching/sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers
What we offer
What we offer
  • A business development incentive equity may be awarded based on eligibility and performance
  • Paid time off subject to eligibility, including paid parental leave, vacation, sick, and bereavement
  • Medical, Dental, Vision, Disability, Health, and Dependent Care Reimbursement Accounts, Employee Assistance Program (EAP), Insurance (Accident, Group Legal, Life), Defined Contribution Retirement Plan
  • Fulltime
Read More
Arrow Right

Cloud Platform Engineer

Citi’s Operations & Technology organization (O&T) is driving an innovative Cloud...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Developer experience across multiple languages – Java, Python etc.
  • Cloud platforms, more than one cloud AWS, GCP or Azure
  • Has built CICD / SDLC pipelines for example Terraform and Harness
  • Performed as tech lead within a specialist domain eg tech lead for container or data platforms
  • 5+ years of application architecture and modernization (cloud native)
  • 5+ years of messaging, data, analytics, api, service and data mesh
  • Experience of working in regulator governed industries, good overall understanding of compliance and security controls
Job Responsibility
Job Responsibility
  • Implement cloud architecture (on AWS, GCP and Azure) that enables the infrastructure (compute, database network, storage, observability) required for application hosting in public cloud using Citi’s engineering processes and best practices, with particular emphasis on automation and security by design.
  • To engineer platforms and services across Google and AWS
  • Working in an agile empowered team to solve complex problems
  • Engineering emergent technologies to create value across Citi
What we offer
What we offer
  • Private Medical Care Program
  • Life Insurance Program
  • Pension Plan contribution (PPE Program)
  • Employee Assistance Program
  • Paid Parental Leave Program (maternity and paternity leave)
  • Sport Card
  • Holidays Allowance
  • Sport and team recreation activities
  • Special offers and discounts for employees
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Public Cloud - Senior Platform Engineer - SVP

Citi’s Operations & Technology organization (O&T) is driving an innovative Cloud...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Developer experience across multiple languages – Java, Python etc.
  • Cloud platforms, more than once cloud AWS, GCP or Azure
  • Has built CICD / SDLC pipelines for example Terraform and Harness
  • Performed as tech lead within a specialist domain eg. tech lead for container or data platforms
Job Responsibility
Job Responsibility
  • Implement cloud architecture (on AWS, GCP and Azure) that enables the infrastructure (compute, database network, storage, observability) required for application hosting in public cloud using Citi’s engineering processes and best practices, with particular emphasis on automation and security by design
  • To engineer platforms and services across Google and AWS
  • Working in an agile empowered team to solve complex problems
  • Engineering emergent technologies to create value across Citi
What we offer
What we offer
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Specialist Software Engineer (Fullstack)

The role is responsible for designing, developing, and deploying complex softwar...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s or Bachelor's degree with 8-12 years of experience in Computer Science, IT or related field
  • Proficient in JavaScript, TypeScript, React framework, HTML5, CSS, and NPM
  • Hands on experience with various cloud services
  • Hands-on experience with Full Stack software development including REST APIs and data pipelines
  • Proficient in programming language Python(preferred) and SQL/NoSQL with exposure to multi source integration involving various platforms
  • Experience in microservices architecture and containerization technologies such as Docker, Kubernetes, Azure, AWS, or other cloud platforms
  • Committed to delivering top-tier quality in product development and support.
Job Responsibility
Job Responsibility
  • Possesses strong rapid prototyping skills and can quickly translate concepts into working code
  • Provide technical guidance and mentorship to junior developers
  • Take ownership of complex software projects from conception to deployment
  • Manage software delivery scope, risk, and timeline
  • Contribute to both front-end and back-end development using cloud technology
  • Define and implement robust software architectures on the cloud, AWS preferred
  • Conduct code reviews to ensure code quality and adherence to best practices
  • Create and maintain documentation on software architecture, design, deployment, disaster recovery, and operations
  • Identify and resolve technical challenges effectively
  • Stay updated with the latest trends and advancements
Read More
Arrow Right

Specialist Software Engineer - R&D Omics

In this vital role you will work for Research Informatics and you will be respon...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's or Bachelor’s degree and 6 to 8 years of in Software Development, IT, or related field
  • Proficiency in code development (Python, R) and the software development lifecycle
  • Experience with Application development (RShiny, Ploty Dash, etc)
  • Proficient with SQL and relational databases (e.g PostgreSQL, MySQL, Oracle, Databricks)
  • Experience with cloud computing platforms and infrastructure
Job Responsibility
Job Responsibility
  • Develop software to transform and visualize omics (genomics, proteomics, transcriptomics) data using programming languages such as Python, Java, R
  • Develop data processing pipelines for large datasets in the cloud (e.g. Nextflow)
  • integrate with other data sources where applicable
  • Collaborate with the other engineering team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms
  • Adhere to best practices for testing and designing reusable code
  • Ensure effective communication between scientific area management, technical staff and vendors to analyze scientific needs and implement informatics solutions in data acquisition, integration and analysis
Read More
Arrow Right

Cloud Services Sales Specialist

As a Cloud Sales at NTT DATA, your role will focus on identifying, developing, a...
Location
Location
Philippines , Metro Manila, National Capital Region (Manila)
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Business, IT, Marketing, or a related field (or equivalent experience)
  • 3–7+ years of experience in B2B technology or cloud sales
  • Strong understanding of cloud platforms (e.g., Microsoft Azure, AWS, Google Cloud)
  • Proven track record of meeting or exceeding sales quotas
  • Experience selling complex solutions and managing long sales cycles
  • Excellent communication, presentation, and negotiation skills
Job Responsibility
Job Responsibility
  • Prospect, qualify, and manage a pipeline of cloud opportunities across assigned accounts or territories
  • Sell cloud solutions including IaaS, PaaS, SaaS, and related services (migration, security, data, AI, networking)
  • Engage customers through discovery sessions to understand business challenges, IT environments, and transformation goals
  • Develop and present value-based proposals, business cases, and ROI justifications for cloud adoption
  • Collaborate with cloud architects, pre-sales engineers, and partner ecosystems to design and position solutions
  • Build strong relationships with key customer stakeholders (IT, procurement, finance, line-of-business leaders)
  • Drive cloud consumption growth, renewals, and upsell/cross-sell opportunities
  • Maintain accurate forecasts, pipeline updates, and activity reports in CRM tools
  • Stay current on cloud technologies, industry trends, and competitive offerings
  • Meet or exceed quarterly and annual sales targets
  • Fulltime
Read More
Arrow Right

Cloud Services Sales Specialist

Join NTT DATA as a Cloud Services Sales Specialist, where you will leverage your...
Location
Location
Philippines , Metro Manila
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Business, IT, Marketing, or a related field
  • 3–7+ years of experience in B2B technology or cloud sales
  • Strong understanding of cloud platforms (e.g., Microsoft Azure, AWS, Google Cloud)
  • Proven track record of meeting or exceeding sales quotas
  • Experience selling complex solutions and managing long sales cycles
  • Excellent communication, presentation, and negotiation skills
Job Responsibility
Job Responsibility
  • Prospect, qualify, and manage a pipeline of cloud opportunities across assigned accounts or territories
  • Sell cloud solutions including IaaS, PaaS, SaaS, and related services (migration, security, data, AI, networking)
  • Engage customers through discovery sessions to understand business challenges, IT environments, and transformation goals
  • Develop and present value-based proposals, business cases, and ROI justifications for cloud adoption
  • Collaborate with cloud architects, pre-sales engineers, and partner ecosystems to design and position solutions
  • Build strong relationships with key customer stakeholders
  • Drive cloud consumption growth, renewals, and upsell/cross-sell opportunities
  • Maintain accurate forecasts, pipeline updates, and activity reports in CRM tools
  • Stay current on cloud technologies, industry trends, and competitive offerings
  • Meet or exceed quarterly and annual sales targets
  • Fulltime
Read More
Arrow Right