CrawlJobs Logo
Amgen Logo Amgen · IT - Software Development

Data Engineer

India, Hyderabad · Job Posted April 01, 2026
Apply Position
Job Link Share

Job Description

Build and operate large-scale healthcare data pipelines across batch workflows, metadata-driven ingestion, and data service publishing. Own end-to-end engineering from source ingestion to conformed data products, with strong focus on reliability, data quality, and operational observability. Partner with analytics, business, and platform teams to deliver trusted datasets for sales, claims, activity, patient, and rare disease use cases.

Job Responsibility

  • Design and maintain PySpark/SQL pipelines in Databricks for landing, unified, unstitched, and published data layers
  • Build and support Airflow DAGs for scheduling, dependencies, retries, and production operations
  • Implement metadata/config-driven frameworks for ingestion, transformation, and rule-based processing
  • Develop robust data quality controls, DQ summaries, failure handling, and alerting workflows
  • Manage batch/process audit logs, run status tracking, release flags, and operational reporting
  • Integrate multi-source data (files, APIs, cloud storage, and relational systems) into governed Delta/Spark tables
  • Optimize pipeline performance using partitioning, parallelization, and query tuning
  • Collaborate on schema evolution, business-rule onboarding, and production support

Requirements

  • Bachelor’s degree in Computer Science, Information Technology, or a related field with 5-9 years of experience
  • Advanced Python, PySpark, and SQL (window functions, complex joins, MERGE patterns, optimization)
  • Hands-on Databricks and Airflow experience in enterprise environments
  • Experience with cloud data platforms (AWS), object storage, and secure secret handling
  • Strong data quality engineering, monitoring, and troubleshooting in regulated data contexts
  • Solid understanding of ETL orchestration, dependency management, and SLA-driven delivery
Amgen - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

We believe in the power of ingenuity to build a positive human future. We challe...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
paconsulting.com Logo
PA Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You thrive in problem-solving and analytical thinking
  • You enjoy collaborating with multiple stakeholders in a fast-paced environment
  • Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL
  • Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc
  • Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming
Job Responsibility
Job Responsibility
  • Work to agile best practices and cross-functionally with multiple teams and stakeholders
  • Use technical skills to problem solve with clients and work on internal projects
  • Live in-person whiteboarding sessions to problem solve as a team, alongside asynchronous communication on Teams
  • Work alongside colleagues from across PA – delivering transformative digital solutions to today’s most complex business challenges
  • Design and build for the AWS cloud
What we offer
What we offer
  • Health and lifestyle perks accompanying private healthcare for you and your family
  • 25 days annual leave (plus a bonus half day on Christmas Eve) with the opportunity to buy 5 additional days
  • Generous company pension scheme
  • Opportunity to get involved with community and charity-based initiatives
  • Annual performance-based bonus
  • PA share ownership
  • Tax efficient benefits (cycle to work, give as you earn)
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to play a key role in shaping and scaling our...
Location
Location
Salary
Salary:
Not provided
mdotm.ai Logo
MDOTM Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Computer Science, Engineering, or a related field
  • Strong programming skills in Java or Python (or other JVM-based languages)
  • Strong understanding of data modeling, SQL, and NoSQL databases
  • Strong focus on data quality, validation, and monitoring practices
  • Experience working with large-scale and time-series datasets in financial contexts, with an understanding of their structure and common data quality challenges
  • Experience building and maintaining production data pipelines or data-intensive systems, with focus on reliability and performance
  • Ability to troubleshoot and optimize production data systems
  • Experience with workflow orchestration and data pipeline scheduling tools
  • Solid understanding of financial data structures and concepts, with the ability to model and validate financial data accurately
  • Strong problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, build, and maintain production-grade data pipelines and data-intensive systems
  • Configure, schedule, and monitor data pipeline execution to ensure reliability, maintainability, and timely delivery across all data processes
  • Deploy and manage data infrastructure on AWS or on-premises, ensuring scalability, security, and cost-efficiency
  • Monitor and optimize relational and NoSQL database performance (e.g., MySQL, PostgreSQL, MongoDB) to ensure efficient querying, indexing, and data access at scale
  • Ensure reliable ingestion, transformation, and availability of large-scale and time-series financial data, considering financial-specific data quality characteristics
  • Implement and maintain data quality, validation, and monitoring mechanisms across data workflows
  • Define and evolve data models and storage structures across relational and NoSQL systems
  • Collaborate with Data Scientists and Analysts to ensure accurate and efficient data access for analytics and modeling use cases
  • Optimize data processing workflows for performance, reliability, and operational stability
  • Troubleshoot complex data issues and drive root cause analysis
  • Fulltime
Read More
Arrow Right

Data Engineer

Design, build, and maintain scalable data pipelines and ETL/ELT processes. Devel...
Location
Location
United States , Austin
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data engineering, data integration, or a related role
  • Strong proficiency in SQL and experience working with large, complex datasets
  • Experience building and maintaining ETL/ELT data pipelines
  • Proficiency in at least one programming language (Python, Java, Scala, or similar)
  • Hands‑on experience with data warehouses and data platforms (Snowflake, Redshift, BigQuery, Databricks, etc.)
  • Experience working in cloud environments (AWS, Azure, or GCP)
  • Familiarity with data modeling, schema design, and performance optimization
  • Experience integrating data from APIs, databases, and streaming sources
  • Strong problem‑solving and troubleshooting skills related to data pipelines and performance
  • Ability to collaborate with data analysts, data scientists, and business stakeholders
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines and ETL/ELT processes
  • Develop and manage data architectures such as data warehouses, data lakes, and lakehouses
  • Ingest and integrate data from multiple sources (databases, APIs, streaming platforms)
  • Ensure data quality, integrity, and reliability across systems
  • Optimize data processing, storage, and query performance
  • Collaborate with data analysts, data scientists, and business teams to support analytics and reporting needs
  • Implement automation for data workflows, monitoring, and error handling
  • Troubleshoot and resolve data pipeline issues and performance bottlenecks
  • Support batch and real‑time data processing frameworks
  • Document data models, pipelines, and data engineering processes
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • enrollment in company 401(k) plan
Read More
Arrow Right

Data Engineer

We are seeking a Data Engineer with strong experience in Microsoft Azure and Dat...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of Data Engineering experience
  • Hands-on experience with Azure Databricks
  • Experience with Azure services such as: Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL Database
  • Strong SQL development skills
  • Experience with Python, PySpark, or Spark
  • Experience building and maintaining ETL/ELT pipelines
  • Understanding of data warehousing concepts and dimensional modeling
  • Experience working with large datasets in cloud environments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines in Azure and Databricks
  • Build and optimize ETL/ELT processes for structured and unstructured data
  • Develop and support data lake, data warehouse, and analytics solutions
  • Integrate data from multiple internal and external sources
  • Collaborate with business analysts, data scientists, and stakeholders to understand data requirements
  • Ensure data quality, integrity, security, and governance standards are met
  • Monitor and troubleshoot data workflows and performance issues
  • Create and maintain technical documentation and data models
  • Support reporting and analytics initiatives by delivering reliable datasets
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Data Engineer

As a Data Engineer in our Finance Systems and Analytics team, you’ll help design...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience building and maintaining data pipelines and scalable data products using structured and unstructured data
  • Strong knowledge of SQL, ideally within a Snowflake environment
  • Experience with at least one server-side language such as Python, Java, Kotlin or NodeJS or experience with Alteryx
  • Knowledge of event-driven, loosely coupled architectures and data processing patterns
  • Experience working with CI/CD tools such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development approaches
  • Experience with automated testing techniques within data or software engineering environments
  • Proven experience working in the energy industry
  • Ability to translate complex data concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Building and maintaining scalable data products that deliver insight across finance systems
  • Designing and optimising ETL processes to ensure data integrity and performance
  • Collaborating with engineers, analysts, and business teams to define and deliver data solutions
  • Contributing to agile delivery, including planning, retrospectives, and continuous improvement
  • Supporting the operational performance, monitoring, and reliability of data platforms
What we offer
What we offer
  • Competitive salary and potential for an annual bonus
  • Market-leading pension scheme
  • Electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
!
Read More
Arrow Right

Data Engineer

Design, develop, and maintain data solutions, pipelines and analytics applicatio...
Location
Location
United States , Alpharetta
Salary
Salary:
Not provided
iqzsystems.com Logo
IQZ Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MS or foreign equivalent in Computer Science or Engineering (any) or Information Systems or Data Science or Related
  • 1 year experience in data storage, analysis and pipelines, ETL, Apache Kafka and Apache Storm
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions, pipelines and analytics applications using various tools and technologies including Hadoop, Spark, Hive, Kafka, SQL, MapReduce, Apache Kafka, Apache Storm, AWS, Snowflake etc
  • Gather & analyze requirements
  • Identify and implement process improvements
  • Assemble large, complex data sets to meet requirements
  • Implement methods to improve data reliability and data quality
  • Design and develop frameworks to stream data
  • Optimize data delivery and re-design infrastructure for greater scalability
  • Perform troubleshooting and provide issue resolution and similar duties
  • Fulltime
Read More
Arrow Right

Data Engineer

The Role: We are seeking a passionate Data Engineer to design scalable, robust s...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 16, 2026
Flip Icon
Requirements
Requirements
  • Deep expertise in data engineering with the ability to extend into backend services
  • Proven experience building pipelines for large-scale transactional or financial data
  • Fluency in Scala (Scio/Dataflow) and comfort with cloud-native development on GCP
  • Strong communication skills to collaborate with Finance, Product, and Engineering teams to ship auditable, reliable systems that meet regulatory scrutiny
  • Ability to thrive in fast-moving, ambiguous spaces while prioritizing long-term sustainability
Job Responsibility
Job Responsibility
  • Design scalable, robust systems that turn large-scale consumption and royalty data into accurate payouts
  • Build self-serve tools for our Finance team
  • Develop modular, easily maintainable platform capabilities
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to help shape and scale a modern cloud-based ...
Location
Location
United States , Wood Dale
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering, analytics engineering, or a closely related discipline
  • Strong practical experience with Google Cloud Platform, including deep expertise in BigQuery
  • Advanced SQL skills with a proven ability to design semantic models and curated data layers
  • Experience developing integrations and pipelines through APIs, ingestion frameworks, or ETL processes
  • Hands-on familiarity with BI and reporting platforms such as Looker Studio, Tableau, or comparable tools
  • Solid communication skills with the ability to work effectively across technical teams and business functions
  • Demonstrated success in ambiguous environments where processes, models, and standards must be built from scratch.
Job Responsibility
Job Responsibility
  • Create and refine scalable data models and curated datasets within BigQuery to support accurate analysis and reporting
  • Build, manage, and optimize ETL workflows and data pipelines that connect information from SaaS applications and other source systems
  • Develop reporting-ready data structures and dashboards that provide clear, dependable insights for business users
  • Establish data quality practices, documentation standards, and performance metrics to strengthen trust in enterprise reporting
  • Collaborate with cross-functional stakeholders to translate reporting objectives into well-structured data solutions
  • Automate repetitive data tasks through scripting and lightweight engineering approaches using tools such as Python
  • Apply governance and maintainability best practices to improve how data is organized, accessed, and supported over time
  • Contribute to modernization efforts by helping move data processes away from legacy workflows into scalable cloud-based platforms.
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right