CrawlJobs Logo

Sr Data Engineer

amgen.com Logo

Amgen

Location Icon

Location:
India , Hyderabad

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a highly motivated and expert Senior Data Engineer for Framework Development who will lead the design and development of enterprise-grade testing frameworks, data quality (DQ) frameworks, and automation frameworks to strengthen the reliability and scalability of Amgen’s enterprise data ecosystem. The ideal candidate will architect reusable frameworks that enable efficient validation, continuous testing, data observability, and governance automation across data pipelines, analytics models, and platform components.

Job Responsibility:

  • Design, develop, and maintain testing frameworks and automation libraries for data pipelines, APIs, and ETL/ELT processes
  • Architect and implement Data Quality (DQ) frameworks with automated validation, anomaly detection
  • Develop common framework components and utilities to support cross-team use for data, integration, and analytics testing
  • Implement framework-driven CI/CD pipelines to automate testing, validation, and deployment of data solutions
  • Collaborate with data engineering teams to embed testing and quality automation within data ingestion, transformation, and consumption layers
  • Integrate frameworks with enterprise monitoring and observability tools to ensure proactive detection of data and system issues
  • Optimize framework performance, scalability, and maintainability using modular architecture and code reusability principles
  • Contribute to standards, guidelines, and best practices for test automation, data validation, and continuous quality engineering
  • Work with DevOps and platform teams to ensure seamless integration with version control, CI/CD pipelines, and infrastructure-as-code
  • Stay current with emerging technologies in testing, data quality engineering, and observability frameworks to continuously enhance Amgen’s engineering maturity

Requirements:

  • Hands-on experience in developing automation or testing frameworks using Python, PySpark, Java, or similar languages
  • Proficiency with testing tools and frameworks such as PyTest, unittest, Robot Framework, Great Expectations, or similar
  • Strong understanding of data validation, data quality, and metadata management practices
  • Experience in integrating frameworks into data platforms (Databricks, AWS Glue, Spark, Airflow, etc.)
  • Proficiency in CI/CD automation (GitHub Actions, Jenkins, or Azure DevOps)
  • Strong understanding of AWS services, especially data-related ones (S3, Glue, EMR, Lambda, Redshift)
  • Experience with test-driven development (TDD) and agile delivery practices
  • Excellent problem-solving, debugging, and analytical skills
  • Strong communication and collaboration skills to work with cross-functional engineering teams
  • Any degree and 8 to 13 years of experience in Computer Science, IT, or related field

Nice to have:

  • Experience with data observability tools (e.g., Monte Carlo, Soda, or Databand)
  • Knowledge of Data Fabric or Data Mesh concepts and integration with testing and DQ frameworks
  • Experience in API testing frameworks and contract testing (e.g., Postman, Karate, or REST Assured)
  • Experience with DataOps and MLOps testing practices
  • Familiarity with software engineering best practices, including version control, code reviews, CI/CD, and automated unit testing
  • Good to have domain experience in Biotech or Pharma industries
  • AWS Certified Developer or Data Engineer preferred
  • Databricks Developer/Engineer certification preferred
  • Scaled Agile SAFe certification preferred

Additional Information:

Job Posted:
January 04, 2026

Work Type:
On-site work
Icon
Amgen - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Sr Data Engineer

Sr. Data Engineer

We are looking for a Sr. Data Engineer to join our team.
Location
Location
Salary
Salary:
Not provided
bostondatapro.com Logo
Boston Data Pro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineering: 8 years (Preferred)
  • Data Programming languages: 5 years (Preferred)
  • Data Developers: 5 years (Preferred)
Job Responsibility
Job Responsibility
  • Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction
  • Ensures quality of technical solutions as data moves across multiple zones and environments
  • Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions
  • Ensures managed analytic assets to support the company’s strategic goals by creating and verifying data acquisition requirements and strategy
  • Develops, constructs, tests, and maintains architectures
  • Aligns architecture with business requirements and use programming language and tools
  • Identifies ways to improve data reliability, efficiency, and quality
  • Conducts research for industry and business questions
  • Deploys sophisticated analytics programs, machine learning, and statistical methods to efficiently implement solutions
  • Prepares data for predictive and prescriptive modeling and find hidden patterns using data
Read More
Arrow Right

Sr. Data Engineer

We are looking for a Sr. Data Engineer to join our team.
Location
Location
Salary
Salary:
Not provided
bostondatapro.com Logo
Boston Data Pro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineering: 8 years (Preferred)
  • Data Programming languages: 5 years (Preferred)
  • Data Developers: 5 years (Preferred)
Job Responsibility
Job Responsibility
  • Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction
  • Ensures quality of technical solutions as data moves across multiple zones and environments
  • Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions
  • Ensures managed analytic assets to support the company’s strategic goals by creating and verifying data acquisition requirements and strategy
  • Develops, constructs, tests, and maintains architectures
  • Aligns architecture with business requirements and use programming language and tools
  • Identifies ways to improve data reliability, efficiency, and quality
  • Conducts research for industry and business questions
  • Deploys sophisticated analytics programs, machine learning, and statistical methods to efficiently implement solutions
  • Prepares data for predictive and prescriptive modeling and find hidden patterns using data
Read More
Arrow Right

Sr. Manager- Data Engineering

Adtalem is a data driven organization. The Data Engineering team builds data sol...
Location
Location
United States , Lisle
Salary
Salary:
96404.10 - 169021.85 USD / Year
adtalem.com Logo
Adtalem Global Education
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • Master's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • 8+ years experience in data engineering solutions such as data platforms, data ingestion, data management, or publication/analytics
  • 3+ years leadership experience building and managing a high performing teams
  • 2+ years experience in Google Cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows
  • Progressively responsible experience starting as Data Engineer and advancement in complexity, and level of responsibility
  • Must be highly analytical having the proven ability to develop and reverse complex engineering solutions
  • Critical thinking and advanced problem-solving skills are core behaviors among the team
  • Excellent oral/written communication and presentation skills
  • Experience in objectively evaluating current processes for opportunities to optimize inter departmental communication, collaboration, and end-to-end process performance
Job Responsibility
Job Responsibility
  • Design and build trusted, reliable and timely datasets, metrics and data pipelines that are critical to the direction of the company
  • Build and lead a high-performing data engineering team in a hands-on technical capacity
  • Be responsible for shaping how we acquire, collect and leverage data
  • Define and manage SLA's for all data sets and processes running in production
  • Work closely with Product Managers, Analysts, Data Scientists to develop and own data-driven systems
  • Develop data democratization layer for self-served reporting
  • Assist development team in troubleshooting, coding, testing, implementation, and documenting solutions
  • Support, grow, mentor and inspire new and existing team members
  • Be a key leader of the Data and Analytics team, working to propel the business towards being more data-driven
  • Performs other duties as assigned
What we offer
What we offer
  • Health, dental, vision, life and disability insurance
  • 401k Retirement Program + 6% employer match
  • Participation in Adtalem’s Flexible Time Off (FTO) Policy
  • 12 Paid Holidays
  • Eligible to participate in an annual incentive program
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

Resource Informatics Group, Inc. is actively seeking a skilled Senior Data Engin...
Location
Location
United States , Irving
Salary
Salary:
Not provided
rigusinc.com Logo
Resource Informatics Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related fields
  • Strong expertise in data engineering and cloud-based solutions
  • 6+ years of experience in data engineering, architecture, and implementation of large-scale data solutions
  • Proficiency in designing and implementing data models, data structures, and algorithms
  • Advanced knowledge of SQL and NoSQL databases
  • Demonstrated expertise in optimizing data pipelines and improving data reliability, efficiency, and quality
  • Excellent problem-solving capabilities with a keen attention to detail
  • Strong communication and collaboration skills, with the ability to work effectively across diverse teams
  • Relevant certifications in cloud technologies (Azure, AWS, or GCP) advantageous
  • Master’s in Data Science or Computer Science or foreign equivalent, plus 6+ years of experience, OR Bachelor’s in Computer Science, Information Technology, or Electronics and Communication Engineering or foreign equivalent
Job Responsibility
Job Responsibility
  • Develop and execute ETL processes for data extraction, transformation, and loading into warehouses and data lakes
  • Architect data warehousing solutions using Azure Synapse Analytics for efficient querying and reporting
  • Optimize query performance, data processing speed, and resource utilization within Azure environments
  • Construct seamless data pipelines across Azure services utilizing Azure Data Factory, Databricks, and SQL Server Integration Services
  • Collaborate with stakeholders, including data scientists and analysts, to understand data requirements and deliver effective solutions
  • Manage large data volumes leveraging the Hadoop ecosystem for diverse source collection and loading
  • Design, maintain, and optimize data processing jobs using Hadoop MapReduce, Spark, and Hive, with coding in Java or Python for custom applications
  • Monitor job and cluster performance using tools like Ambari and custom monitoring scripts, scaling and maintaining Hadoop clusters and Azure data services
  • Ensure adherence to data security measures and governance standards
  • Integrate cross-cloud data with AWS and GCP services
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer I, Data Infrastructure

Khan Academy is partnering with SafeInsights to provide researchers access to st...
Location
Location
United States , Mountain View
Salary
Salary:
137871.00 - 172339.00 USD / Year
khanacademy.org Logo
Khan Academy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering within a production environment
  • Experience with Google infrastructure services and data services particularly GCS & Big Query
  • Advanced knowledge of Python
  • Strong SQL skills
  • Demonstrated proficiency with Docker and Kubernetes
  • Experience with Airflow
  • Background in applied math, statistics, economics, or a related technical field
  • Motivated by the Khan Academy mission “to provide a free world-class education for anyone, anywhere"
  • Proven cross-cultural competency skills demonstrating self-awareness, awareness of other, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization.
Job Responsibility
Job Responsibility
  • Collaborate with our Data Insights Group to understand the desired end data product and the overall projects goals
  • Collaborate with our data architect and Data Infrastructure team to understand available data source and tooling
  • Propose tooling and processes that will work with extant Khan Academy systems to meet the projects goals
  • Build test and refine these tools and processes
  • Deliver the SafeInsights container and associated project deliverables
  • Provide documentation and training required to maintain and enhance the above
What we offer
What we offer
  • Competitive salaries
  • Ample paid time off as needed
  • Remote-first culture
  • Generous parental leave
  • An exceptional team
  • The chance to put your talents towards a deeply meaningful mission
  • Opportunities to connect through affinity, ally, and social groups
  • 401(k) + 4% matching
  • Comprehensive insurance, including medical, dental, vision, and life
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

(Locals or Nearby resources only). You will work with technologies that include ...
Location
Location
United States , Glendale
Salary
Salary:
Not provided
enormousenterprise.com Logo
Enormous Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of data engineering experience developing large data pipelines
  • Proficiency in at least one major programming language (e.g. Python, Java, Scala)
  • Hands-on production environment experience with distributed processing systems such as Spark
  • Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, Big Query)
  • Experience in developing APIs with GraphQL
  • Advance understanding of OLTP vs OLAP environments
  • Candidates must work W2, no Corp 2 Corp
  • US Citizen, Green Card Holder, H4-EAD, TN-Visa
  • Airflow
Job Responsibility
Job Responsibility
  • Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines
  • Build and maintain APIs to expose data to downstream applications
  • Develop real-time streaming data pipelines
  • Collaborate with product managers, architects, and other engineers to drive the success of the Core Data platform
  • Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and more
  • Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)
What we offer
What we offer
  • 3 levels of medical insurance for you and your family
  • Dental insurance for you and your family
  • 401k
  • Overtime
  • Sick leave policy: accrue 1 hour for every 30 hours worked up to 48 hours
Read More
Arrow Right

Sr. Data Engineer

We are looking for a Sr. Data Engineer to join our growing Quality Engineering t...
Location
Location
Salary
Salary:
Not provided
dataideology.com Logo
Data Ideology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Systems, or a related field (or equivalent experience)
  • 5+ years of experience in data engineering, data warehousing, or data architecture
  • Expert-level experience with Snowflake, including data modeling, performance tuning, security, and migration from legacy platforms
  • Hands-on experience with Azure Data Factory (ADF) for building, orchestrating, and optimizing data pipelines
  • Strong experience with Informatica (PowerCenter and/or IICS) for ETL/ELT development, workflow management, and performance optimization
  • Deep knowledge of data modeling techniques (dimensional, tabular, and modern cloud-native patterns)
  • Proven ability to translate business requirements into scalable, high-performance data solutions
  • Experience designing and supporting end-to-end data pipelines across cloud and hybrid architectures
  • Strong proficiency in SQL and experience optimizing large-scale analytic workloads
  • Experience working within SDLC frameworks, CI/CD practices, and version control
Job Responsibility
Job Responsibility
  • Ability to collect and understand business requirements and translate those requirements into data models, integration strategies, and implementation plans
  • Lead modernization and migration initiatives to move clients from legacy systems into Snowflake, ensuring functionality, performance and data integrity
  • Ability to work within the SDLC framework in multiple environments and understand the complexities and dependencies of the data warehouse
  • Optimize and troubleshoot ETL/ELT workflows, applying best practices for scheduling, orchestration, and performance tuning
  • Maintain documentation, architecture diagrams, and migration plans to support knowledge transfer and project tracking
What we offer
What we offer
  • PTO Policy
  • Eligibility for Health Benefits
  • Retirement Plan
  • Work from Home
  • Fulltime
Read More
Arrow Right

Sr. Data Engineer - Snowflake

Data Ideology is seeking a Sr. Snowflake Data Engineer to join our growing team ...
Location
Location
Salary
Salary:
Not provided
dataideology.com Logo
Data Ideology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in data engineering, data warehousing, or data architecture
  • 3+ years of hands-on Snowflake experience (performance tuning, data sharing, Snowpark, Snowpipe, etc.)
  • Strong SQL and Python skills, with production experience using dbt
  • Familiarity with cloud platforms (AWS, Azure, or GCP) and modern data tooling (Airflow, Fivetran, Power BI, Looker, Informatica, etc.)
  • Prior experience in a consulting or client-facing delivery role
  • Excellent communication skills, with the ability to collaborate across technical and business stakeholders
  • SnowPro Core Certification required (or willingness to obtain upon hire)
  • advanced Snowflake certifications preferred
Job Responsibility
Job Responsibility
  • Design and build scalable, secure, and cost-effective data solutions in Snowflake
  • Develop and optimize data pipelines using tools such as dbt, Python, CloverDX, and cloud-native services
  • Participate in discovery sessions with clients to gather requirements and translate them into solution designs and project plans
  • Collaborate with engagement managers and account teams to help scope work and provide technical input for Statements of Work (SOWs)
  • Serve as a Snowflake subject matter expert, guiding best practices in performance tuning, cost optimization, access control, and workload management
  • Lead modernization and migration initiatives to move clients from legacy systems into Snowflake
  • Integrate Snowflake with BI tools, governance platforms, and AI/ML frameworks
  • Contribute to internal accelerators, frameworks, and proofs of concept
  • Mentor junior engineers and support knowledge sharing across the team
What we offer
What we offer
  • Flexible Time Off Policy
  • Eligibility for Health Benefits
  • Retirement Plan with Company Match
  • Training and Certification Reimbursement
  • Utilization Based Incentive Program
  • Commission Incentive Program
  • Referral Bonuses
  • Work from Home
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Poland Jobs Germany Jobs Ireland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy