CrawlJobs Logo
Amgen Logo Amgen · IT - Software Development

Sr Data Engineer

India, Hyderabad · Job Posted June 09, 2026
Apply Position
Job Link Share

Job Description

Designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. Working with large datasets, developing reports, supporting and executing data governance initiatives and visualizing data to ensure data is accessible, reliable, and efficiently managed.

Job Responsibility

  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate and communicate effectively with product teams
  • Collaborate with Data Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines to meet fast-paced business needs across geographic regions
  • Identify and resolve complex data-related challenges
  • Adhere to best practices for coding, testing, and designing reusable code/component
  • Explore new tools and technologies that will help to improve ETL platform performance
  • Participate in sprint planning meetings and provide estimations on technical implementation
  • Design and develop data pipelines leveraging Databricks, PySpark, and SQL to ingest, transform, and process large-scale datasets
  • Engineer solutions for both structured and unstructured data to enable advanced analytics and insights
  • Implement automated workflows for data ingestion, transformation, and deployment using Databricks Jobs and notebooks, with ongoing monitoring and scheduling
  • Apply performance optimization techniques, including Spark job tuning, caching, partitioning, and indexing, to improve scalability and efficiency
  • Build integrations with multiple data sources, such as SQL databases, APIs, and cloud storage platforms, ensuring seamless connectivity and reliability
  • Collaborate effectively with global teams across time zones to maintain alignment, resolve issues, and deliver on shared objectives

Requirements

  • Bachelor’s / Master’s degree and 8 to 13 years of Computer Science, IT or related field experience
  • Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing
  • Proficiency in data analysis tools (e.g. SQL) and experience with data visualization tools
  • Excellent problem-solving skills and the ability to work with large, complex datasets
  • Strong understanding of data governance frameworks, tools, and best practices
  • Excellent critical-thinking and problem-solving skills
  • Strong communication and collaboration skills
  • Demonstrated awareness of how to function in a team setting
  • Demonstrated presentation skills

Nice to have

  • Knowledge of data protection regulations and compliance requirements (e.g., GDPR, CCPA) processing
  • Experience with ETL tools such as Apache Spark, and various Python packages related to data processing, machine learning model development
  • Strong understanding of data modeling, data warehousing, and data integration concepts
  • Knowledge of Python/R, Databricks, SageMaker, cloud data platforms
  • Experience implementing automated orchestration and monitoring of data pipelines using Databricks Jobs, Apache Airflow, or similar workflow tools
  • Familiarity with performance optimization techniques for big data processing, such as Spark job tuning, caching, partitioning, and indexing
  • Exposure to multi-source integration involving APIs, SQL databases, and cloud storage platforms
  • Demonstrated ability to collaborate across global teams and time zones, ensuring alignment and delivery in distributed environments
Amgen - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Sr Data Engineer

8 matching positions

Sr Data Engineer

We’re seeking a Data Engineer with strong Databricks and Azure experience.
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Databricks + Spark
  • Azure Data Factory or similar
  • SQL and Python
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines
  • Work with large-scale data processing frameworks
  • Optimize data flows and storage solutions
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Company 401(k) plan
  • Free online training
Read More
Arrow Right

Sr Data Engineer

The purpose of the Data Engineer position is to leverage their technical experti...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 03, 2026
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Data Science, Information Technology, or a related field with a focus on data engineering or data analytics
  • Strong proficiency in programming languages such as Python, SQL, Java, or Scala for data processing and analysis
  • Experience with data modeling, ETL processes, data warehousing, data integration, and data pipeline development
  • Proficiency in relational databases (e.g., SQL, PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra)
  • Working knowledge of cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform for data storage and processing
  • Experience with data visualization tools (e.g., Power BI) to create meaningful insights from data
  • Understanding of data quality principles, data governance, and data validation processes
  • Ability to analyze complex data sets, identify trends, patterns, and insights to drive data-driven decision-making
  • Proficiency in troubleshooting data-related issues, identifying root causes, and implementing solutions
  • Familiarity with project management methodologies to contribute effectively to project planning and execution
Job Responsibility
Job Responsibility
  • Build pipelines using standard patterns for data pipelines and workflows utilizing Streamsets, Kestra, dbt, Git
  • Design and Implement data storage and processing solutions employing Snowflake
  • Utilize AWS services for cloud-based platform tooling infrastructure including but not limited to Lambda,ECS,MSK,RDS,EC2, Secrets Manager, ALB, Cloud Watch, Event Bridge
  • Utilize Terraform for AWS and Azure deployments
  • Leverage and integrate APIs for data access and manipulation
  • Write Python scripts for data common processing and automation tasks
  • Leverage Platform API’s and Web Applications to enforce Platform Security
  • Create and execute comprehensive test plans to ensure the pipelines functionality and performance
  • Develop unit tests, integration tests, and end-to-end tests for data pipelines and workflows
  • Ensure data accuracy and consistency through rigorous testing processes
What we offer
What we offer
  • Commitment to your ongoing development, including on the job opportunities and formal programs
  • Inclusive parental leave entitlements for both parents
  • Values led culture
  • Flexible work options
  • Generous annual leave, sick leave and casual leave
  • Cultural and religious leave with flexible public holiday opportunities
  • A competitive remuneration package featuring performance based incentives with uncapped Employer Provident Fund
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

Roku is changing how the world watches TV. Roku is the #1 TV streaming platform ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive SQL Skills
  • Proficiency in at least one scripting language, Python is required
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Proficiency in data modeling, including designing, implementing, and optimizing conceptual, logical, and physical data models to support scalable and efficient data architectures
  • 8+ years professional experience as a data Engineer
  • BS in Computer Science
  • AI Literacy / AI growth mindset
Job Responsibility
Job Responsibility
  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 10s of terabytes of data ingested every day and petabyte-sized data warehouse
  • Build quality data solutions and refine existing diverse datasets to simplified data models encouraging self-service
  • Build data pipelines that optimise on data quality and are resilient to poor quality data sources
  • Own the data mapping, business logic, transformations and data quality
  • Low level systems debugging, performance measurement & optimization on large production clusters
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Employees are supported in taking time off, in accordance with local leave policies and other personal needs to support their evolving work and life needs
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

The Senior Data Engineer plays a critical role in delivering strategic and opera...
Location
Location
United States
Salary
Salary:
120000.00 - 160000.00 USD / Year
personifyhealth.com Logo
Personify Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least one AWS certification (e.g., AWS Certified Data Analytics – Specialty, Big Data – Specialty, Developer – Associate)
  • 7+ years in data engineering or analytics engineering, with a strong focus on cloud-native architectures. Proven experience designing and operating scalable data platforms in AWS
  • 5+ years in healthcare, insurance, or claims processing, including 5+ years working with EDI (834, 835, 837, 2222, 2223, 999), X12 file standards or HL7 standards and familiarity with HIPAA and CMS compliance
  • Expert-level proficiency in SQL (including pivots, window functions, and complex date calculations) and Python for data processing, transformation, and application development
  • Hands-on experience with orchestration tools like Airflow, containerization with Docker, and CI/CD pipelines. Strong bias for automation and continuous improvement
  • Proficient in consuming and transforming REST APIs and JSON data into relational models. Skilled in building robust data ingestion and transformation pipelines
  • Experience with JIRA, BitBucket Git, BitBucket Pipelines, and collaboration with cross-functional teams including Data Analysts, Data Scientists, Product, and Account Management
  • Proficient in Excel and BI tools such as Tableau, Power BI, and MicroStrategy for data analysis and reporting
  • Detail-oriented with a strong focus on data quality, accuracy, and performance tuning for large-scale data systems. Background in cost optimization and system reliability
  • Ability to mentor engineers, share technical knowledge, and communicate effectively with both technical and non-technical stakeholders. Strong documentation and systems thinking
Job Responsibility
Job Responsibility
  • Build data applications and processes using Python, SQL, and Django
  • manage and query data in PostgreSQL, Oracle, and cloud-native databases
  • Examine, extract, cleanse, and load data while implementing quality assurance rules and tools to ensure consistent and accurate data
  • Work with healthcare-specific data processes such as EDI file transfers, claims adjudication, audits, eligibility verification, and reporting workflows
  • Collaborate with cross-functional teams (Data Analysts, Data Scientists, Product, Reporting, Account Management) to define requirements and deliver data-driven solutions
  • Ensure data quality, integrity, and security through automated validation, auditing, and monitoring, with compliance to HIPAA and CMS regulations
  • Monitor, maintain, and tune pipeline performance
  • proactively troubleshoot and resolve complex data flow and system issues
  • Provide technical mentorship to Data Engineers, sharing expertise in data modeling, pipeline development, and troubleshooting practices
  • Research and propose improvements to the tech stack and data engineering processes
What we offer
What we offer
  • Competitive base salary and benefits effective day one
  • Comprehensive medical and dental through our own health solutions (yes, we use what we build)
  • Unlimited PTO—rest and recharge time is non-negotiable
  • Mental health support, retirement planning, and financial protection
  • Professional development with clear career progression and learning budgets
  • Mission-driven culture where diverse perspectives drive real impact on people's health
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

We are looking for a full stack Azure Data Engineer to serve as the primary tech...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
Job Responsibility
Job Responsibility
  • Technology Stack Ownership & Operations
  • Proof-of-Concept Management & Evaluation
  • Data Engineering & Pipeline Development
  • Stakeholder Partnership & Communication
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

The Senior Data Engineer role involves leading data architecture and modernizati...
Location
Location
India , Chennai
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong expertise in Azure and Databricks
  • Focus on data modeling and integration
  • Azure
  • Databricks
  • Data Modeling
  • Team Leadership
  • Client Interviews
  • SQL
Job Responsibility
Job Responsibility
  • Engage heavily with business users across North America and Europe, facilitating workshops and data discovery sessions
  • Drive consensus on business rules, data definitions, and data sources, especially where regional processes differ
  • Serve as the architectural thought leader enabling teams to transition from manual, inconsistent processes to standardized, modernized workflows
  • Partner closely with business analysts, data analysts, product owners, and engineering teams across multiple geographies
  • Architect a unified master stitched data model to replace downstream reliance on Varicent for data assembly
  • Lead the re‑architecture of compensation data processing—including internal and external compensation flows—into a scalable, cloud‑native Azure environment
  • Define patterns, frameworks, and integration strategies across Azure services (Data Factory, Databricks, Data Lake, SQL, etc.)
  • Evaluate and evolve the use of rules engines/ODM/Drools to externalize and modernize embedded business logic currently locked in application code
  • Guide decisions to shift logic and data ownership into enterprise‑owned systems rather than third‑party tools
  • Analyze current‑state processes (38 in NA, 9 in Europe) and identify opportunities for re‑engineering, automation, and consolidation
Read More
Arrow Right

Sr Data Engineer

The mission of Roku's Data Engineering team is to develop a world-class big data...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive SQL Skills
  • Proficiency in at least one scripting language, Python is required
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Proficiency in data modeling, including designing, implementing, and optimizing conceptual, logical, and physical data models to support scalable and efficient data architectures.
  • Experience with AWS, GCP, Looker is a plus
  • Collaborate with cross-functional teams such as developers, analysts, and operations to execute deliverables
  • 8+ years professional experience as a data Engineer
  • BS in Computer Science
  • MS in Computer Science preferred
  • AI Literacy / AI growth mindset
Job Responsibility
Job Responsibility
  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 10s of terabytes of data ingested every day and petabyte-sized data warehouse
  • Build quality data solutions and refine existing diverse datasets to simplified data models encouraging self-service
  • Build data pipelines that optimise on data quality and are resilient to poor quality data sources
  • Own the data mapping, business logic, transformations and data quality
  • Low level systems debugging, performance measurement & optimization on large production clusters
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures
What we offer
What we offer
  • global access to mental health and financial wellness support and resources
  • Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension)
  • vacation and other personal time off
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

We are looking for a highly motivated expert Data Engineer to design and develop...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Any degree and 9 to 12 years of Computer Science, IT or related field experience
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration and performance tuning on big data processing
  • Strong understanding of AWS services
  • Ability to quickly learn, adapt, and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets
  • Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains
  • Design and implement solutions to enable unified data access, governance, and interoperability across hybrid cloud environments
  • Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms
  • Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring
  • Innovate, explore, and implement new tools and technologies to enhance efficient data processing
  • Stay updated with the latest design trends and techniques to ensure the best data engineering
  • Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
  • Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value
  • Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories
What we offer
What we offer
  • Competitive and comprehensive Total Rewards Plans that are aligned with local industry standards
Read More
Arrow Right