CrawlJobs Logo
Amgen Logo Amgen · IT - Software Development

Data Engineer

India, Hyderabad · Job Posted June 09, 2026
Apply Position
Job Link Share

Job Description

We are looking for a highly motivated expert Data Engineer to design and develop advanced data pipelines and solutions for our Manufacturing Applications Product Team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics for Manufacturing and Operations use cases. This role requires deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management.

Job Responsibility

  • Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets
  • Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains
  • Design and implement solutions to enable unified data access, governance, and interoperability across hybrid cloud environments
  • Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms
  • Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring
  • Innovate, explore, and implement new tools and technologies to enhance efficient data processing
  • Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
  • Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value
  • Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories
  • Support continuous improvement, test automation, and DevOps practices in the data engineering lifecycle
  • Collaborate and communicate effectively with product teams and cross-functional teams to understand business requirements and translate them into technical solutions

Requirements

  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration and performance tuning on big data processing
  • Strong understanding of AWS services
  • Ability to quickly learn, adapt, and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Experience with streaming technologies such as Apache Kafka, Debezium, or similar platforms for real-time data processing and integration
  • Master’s /Bachelor’s degree and 5-8 years of Computer Science, IT, or related field experience

Nice to have

  • Experience with AI assisted code development using tools like GitHub Copilot, Cursor, Claude Code
  • Data engineering experience in biotechnology or pharma industry
  • Experience in writing APIs to make data available to consumers
  • Experience with SQL/NoSQL databases, vector databases for large language models
  • Experience with data modeling and performance tuning for both OLAP and OLTP databases
  • Experience with software engineering best practices, including version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven, etc.), automated unit testing, and DevOps
  • Experience with manufacturing related data sources like SCADA, Data Historians is a plus
Amgen - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

We are looking for a skilled Data Engineer to join our team on a long-term contr...
Location
Location
United States , New York
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in implementing and managing Snowflake and Palantir platforms
  • Strong proficiency in programming languages such as Python for data manipulation and analysis
  • Expertise in working with Apache Spark, Hadoop, and Kafka for large-scale data processing
  • In-depth knowledge of ETL processes and tools to handle complex data workflows
  • Familiarity with building and optimizing data pipelines and architectures
  • Ability to troubleshoot and resolve data system issues in a timely manner
  • Excellent problem-solving skills and attention to detail
  • Strong communication skills to collaborate effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data pipelines to support efficient data integration and processing
  • Implement and manage Snowflake-based data repositories to centralize and secure organizational data
  • Utilize Palantir to standardize and analyze data across multiple divisions, ensuring consistency and accuracy
  • Develop ETL processes to extract, transform, and load data from various sources into centralized systems
  • Collaborate with stakeholders to define data requirements and optimize system performance
  • Leverage tools like Apache Spark, Hadoop, and Kafka to build scalable data solutions
  • Monitor and troubleshoot data systems to ensure reliability and address any issues promptly
  • Deploy advanced analytics and AI models to drive operational efficiencies
  • Document processes and provide technical support to ensure smooth implementation and usage of data systems
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Read More
Arrow Right

Data Engineer

As a Data Engineer, you will take ownership of major parts of our data platform ...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
lensa.com Logo
Lensa
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience in data engineering or a related field
  • Strong programming skills in Python and SQL (CTEs, window functions, complex joins, stored procedures)
  • Experience building batch and real-time data pipelines with Spark, Flink or similar frameworks
  • Solid understanding of ETL/ELT workflows, CI/CD pipelines, and production-grade deployment practices
  • Strong knowledge of data modeling, Redshift or similar MPP data warehouses, and distributed systems
  • Experience with AWS or other cloud provider services (EC2, Lambda, Step Functions, Glue, Redshift, S3)
  • Ability to operate independently, solve complex problems, and make sound technical decisions
  • Excellent communication skills and ability to work with both technical and non-technical stakeholders
  • Solid communication skills in English
Job Responsibility
Job Responsibility
  • Design data structures, batch and streaming pipelines, and processes for large-scale analytics and machine learning
  • Design, optimize and implement robust ETL/ELT workflows to feed Data Warehouse (Redshift) and other analytical layers for reporting, analytics, and operational use cases
  • Maintain, improve, and troubleshoot production pipelines, ensuring high reliability and performance
  • Own the architecture and development of core data systems end-to-end
  • Mentor Mid-Level and Junior Engineers and provide guidance on best practices, workflow standards, and troubleshooting
  • Collaborate closely with Data Scientists, Product, and Engineering teams to translate business requirements into scalable data solutions
  • Document systems, pipelines, and architecture
  • maintain runbooks and operational guides
  • Identify technical risks, propose solutions, and drive improvements in platform design, reliability, and performance
  • Participate in code reviews, provide technical mentorship, and help establish best practices
What we offer
What we offer
  • Flexible working hours with home office opportunity
  • Medicover health insurance
  • Company lunch every day in the office
  • In-house gym in the office
  • Exciting programs and team-building events
  • Recreation room with darts, ping pong, foosball, XBox, and other games
  • Modern and fancy office in Buda close to Széll Kálmán tér
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Microsoft’s mission is to empower every person and every organization on the pla...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Formulate business problems and translate them into actionable data science projects
  • Explore, analyze, and centralize data to supply meaningful insights and create a single version of the truth
  • Design, prototype, implement, and test descriptive, predictive, forecasting, and causal inference models
  • Identify and action IT operations return to capacity success improvement
  • perform defect analysis, quantify opportunities, and set targets
  • Partner and collaborate with teams to identify opportunities for machine learning and predictive analysis
  • Build and deploy visualizations that deliver insights to decision-makers at all organizational levels
  • Communicate effectively with technical and non-technical audiences, contributing modeling expertise as a team player
  • Influence across disciplines to ensure data-driven decisions and solve critical problems for customers
  • Mentor others and foster a culture of continuous learning
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer to design and build scalable data pipelines and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in cloud environments (AWS and/or Azure)
  • Hands‑on experience with Databricks, Apache Spark, and Delta Lake
  • Strong skills in Python / PySpark and SQL
  • Experience with data pipelines, ETL/ELT, and data modeling
  • Familiarity with orchestration tools (Airflow or similar) and modern data architectures
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services
  • Develop and optimize ETL/ELT workflows for batch and streaming data across AWS and Azure environments
  • Build and manage data models, data lakes, and warehousing solutions for analytics and AI use cases
  • Ensure data quality, reliability, and governance across the data lifecycle
  • Collaborate with data science, analytics, and platform teams to deliver data solutions
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to join a real estate and property organizati...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Microsoft Fabric and/or Azure Data Factory, including building and optimizing pipelines
  • Proven background working with Azure data services and cloud-based data architecture
  • Advanced experience with data modeling, complex querying, and performance tuning in enterprise data platforms
  • Solid programming skills in Python, Java, Scala, or a comparable language used in data engineering
  • Experience with ETL development, relational databases, and data warehousing concepts
  • Familiarity with technologies such as Apache Spark, Hadoop, or Kafka in support of large-scale data processing
  • Ability to work effectively as an individual contributor in a lean team environment with high accountability
  • Exposure to Power BI or Tableau, along with the ability to align technical solutions with business needs
Job Responsibility
Job Responsibility
  • Design, build, and enhance end-to-end data pipelines using Microsoft Fabric and/or Azure Data Factory for production use
  • Manage and improve the data environment with a strong ownership mindset, ensuring performance, reliability, and maintainability
  • Integrate data from varied sources such as APIs, databases, and flat files into structured, usable datasets
  • Develop data models and schema designs that support reporting, analytics, and downstream business needs
  • Monitor data quality and implement validation checks, troubleshooting issues through root cause analysis and continuous optimization
  • Create scalable cloud-based data solutions within Azure that support long-term operational and analytical goals
  • Partner with cross-functional stakeholders to translate business questions into practical data engineering solutions
  • Contribute to orchestration, automation, and ongoing support of data workflows using modern engineering tools and programming languages
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Data Engineer

We’re on the lookout for a Data Engineer to join us on a 12-month fixed-term con...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
45000.00 GBP / Year
microlise.com Logo
Microlise
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Strong experience building SQL-based pipelines and transformations
  • Solid understanding of data modelling and structured datasets
  • Experience working with data quality, governance, or metadata concepts
  • A collaborative mindset with the ability to translate business needs into data solutions
  • Someone who thrives in a fast-paced, delivery-focused environment
Job Responsibility
Job Responsibility
  • Build and maintain robust data pipelines and transformations
  • Create curated, analytics-ready datasets aligned to business logic
  • Translate business requirements into data structures and reusable models
  • Apply and monitor data quality checks and validation rules
  • Support data governance, metadata and lineage standards
  • Collaborate with stakeholders to understand data usage and requirements
  • Deliver datasets that directly support Analytics & AI teams
What we offer
What we offer
  • 37.5 hour week with flexible working opportunities
  • Access to our salary sacrifice EV Car Scheme
  • Private medical insurance with Vitality Health including rewards
  • 25 days holiday, excluding bank holidays, increasing with service
  • Invested in employee health and well-being with over 20 mental health first aiders
  • Employee Assistance Programmes
  • Free Costco membership, 20% off EE mobile and line rental, and other local discounts
  • Great staff extras: Easter eggs, yearly BBQ, Christmas gifts and annual staff awards
  • Free Microlise Cresswell Racing Tickets
  • Executive Box at Motorpoint Arena Nottingham
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a growing financial services organiza...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-8 years of experience in data engineering or a closely related field
  • Strong hands-on background in building and supporting ETL or data pipeline solutions
  • Proven experience working with Snowflake in a production environment
  • Proficiency in Python for scripting, automation, and data processing tasks
  • Familiarity with modern cloud platforms
  • Experience with data ingestion technologies such as Fivetran or similar platforms
  • Ability to work through imperfect or incomplete data while communicating clearly with technical and business partners
Job Responsibility
Job Responsibility
  • Design and support data workflows that collect, refine, and deliver information across a contemporary cloud ecosystem
  • Develop and enhance scalable data pipelines using Python and automated ingestion platforms such as Fivetran or comparable tools
  • Model and transform datasets within Snowflake to enable reliable analytics and downstream business intelligence reporting
  • Collaborate closely with the data architect to expand and improve the organization’s overall data infrastructure
  • Contribute to reporting readiness by preparing curated datasets for visualization tools including Power BI and Sigma
  • Monitor pipeline performance and resolve data issues to maintain accuracy, consistency, and dependable delivery
  • Assess emerging technologies and recommend practical additions to the data stack as business needs evolve
  • Work effectively in a fast-paced team environment where priorities can shift and new tooling may be introduced regularly
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Data Engineer

We are seeking experienced Data Engineers to join our team. This role is focused...
Location
Location
United States , Tampa
Salary
Salary:
60.00 - 70.00 USD / Hour
apexsystems.com Logo
Apex Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in SQL, T-SQL, stored procedures, and complex transformation logic
  • Proven experience with ETL processes and data modeling
  • Proficiency with the Snowflake platform, including an understanding of SnowSQL, tasks, streams, and stored procedures
  • Experience with Python for data-related tasks
  • Familiarity with GitLab for code management
  • Strong analytical background and problem-solving skills
  • Experience with Jira
Job Responsibility
Job Responsibility
  • Develop and maintain ETL processes for Snowflake data warehousing
  • Write data transformation processes that align with Snowflake fact and dimensions, including slowly-changing dimensions
  • Rework SSIS packages into Snowflake and support the migration of approximately 300 reports
  • Utilize Python for tasks such as zipping and encrypting locally stored files
  • Use GitLab to manage code through development, testing, and production environments
  • Optimize data warehousing concepts for reporting capabilities within the Snowflake platform
  • Gather requirements and collaborate with business teams to create documentation
  • Perform SQL performance tuning and manage complex transformation logic
What we offer
What we offer
  • Medical, dental, vision, life, disability, and other insurance plans
  • Employee stock purchase program (ESPP)
  • 401K program with company match after 12 months of tenure
  • Health Savings Account (HSA) on the HDHP plan
  • SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions
  • Corporate discount savings program and other discounts
  • On-demand training program
  • Access to certification prep and library of technical and leadership courses/books/seminars once you have 6+ months of tenure
  • Certification discounts and other perks to associations that include CompTIA and IIBA
  • Dedicated customer service team for Consultants
  • Fulltime
Read More
Arrow Right