CrawlJobs Logo

Sr. Associate Data Engineer

India, Hyderabad · Job Posted May 05, 2026
Apply Position
Job Link Share

Job Description

As part of the cybersecurity organization, the Data Engineer is responsible for designing, building, and maintaining data infrastructure to support data-driven decision-making. This role involves working with large datasets, developing reports, executing data governance initiatives, and ensuring data is accessible, reliable, and efficiently managed. The role sits at the intersection of data infrastructure and business insight delivery, requiring the Data Engineer to design and build robust data pipelines while also translating data into meaningful visualizations for stakeholders across the organization. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture, ETL processes, and cybersecurity data frameworks.

Job Responsibility

  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Develop and maintain interactive dashboards and reports using tools like Tableau, ensuring data accuracy and usability
  • Schedule and manage workflows the ensure pipelines run on schedule and are monitored for failures
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate and communicate effectively with product teams
  • Collaborate with data scientists to develop pipelines that meet dynamic business needs
  • Share and discuss findings with team members practicing SAFe Agile delivery model

Requirements

  • Master’s degree OR Bachelor’s degree and 5 to 9 years of Computer Science, IT or related field experience
  • Hands on experience with data practices, technologies, and platforms, such as Databricks, Python, Gitlab, LucidChart, etc.
  • Proficiency in data analysis tools (e.g. SQL) and experience with data sourcing tools
  • Excellent problem-solving skills and the ability to work with large, complex datasets
  • Understanding of data governance frameworks, tools, and best practices
  • Knowledge of and experience with data standards (FAIR) and protection regulations and compliance requirements (e.g., GDPR, CCPA)
  • Experience with ETL tools and various Python packages related to data processing, machine learning model development
  • Strong understanding of data modeling, data warehousing, and data integration concepts
  • Experience with data visualization and dashboarding tools—Tableau, Power BI, or similar is a plus
  • Knowledge of Python/R, Databricks, cloud data platforms
  • Experience working in Product team's environment
  • Experience working in an Agile environment
  • AWS Certified Data Engineer preferred
  • Databricks Certificate preferred
  • Initiative to explore alternate technology and approaches to solving problems
  • Skilled in breaking down problems, documenting problem statements, and estimating efforts
  • Excellent analytical and troubleshooting skills
  • Strong verbal and written communication skills
  • Ability to work effectively with global, virtual teams
  • High degree of initiative and self-motivation
  • Ability to manage multiple priorities successfully
  • Team-oriented, with a focus on achieving team goals

Nice to have

  • Experience with ETL tools and various Python packages related to data processing, machine learning model development
  • Strong understanding of data modeling, data warehousing, and data integration concepts
  • Experience with data visualization and dashboarding tools—Tableau, Power BI, or similar is a plus
  • Knowledge of Python/R, Databricks, cloud data platforms
  • Experience working in Product team's environment
  • Experience working in an Agile environment
  • AWS Certified Data Engineer preferred
  • Databricks Certificate preferred

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Sr. Associate Data Engineer

8 matching positions

Sr. Associate Data Engineer

In this vital role you will be responsible for the development and implementatio...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, or a related field with 5+ years of experience
  • Mastery with at least one programming language (Python, Scala, or similar)
  • Experience with data engineering platforms like Databricks
  • Experience with vibe coding using large language models for production systems
  • Broad interest in various Amgen preferred platforms/tools
  • Eagerness to learn and grow in a data engineering environment
  • Ability to work well within a team and communicate effectively
  • Experienced with data modelling and structuring
  • Experienced working with ETL orchestration technologies
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and DevOps
Job Responsibility
Job Responsibility
  • Design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Deliver for data pipeline projects from development to deployment, managing, timelines, and risks
  • Ensure data quality and integrity through meticulous testing and monitoring
  • Leverage cloud platforms (AWS, Databricks) to build scalable and efficient data solutions
  • Work closely with product team, and key collaborators to understand data requirements
  • Enforce to data engineering industry standards and standards
  • Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies
  • Familiarity with code versioning using GIT and code migration tools
  • Familiarity with JIRA
  • Stay up to date with the latest data technologies and trends
Read More
Arrow Right

Sr. Associate Data Scientist

The Data Scientist is responsible for developing and implementing AI-driven solu...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree OR Bachelor’s degree and 3 to 5 years of experience with one or more analytic software tools or languages (e.g., SAS, SPSS, R, Python)
Job Responsibility
Job Responsibility
  • Develop analytics to address security concerns, enhancements, and capabilities to improve the organization's security posture
  • Collaborate with Data Engineers to translate security-focused algorithms into effective solutions
  • Work in technical teams in development, deployment, and application of applied analytics, predictive analytics, and prescriptive analytics
  • Perform exploratory and targeted data analyses using descriptive statistics and other methods to identify security patterns and anomalies
  • Design and implement security-focused analytics pipelines leveraging MLOps practices, generative AI, and agent-based architectures
  • Collaborate with data engineers on data quality assessment, data cleansing, and the development of security-related data pipelines
  • Contribute to data engineering efforts to refine data infrastructure and ensure scalable, efficient security analytics
  • Generate reports, annotated code, and other project artifacts to document, archive, and communicate your work and outcomes
  • Share and discuss findings with team members practicing SAFe Agile delivery model
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

The Senior Data Engineer plays a critical role in delivering strategic and opera...
Location
Location
United States
Salary
Salary:
120000.00 - 160000.00 USD / Year
personifyhealth.com Logo
Personify Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least one AWS certification (e.g., AWS Certified Data Analytics – Specialty, Big Data – Specialty, Developer – Associate)
  • 7+ years in data engineering or analytics engineering, with a strong focus on cloud-native architectures. Proven experience designing and operating scalable data platforms in AWS
  • 5+ years in healthcare, insurance, or claims processing, including 5+ years working with EDI (834, 835, 837, 2222, 2223, 999), X12 file standards or HL7 standards and familiarity with HIPAA and CMS compliance
  • Expert-level proficiency in SQL (including pivots, window functions, and complex date calculations) and Python for data processing, transformation, and application development
  • Hands-on experience with orchestration tools like Airflow, containerization with Docker, and CI/CD pipelines. Strong bias for automation and continuous improvement
  • Proficient in consuming and transforming REST APIs and JSON data into relational models. Skilled in building robust data ingestion and transformation pipelines
  • Experience with JIRA, BitBucket Git, BitBucket Pipelines, and collaboration with cross-functional teams including Data Analysts, Data Scientists, Product, and Account Management
  • Proficient in Excel and BI tools such as Tableau, Power BI, and MicroStrategy for data analysis and reporting
  • Detail-oriented with a strong focus on data quality, accuracy, and performance tuning for large-scale data systems. Background in cost optimization and system reliability
  • Ability to mentor engineers, share technical knowledge, and communicate effectively with both technical and non-technical stakeholders. Strong documentation and systems thinking
Job Responsibility
Job Responsibility
  • Build data applications and processes using Python, SQL, and Django
  • manage and query data in PostgreSQL, Oracle, and cloud-native databases
  • Examine, extract, cleanse, and load data while implementing quality assurance rules and tools to ensure consistent and accurate data
  • Work with healthcare-specific data processes such as EDI file transfers, claims adjudication, audits, eligibility verification, and reporting workflows
  • Collaborate with cross-functional teams (Data Analysts, Data Scientists, Product, Reporting, Account Management) to define requirements and deliver data-driven solutions
  • Ensure data quality, integrity, and security through automated validation, auditing, and monitoring, with compliance to HIPAA and CMS regulations
  • Monitor, maintain, and tune pipeline performance
  • proactively troubleshoot and resolve complex data flow and system issues
  • Provide technical mentorship to Data Engineers, sharing expertise in data modeling, pipeline development, and troubleshooting practices
  • Research and propose improvements to the tech stack and data engineering processes
What we offer
What we offer
  • Competitive base salary and benefits effective day one
  • Comprehensive medical and dental through our own health solutions (yes, we use what we build)
  • Unlimited PTO—rest and recharge time is non-negotiable
  • Mental health support, retirement planning, and financial protection
  • Professional development with clear career progression and learning budgets
  • Mission-driven culture where diverse perspectives drive real impact on people's health
  • Fulltime
Read More
Arrow Right
New

Sr Associate Software Engineer

Amgen is seeking a Sr. Associate Software Developer to contribute to the design,...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree and 1 to 3 years of Computer Science, IT or related field experience OR Bachelor’s degree and 3 to 5 years of Computer Science, IT or related field experience OR Diploma and 7 to 9 years of Computer Science, IT or related field experience
  • Hands on experience with various cloud services, understand pros and cons of various cloud services in well architected cloud design principles
  • Hands on experience with Full Stack software development. Proficient in programming language Python(preferred), JavaScript,React.js/Node.js/Express.js SQL/NoSQL
  • Strong problem solving, analytical skills
  • Ability to learn quickly
  • Excellent communication and interpersonal skills
  • Experienced with API integration, serverless, microservices architecture.
Job Responsibility
Job Responsibility
  • End-to-End Ownership: Take ownership of complex software projects from conception to deployment, managing scope, risks, and timelines
  • Front-End Development: Design and implement responsive, accessible, and visually appealing user interfaces using HTML, CSS, JavaScript, and modern frameworks (React.js, Angular, or Vue.js)
  • Back-End Development: Build and optimize scalable server-side logic and APIs using Node.js, Express.js, or Python, ensuring secure integration with databases and microservices
  • Database Design & Management: Design, develop, and maintain SQL/NoSQL databases, focusing on security, performance, and reliability
  • API Development: Create RESTful or GraphQL APIs for communication between front-end, back-end, and external systems
  • Cross-Browser & Cross-Platform Compatibility: Ensure applications run seamlessly across multiple browsers, devices, and platforms
  • Generative AI & Innovation: Develop innovative solutions leveraging generative AI technologies to enhance applications and workflows
  • Cloud Deployment & Management: Deploy, manage, and scale applications on cloud platforms (AWS, Azure, GCP)
  • apply DevOps and CI/CD best practices
  • Software Architecture & Documentation: Design software architecture and produce technical documentation on system design, deployment, integration, disaster recovery, and operations
  • Fulltime
Read More
Arrow Right

Sr Associate Software Engineer - Full Stack

Amgen is seeking a Sr Software Engineer - Full Stack to design, develop, and sup...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s / Bachelor’s degree with 5 - 8 years of experience in Computer Science, IT or related field
  • Strong hands-on experience developing full-stack applications using React.js, Next.js, Node.js, Typescript, Javascript
  • Strong experience building scalable RESTful APIs and backend services
  • Hands-on experience building Retrieval-Augmented Generation (RAG) pipelines and integrating vector databases
  • Understanding of AI agent architectures, orchestration frameworks, and context-aware AI systems
  • Experience integrating AI capabilities into web applications, APIs, and enterprise workflows
  • Experience with AWS cloud data platforms
  • Certified AWS Professional or Associate certification (Required)
  • Excellent critical-thinking and problem-solving skills
  • Strong communication and collaboration skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable full-stack web applications using React.js, Next.js, Node.js, Typescript
  • Build responsive, mobile-first, and user-centric interfaces that support enterprise Insights and Field Intelligence use cases
  • Develop reusable UI components, application frameworks, and shared libraries following modern front-end engineering best practices
  • Design and develop secure and scalable backend services, APIs, and microservices using Node.js and REST/GraphQL architectures
  • Implement server-side rendering (SSR), static site generation (SSG), and modern web optimization techniques using Next.js
  • Ensure application scalability, performance optimization, accessibility, and cross-browser compatibility
  • Design and develop AI-enabled applications leveraging Large Language Models (LLMs) such as OpenAI models and enterprise AI services
  • Develop Retrieval-Augmented Generation (RAG) solutions using vector databases and enterprise knowledge sources
  • Design and implement AI agent workflows and orchestration frameworks to automate business processes and insight generation
  • Integrate AI capabilities into enterprise web applications, APIs, and workflows for real-time intelligence and automation
  • Fulltime
Read More
Arrow Right

Sr Associate Software Engineer

Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree with 5 - 9 years of experience in Computer Science, IT or related field
  • Strong knowledge of information systems and network technologies
  • 5+ years of hands on experience developing SFMC applications
  • 5+ years of experience integrating Salesforce.com with other applications
  • Strong understanding of Agile, Scrum, Design Thinking, and Lean Startup principles
Job Responsibility
Job Responsibility
  • Take ownership of complex software projects from conception to deployment
  • Manage software delivery scope, risk, and timeline
  • Possesses strong rapid prototyping skills and can quickly translate concepts into working code
  • Contribute to both front-end and back-end development using cloud technology
  • Develop innovative solution using generative AI technologies
  • Conduct code reviews to ensure code quality and adherence to best practices
  • Create and maintain documentation on software architecture, design, deployment, disaster recovery, and operations
  • Identify and resolve technical challenges effectively
  • Stay updated with the latest trends and advancements
  • Work closely with product team, business team, and other stakeholders
  • Fulltime
Read More
Arrow Right

Sr Associate Software Engineer

Sr Associate Software Engineer, Manufacturing Data & Analytics. What you will do...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Any degree and 5 to 9 years of Computer Science, IT or related field experience
  • Solid understanding and experience in cloud computing principles, particularly within the AWS ecosystem, understand pros and cons of various services in well architected cloud design principles
  • Knowledge of HTML, CSS, and JavaScript, along with popular front-end frameworks like React (preferred) or Angular, is required to build interactive and responsive web applications
  • Proficiency in Python/PySpark development, Fast API, Databricks, DevOps Tools, CI/CD, Data Ingestion
  • In-depth knowledge of data engineering concepts, ETL processes, and data architecture principles
  • Experienced with API integration, serverless, microservices architecture
  • Candidates should be able to write clean, efficient, and maintainable code
  • Experience with software engineering best practices, including version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven, etc.), automated unit testing, and DevOps
  • Ability to quickly learn, adapt, and apply new technologies
  • Strong problem-solving and analytical skills
Job Responsibility
Job Responsibility
  • Designing, developing, and maintaining software applications and solutions that meet business needs and ensuring the availability and performance of critical systems and applications
  • Working closely with product owners, designers, data engineers, and other engineers to create high-quality, scalable software solutions and automating operations, monitoring system health, and responding to incidents to minimize downtime
  • Contributing to both front-end and back-end development using cloud technology
  • Developing innovative solution using generative AI technologies
  • Ensuring code quality and consistency to standard methodologies
  • Creating and maintaining documentation on software architecture, design, deployment, disaster recovery, and operations
  • Identifying and resolving technical challenges effectively
  • Working closely with product team, business team, and other collaborators
  • Designing, developing, and implementing applications and modules, including custom reports, interfaces, and enhancements
  • Analyzing and understanding the functional and technical requirements of applications, solutions and systems and translating them into software architecture and design specifications
  • Fulltime
Read More
Arrow Right

Sr Associate Software Engineer

Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s/Bachelor’s degree and 4 to 8 years of Computer Science, IT or related field experience
  • Bachelor’s or master’s degree in computer science, Data Science, or a related field
  • Hands on experience with big data technologies and platforms, such as Databricks, REST APIs, Bulk APIs, Apache Spark (PySpark, SparkSQL), python for workflow orchestration, performance tuning on big data processing
  • Proficiency in data analysis tools (eg. SQL)
  • Proficient in SQL for extracting, transforming, and analyzing complex datasets from relational data stores
  • Strong programming skills in Python, PySpark, and SQL
  • Familiarity with Informatica and/or other ETL tools
  • Experience working with cloud data services (Azure, AWS, or GCP)
  • Strong understanding of data modeling, entity relationships
  • Excellent problem-solving and analytical skills
Job Responsibility
Job Responsibility
  • Build Rest APIs, Bulk APIs, SOAP APIs to integrate different systems
  • Strong experience with designing schema and writing postgresSQL queries and SQL queries in general
  • Solid understanding of AWS Lambda, S3 bucket upload, EMR and EC2
  • Understanding of Object model in Salesforce applications
  • Design, develop, and optimize data pipelines/workflows using Databricks (Spark, Delta Lake) for ingestion, transformation, and processing of large-scale data
  • Build ETL pipeline with Informatica or other ETL tools
  • Support data governance and metadata management
  • Experience using static code scan tools
  • Collaborate with Data Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines to meet fast paced business needs across geographic regions
  • Identify and resolve complex challenges
  • Fulltime
Read More
Arrow Right