CrawlJobs Logo

Senior Associate Software Engineer Databricks Developer

India, Hyderabad · Job Posted April 12, 2026
Apply Position
Job Link Share

Job Description

Amgen is looking for highly motivated expert Senior Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks. The ideal candidate will be responsible for designing, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management.

Job Responsibility

  • Design, develop, and maintain scalable data pipelines using AWS (Redshift, S3, Glue, Lambda) and Databricks (Spark, Delta Lake) to support enterprise analytics and reporting
  • Architect and implement robust data models (dimensional and normalized) to enable high-performance querying and optimized reporting in Redshift
  • Build and optimize batch and real-time data processing frameworks, leveraging Spark Structured Streaming and cloud-native services
  • Lead data ingestion, transformation, and orchestration workflows ensuring data quality, reliability, and performance at scale
  • Perform advanced data analytics and root cause analysis to troubleshoot data discrepancies, performance issues, and pipeline failures
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop and drive continuous improvements in CI/CD pipelines for automated data pipeline deployments, automated testing, version control, and monitoring for data platforms in a cloud-native environment
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement
  • Partner with BI and reporting teams to support report development, dashboard optimization, and data validation for business stakeholders
  • Implement data governance best practices including data lineage, auditing, access controls, and performance tuning
  • Mentor junior engineers and contribute to architectural decisions, code reviews, and engineering standards

Requirements

  • Any degree with 5 - 9 years of experience in Computer Science, IT or related field
  • Strong solution design and problem solving skills
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, Redshift, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • 5 to 9 years of Computer Science, IT or related field experience

Nice to have

  • Good to have deep expertise in Biotech & Pharma industries
  • Experience in writing APIs to make the data available to the consumers
  • Experienced with SQL/NOSQL database, vector database for large language models
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
  • AWS Certified Data Engineer preferred
  • Databricks Certified preferred
  • Scaled Agile SAFe certification preferred

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Associate Software Engineer Databricks Developer

8 matching positions

Senior Associate - RWE Obesity Statistical Programming

Amgen is seeking a dedicated Senior Statistical Programmer to join our Center fo...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Statistics, Mathematics, Life Sciences, Economics or other relevant scientific subject
  • At least four (4) years of relevant statistical programming, systems engineering or application programming experience in a clinical development or life sciences setting
  • Experience in SQL, and statistical programming using SAS or R
Job Responsibility
Job Responsibility
  • Write, test and validate software programs in Unix and Databricks to produce analysis datasets and presentation output such as tables and figures, to be included in reports for submission to regulatory agencies, publications and other communications
  • Provide technical solutions to programming problems within CfOR
  • Lead and develop technical programming and process improvement initiatives within CfOR
  • Represent the programming function and participate in multidisciplinary project team meetings
  • Manage all programming activities, according to agreed resource and timeline plans
  • Ensure all programming activities on the project adhere to departmental standards
  • Write and/or review and approve all programming plans
  • Write and/or review and approve analysis dataset specifications
  • Review and approve key study-related documents produced by other functions, e.g. SAPs, CRF, Data Management Plan, etc.
  • Write, test, validate and execute department-, product- and protocol-level macros and utilities
Read More
Arrow Right

Senior Data Engineer

Join our client in embarking on an ambitious data transformation journey using D...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
Not provided
rullion.co.uk Logo
Rullion
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience of Python preferred, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions
  • Strong understanding of SQL, database design, and data architecture
  • Experience with Databricks and/or Spark
  • Knowledgeable in data governance, data cataloguing, data quality principles, and related tools
  • Skilled in data extraction, joining, and aggregation tasks, especially with big data and real-time data using Spark
  • Capable of performing data cleansing operations to prepare data for analysis, including transforming data into useful formats
  • Understand data storage concepts and logical data structures, such as data warehousing
  • Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed
  • Can make data pipeline design recommendations based on business requirements
  • Open to new ways of working and new technologies
Job Responsibility
Job Responsibility
  • Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change
  • Build and manage an enterprise data model within Databricks
  • Integrate new data sources into the platform using batch and streaming processes, adhering to SLAs
  • Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols
  • Ensure data quality and reliability processes are effective, maintaining trust in the data
  • Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements
  • Able to work closely with stakeholders and managing their requirements
  • Actively coach and mentor others in the team and foster a culture of innovation and peer review within the team to ensure best practice
  • Fulltime
Read More
Arrow Right

Data Modeler

The Data Modeler role requires expertise in developing and maintaining data mode...
Location
Location
India , Remote
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience delivering data models for P&C, Specialty insurance projects with exposure to Lloyd’s/London Market and Syndicate data structures is required
  • Understanding of insurance domain concepts and proficiency with data modelling tools(eg Erwin)
  • Expertise in enterprise data modelling, including conceptual, logical, and physical models for transactional domains
  • Experience in data modelling using Dimensional Star/Snowflake, Data Vault, and 3NF methodologies
  • Knowledge of data warehousing and ETL/ELT pipelines
  • Experience with Azure Data Factory and Databricks, designing data pipelines can be advantageous
  • Understanding and knowledge of system development life cycle methodologies (such as agile software development)
  • Excellent collaboration and communications skills to deal with senior leaders, stakeholders and technical teams is required
  • Flexibility and bringing a curious and creative mindset, open to new things and able to propose innovative idea
  • A minimum of 5 years of experience is required
Job Responsibility
Job Responsibility
  • Develop and maintain data models-Logical and Physical, to support business needs ensuring data integrity for Insurance domains
  • Design models aligned to Databricks medallion architecture by translating the requirements of underwriting, delegated authority, reinsurance, actuarial, claims and finance
  • Implement and maintain modelling standards, naming conventions, metadata and documentation working closely with data analyst, data engineers, and associates in data office
  • Review existing models and propose simplification, standardisation and target state improvements across projects and for wider requirements
  • Lead the evolution of requirements, refine and translate the specifications into data models to enable development phase
  • Ensure the models accurately reflect Insurance processes and data elements before handing it over to engineering
Read More
Arrow Right
New

Primary Teacher

We are currently recruiting on behalf of a highly regarded Primary School locate...
Location
Location
United Kingdom , Stevenage
Salary
Salary:
141.00 - 163.00 GBP / Day
https://www.randstad.com Logo
Randstad
Expiration Date
August 04, 2026
Flip Icon
Requirements
Requirements
  • Qualified Teacher Status (QTS)
  • proven background in a UK primary school setting
  • deep knowledge of primary age-group development milestones, modern assessment practices, and core subject frameworks
  • patient, emotionally resilient, and professional demeanour with strong behavioural management skills
  • commitment to manage a full-time, Monday-to-Friday teaching schedule across the 2026/27 academic year
  • Enhanced Child DBS on the Update Service (or willingness to initiate a new application swiftly via Randstad)
Job Responsibility
Job Responsibility
  • Design and facilitate engaging, differentiated lessons aligned with the National Curriculum frameworks to inspire children across all ability levels
  • Formulate and execute regular formative assessments, using the insights gained to tailor small-group interventions or challenge high-flying pupils
  • Work in close synchronisation with your classroom Teaching Assistants to maximise support for children with SEND or EAL profiles
  • Foster an emotionally safe, highly focused, and respectful classroom environment built upon clear operational routines and positive reinforcement
  • Maintain transparent, encouraging communication with parents and guardians regarding academic breakthroughs and social development
What we offer
What we offer
  • Direct PAYE Earnings: £141 - £163 per day
  • Early Autumn Security: Conclude your current term with your upcoming autumn placement fully locked in and finalized well before the summer holidays start
  • Free Continuous Professional Development: complimentary, unrestricted access to certified CPD learning academy, featuring high-value training in Behaviour Management, Phonics Supports, and Advanced Safeguarding
  • Personalized Agency Advocacy: dedicated education consultant
  • Referral Scheme: £300 retail voucher for successful introduction of another qualified peer
  • Fulltime
Read More
Arrow Right
New

Software Developer

We are an innovation-driven biotech company operating in Australia, the USA, and...
Location
Location
Australia , Perth
Salary
Salary:
Not provided
ozgene.com Logo
Ozgene
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You have a degree in Computer Science, Software Engineering, or a related field, or equivalent experience
  • You have around two or more years building and shipping software in a commercial setting
  • You are confident across front-end and back-end work, including JavaScript, REST APIs, and databases
  • You have hands-on experience with cloud and serverless services, ideally AWS and Azure
  • You can work independently, investigating a problem, deciding on an approach, and delivering it with minimal supervision
  • You are comfortable using AI development tools such as Cursor as part of your daily workflow
  • You bring a security-conscious mindset and are happy to lend a hand with the broader IT environment when needed
  • You communicate clearly and understand that good software solves a business problem, not just a technical one
Job Responsibility
Job Responsibility
  • Build and maintain the web applications that support our scientific and commercial operations
  • Design and build cloud and serverless services on AWS that connect our systems
  • Own features from requirements gathering through design, development, testing, and deployment
  • Investigate and resolve issues across a set of connected systems, understanding how a change in one affects the others
  • Work directly with the people who use the software to understand their needs and turn them into working solutions
  • Use AI-assisted development with Cursor to work efficiently while keeping quality high
  • Help keep our systems secure and reliable, and pitch in on the wider tech environment that comes with a small team
  • Help shape our technical direction as we modernise and scale
  • Fulltime
Read More
Arrow Right
New

Yard Sales Assistant

Every day is different at Travis Perkins, but here's what you can expect: Our su...
Location
Location
United Kingdom , Falkirk
Salary
Salary:
Not provided
travisperkins.co.uk Logo
Travis Perkins
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Enthusiastic and have great interpersonal skills
  • Confident in physical ability to process heavy and bulky stock
  • Thrive in a dynamic and fast paced environment
  • Be adaptable and resilient
Job Responsibility
Job Responsibility
  • Processing customer orders
  • Loading and unloading customer and company vehicles
  • Unloading building products from supplier deliveries and booking them in the branch warehouse
  • Maintaining a tidy and safe working environment
What we offer
What we offer
  • Support to enrol onto development schemes
  • Competitive salary with bonus earning potential
  • 22 days of holiday
  • Enhanced pension scheme matching contributions up to 10%
  • 20% off at Toolstation with wider group savings
  • Sociable daytime hours
  • ShareSave scheme
  • Online shopping discounts
  • Fulltime
Read More
Arrow Right
New

Primary Supply Teacher

Are you a passionate educator ready to inspire young minds? Hold a QTS/PGCE and ...
Location
Location
United Kingdom , Caterham
Salary
Salary:
140.00 GBP / Day
https://www.randstad.com Logo
Randstad
Expiration Date
August 04, 2026
Flip Icon
Requirements
Requirements
  • QTS/PGCE
  • communication
  • good behaviour management skills
  • good classroom management
  • good communication skills
  • key stage 1 experience
  • key stage 2 experience
  • knowledge of curriculum
  • using school software
What we offer
What we offer
  • Work days on your terms
  • fantastic daily rates
  • seamless weekly payments
  • convenient for drivers
  • user-friendly time sheet app
  • £300 Refer a Friend program
  • dedicated consultant
  • hands-on support for compliance and on-boarding
  • Parttime
Read More
Arrow Right
New

Assistente 2° Governante - The St. Regis Florence

Combining timeless glamour with a vanguard spirit, St. Regis Hotels & Resorts is...
Location
Location
Italy , Florence
Salary
Salary:
22000.00 - 23000.00 EUR / Year
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or G.E.D. equivalent
  • At least 1 year of related work experience
  • At least 1 year of supervisory experience
Job Responsibility
Job Responsibility
  • Inspect guest rooms, public areas, pool, etc. after being cleaned by Housekeeper to ensure quality standards
  • Run sold room reports, verify room status, determine discrepant rooms, prioritize room cleaning, and update status of departing guest rooms
  • Assist Housekeeping management in managing daily activities
  • Act as a liaison to coordinate the efforts of Housekeeping, Engineering, Front Office, and Laundry
  • Document and resolve issues with discrepant rooms with the Front Desk
  • Prepare, distribute, and communicate changes in room assignments
  • Communicate issues to next shift
  • Complete required paperwork
  • Assist management in hiring, training, scheduling, evaluating, counseling, disciplining, and motivating and coaching employees
  • Follow all company and safety and security policies and procedures
What we offer
What we offer
  • Premio Produzione
  • Fulltime
Read More
Arrow Right