CrawlJobs Logo

Senior Associate Software Engineer Databricks Developer

India, Hyderabad · Job Posted April 12, 2026
Apply Position
Job Link Share

Job Description

Amgen is looking for highly motivated expert Senior Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks. The ideal candidate will be responsible for designing, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management.

Job Responsibility

  • Design, develop, and maintain scalable data pipelines using AWS (Redshift, S3, Glue, Lambda) and Databricks (Spark, Delta Lake) to support enterprise analytics and reporting
  • Architect and implement robust data models (dimensional and normalized) to enable high-performance querying and optimized reporting in Redshift
  • Build and optimize batch and real-time data processing frameworks, leveraging Spark Structured Streaming and cloud-native services
  • Lead data ingestion, transformation, and orchestration workflows ensuring data quality, reliability, and performance at scale
  • Perform advanced data analytics and root cause analysis to troubleshoot data discrepancies, performance issues, and pipeline failures
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop and drive continuous improvements in CI/CD pipelines for automated data pipeline deployments, automated testing, version control, and monitoring for data platforms in a cloud-native environment
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement
  • Partner with BI and reporting teams to support report development, dashboard optimization, and data validation for business stakeholders
  • Implement data governance best practices including data lineage, auditing, access controls, and performance tuning
  • Mentor junior engineers and contribute to architectural decisions, code reviews, and engineering standards

Requirements

  • Any degree with 5 - 9 years of experience in Computer Science, IT or related field
  • Strong solution design and problem solving skills
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, Redshift, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • 5 to 9 years of Computer Science, IT or related field experience

Nice to have

  • Good to have deep expertise in Biotech & Pharma industries
  • Experience in writing APIs to make the data available to the consumers
  • Experienced with SQL/NOSQL database, vector database for large language models
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
  • AWS Certified Data Engineer preferred
  • Databricks Certified preferred
  • Scaled Agile SAFe certification preferred

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Associate Software Engineer Databricks Developer

8 matching positions

Data Modeler

The Data Modeler role requires expertise in developing and maintaining data mode...
Location
Location
India , Remote
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience delivering data models for P&C, Specialty insurance projects with exposure to Lloyd’s/London Market and Syndicate data structures is required
  • Understanding of insurance domain concepts and proficiency with data modelling tools(eg Erwin)
  • Expertise in enterprise data modelling, including conceptual, logical, and physical models for transactional domains
  • Experience in data modelling using Dimensional Star/Snowflake, Data Vault, and 3NF methodologies
  • Knowledge of data warehousing and ETL/ELT pipelines
  • Experience with Azure Data Factory and Databricks, designing data pipelines can be advantageous
  • Understanding and knowledge of system development life cycle methodologies (such as agile software development)
  • Excellent collaboration and communications skills to deal with senior leaders, stakeholders and technical teams is required
  • Flexibility and bringing a curious and creative mindset, open to new things and able to propose innovative idea
  • A minimum of 5 years of experience is required
Job Responsibility
Job Responsibility
  • Develop and maintain data models-Logical and Physical, to support business needs ensuring data integrity for Insurance domains
  • Design models aligned to Databricks medallion architecture by translating the requirements of underwriting, delegated authority, reinsurance, actuarial, claims and finance
  • Implement and maintain modelling standards, naming conventions, metadata and documentation working closely with data analyst, data engineers, and associates in data office
  • Review existing models and propose simplification, standardisation and target state improvements across projects and for wider requirements
  • Lead the evolution of requirements, refine and translate the specifications into data models to enable development phase
  • Ensure the models accurately reflect Insurance processes and data elements before handing it over to engineering
Read More
Arrow Right

Senior Associate - RWE Obesity Statistical Programming

Amgen is seeking a dedicated Senior Statistical Programmer to join our Center fo...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Statistics, Mathematics, Life Sciences, Economics or other relevant scientific subject
  • At least four (4) years of relevant statistical programming, systems engineering or application programming experience in a clinical development or life sciences setting
  • Experience in SQL, and statistical programming using SAS or R
Job Responsibility
Job Responsibility
  • Write, test and validate software programs in Unix and Databricks to produce analysis datasets and presentation output such as tables and figures, to be included in reports for submission to regulatory agencies, publications and other communications
  • Provide technical solutions to programming problems within CfOR
  • Lead and develop technical programming and process improvement initiatives within CfOR
  • Represent the programming function and participate in multidisciplinary project team meetings
  • Manage all programming activities, according to agreed resource and timeline plans
  • Ensure all programming activities on the project adhere to departmental standards
  • Write and/or review and approve all programming plans
  • Write and/or review and approve analysis dataset specifications
  • Review and approve key study-related documents produced by other functions, e.g. SAPs, CRF, Data Management Plan, etc.
  • Write, test, validate and execute department-, product- and protocol-level macros and utilities
Read More
Arrow Right
New

Administrative Assistant

As the Administrative Assistant you will work directly with executive and other ...
Location
Location
United States , Rockford
Salary
Salary:
Not provided
wolverineworldwide.com Logo
Wolverine Worldwide
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree desired or equivalent experience
  • 3+ years’ secretarial/clerical experience or equivalent skills and abilities
  • Excellent sense of discretion and confidentially with highly sensitive information
  • Strong project management skills and event planning experience desired
  • Advanced proficiency in Microsoft Office applications: Outlook, PowerPoint, Excel, Word
  • Familiarity with video conferencing or ability to adapt and learn quickly
  • Strong influence skills
  • Exceptional organizational and communication skills–able to communicate effectively with a variety of audiences, including Board members, executives, and partners
  • Proven ability to manage multiple priorities with excellent follow-through to meet deadlines in a fast-paced environment
  • Self-driven, strong work ethic and ability to work independently with little or no supervision
Job Responsibility
Job Responsibility
  • Manages travel arrangements, including arranging appropriate flights, visas, hotels, ground transportation and meeting agendas for extensive and complex international travel
  • Reconcile and expense corporate credit card accounts and travel expenses according to corporate travel policy and in timely manner
  • troubleshoot any reimbursement issues
  • Manages calendars, coordinates schedules, makes appointments, arranges meetings and events, prepares agendas, reserves and prepares facilities
  • Creation, production and distribution of ad hoc reports, documents and presentations
  • Composes and types correspondence from rough drafts, making changes in grammar, punctuation or spelling as needed, organizes and maintains confidential file system files correspondence and other records
  • Sorts and distributes incoming mail as well as preparing outgoing mail and packages, prepares customs documents
  • Exercises initiative, independent judgment and discretion in screening calls, greets and escorts visitors, and corresponds to written and oral requests for information
  • Coordinates on boarding of new employees, including electronics, office set up, business cards, and schedules introductory meetings
  • Coordinate other group needs: printing and binding for Group presentations, ordering office and printing supplies, meeting room support, etc
  • Fulltime
Read More
Arrow Right
New

Senior Developer, Salesforce Commerce Cloud

We are seeking a highly skilled and experienced Senior Full Stack Commerce Cloud...
Location
Location
United States
Salary
Salary:
104000.00 - 136500.00 USD / Year
wolverineworldwide.com Logo
Wolverine Worldwide
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science or related field
  • 7+ years of experience in full-stack development, with a focus on integrating systems and working with e-commerce platforms
  • 5+ years of experience working with SalesforceCommerceCloud, including customizations and extensions
  • Demonstrated experience in the roles of Salesforce Commerce Cloud Architect or Lead focused on PWA and/or Legacy Demandware
  • Strong knowledge of web technologies such as HTML, CSS, JavaScript, and AJAX
  • Strong knowledge of web frameworks or libraries such as Vue.JS, React or Angular
  • Experience with C#, .NET Framework 4.0+, LINQ, ASP.NET MVC
  • Must have fundamentals in Object Oriented Design & Data Structures
  • Experience with database design and development: SQL and/or NoSQL
  • Experience with REST API(s)
Job Responsibility
Job Responsibility
  • Develop and maintain integrations between various systems, including ERP, CRM, and e-commerce platforms
  • Collaborate with cross-functional teams to understand business requirements and design solutions that meet those requirements
  • Work with SalesforceCommerce Cloud to build and maintain custom e-commerce capabilities
  • Design and develop customizations and extensions to SalesforceCommerce Cloud platform
  • Ensure that all code is well-documented, maintainable, and scalable
  • Troubleshoot and debug issues in a timely manner
  • Mentor and provide technical guidance to junior developers
  • Technical lead experience including the ability to coordinate the development efforts of a small team
  • Investigate and address technical issues as they arise while keeping stakeholders informed and updated with progress
  • Actively participate with the team following our ways of working to ensure high-quality product delivery
  • Fulltime
Read More
Arrow Right
New

Cleaner

At a glance, your role is to clean all areas of the pub thoroughly, with the aim...
Location
Location
United Kingdom , Birmingham
Salary
Salary:
12.91 GBP / Hour
jdwetherspoon.com Logo
J D Wetherspoon plc
Expiration Date
June 03, 2026
Flip Icon
Requirements
Requirements
  • No experience needed
  • good attitude
  • willingness to learn
  • calm head under pressure
  • reliable
  • friendly
  • love working as part of a team
Job Responsibility
Job Responsibility
  • Clean all areas of the pub thoroughly
  • maintain cleanliness in customer areas, toilets, bar, kitchen, staff areas and outside spaces
  • complete daily, weekly and monthly cleaning tasks
  • follow correct procedures when using cleaning chemicals and equipment
  • monitor cleaning supplies and notify manager when more are needed
  • report all maintenance and pest-management issues to manager on duty
  • interact politely with customers
  • complete required induction, role-specific and ongoing refresher training
What we offer
What we offer
  • competitive rate of pay
  • free meal and a drink when working
  • 20% discount on all food, drinks and hotel accommodation for you and up to three guests when not working
  • £1 extra per hour for hours worked during midnight-5.59am
  • bonus scheme - earn up to 19% of your pay
  • availability of guaranteed-hours contracts and variable-hours contracts
  • paid holiday
  • free shares after a qualifying period
  • loyalty reward scheme
  • Parttime
!
Read More
Arrow Right
New

Pre-Sales Solutions Architect (Cloud & Infrastructure)

We're looking for a highly skilled Pre-Sales Solutions Architect to bridge the g...
Location
Location
United Kingdom , London
Salary
Salary:
70000.00 - 80000.00 GBP / Year
thepeoplenetwork.co.uk Logo
Fynity
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in a Pre-Sales, Solutions Architect, or similar role
  • Strong background in private cloud and infrastructure (e.g. Nutanix, VMware, OpenStack, Proxmox)
  • Knowledge of public cloud platforms (AWS, Azure, GCP)
  • Solid networking expertise (LAN/WAN, firewalls, VPNs, load balancing)
  • Understanding of security and compliance frameworks (ISO 27001, GDPR, NIST)
  • Ability to design scalable, resilient, and secure solutions
  • Excellent communication and stakeholder management skills
  • Commercial awareness and able to align technical solutions with business value
Job Responsibility
Job Responsibility
  • Partner with Sales teams to qualify opportunities and understand customer needs
  • Design end-to-end solutions across cloud, infrastructure, and networking
  • Translate business and technical requirements into solution architectures
  • Lead technical workshops, presentations, and solution demos
  • Produce Statements of Work (SoW), proposals, and supporting documentation
  • Ensure solutions meet security and compliance standards
  • Collaborate with Engineering and Delivery teams for seamless handover
  • Contribute to service design, pricing, and risk assessment
  • Stay up to date with emerging technologies in cloud and security
  • Fulltime
Read More
Arrow Right
New

DevOps Engineer

IT House is looking for a DevOps Engineer for a direct placement with an end cli...
Location
Location
Portugal , Porto
Salary
Salary:
Not provided
https://egor.pt Logo
Egor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Completed studies in computer science, business informatics or training in the IT environment
  • Experience in DevOps and in the operation of cloud infrastructures
  • Knowledge of Kubernetes and OpenShift desirable
  • Experience with CI/CD tools and version control systems
  • Strong problem-solving skills and a structured way of working
  • Good knowledge of English and the ability to collaborate successfully in an agile environment
Job Responsibility
Job Responsibility
  • Responsibility for the implementation, management and maintenance of our DevOps infrastructure
  • Configuration, deployment and scaling of containers and microservices in a containerized environment
  • Automation of build, test and deployment processes through the use of suitable tools and scripts
  • Monitoring system performance and availability as well as third-level support
  • Support in the design and implementation of security measures and compliance requirements
  • Identifying and implementing DevOps best practices to continuously improve software development and deployment
  • Collaborating with other IT teams to ensure the deployment and integration of new software components
What we offer
What we offer
  • Direct integration into the end clients organization
  • Contractual conditions aligned with the candidates profile and experience
  • Hybrid working model (Porto)
  • 24 vacation days per year and additional benefits
  • Fulltime
Read More
Arrow Right
New

Bar staff

The ideal applicant - We're looking for fun, enthusiastic, passionate people to ...
Location
Location
United Kingdom , Bramley
Salary
Salary:
12.81 GBP / Hour
jdwetherspoon.com Logo
J D Wetherspoon plc
Expiration Date
June 03, 2026
Flip Icon
Requirements
Requirements
  • Good attitude
  • willingness to learn
  • calm head under pressure
  • reliable
  • friendly
  • love working as part of a team
Job Responsibility
Job Responsibility
  • Work as part of a team to serve food and drinks to the correct specification
  • working efficiently while maintaining high standards of cleanliness, safety and customer service
  • taking orders, preparing, dispensing and serving drinks
  • delivering food to customers, completing check-backs and clearing plates
  • providing friendly customer interactions
  • being knowledgeable about promotions, events and new products
  • maintaining 'clean as you go' standards
  • working in all areas including glass-washing, restocking fridges, floor and beer garden clearing
What we offer
What we offer
  • Competitive rate of pay
  • free meal and drink when working
  • 20% discount on all food, drinks and hotel accommodation for you and up to three guests when not working
  • £1 extra per hour for hours worked during midnight-5.59am
  • bonus scheme up to 19% of your pay
  • availability of guaranteed-hours contracts and variable-hours contracts
  • paid holiday
  • free shares after qualifying period
  • loyalty reward scheme
  • structured on-the-job training
  • Parttime
!
Read More
Arrow Right