CrawlJobs Logo

Senior Associate Software Engineer Databricks Developer

India, Hyderabad · Job Posted April 12, 2026
Apply Position
Job Link Share

Job Description

Amgen is looking for highly motivated expert Senior Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks. The ideal candidate will be responsible for designing, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management.

Job Responsibility

  • Design, develop, and maintain scalable data pipelines using AWS (Redshift, S3, Glue, Lambda) and Databricks (Spark, Delta Lake) to support enterprise analytics and reporting
  • Architect and implement robust data models (dimensional and normalized) to enable high-performance querying and optimized reporting in Redshift
  • Build and optimize batch and real-time data processing frameworks, leveraging Spark Structured Streaming and cloud-native services
  • Lead data ingestion, transformation, and orchestration workflows ensuring data quality, reliability, and performance at scale
  • Perform advanced data analytics and root cause analysis to troubleshoot data discrepancies, performance issues, and pipeline failures
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop and drive continuous improvements in CI/CD pipelines for automated data pipeline deployments, automated testing, version control, and monitoring for data platforms in a cloud-native environment
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement
  • Partner with BI and reporting teams to support report development, dashboard optimization, and data validation for business stakeholders
  • Implement data governance best practices including data lineage, auditing, access controls, and performance tuning
  • Mentor junior engineers and contribute to architectural decisions, code reviews, and engineering standards

Requirements

  • Any degree with 5 - 9 years of experience in Computer Science, IT or related field
  • Strong solution design and problem solving skills
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, Redshift, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • 5 to 9 years of Computer Science, IT or related field experience

Nice to have

  • Good to have deep expertise in Biotech & Pharma industries
  • Experience in writing APIs to make the data available to the consumers
  • Experienced with SQL/NOSQL database, vector database for large language models
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
  • AWS Certified Data Engineer preferred
  • Databricks Certified preferred
  • Scaled Agile SAFe certification preferred

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Associate Software Engineer Databricks Developer

8 matching positions

Data Modeler

The Data Modeler role requires expertise in developing and maintaining data mode...
Location
Location
India , Remote
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience delivering data models for P&C, Specialty insurance projects with exposure to Lloyd’s/London Market and Syndicate data structures is required
  • Understanding of insurance domain concepts and proficiency with data modelling tools(eg Erwin)
  • Expertise in enterprise data modelling, including conceptual, logical, and physical models for transactional domains
  • Experience in data modelling using Dimensional Star/Snowflake, Data Vault, and 3NF methodologies
  • Knowledge of data warehousing and ETL/ELT pipelines
  • Experience with Azure Data Factory and Databricks, designing data pipelines can be advantageous
  • Understanding and knowledge of system development life cycle methodologies (such as agile software development)
  • Excellent collaboration and communications skills to deal with senior leaders, stakeholders and technical teams is required
  • Flexibility and bringing a curious and creative mindset, open to new things and able to propose innovative idea
  • A minimum of 5 years of experience is required
Job Responsibility
Job Responsibility
  • Develop and maintain data models-Logical and Physical, to support business needs ensuring data integrity for Insurance domains
  • Design models aligned to Databricks medallion architecture by translating the requirements of underwriting, delegated authority, reinsurance, actuarial, claims and finance
  • Implement and maintain modelling standards, naming conventions, metadata and documentation working closely with data analyst, data engineers, and associates in data office
  • Review existing models and propose simplification, standardisation and target state improvements across projects and for wider requirements
  • Lead the evolution of requirements, refine and translate the specifications into data models to enable development phase
  • Ensure the models accurately reflect Insurance processes and data elements before handing it over to engineering
Read More
Arrow Right

Senior Associate - RWE Obesity Statistical Programming

Amgen is seeking a dedicated Senior Statistical Programmer to join our Center fo...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Statistics, Mathematics, Life Sciences, Economics or other relevant scientific subject
  • At least four (4) years of relevant statistical programming, systems engineering or application programming experience in a clinical development or life sciences setting
  • Experience in SQL, and statistical programming using SAS or R
Job Responsibility
Job Responsibility
  • Write, test and validate software programs in Unix and Databricks to produce analysis datasets and presentation output such as tables and figures, to be included in reports for submission to regulatory agencies, publications and other communications
  • Provide technical solutions to programming problems within CfOR
  • Lead and develop technical programming and process improvement initiatives within CfOR
  • Represent the programming function and participate in multidisciplinary project team meetings
  • Manage all programming activities, according to agreed resource and timeline plans
  • Ensure all programming activities on the project adhere to departmental standards
  • Write and/or review and approve all programming plans
  • Write and/or review and approve analysis dataset specifications
  • Review and approve key study-related documents produced by other functions, e.g. SAPs, CRF, Data Management Plan, etc.
  • Write, test, validate and execute department-, product- and protocol-level macros and utilities
Read More
Arrow Right
New

Pharmacy Intern

You’ve invested a lot of time and energy in your education. Now you want the cha...
Location
Location
United States , Natrona Heights
Salary
Salary:
18.00 - 19.75 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 10, 2026
Flip Icon
Requirements
Requirements
  • Accepted into, or actively enrolled in, an ACPE accredited college or school of pharmacy
  • Must possess, or be in the process of obtaining, valid intern and/or technician licensure as required
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists and Technicians manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Offering to counsel, fielding medical questions, and soliciting information on a patient’s medical history to provide optimal care, when appropriate under the direct supervision of a licensed pharmacist
  • Taking telephonic prescriptions from the prescriber, and calling the prescriber to clarify prescriptions or facilitate medication changes, where allowed by state regulation
  • Maintaining the highest level of self-awareness and providing in-the-moment coaching, training, and mentoring to pharmacy team members while sharing best practices
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • Parttime
Read More
Arrow Right
New

Bms Quality Manager (Bqm) - Data Center Design, Engineering And Construction

Meta is seeking an experienced Building Management System (BMS) Quality Manager ...
Location
Location
United States
Salary
Salary:
150000.00 - 209000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree (Engineering, Construction Management, or equivalent degree) or relevant work experience
  • 10+ years of experience with a combination of Instrumentation and Controls programming/installation, general contractor MEP coordination/project management, commissioning (both mechanical and electrical) of data centers, or other large scale mission critical buildings
  • Experience with Industrial Automation and Building Management Control Systems (i.e. PLC/DDC)
  • 3+ years of experience with programming/designing of HVAC control systems & Electrical Power Monitoring
Job Responsibility
Job Responsibility
  • Manage, onboard, and lead the General Contractor BMS Lead(s), the Control Systems Integrator (CSI) and Electrical and Installation (E&I) controls contractors throughout all phases of the project, while developing efficiency improvements and incorporating lessons learned to ensure a safe, robust, reliable and functional controls system that adheres to Meta’s design and quality requirements
  • Establish a clear vision and foster cross-functional collaboration, coordination, and support among on-site project teams, including the Meta BMS team, general contractors, Control System Integrators, and installation contractors
  • Drive consistency and standardization across all buildings and Control System Integrators and installation contractors
  • Review, understand and ensure project level adherence to the issued revision of the BMS PLC Playbook
  • Perform BMS inspections (wiring, installation, and commissioning) and validate the status/progress of the projects including supporting the project teams, both internal and external, starting from the early stages of Mechanical, Electrical and Plumbing (MEP) construction by working with project level Construction Managers (both internal and external) to check the health of the project (including schedule), working with the project teams and supporting Regional Quality Managers (RQMs)
  • Align internally on program/project related communications to ensure a clear, consistent message to trade partners
  • Assess team performance, build relationships, and support the project benchmark and mock-up process of the BMS installations to assure consistency across the project while coordinating these efforts across multiple cross-functional partners, in a timely manner, to minimize re-work
  • Work with Construction Managers, Regional Quality Managers and General Contractors to ensure creation, accuracy and maintenance of logical schedule(s) for construction, commissioning, and packaged equipment BMS activities while leveraging this data to identify early finish dates for detailed design delivery
  • Coordinate and manage both packaged equipment factory installed controls audits and BMS commissioning audits to ensure specification/requirement adherence and track identified deficiencies through completion
  • Coordinate and lead large multi-stakeholder meetings on a regular basis and communicate discussions to all key stakeholders
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right
New

Account Manager, Manufacturing

Account Managers will produce positive sales growth for a specific geography or ...
Location
Location
United States , MARYLAND HEIGHTS
Salary
Salary:
62300.00 - 103900.00 USD / Year
grainger.com Logo
W. W. Grainger
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma/GED
  • 3+ years direct outside sales experience
  • Sales forecasting opportunity management and customer planning
  • Travel required to each customer within aligned market at least once per month, or more frequently where needed
  • Process discipline, ability to align planning goals with a pipeline development process to grow market revenue
  • Ability to utilize sales process to uncover customer objections/concerns, and determine appropriate solutions
Job Responsibility
Job Responsibility
  • Understand customer goals and remain alert and responsive to changing customer needs
  • Demonstrate knowledge of market data and access to resources to quickly respond to new developments in the customer's business
  • Oversee support of managed inventory tasks to guide greater understanding of the customers, increase contacts within the customer group and increase sales results
  • Understand Grainger's Value Proposition by providing solutions to grow profitable sales
  • Develop account penetration strategies to include regular business reviews for essential customers to maximize sales
What we offer
What we offer
  • Medical, dental, vision, and life insurance plans with coverage starting on day one of employment and 6 free sessions each year with a licensed therapist to support your emotional wellbeing
  • 18 paid time off (PTO) days annually for full-time employees (accrual prorated based on employment start date) and 6 company holidays per year
  • 6% company contribution to a 401(k) Retirement Savings Plan each pay period, no employee contribution required
  • Employee discounts, tuition reimbursement, student loan refinancing and free access to financial counseling, education, and tools
  • Maternity support programs, nursing benefits, and up to 14 weeks paid leave for birth parents and up to 4 weeks paid leave for non-birth parents
  • Fulltime
Read More
Arrow Right
New

Network Engineer, Deployment & Support

Meta is looking for an Network Deployment & Support Engineering lead to join the...
Location
Location
United States , Menlo Park
Salary
Salary:
162000.00 - 227000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of Network Engineering, including hands-on responsibility for planning, building, deployment or migrating production network environments
  • Hands-on experience with enterprise and carrier class routing, switching, and optical transport platforms
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Experience interacting with vendors and external parties to drive projects to completion
  • Knowledge of data center design and operational best practices
  • Proven experience leading and executing network deployment and migration projects
Job Responsibility
Job Responsibility
  • Lead the technical strategy, architecture, and execution for your team’s projects within Edge Network Services (ENS) on network deployment and migrations, ensuring alignment with organizational vision and goals
  • Provide hands-on technical contributions (design, deployment, migrate, code reviews, troubleshooting, etc.) on large scale complex programs at the experienced engineer level, demonstrating domain expertise and technical impact
  • Drive strategic planning by building and executing six-month to multi-year roadmaps that support business growth and transformation. Balance high-level strategic vision with hands-on leadership to deliver results across a broad portfolio of initiatives
  • Ensure high standards for reliability, scalability, and performance in all deliverables, driving continuous improvement in engineering processes and technical quality
  • Collaborate cross-functionally across Network Engineering, Data Center, Edge, and Planning teams to ensure successful execution of shared goals on Network Capacity and Reliability
  • Deploy, migrate and support our global production network including edge, backbone, and data center infrastructure
  • Manage key vendor relationships including contract negotiations, pricing, and evaluation of current and potential partnerships
  • Manage partner engineering team relationships to enable the team(s) to effectively meet business needs
  • Mentor and onboard new team members, raising the team’s overall technical acumen and building internal community
  • Demonstrate leadership behaviors by helping others, showing respect, connecting people, and driving collaboration within the team and organization
What we offer
What we offer
  • bonus
  • equity
  • benefits at Meta
  • Fulltime
Read More
Arrow Right
New

Sr Admin Asst

The Senior Administrative Assistant supports Directors, providing a wide range o...
Location
Location
United States , Lake Forest
Salary
Salary:
23.08 - 34.62 USD / Hour
grainger.com Logo
W. W. Grainger
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School diploma or equivalent
  • 1 or more years of administrative experience
  • Proficiency in Microsoft Office Suite (Word, Excel, PowerPoint) and LucidChart
  • Experience communicating essential information concisely, both in writing and verbally
  • The ability to proofread documents for correct grammar, spelling and punctuation
  • The ability to learn multiple software programs
  • A proactive approach with the initiative to anticipate needs and take ownership of responsibilities
  • Attention to detail, ensuring accuracy in all tasks
  • A problem-solving mindset, with the ability to adapt and respond effectively to challenges
Job Responsibility
Job Responsibility
  • Respond to requests by asking probing questions, gathering and providing information
  • Manage logistics/event planning for all leadership meetings including selecting venues, food, coordinating development of schedules, and providing on-site meeting support
  • Schedule and manage business travel logistics and ensure leader has necessary documentation for travel (Domestic/international)
  • Manage multiple documents including composing, modifying, and proofreading (i.e. memos/letters, reports, PowerPoint presentations, SharePoint updates, surveys, organizational charts, or records management
  • Task and project management may include (but not limited to) managing invites, coordinating presentation content and handouts, transcribing/recording meeting notes, capturing action items, takeaways, recording audio when necessary, facilitating online questions from participants during meetings, troubleshooting technical and logistical issues, and organizing follow up activities. Effectively manage leaders’ time using strategic and proactive calendar management
  • Support leadership in planning and distributing team member and leader communications
  • Prepare personnel, purchasing and other administrative forms for the leadership teams and forward for approval and processing
  • Train and provide backup support for other Administrative Business Partners as needed
  • Support the onboarding and departure process for department team members
  • Demonstrate a thorough understanding of the department and appropriate Company policies, procedures and operations
What we offer
What we offer
  • Medical, dental, vision, and life insurance plans with coverage starting on day one of employment and 6 free sessions each year with a licensed therapist to support your emotional wellbeing
  • 18 paid time off (PTO) days annually for full-time employees (accrual prorated based on employment start date) and 6 company holidays per year
  • 6% company contribution to a 401(k) Retirement Savings Plan each pay period, no employee contribution required
  • Employee discounts, tuition reimbursement, student loan refinancing and free access to financial counseling, education, and tools
  • Maternity support programs, nursing benefits, and up to 14 weeks paid leave for birth parents and up to 4 weeks paid leave for non-birth parents
  • Fulltime
Read More
Arrow Right
New

Foreign Pharmacy Grad - International Pharmacy Intern

You’ve invested a lot of time and energy in your education. Now you want the cha...
Location
Location
United States , Lancaster
Salary
Salary:
30.00 - 42.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 10, 2026
Flip Icon
Requirements
Requirements
  • High School Diploma or General Equivalent Development (GED)
  • Doctorate (PharmD) or equivalent Pharmacist degree from a Non-US accredited school of pharmacy
  • active Pharmacy Intern license in state where district is located
  • Foreign Graduate from a Non-US Accredited college or school of pharmacy prior to beginning Non-US Accredited Foreign Graduate Training Program at CVS
  • Pharmacist licensure in the state in which the position is based within 120 days of completion of US Intern hours
  • Strong communication and presentation skills
  • Ability to have regular and predictable attendance including nights and weekends
  • Ability to complete any additional tasks as directed by supervisor or manager
  • Ability to complete all required training and obtain required licensure (if applicable) within guidelines
  • Ability to lift and exert up to 20 lbs. of force occasionally, up to 10 lbs. of force frequently, and a negligible amount of force regularly to move objects to and from, including overhead lifting
Job Responsibility
Job Responsibility
  • Lead with Heart – display empathy and compassion for your patients, customers, caregivers, and colleagues on your team
  • Support your Pharmacy manager in motivating, inspiring, and developing their Pharmacy Support Staff by balancing assignments that maximize colleagues’ strengths, address development opportunities, and decrease knowledge gaps
  • Identify critical business opportunities and meaningful solutions to drive growth and improve performance in your pharmacy and work toward successfully implementing those solutions by leading your team to achieve specified goals
  • Adapt to change and adjust plans to thrive in a dynamic community healthcare setting
  • Seek new ways to grow, collaborate with others, and deliver better outcomes
  • Align others around our purpose to bring your heart to every moment of your health and gain support and commitment
  • Facilitate a ‘team’ culture that promotes caring, energy, enthusiasm, and pride
  • Apply acquired knowledge to help drive healthy outcomes and differentiate CVS from competitors
  • Greet each customer in a courteous and professional manner both in-store and at the drive thru window
  • Assist all pharmacy and front store customers with their questions and concerns
What we offer
What we offer
  • medical, dental, and vision coverage
  • paid time off
  • retirement savings options
  • wellness programs
  • Fulltime
Read More
Arrow Right