CrawlJobs Logo

Principal Data Architect - Data Engineering

cencora.com Logo

Cencora

Location Icon

Location:
India , Pune

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Data, Analytics & AI Architect actively participates in providing the overall direction of architecture across the entire data analytics ecosystem. The role is responsible for defining and driving the strategic vision for enterprise data and AI systems. This position oversees the design and implementation of scalable, secure, and innovative data platforms and AI capabilities that empower business intelligence, advanced analytics, and machine learning across the organization. This role is critical in shaping the enterprise data and analytics vision and strategy, ensuring alignment with the company's strategic business plans.

Job Responsibility:

  • Developing architecture for technology including best practices and guiding principles, and design of new data and analytics technology
  • Partner through implementation and operational support to ensure technology is achieving desired business outcomes
  • Collaborate with business and solution architectures for less complex data and analytics initiatives
  • Analyze current architectures to identify weaknesses and develop opportunities for improvements
  • Ensure the completeness of technical requirements and functional architecture analysis for the design and implementation of data and analytics business solutions
  • Define, document, and maintain architecture patterns
  • Complete architecture solution blueprint for data and analytics initiatives
  • Ability to define and architect interim architectures and strategy to ultimately align to end state
  • Develop and present a variety of architectural artifacts and documentation
  • Establish standard architectural principles, patterns, and processes
  • Participate in proof-of-concept initiatives to assess and analyze fit for purpose of potential solutions
  • Participate in data and analytics capability maturity assessment leveraging insights to build foundational future state architecture and corresponding roadmaps
  • Foster innovation by evaluating emerging technologies and recommending adoption where appropriate
  • Strives to continuously increase the overall data and analytics architecture practice maturity
  • Model development and deployment using frameworks such as TensorFlow, PyTorch, or Scikit-learn
  • Integrate advanced analytics and AI/ML models into existing data workflows, ensuring seamless access and usability

Requirements:

  • Bachelor’s Degree in Statistics, Computer Science, Information Technology or any other related discipline or equivalent related experience
  • 12+ years of directly-related or relevant experience, preferably in healthcare data analytics or data engineering
  • Data and Analytics computing methodologies
  • Data and Analytics platforms, tools, and integration processes both on-prem and cloud
  • Common integration patterns (batch, micro-batch, near real time, real time)
  • Data Fabric framework
  • Basic Programming skills in Python, SQL
  • Data management and data security
  • Data pipeline tools like ADF, IICS
  • Data platforms: Snowflake, Databricks, BigQuery
  • BI tools: Power BI, Tableau, Looker
  • Cloud platforms: Azure, AWS, GCP
  • Streaming/Event processing and pub/sub software
  • AI/ML Tools like MLOps, Tensorflow, Mosaic AI, AWS Sagemaker, Pytorch
  • Advanced Data Visualization Techniques
  • Advanced Statistical Analysis
  • Big Data Analysis Tools and Techniques
  • Data Governance
  • Data Modelling
  • Data Quality Assurance
  • Machine Learning and AI Fundamentals
  • Business Intelligence Software like Tableau, Power BI, Alteryx, QlikSense
  • Data Visualization Tools
  • Microsoft Office Suite
  • Statistical Analytics tools (SAS, SPSS3)
  • Organizational Agility
  • Growth mindset
  • Creative, Innovative thinking
  • Customer Focus
  • Learning Agility & Self Development
  • Cross functional people management
  • Stakeholder management
  • Mentoring and coaching
  • Problem solving
  • Drives for results
  • Verbal & written communication
  • Coaching and Mentoring
  • Decision Making
  • Impact and Influencing
  • Leadership Skills
  • Multitasking
  • People Management
  • Planning

Nice to have:

  • Preferred Certifications: Advanced Data Analytics Certifications
  • AI and ML Certifications
  • SAS Statistical Business Analyst Professional Certification

Additional Information:

Job Posted:
February 20, 2026

Expiration:
February 28, 2026

Employment Type:
Fulltime
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Data Architect - Data Engineering

Principal Data Engineer

Atlassian is looking for a Principal Data Engineer to join our Data Engineering ...
Location
Location
United States , San Francisco
Salary
Salary:
168700.00 - 271100.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You have 12+ years of experience in a Data Engineer role as an individual contributor
  • You have at least 2 years of experience as a tech lead for a Data Engineering team
  • You are an engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts
  • You are a great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success
  • Experience with building streaming pipelines with a micro-services architecture for low-latency analytics
  • Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
  • Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools
  • Experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka)
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
  • Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a 'Streaming First' mindset to drive Atlassian's business growth and improve the product experience
Job Responsibility
Job Responsibility
  • Own the technical evolution of the data engineering capabilities and be responsible for ensuring solutions are being delivered incrementally, meeting outcomes, and promptly escalating risks and issues
  • Establish a deep understanding of how things work in data engineering, use this to direct and coordinate the technical aspects of work across data engineering, and systematically improve productivity across the teams
  • Maintain a high bar for operational data quality and proactively address performance, scale, complexity and security considerations
  • Drive complex decisions that can impact the work in data engineering. Set the technical direction and balance customer and business needs with long-term maintainability & scale
  • Understand and define the problem space, and architect solutions. Coordinate a team of engineers towards implementing them, unblocking them along the way if necessary
  • Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager, and provide consistent feedback to help them manage and grow the team
  • Work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Atlassian is looking for a Principal Data Engineer to join our Corporate Data En...
Location
Location
United States , San Francisco; Mountain View
Salary
Salary:
168700.00 - 271100.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in a Data Engineer role as an individual contributor
  • at least 2 years of experience as a tech lead for a Data Engineering team
  • track record of driving and delivering large and complex efforts
  • great communicator and maintain cross-team and cross-functional relationships
  • experience with building streaming pipelines with a micro-services architecture for low-latency analytics
  • experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
  • experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools
  • experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka)
  • understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
  • industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a "Streaming First" mindset
Job Responsibility
Job Responsibility
  • help our stakeholder teams ingest data faster into our data lake
  • find ways to make our data pipelines more efficient
  • come up ideas to help instigate self-serve data engineering within the company
  • building micro-services, architecting, designing, and enabling self serve capabilities at scale to help Atlassian grow
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Senior Principal Data Engineer

Atlassian is looking for a Senior Principal Data Engineer to join the Go-To Mark...
Location
Location
United States , San Francisco
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 18+ years of experience in a Data Engineer role as an individual contributor
  • at least 7 years of experience as a tech lead for Data Engineering teams, and delivered complex, cross-team initiatives
  • built durable relationships with executives/senior leaders across Sales, Marketing, Finance, Commerce and related organizations, and understand complexities of data in these organizations
  • a track record of driving and delivering large complex, multi-team efforts
  • a great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success
  • experience with building streaming pipelines with a micro-services architecture for low-latency analytics
  • experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, dbt, and column stores (e.g. Redshift)
  • experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools
  • experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka)
  • understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
Job Responsibility
Job Responsibility
  • Help stakeholder teams ingest data faster into our data lake
  • find ways to make data pipelines more efficient
  • come up with ideas to help instigate self-serve data engineering within the company
  • building micro-services, architecting, designing, and enabling self-serve capabilities at scale to help Atlassian grow
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Atlassian is looking for a Principal Data Engineer to join our Data Engineering ...
Location
Location
United States , San Francisco; Seattle; Austin
Salary
Salary:
168700.00 - 271100.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in a Data Engineer role as an individual contributor
  • At least 2 years of experience as a tech lead for a Data Engineering team
  • Engineer with a track record of driving and delivering large (multi-person or multi-team) and complex efforts
  • Great communicator and maintain many of the essential cross-team and cross-functional relationships necessary for the team's success
  • Experience with building streaming pipelines with a micro-services architecture for low-latency analytics
  • Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
  • Experience building scalable data pipelines using Spark using Airflow scheduler/executor framework or similar scheduling tools
  • Experience working in a technical environment with the latest technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, or Kafka)
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
  • Industry experience working with large-scale, high-performance data processing systems (batch and streaming) with a "Streaming First" mindset to drive Atlassian's business growth and improve the product experience
Job Responsibility
Job Responsibility
  • Own the technical evolution of the data engineering capabilities and be responsible for ensuring solutions are being delivered incrementally, meeting outcomes, and promptly escalating risks and issues
  • Establish a deep understanding of how things work in data engineering, use this to direct and coordinate the technical aspects of work across data engineering, and systematically improve productivity across the teams
  • Maintain a high bar for operational data quality and proactively address performance, scale, complexity and security considerations
  • Drive complex decisions that can impact the work in data engineering
  • Set the technical direction and balance customer and business needs with long-term maintainability & scale
  • Understand and define the problem space, and architect solutions
  • Coordinate a team of engineers towards implementing them, unblocking them along the way if necessary
  • Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager, and provide consistent feedback to help them manage and grow the team
  • Work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

We are on the lookout for a Principal Data Engineer to help define and lead the ...
Location
Location
United Kingdom
Salary
Salary:
Not provided
dotdigital.com Logo
Dotdigital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience delivering python-based projects in the data engineering space
  • Extensive experience working with SQL and NoSQL database technologies (e.g. SQL Server, MongoDB & Cassandra)
  • Proven experience with modern data warehousing and large-scale data processing tools (e.g. Snowflake, DBT, BiqQuery, Clickhouse)
  • Hands on experience with data orchestration tools like Airflow, Dagster or Prefect
  • Experience using cloud environments (e.g. Azure, AWS, GCP) to process, store and surface large scale data
  • Experience using Kafka or similar event-based architectures e.g. (Pub/Sub via AWS SQS, Azure EventHubs, AWS Kinesis)
  • Strong grasp of data architecture and data modelling principles for both OLAP and OLTP workloads
  • Capable in the wider software development lifecycle in terms of agile ways of working and continuous integration/deployment of data solutions
  • Experience as a lead or Principal Engineer on large-scale data initiative or product builds
  • Demonstrated ability to architect data systems and data structures for high volume, high throughput systems
Job Responsibility
Job Responsibility
  • Lead the design and implementation of scalable, secure and resilient data systems across streaming, batch and real-time use cases
  • Architect data pipelines, model and storage solutions that power analytical and product use cases
  • using primarily Python and SQL via orchestration tooling that run workloads in the cloud
  • Leverage AI to automate both data processing and engineering processes
  • Assure and drive best practices relating to data infrastructure, governance, security and observability
  • Work with technologists across multiple teams to deliver coherent features and data outcomes
  • Support the data team to help adopt data engineering principles
  • Identify, validate and promote new tools and technologies that improve the performance and stability of data services
What we offer
What we offer
  • Parental leave
  • Medical benefits
  • Paid sick leave
  • Dotdigital day
  • Share reward
  • Wellbeing reward
  • Wellbeing Days
  • Loyalty reward
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

The Principal Data Engineer will lead the design, development, and optimization ...
Location
Location
United States , Washington DC; Philadelphia PA; Wilmington DE
Salary
Salary:
113200.00 - 146664.00 USD / Year
amtrak.com Logo
AMTRAK
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree or equivalent combination of education, training and/or relevant experience
  • Plus 7 years of relevant work experience
  • Proficiency and hands on experience designing and implementing end-to-end data solutions in AWS (e.g., S3, EMR, Glue, Redshift, Kenesis) and/or Azure (e.g. Azure Data Factory, Synaps Analytics, Azure Data Lakre Storage)
  • Experience with some of the following technologies, Databricks, Python, Apche Sparks, IDMC, Talend, CI/CD pipelines, Jenkins, Gitlab, Power BI, SQL and NoSQL
Job Responsibility
Job Responsibility
  • Architect and Design: Define and implement the architectural strategy for our enterprise data platform, focusing on scalability, security, and performance. Design and build robust, high-volume, and performant data pipelines using cloud-native services like AWS Data Pipelines (Glue, EMR, S3, Redshift, etc.) or Azure Data Factory/Synapse Analytics
  • Technical Leadership: Act as a subject matter expert and mentor for junior and mid-level data engineers, setting best practices for code quality, testing, and deployment
  • Data Governance & Management: Utilize tools like IDMC (Informatica Data Management Cloud) for data integration, quality, governance, and cataloging across the enterprise
  • Data Processing and Analysis: Develop, optimize, and manage large-scale data processing jobs using Databricks(Spark/Delta Lake) for ETL/ELT workflows and advanced analytics
  • Coding and Scripting: Write high-quality, efficient, and well-documented code primarily in Python for data manipulation, automation, and pipeline orchestration
  • Deployment and Automation: Implement and maintain robust CI/CD pipelines and infrastructure-as-code (e.g., Terraform/CloudFormation) for automated deployment and management of data solutions
  • Business Intelligence: Ensure data readiness for reporting and analytics and possess working knowledge/experience with BI tools like Tableau and PowerBI to facilitate data consumption
  • Performance and Optimization: Monitor, troubleshoot, and tune existing data infrastructure and pipelines to ensure optimal performance and cost efficiency
What we offer
What we offer
  • health, dental, and vision plans
  • health savings accounts
  • wellness programs
  • flexible spending accounts
  • 401K retirement plan with employer match
  • life insurance
  • short and long term disability insurance
  • paid time off
  • back-up care
  • adoption assistance
  • Fulltime
Read More
Arrow Right

Principal Data Architect

We’re seeking a Principal Data Architect to lead strategic data modernization ad...
Location
Location
United States; Canada
Salary
Salary:
170000.00 - 200000.00 USD / Year
terazo.com Logo
Terazo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years designing and delivering enterprise‑scale data solutions (with at least 5 years in cloud platforms such as Azure, Databricks, Snowflake, and/or AWS/GCP)
  • Proven experience working with Cloud Platforms and services
  • Proven experience migrating workloads to Cloud environments
  • Proven track record leading advisory and modernization programs end‑to‑end, from discovery through roadmap and into delivery oversight
  • Deep knowledge of enterprise data reference architecture, including Lakehouse/Medallion patterns, Mesh principles, CDC/streaming, and domain‑oriented data products
  • Expertise in data modeling (dimensional, 3NF, Data Vault), metadata/lineage, data quality, and observability
  • Hands-on governance with Unity Catalog (Databricks) and/or Microsoft Purview
  • pragmatic implementation of RBAC, lineage, and data masking
  • Strong grasp of governance (policy‑driven access, privacy/security, and regulatory expectations in banking such as GLBA, AML/KYC, BCBS 239), FinOps/cost management, and performance/scalability
  • Executive‑level communication and facilitation skills
Job Responsibility
Job Responsibility
  • Partner with Sales/Accounts to shape opportunities, conduct discovery, craft SOWs and proposals, build estimates/approaches, and present to executives
  • Lead executive advisory engagements that connect business value (growth, efficiency, risk) to a pragmatic data modernization strategy and investment plan
  • Define and validate target-state enterprise data architecture. Produce a phased, value‑anchored roadmap with clear outcomes, success metrics, and FinOps/budget guardrails. Build additional architecture artifacts to describe desired-state architecture
  • Design governance frameworks (policy-driven access, quality, lineage, metadata, ownership/stewardship, regulatory alignment) and connect them to measurable outcomes
  • Design reference architectures based on Cloud principles, such as the Well-Architected Framework
  • Own the reference architecture across Lakehouse, Warehouse, and Mesh patterns leveraging industry leading technologies
  • Define design patterns for ingestion, transformation, orchestration, and observability (monitoring, logging, alerting) that scale across domains
  • Mentor and coach architects, engineers, and analysts
What we offer
What we offer
  • Pawreavement & Pawternity Leave: Two days off of work if you bring a new furry friend home, and two days off of work if you have to say goodbye to one
  • Unlimited PTO
Read More
Arrow Right

Principal Software Engineer, Trusted Data Platform

As a Principal Software Engineer, you will be a technical leader and hands-on co...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field
  • 10+ years of experience in backend software development, focusing on distributed systems and storage solutions
  • 5+ years of experience working with AWS storage services (S3, DynamoDB, EBS, EFS, FSx, Glacier)
  • Strong expertise in system design, architecture, and scalability for large-scale storage solutions
  • Proficiency in at least one major backend programming language (Kotlin, Java, Go, Rust, or Python)
  • Experience designing and implementing highly available, fault-tolerant, and cost-efficient storage architectures
  • Deep understanding of distributed systems, replication strategies, sharding, and caching
  • Knowledge of data security, encryption best practices, and compliance requirements (SOC2, GDPR, HIPAA)
  • Experience leading engineering teams, mentoring senior engineers, and driving technical roadmaps
  • Proficiency with observability tools, performance monitoring, and troubleshooting at scale
Job Responsibility
Job Responsibility
  • Designing and optimizing high-scale, distributed storage systems built on AWS storage technologies
  • Shaping the architecture, performance, and reliability of backend storage solutions that power critical applications at scale
  • Designing, implementing, and optimizing backend storage services that support high throughput, low latency, and fault tolerance
  • Working closely with senior engineers, architects, and cross-functional teams to drive scalability, availability, and efficiency improvements in large-scale storage solutions
  • Leading technical deep dives, architecture reviews, and root cause analyses to resolve complex production issues related to storage performance, consistency, and durability
  • Driving best practices in distributed system design, security, and cloud cost optimization
  • Mentoring senior engineers, contributing to technical roadmaps, and helping shape the long-term storage strategy
  • Collaborating with Site Reliability Engineers (SREs) to implement observability, monitoring, and disaster recovery strategies, ensuring high availability and compliance with industry standards
  • Advocating for automation, Infrastructure-as-Code (IaC), and DevOps best practices, leveraging tools like Terraform, AWS CloudFormation, Kubernetes (EKS), and CI/CD pipelines to enable scalable deployments and operational excellence
What we offer
What we offer
  • Atlassians can choose where they work – whether in an office, from home, or a combination of the two
  • Atlassians have more control over supporting their family, personal goals, and other priorities
  • We can hire people in any country where we have a legal entity
  • Interviews and onboarding are conducted virtually
  • Whatever your preference - working from home, an office, or in between - you can choose the place that's best for your work and your lifestyle
Read More
Arrow Right