CrawlJobs Logo
Cloudera Logo Cloudera · IT - Software Development

Principal Engineer, Iceberg

· Job Posted January 26, 2026
Apply Position
Job Link Share

Job Description

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. The Data Platform Pillar is the bedrock of Cloudera’s technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance. Cloudera is looking for exceptional software engineers to own and deliver Cloudera Distribution of Apache Iceberg through various platforms of Cloudera. This is an exciting opportunity to gather experience with Apache Iceberg on multiple cloud platforms. You will gain understanding in big data use cases and participate in the vibrant Apache Software Foundation community.

Job Responsibility

  • Become a core contributor to Apache Iceberg
  • Bring performance improvements to all of the engines in the Cloudera stack, by implementing new features in Iceberg and working with other teams to leverage them during queries
  • Work with Product Managers and Customers to determine ways Iceberg can be improved for Modern Data Lakes
  • Develop new features in Java on a modern platforms
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera stack, but focusing on Iceberg, which you can utilize in your daily tasks
  • Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures
  • Collaborate with other team members and stakeholders

Requirements

  • BS or MS in Computer Science or related field
  • 8+ years experience as a Software Engineer
  • Hands-on programmer with solid data-structures and algorithms
  • Experience with systems design, development
  • Strong understanding of at least one of the following languages: Java, Scala, C++, Python. And interested to learn the languages we’re using.
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong ability to research and solve problems independently without constant supervision
  • Ability to work effectively both independently and as part of an international and virtual team
  • Excellent communication and collaboration skills
  • Open-minded attitude, desire to learn new things and build great products

Nice to have

  • Experience with using/developing Apache Iceberg or other related technologies
  • Experience (or demonstrated interest) in distributed computing or high availability systems
  • Contributions to open-source projects
  • Experience with SQL optimization, from analyzing query plans to implementing optimization in SQL engines

What we offer

  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
Cloudera - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Engineer, Iceberg

8 matching positions

Principal Engineer, Iceberg

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS or MS in Computer Science or related field
  • 8+ years experience as a Software Engineer
  • Hands-on programmer with solid data-structures and algorithms
  • Experience with systems design, development
  • Strong understanding of at least one of the following languages: Java, Scala, C++, Python. And interested to learn the languages we’re using.
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong ability to research and solve problems independently without constant supervision
  • Ability to work effectively both independently and as part of an international and virtual team
  • Excellent communication and collaboration skills
  • (Most importantly) Open-minded attitude, desire to learn new things and build great products
Job Responsibility
Job Responsibility
  • Become a core contributor to Apache Iceberg
  • Bring performance improvements to all of the engines in the Cloudera stack, by implementing new features in Iceberg and working with other teams to leverage them during queries
  • Work with Product Managers and Customers to determine ways Iceberg can be improved for Modern Data Lakes
  • Develop new features in Java on a modern platforms
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera stack, but focusing on Iceberg, which you can utilize in your daily tasks
  • Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures
  • Collaborate with other team members and stakeholders
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Principal Engineer, Tableflow

As a Principal Engineer, you will be a key technical leader shaping the long-ter...
Location
Location
United States
Salary
Salary:
274500.00 - 329400.00 USD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep expertise in leading architecture and delivery of large-scale distributed storage systems with company-level impact
  • Comprehensive knowledge of fault tolerance, consistency, scalability, and cloud-native platforms
  • Ability to navigate extreme ambiguity, reduce systemic complexity, and anticipate industry trends to design systems for the next 3–5 years
  • Strong ability to influence executives and stakeholders while fostering a collaborative environment across multiple teams
  • Demonstrated ability to move from high-level vision to detailed technical implementation and delivery
Job Responsibility
Job Responsibility
  • Define and drive company-level technical strategy for critical systems
  • Architect and evolve a high-performance, metadata management system
  • Design and implement innovative strategies for table schematization, materialization, and compaction at a massive scale
  • Build and maintain multi-tenant, highly available infrastructure for background computational tasks
  • Establish and evangelize engineering standards, architectural patterns, and technical frameworks
  • Partner with executives, product management, and engineering leaders to align technical vision with business objectives
  • Mentor senior and staff-level engineers
  • Lead contributions to relevant open-source projects like Apache Iceberg
  • Represent Confluent externally through technical talks and thought leadership
What we offer
What we offer
  • Remote-first work
  • Robust insurance benefits
  • Flexible time away
  • Experience ambassadors
  • Open and honest culture
  • Well-being and growth
  • Offers equity
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Data Platform

Arcesium seeks an exceptional Principal Software Engineer – Data Platform to joi...
Location
Location
United States , New York
Salary
Salary:
200000.00 - 250000.00 USD / Year
arcesium.com Logo
Arcesium
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong academic background in computer science
  • 5+ years of relevant experience as a software engineer at a top startup or technology firm
  • Expertise in at least one of: Kafka, ZeroMQ, AWS SNS/SQS, or equivalent streaming technology
  • Expertise in at least one of: Spark, Flink, Beam, or equivalent streaming data processing frameworks
  • Expertise in at least one of: Iceberg, delta lake, or other data lake table formats and supporting tooling
  • Hands-on experience in building near real-time data ETL, ELT and normalization
  • Fluency with Java, Kotlin, Scala, or any other JVM language
  • Familiarity with relational databases like Postgres, MSSQL, or Sqlite
  • Track record and appetite for building and launching new data products from scratch
  • Experience guiding and mentoring highly skilled engineers and driving large scale engineering projects across the firm
Job Responsibility
Job Responsibility
  • Build next generation technology used by some of the most sophisticated financial institutions in the world
  • Design exciting new products for our offering with best of breed distributed systems technologies
  • Drive solutions around data modeling, data pipelining & orchestration, data transport, and access control
  • Propose and review solution design across engineering teams as they onboard onto the data platform
  • Lead high-visibility engineering efforts on some of our data intensive core components
  • Take a hands-on technical leadership role in guiding a group of equally talented engineers to own and deliver high quality solutions under tight market-driven deadlines
What we offer
What we offer
  • Variable compensation in the form of a year-end bonus, guaranteed in the first year of hire
  • Medical and prescription drug coverage
  • 401k contribution matching
  • Fulltime
Read More
Arrow Right

Principal Full Stack Engineer - Analytics Platform

Titan is Microsoft’s self-serve analytics platform, powering millions of queries...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science or related technical field AND 6+ years of engineering experience designing and operating production-scale systems with strong UX focus, with coding in languages including, but not limited to, Python, C++, C#, Java, or JavaScript
  • OR equivalent experience
  • Front-end expertise: React, TypeScript, state management, performance, accessibility, data visualization (ECharts, Vega Lite, D3)
  • Back-end experience: Node.js, Python, REST, GraphQL, microservices, asynchronous messaging, caching
  • Strong SQL optimization and familiarity with columnar formats (Parquet, Delta, Iceberg)
  • Cloud experience: Azure, CI/CD, containers, Kubernetes, infrastructure as code
  • Security and reliability: OAuth, OpenID Connect, Azure AD, RBAC/ABAC, auditing, lineage, SLO ownership, incident response
  • Apache Superset customization (plug-ins, embedding, dashboard performance, security integration)
  • Experience with Databricks, Spark, ClickHouse, StarRocks, Cosmos DB, lakehouse/HDFS patterns
  • Knowledge of experimentation frameworks, semantic layers, data catalogs, lineage, Microsoft Purview
Job Responsibility
Job Responsibility
  • Architect and deliver intuitive analytics workflows for all skill levels: no code slice and dice, guided analysis, SQL, notebooks, and interactive app frameworks (e.g., Streamlit or Dash like)
  • Advance security and governance with role based and attribute based access control, row and column level security, auditing, lineage, and cost controls
  • standardize metrics and the semantic layer across APIs, notebooks, and experiments
  • Drive performance and reliability by meeting latency and Service Level Objective (SLO) targets
  • apply caching, pushdown, and incremental compute
  • build robust observability with tracing, metrics, and logs
  • Mentor and empower globally distributed teams
  • collaborate across product, design, data engineering, privacy, and security
  • foster inclusive engineering practices
  • Infuse AI into analytics: natural language queries, automated insights, anomaly detection, and narrative summaries with clear governance guardrails
  • Fulltime
Read More
Arrow Right

Principal Data And Analytics Engineer

The Principal Data and Analytics Engineer holds comprehensive responsibility for...
Location
Location
United States
Salary
Salary:
108086.00 - 180144.00 USD / Year
oreillyauto.com Logo
O'Reilly Auto Parts
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience architecting enterprise-scale data platforms and ecosystems, including hybrid and cloud-native environments (e.g., GCP BigQuery, Snowflake, Iceberg, Advanced SQL, Erwin, dbt, Kafka, Alation, Collibra)
  • Deep expertise in designing and scaling highly available, secure, and fault-tolerant batch and streaming pipelines with strong emphasis on cost optimization, observability, and latency control
  • Advanced proficiency in semantic modeling, reusable data asset design, and cross-functional data product delivery aligned to medallion architecture
  • Leadership in implementing CI/CD-enabled pipelines, RBAC frameworks, schema evolution strategies, and interoperable data exchange using Iceberg or equivalent table formats
  • Ownership of organization-wide metrics store and semantic layers, ensuring consistency, governance, and performance across reporting, AI, and ML use cases
  • Advanced expertise in programming languages such as Python, Scala, with the ability to architect complex data solutions
  • Demonstrated leadership in designing and overseeing the implementation of scalable, idempotent workflows using orchestration frameworks such as Airflow and Prefect
  • Demonstrated ability to translate business transformation goals into scalable data solutions and reusable patterns
  • Deep understanding of business processes, KPIs, and capability maps across functions such as supply chain, customer, store ops, and finance
  • Proven experience in driving cross-functional data product prioritization, influencing senior stakeholders, and quantifying impact of data initiatives
Job Responsibility
Job Responsibility
  • Help define and evolve enterprise data engineering blueprints, including data mesh, medallion architecture, and hybrid cloud data platforms
  • Set strategic direction for data platforms, tools, and services (e.g., Snowflake, GCP BigQuery, dbt, Kafka, Airflow/Prefect) in alignment with future-state architecture and business priorities
  • Architect and design highly scalable, resilient, cost optimal and secure data platforms
  • Lead the design and implementation of next-generation data platforms, ensuring fault tolerance, high availability, and optimal performance for petabyte-scale data
  • Establish and enforce organization-wide best practices for data pipeline development, CI/CD for data workflows, automated deployment playbooks, and robust rollback strategies
  • Lead technology evaluation and adoption, proactively researching, evaluating, and championing the integration of cutting-edge data technologies, frameworks, and methodologies
  • Define and scale enterprise knowledge management frameworks that ensure consistent documentation, discoverability, and reusability of data assets across domains
  • Establish and govern standards for metadata management, data lineage, architectural diagrams, and runbooks
  • Lead the design of federated governance models that empower domain-aligned teams to operate autonomously while conforming to centralized policies, frameworks and playbooks
  • Collaborate with data governance, compliance, and security teams to operationalize policy-as-code frameworks for data retention, access control, and PII handling
What we offer
What we offer
  • Competitive Wages & Paid Time Off
  • Stock Purchase Plan & 401k with Employer Contributions Starting Day One
  • Medical, Dental, & Vision Insurance with Optional Flexible Spending Account (FSA)
  • Team Member Health/Wellbeing Programs
  • Tuition Educational Assistance Programs
  • Opportunities for Career Growth
  • Fulltime
Read More
Arrow Right
New

Senior CloudOps Engineer

We are looking for a Senior Cloud DevOps Engineer to design, build, and optimize...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7 - 10 years of experience in Cloud Infrastructure, DevOps, or SRE roles
  • Strong hands-on experience with AWS, Azure, and/or GCP, especially in networking (VPC setup, VPNs, routing, firewall configurations)
  • Expertise in Terraform, Kubernetes, Helm, and scripting languages (Python or Bash)
  • Proven experience supporting live, production SaaS environments
  • Solid understanding of cloud security concepts and practices
  • Strong troubleshooting skills in distributed, cloud-based environments
  • Excellent communication and collaboration skills
Job Responsibility
Job Responsibility
  • Design, implement, and optimize cloud infrastructure with a strong focus on scalability, security, and cost-efficiency
  • Build and maintain secure cloud networking infrastructure — including VPCs, subnets, routing, VPNs, firewalls, and load balancers
  • Develop Infrastructure as Code solutions using Terraform, Kubernetes, and Helm
  • Enhance CI/CD pipelines and deployment workflows (Argo CD) to support frequent production releases
  • Implement monitoring, alerting, and observability systems using Prometheus, Grafana, and logging tools
  • Troubleshoot and resolve complex production issues, ensuring high availability and customer satisfaction
  • Collaborate closely with development, security, and operations teams to integrate infrastructure with application needs
  • Contribute to cloud cost optimization initiatives by improving efficiency and resource usage
  • Maintain cloud security best practices and compliance with standards (e.g., SOC2, ISO27001)
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right
New

Support Worker

As a Support Worker in Bridgend, you’ll help make the everyday remarkable for th...
Location
Location
United Kingdom , Bridgend
Salary
Salary:
13.59 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • No experience required
  • patience and empathy
  • ability to support with intimate personal care
  • strong communication and teamwork skills
  • ability to speak on behalf of others
  • good written skills
  • full driving licence
Job Responsibility
Job Responsibility
  • Support individuals in making their own choices and set their own goals
  • empower people to follow through on choices
  • offer practical support to help meet responsibilities like paying bills, maintaining homes, being good neighbours, staying connected with friends and family
  • enhance well-being and focus on meaningful moments
What we offer
What we offer
  • Excellent training and development opportunities
  • 25 days annual leave rising to 30 days after 5 years’ service with option to buy and sell leave
  • Benevolent Fund
  • Health and Wellbeing programme / Employee Assistance Programme
  • Refer a Friend programme
  • Company pension
  • Cycle to work scheme
  • Benefits and discount platform
  • Eligibility for Blue Light discount card
Read More
Arrow Right
New

Digital Presales Greenlake Solutions Architect

Global Sales at HPE is about building the future. We are creating opportunities ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3 - 5 years of technical experience and a Bachelor of Arts/Science or equivalent degree in computer science or related area of study
  • without a degree, two additional years of relevant professional experience (5-7 years in total)
Job Responsibility
Job Responsibility
  • Responsible for delivery of assigned tasks within the delivery cycle of a project
  • Understands a broad spectrum of the company's technology in order to deliver part of a detailed technical design, which meets customer requirements
  • Tasks may include installing new systems applications
  • updating applications, firmware, and drivers
  • creating boundaries for as well as performing configuration and testing activities
  • applications programming for assigned modules within a larger program
  • assisting in the preparation of technical presentations and demonstrations
  • and participating in customer meetings
  • Works with minimal direction from the technical lead and with customer nominated representatives to accomplish assigned tasks
  • Contributes to design for specific deliverables and assists in the development of technical solutions
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
Read More
Arrow Right