CrawlJobs Logo

Principal Engineer, Iceberg

cloudera.com Logo

Cloudera

Location Icon

Location:

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. The Data Platform Pillar is the bedrock of Cloudera’s technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance. Cloudera is looking for exceptional software engineers to own and deliver Cloudera Distribution of Apache Iceberg through various platforms of Cloudera. This is an exciting opportunity to gather experience with Apache Iceberg on multiple cloud platforms. You will gain understanding in big data use cases and participate in the vibrant Apache Software Foundation community.

Job Responsibility:

  • Become a core contributor to Apache Iceberg
  • Bring performance improvements to all of the engines in the Cloudera stack, by implementing new features in Iceberg and working with other teams to leverage them during queries
  • Work with Product Managers and Customers to determine ways Iceberg can be improved for Modern Data Lakes
  • Develop new features in Java on a modern platforms
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera stack, but focusing on Iceberg, which you can utilize in your daily tasks
  • Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures
  • Collaborate with other team members and stakeholders

Requirements:

  • BS or MS in Computer Science or related field
  • 8+ years experience as a Software Engineer
  • Hands-on programmer with solid data-structures and algorithms
  • Experience with systems design, development
  • Strong understanding of at least one of the following languages: Java, Scala, C++, Python. And interested to learn the languages we’re using.
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong ability to research and solve problems independently without constant supervision
  • Ability to work effectively both independently and as part of an international and virtual team
  • Excellent communication and collaboration skills
  • Open-minded attitude, desire to learn new things and build great products

Nice to have:

  • Experience with using/developing Apache Iceberg or other related technologies
  • Experience (or demonstrated interest) in distributed computing or high availability systems
  • Contributions to open-source projects
  • Experience with SQL optimization, from analyzing query plans to implementing optimization in SQL engines
What we offer:
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups

Additional Information:

Job Posted:
January 26, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Engineer, Iceberg

Principal Engineer, Iceberg

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS or MS in Computer Science or related field
  • 8+ years experience as a Software Engineer
  • Hands-on programmer with solid data-structures and algorithms
  • Experience with systems design, development
  • Strong understanding of at least one of the following languages: Java, Scala, C++, Python. And interested to learn the languages we’re using.
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong ability to research and solve problems independently without constant supervision
  • Ability to work effectively both independently and as part of an international and virtual team
  • Excellent communication and collaboration skills
  • (Most importantly) Open-minded attitude, desire to learn new things and build great products
Job Responsibility
Job Responsibility
  • Become a core contributor to Apache Iceberg
  • Bring performance improvements to all of the engines in the Cloudera stack, by implementing new features in Iceberg and working with other teams to leverage them during queries
  • Work with Product Managers and Customers to determine ways Iceberg can be improved for Modern Data Lakes
  • Develop new features in Java on a modern platforms
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera stack, but focusing on Iceberg, which you can utilize in your daily tasks
  • Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures
  • Collaborate with other team members and stakeholders
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Principal Engineer, Tableflow

As a Principal Engineer, you will be a key technical leader shaping the long-ter...
Location
Location
United States
Salary
Salary:
274500.00 - 329400.00 USD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep expertise in leading architecture and delivery of large-scale distributed storage systems with company-level impact
  • Comprehensive knowledge of fault tolerance, consistency, scalability, and cloud-native platforms
  • Ability to navigate extreme ambiguity, reduce systemic complexity, and anticipate industry trends to design systems for the next 3–5 years
  • Strong ability to influence executives and stakeholders while fostering a collaborative environment across multiple teams
  • Demonstrated ability to move from high-level vision to detailed technical implementation and delivery
Job Responsibility
Job Responsibility
  • Define and drive company-level technical strategy for critical systems
  • Architect and evolve a high-performance, metadata management system
  • Design and implement innovative strategies for table schematization, materialization, and compaction at a massive scale
  • Build and maintain multi-tenant, highly available infrastructure for background computational tasks
  • Establish and evangelize engineering standards, architectural patterns, and technical frameworks
  • Partner with executives, product management, and engineering leaders to align technical vision with business objectives
  • Mentor senior and staff-level engineers
  • Lead contributions to relevant open-source projects like Apache Iceberg
  • Represent Confluent externally through technical talks and thought leadership
What we offer
What we offer
  • Remote-first work
  • Robust insurance benefits
  • Flexible time away
  • Experience ambassadors
  • Open and honest culture
  • Well-being and growth
  • Offers equity
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Data Platform

Arcesium seeks an exceptional Principal Software Engineer – Data Platform to joi...
Location
Location
United States , New York
Salary
Salary:
200000.00 - 250000.00 USD / Year
arcesium.com Logo
Arcesium
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong academic background in computer science
  • 5+ years of relevant experience as a software engineer at a top startup or technology firm
  • Expertise in at least one of: Kafka, ZeroMQ, AWS SNS/SQS, or equivalent streaming technology
  • Expertise in at least one of: Spark, Flink, Beam, or equivalent streaming data processing frameworks
  • Expertise in at least one of: Iceberg, delta lake, or other data lake table formats and supporting tooling
  • Hands-on experience in building near real-time data ETL, ELT and normalization
  • Fluency with Java, Kotlin, Scala, or any other JVM language
  • Familiarity with relational databases like Postgres, MSSQL, or Sqlite
  • Track record and appetite for building and launching new data products from scratch
  • Experience guiding and mentoring highly skilled engineers and driving large scale engineering projects across the firm
Job Responsibility
Job Responsibility
  • Build next generation technology used by some of the most sophisticated financial institutions in the world
  • Design exciting new products for our offering with best of breed distributed systems technologies
  • Drive solutions around data modeling, data pipelining & orchestration, data transport, and access control
  • Propose and review solution design across engineering teams as they onboard onto the data platform
  • Lead high-visibility engineering efforts on some of our data intensive core components
  • Take a hands-on technical leadership role in guiding a group of equally talented engineers to own and deliver high quality solutions under tight market-driven deadlines
What we offer
What we offer
  • Variable compensation in the form of a year-end bonus, guaranteed in the first year of hire
  • Medical and prescription drug coverage
  • 401k contribution matching
  • Fulltime
Read More
Arrow Right

Big Data and SQL Developer

The Big Data and SQL Developer is a senior level position responsible for establ...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of progressive experience in software engineering, specifically focused on designing, building, and optimizing large-scale Big Data systems
  • Proven track record as a lead or principal engineer on significant data initiatives
  • Significant experience in client-facing or business partner-facing roles
  • Experience in the financial services domain – Liquidity Management, Liquidity Stress Modelling, should be well verse with Markets terminologies
  • Experience with large data volumes, real-time processing, and stringent data quality/security requirements
  • Expert-level proficiency with Apache Spark (Spark SQL, Spark Streaming, PySpark/Scala Spark), Hadoop ecosystem (HDFS, YARN)
  • Expert in Scala, Python, or Java
  • Deep understanding and practical experience with data warehouse models, and relevant technologies (e.g., Delta Lake, Iceberg, Parquet)
  • Strong proficiency in SQL
  • Experience with NoSQL databases (e.g., Cassandra, MongoDB) is a plus
Job Responsibility
Job Responsibility
  • Lead the design and implementation of highly scalable, robust, and performant Big Data solutions, including data warehouses, streaming platforms, and analytical systems
  • Write high-quality, production-ready code for complex data pipelines, processing frameworks, and analytical tools
  • Drive performance tuning, troubleshooting, and optimization of Big Data applications and infrastructure
  • Act as a go-to expert for resolving complex technical challenges across the Big Data ecosystem
  • Research, evaluate, and integrate new Big Data technologies and tools
  • Champion and enforce engineering best practices, including code quality, testing, CI/CD, and documentation
  • Provide technical leadership and guidance to multiple engineering teams
  • Mentor senior and junior engineers
  • Lead comprehensive code reviews
  • Contribute significantly to the Big Data strategy and roadmap
  • Fulltime
Read More
Arrow Right

Principal Full Stack Engineer - Analytics Platform

Titan is Microsoft’s self-serve analytics platform, powering millions of queries...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science or related technical field AND 6+ years of engineering experience designing and operating production-scale systems with strong UX focus, with coding in languages including, but not limited to, Python, C++, C#, Java, or JavaScript
  • OR equivalent experience
  • Front-end expertise: React, TypeScript, state management, performance, accessibility, data visualization (ECharts, Vega Lite, D3)
  • Back-end experience: Node.js, Python, REST, GraphQL, microservices, asynchronous messaging, caching
  • Strong SQL optimization and familiarity with columnar formats (Parquet, Delta, Iceberg)
  • Cloud experience: Azure, CI/CD, containers, Kubernetes, infrastructure as code
  • Security and reliability: OAuth, OpenID Connect, Azure AD, RBAC/ABAC, auditing, lineage, SLO ownership, incident response
  • Apache Superset customization (plug-ins, embedding, dashboard performance, security integration)
  • Experience with Databricks, Spark, ClickHouse, StarRocks, Cosmos DB, lakehouse/HDFS patterns
  • Knowledge of experimentation frameworks, semantic layers, data catalogs, lineage, Microsoft Purview
Job Responsibility
Job Responsibility
  • Architect and deliver intuitive analytics workflows for all skill levels: no code slice and dice, guided analysis, SQL, notebooks, and interactive app frameworks (e.g., Streamlit or Dash like)
  • Advance security and governance with role based and attribute based access control, row and column level security, auditing, lineage, and cost controls
  • standardize metrics and the semantic layer across APIs, notebooks, and experiments
  • Drive performance and reliability by meeting latency and Service Level Objective (SLO) targets
  • apply caching, pushdown, and incremental compute
  • build robust observability with tracing, metrics, and logs
  • Mentor and empower globally distributed teams
  • collaborate across product, design, data engineering, privacy, and security
  • foster inclusive engineering practices
  • Infuse AI into analytics: natural language queries, automated insights, anomaly detection, and narrative summaries with clear governance guardrails
  • Fulltime
Read More
Arrow Right

Principal Data And Analytics Engineer

The Principal Data and Analytics Engineer holds comprehensive responsibility for...
Location
Location
United States
Salary
Salary:
108086.00 - 180144.00 USD / Year
oreillyauto.com Logo
O'Reilly Auto Parts
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience architecting enterprise-scale data platforms and ecosystems, including hybrid and cloud-native environments (e.g., GCP BigQuery, Snowflake, Iceberg, Advanced SQL, Erwin, dbt, Kafka, Alation, Collibra)
  • Deep expertise in designing and scaling highly available, secure, and fault-tolerant batch and streaming pipelines with strong emphasis on cost optimization, observability, and latency control
  • Advanced proficiency in semantic modeling, reusable data asset design, and cross-functional data product delivery aligned to medallion architecture
  • Leadership in implementing CI/CD-enabled pipelines, RBAC frameworks, schema evolution strategies, and interoperable data exchange using Iceberg or equivalent table formats
  • Ownership of organization-wide metrics store and semantic layers, ensuring consistency, governance, and performance across reporting, AI, and ML use cases
  • Advanced expertise in programming languages such as Python, Scala, with the ability to architect complex data solutions
  • Demonstrated leadership in designing and overseeing the implementation of scalable, idempotent workflows using orchestration frameworks such as Airflow and Prefect
  • Demonstrated ability to translate business transformation goals into scalable data solutions and reusable patterns
  • Deep understanding of business processes, KPIs, and capability maps across functions such as supply chain, customer, store ops, and finance
  • Proven experience in driving cross-functional data product prioritization, influencing senior stakeholders, and quantifying impact of data initiatives
Job Responsibility
Job Responsibility
  • Help define and evolve enterprise data engineering blueprints, including data mesh, medallion architecture, and hybrid cloud data platforms
  • Set strategic direction for data platforms, tools, and services (e.g., Snowflake, GCP BigQuery, dbt, Kafka, Airflow/Prefect) in alignment with future-state architecture and business priorities
  • Architect and design highly scalable, resilient, cost optimal and secure data platforms
  • Lead the design and implementation of next-generation data platforms, ensuring fault tolerance, high availability, and optimal performance for petabyte-scale data
  • Establish and enforce organization-wide best practices for data pipeline development, CI/CD for data workflows, automated deployment playbooks, and robust rollback strategies
  • Lead technology evaluation and adoption, proactively researching, evaluating, and championing the integration of cutting-edge data technologies, frameworks, and methodologies
  • Define and scale enterprise knowledge management frameworks that ensure consistent documentation, discoverability, and reusability of data assets across domains
  • Establish and govern standards for metadata management, data lineage, architectural diagrams, and runbooks
  • Lead the design of federated governance models that empower domain-aligned teams to operate autonomously while conforming to centralized policies, frameworks and playbooks
  • Collaborate with data governance, compliance, and security teams to operationalize policy-as-code frameworks for data retention, access control, and PII handling
What we offer
What we offer
  • Competitive Wages & Paid Time Off
  • Stock Purchase Plan & 401k with Employer Contributions Starting Day One
  • Medical, Dental, & Vision Insurance with Optional Flexible Spending Account (FSA)
  • Team Member Health/Wellbeing Programs
  • Tuition Educational Assistance Programs
  • Opportunities for Career Growth
  • Fulltime
Read More
Arrow Right
New

Technician, General Facilities Maintenance

Performs routine preventive maintenance to ensure safety proper functionality an...
Location
Location
United States of America , Queensbury
Salary
Salary:
19.00 - 35.00 USD / Hour
walmart.com Logo
Walmart
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Vocational or Technical certification and 3 years' experience in one of the following trades: plumbing, electrical, material handling equipment, or related trade or 5 years' experience in one of the following trades: plumbing, electrical, material handling equipment, or related trade
  • Valid Driver's License
  • Eligible for a Commercial Driver's License (CDL)
Job Responsibility
Job Responsibility
  • Performs routine preventive maintenance to ensure safety proper functionality and aesthetics of facilities equipment or fixtures
  • Performs major and minor repairs on facilities equipment or fixtures
  • Manages work orders maintenance schedules and contractors
  • Demonstrates uptodate expertise and applies this to the development execution and improvement of action plans
  • Provides and supports the implementation of business solutions
  • Models compliance with company policies and procedures
What we offer
What we offer
  • Medical, vision and dental coverage
  • 401(k), stock purchase and company-paid life insurance
  • PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting
  • Short-term and long-term disability
  • Company discounts
  • Military Leave Pay
  • Adoption and surrogacy expense reimbursement
  • Live Better U education benefit program
  • Fulltime
Read More
Arrow Right
New

Member Specialist

Position Summary... What you'll do... Ensures area of responsibility is maintain...
Location
Location
United States , Myrtle Beach
Salary
Salary:
18.00 - 26.00 USD / Hour
walmart.com Logo
Walmart
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Retail experience including operating front end equipment (for example, cash register)
  • Working with mobile retail applications
Job Responsibility
Job Responsibility
  • Ensures area of responsibility is maintained in accordance with Company policies and procedures by properly handling returns
  • zoning the area
  • arranging and organizing merchandise
  • and identifying shrink and damages
  • Provides member service by maintaining exit areas
  • reviewing member receipts
  • acknowledging the member and identifying member needs
  • assisting members with purchasing decisions
  • assisting members with locating merchandise
  • Provides member service by maintaining self-checkout area
What we offer
What we offer
  • Medical, vision and dental coverage
  • 401(k), stock purchase and company-paid life insurance
  • PTO, parental leave, family care leave, bereavement, jury duty, and voting
  • short-term and long-term disability
  • company discounts
  • Military Leave Pay
  • adoption and surrogacy expense reimbursement
  • Live Better U education benefit program
  • Parttime
Read More
Arrow Right