Principal Engineer, Iceberg Job at Cloudera

Principal Engineer, Iceberg

At Cloudera, we empower people to transform complex data into clear and actionab...

Location

Salary:

Not provided

Cloudera

Expiration Date

Until further notice

Requirements

BS or MS in Computer Science or related field
8+ years experience as a Software Engineer
Hands-on programmer with solid data-structures and algorithms
Experience with systems design, development
Strong understanding of at least one of the following languages: Java, Scala, C++, Python. And interested to learn the languages we’re using.
Passionate about programming, clean coding habits, attention to detail, and focus on quality
Strong ability to research and solve problems independently without constant supervision
Ability to work effectively both independently and as part of an international and virtual team
Excellent communication and collaboration skills
Open-minded attitude, desire to learn new things and build great products

Job Responsibility

Become a core contributor to Apache Iceberg
Bring performance improvements to all of the engines in the Cloudera stack, by implementing new features in Iceberg and working with other teams to leverage them during queries
Work with Product Managers and Customers to determine ways Iceberg can be improved for Modern Data Lakes
Develop new features in Java on a modern platforms
Gain a solid understanding and deep technical knowledge of components across the Cloudera stack, but focusing on Iceberg, which you can utilize in your daily tasks
Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters
Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures
Collaborate with other team members and stakeholders

What we offer

Generous PTO Policy
Support work life balance with Unplugged Days
Flexible WFH Policy
Mental & Physical Wellness programs
Phone and Internet Reimbursement program
Access to Continued Career Development
Comprehensive Benefits and Competitive Packages
Paid Volunteer Time
Employee Resource Groups

Fulltime

Principal Engineer, Tableflow

As a Principal Engineer, you will be a key technical leader shaping the long-ter...

Location

United States

Salary:

274500.00 - 329400.00 USD / Year

Confluent

Expiration Date

Until further notice

Requirements

Deep expertise in leading architecture and delivery of large-scale distributed storage systems with company-level impact
Comprehensive knowledge of fault tolerance, consistency, scalability, and cloud-native platforms
Ability to navigate extreme ambiguity, reduce systemic complexity, and anticipate industry trends to design systems for the next 3–5 years
Strong ability to influence executives and stakeholders while fostering a collaborative environment across multiple teams
Demonstrated ability to move from high-level vision to detailed technical implementation and delivery

Job Responsibility

Define and drive company-level technical strategy for critical systems
Architect and evolve a high-performance, metadata management system
Design and implement innovative strategies for table schematization, materialization, and compaction at a massive scale
Build and maintain multi-tenant, highly available infrastructure for background computational tasks
Establish and evangelize engineering standards, architectural patterns, and technical frameworks
Partner with executives, product management, and engineering leaders to align technical vision with business objectives
Mentor senior and staff-level engineers
Lead contributions to relevant open-source projects like Apache Iceberg
Represent Confluent externally through technical talks and thought leadership

What we offer

Remote-first work
Robust insurance benefits
Flexible time away
Experience ambassadors
Open and honest culture
Well-being and growth
Offers equity

Fulltime

Principal Software Engineer - Data Platform

Arcesium seeks an exceptional Principal Software Engineer – Data Platform to joi...

Location

United States , New York

Salary:

200000.00 - 250000.00 USD / Year

Arcesium

Expiration Date

Until further notice

Requirements

Strong academic background in computer science
5+ years of relevant experience as a software engineer at a top startup or technology firm
Expertise in at least one of: Kafka, ZeroMQ, AWS SNS/SQS, or equivalent streaming technology
Expertise in at least one of: Spark, Flink, Beam, or equivalent streaming data processing frameworks
Expertise in at least one of: Iceberg, delta lake, or other data lake table formats and supporting tooling
Hands-on experience in building near real-time data ETL, ELT and normalization
Fluency with Java, Kotlin, Scala, or any other JVM language
Familiarity with relational databases like Postgres, MSSQL, or Sqlite
Track record and appetite for building and launching new data products from scratch
Experience guiding and mentoring highly skilled engineers and driving large scale engineering projects across the firm

Job Responsibility

Build next generation technology used by some of the most sophisticated financial institutions in the world
Design exciting new products for our offering with best of breed distributed systems technologies
Drive solutions around data modeling, data pipelining & orchestration, data transport, and access control
Propose and review solution design across engineering teams as they onboard onto the data platform
Lead high-visibility engineering efforts on some of our data intensive core components
Take a hands-on technical leadership role in guiding a group of equally talented engineers to own and deliver high quality solutions under tight market-driven deadlines

What we offer

Variable compensation in the form of a year-end bonus, guaranteed in the first year of hire
Medical and prescription drug coverage
401k contribution matching

Fulltime

Principal Full Stack Engineer - Analytics Platform

Titan is Microsoft’s self-serve analytics platform, powering millions of queries...

Location

United States , Redmond

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor’s degree in computer science or related technical field AND 6+ years of engineering experience designing and operating production-scale systems with strong UX focus, with coding in languages including, but not limited to, Python, C++, C#, Java, or JavaScript
OR equivalent experience
Front-end expertise: React, TypeScript, state management, performance, accessibility, data visualization (ECharts, Vega Lite, D3)
Back-end experience: Node.js, Python, REST, GraphQL, microservices, asynchronous messaging, caching
Strong SQL optimization and familiarity with columnar formats (Parquet, Delta, Iceberg)
Cloud experience: Azure, CI/CD, containers, Kubernetes, infrastructure as code
Security and reliability: OAuth, OpenID Connect, Azure AD, RBAC/ABAC, auditing, lineage, SLO ownership, incident response
Apache Superset customization (plug-ins, embedding, dashboard performance, security integration)
Experience with Databricks, Spark, ClickHouse, StarRocks, Cosmos DB, lakehouse/HDFS patterns
Knowledge of experimentation frameworks, semantic layers, data catalogs, lineage, Microsoft Purview

Job Responsibility

Architect and deliver intuitive analytics workflows for all skill levels: no code slice and dice, guided analysis, SQL, notebooks, and interactive app frameworks (e.g., Streamlit or Dash like)
Advance security and governance with role based and attribute based access control, row and column level security, auditing, lineage, and cost controls
standardize metrics and the semantic layer across APIs, notebooks, and experiments
Drive performance and reliability by meeting latency and Service Level Objective (SLO) targets
apply caching, pushdown, and incremental compute
build robust observability with tracing, metrics, and logs
Mentor and empower globally distributed teams
collaborate across product, design, data engineering, privacy, and security
foster inclusive engineering practices
Infuse AI into analytics: natural language queries, automated insights, anomaly detection, and narrative summaries with clear governance guardrails

Fulltime

Principal Data And Analytics Engineer

The Principal Data and Analytics Engineer holds comprehensive responsibility for...

Location

United States

Salary:

108086.00 - 180144.00 USD / Year

O'Reilly Auto Parts

Expiration Date

Until further notice

Requirements

Proven experience architecting enterprise-scale data platforms and ecosystems, including hybrid and cloud-native environments (e.g., GCP BigQuery, Snowflake, Iceberg, Advanced SQL, Erwin, dbt, Kafka, Alation, Collibra)
Deep expertise in designing and scaling highly available, secure, and fault-tolerant batch and streaming pipelines with strong emphasis on cost optimization, observability, and latency control
Advanced proficiency in semantic modeling, reusable data asset design, and cross-functional data product delivery aligned to medallion architecture
Leadership in implementing CI/CD-enabled pipelines, RBAC frameworks, schema evolution strategies, and interoperable data exchange using Iceberg or equivalent table formats
Ownership of organization-wide metrics store and semantic layers, ensuring consistency, governance, and performance across reporting, AI, and ML use cases
Advanced expertise in programming languages such as Python, Scala, with the ability to architect complex data solutions
Demonstrated leadership in designing and overseeing the implementation of scalable, idempotent workflows using orchestration frameworks such as Airflow and Prefect
Demonstrated ability to translate business transformation goals into scalable data solutions and reusable patterns
Deep understanding of business processes, KPIs, and capability maps across functions such as supply chain, customer, store ops, and finance
Proven experience in driving cross-functional data product prioritization, influencing senior stakeholders, and quantifying impact of data initiatives

Job Responsibility

Help define and evolve enterprise data engineering blueprints, including data mesh, medallion architecture, and hybrid cloud data platforms
Set strategic direction for data platforms, tools, and services (e.g., Snowflake, GCP BigQuery, dbt, Kafka, Airflow/Prefect) in alignment with future-state architecture and business priorities
Architect and design highly scalable, resilient, cost optimal and secure data platforms
Lead the design and implementation of next-generation data platforms, ensuring fault tolerance, high availability, and optimal performance for petabyte-scale data
Establish and enforce organization-wide best practices for data pipeline development, CI/CD for data workflows, automated deployment playbooks, and robust rollback strategies
Lead technology evaluation and adoption, proactively researching, evaluating, and championing the integration of cutting-edge data technologies, frameworks, and methodologies
Define and scale enterprise knowledge management frameworks that ensure consistent documentation, discoverability, and reusability of data assets across domains
Establish and govern standards for metadata management, data lineage, architectural diagrams, and runbooks
Lead the design of federated governance models that empower domain-aligned teams to operate autonomously while conforming to centralized policies, frameworks and playbooks
Collaborate with data governance, compliance, and security teams to operationalize policy-as-code frameworks for data retention, access control, and PII handling

What we offer

Competitive Wages & Paid Time Off
Stock Purchase Plan & 401k with Employer Contributions Starting Day One
Medical, Dental, & Vision Insurance with Optional Flexible Spending Account (FSA)
Team Member Health/Wellbeing Programs
Tuition Educational Assistance Programs
Opportunities for Career Growth

Fulltime

New

Principal/Architect Data Consultant - Analytics & AI

We are seeking a seasoned VP, Stream Head Data Analytics for Functions with 15-1...

Location

Pakistan , Karachi, Lahore, Islamabad

Salary:

Not provided

10Pearls

Expiration Date

Until further notice

Requirements

15-18+ years of experience in regulatory reporting, compliance, or financial data analytics
Bachelor's or Master's degree in Computer Science, Engineering, or a related field
Significant experience enabling data transformation in the banking functions space
Strong expertise in Central Bank regulatory frameworks across international banking regions
Proven track record in regulatory technology automation, tool implementation, and vendor management
Experience with Core Banking Transformation programs
Experience leading large cross-functional RTB and Change teams
Strong people leadership skills - ability to build, mentor, and scale high-performing analytics teams
Experience managing cross-functional stakeholders across Corporate, Treasury, and international banking functions
Ability to operate across and manage geographically distributed teams across multiple international offices

Job Responsibility

Lead end-to-end regulatory reporting automation strategy across corporate and international banking divisions
Ensure compliance with all Central Bank requirements and interpret new regulatory circulars
Define governance frameworks and SLAs for timely, accurate reporting
Actively assess new regulatory circulars, interpret their impact, and drive go-forward strategies
Oversee design, architecture, and solutioning of regulatory reporting tools and platforms
Manage vendor selection, implementation, and optimization of reporting systems
Establish and lead Run the Bank (RTB) and Change Management teams for sustainable delivery
Drive adoption of modern data platforms, AI/ML toolkits, and GenAI services including LLM-powered assistants
Collaborate with business, compliance, risk, and technology stakeholders to co-create data-driven solutions
Act as a key member of the Regulatory Reporting COE committee overseeing policy development, vendor selection, use case evaluation, and project approvals

Fulltime

New

Architect Data Quality

10Pearls is seeking a highly skilled and experienced Architect Data Quality Spec...

Location

Pakistan , Lahore, Karachi, Islamabad

Salary:

Not provided

10Pearls

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Information Systems, Finance, or a related field
A Master's degree is preferred
Minimum of 10 years of experience in data governance & Data quality management within the Banking & Financial services industry with overall experience of 14+ yrs in banking and data
Strong understanding of banking processes, systems, and regulatory requirements
Strong knowledge of DAMA DMBOK, BCBS 239, GDPR, and other regulatory requirements related to data quality
Excellent communication and interpersonal skills, with the ability to effectively communicate complex data concepts to non-technical stakeholders
Experience in Data quality tools and technologies preferably Informatica Data Engineering Quality (DEQ), Enterprise Data Catalog, AXON etc.
Experience and working knowledge on tools used for Data analytics and dashboard reporting preferably, Power BI, Qlik
Should have managed successful execution of minimum 2-3 large engagements into production go live with good project oversight and decision-making skills
Hands on experience analyzing data and solving complex queries using SQL, python

Job Responsibility

Define, implement, and maintain enterprise-wide data quality policies, standards, and procedures aligned with the bank's data governance framework
Collaborate with business and technology stakeholders to identify Critical Data Elements (CDEs) and establish data quality rules and controls
Drive data quality initiatives across Retail Banking, Corporate Banking, Treasury, International Banking, and support/control functions
Ensure compliance with regulatory requirements, internal governance standards, and industry best practices for data quality
Design and implement data quality measurement frameworks covering accuracy, completeness, consistency, timeliness, and validity
Develop and maintain data quality dashboards, scorecards, and reporting mechanisms to monitor data health and quality trends
Identify, investigate, and resolve data quality issues through root cause analysis and corrective action plans
Partner with technology teams to implement automated data quality controls, validation checks, and monitoring solutions
Act as the subject matter expert (SME) for data quality, providing guidance across business, risk, finance, compliance, and technology teams
Work closely with Data Owners, Data Stewards, Data Engineers, and business users to enforce data quality standards and governance practices

Fulltime

New

Tax Senior

We are looking for a Tax Senior to join a client-focused services firm serving c...

Location

United States , Framingham

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

Bachelor's in Accounting/Finance
3+ years of public tax experience
CPA/EA a plus
Excellent communication
Accounting software and MS Office experience
Clean resume with limited movement

Job Responsibility

Prepare and examine federal, state, and local tax filings for individuals, privately held companies, nonprofit organizations, and municipal clients
Contribute to audit and assurance engagements by assisting with planning activities, performing testing, maintaining documentation, and helping draft financial statements and disclosures
Handle tax accounting activities such as calculating provisions, reconciling accounts, recording journal entries, and evaluating current and deferred tax positions
Provide client accounting support through bookkeeping review, close process assistance, reconciliations, write-up services, and financial reporting preparation
Use knowledge of governmental and nonprofit accounting principles, including fund accounting and compliance obligations, to support specialized client engagements
Develop and review workpapers, trial balances, ledger details, and supporting schedules to promote accuracy and adherence to industry standards
Investigate tax and accounting questions, summarize findings, and present practical recommendations to clients and internal leadership
Advise clients throughout the year on planning opportunities, estimated tax obligations, and business structure considerations
Manage several client assignments at once while meeting deadlines and maintaining strong quality standards
Guide team members who are new to the role by reviewing work, offering coaching, and supporting their development on client engagements

What we offer

Medical, vision, dental, and life and disability insurance
Company 401(k) plan

Select Country

Principal Engineer, Iceberg

Job Description

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?

Principal Engineer, Iceberg

Principal Engineer, Iceberg

Principal Engineer, Tableflow

Principal Software Engineer - Data Platform

Principal Full Stack Engineer - Analytics Platform

Principal Data And Analytics Engineer

Principal/Architect Data Consultant - Analytics & AI

Architect Data Quality

Tax Senior

Our AI answers in your language