Staff Software Engineer I - Stream Governance Job at Confluent

Member of Technical Staff - Data Engineer

As Microsoft continues to push the boundaries of AI, we are on the lookout for i...

Location

United States , New York

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, or data engineering work
OR equivalent experience
4+ years technical engineering experience building data processing applications (batch and streaming) with coding in languages including, but not limited to, Python, Java, Spark, SQL
Experience working with Apache Hadoop eco system, Kafka, NoSQL, etc
3+ years experience with data governance, data compliance and/or data security
2+ years' experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP. Extensive use datastores like RDBMS, key-value stores, etc
2+ years' experience building distributed systems at scale and extensive systems knowledge that spans bare-metal hosts to containers to networking
Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience
Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security

Job Responsibility

Build scalable data pipelines for sourcing, transforming and publishing data assets for AI use cases
Work collaboratively with other Platform, infrastructure, application engineers as well as AI Researchers to build next generation data platform products and services
Ship high-quality, well-tested, secure, and maintainable code
Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively
Enjoy working in a fast-paced, design-driven, product development cycle
Embody our Culture and Values

Fulltime

New

Senior Software Engineer

Wells Fargo is seeking a Senior Software Engineer. This is for Data Engineering ...

Location

India , Hyderabad

Salary:

Not provided

Wells Fargo

Expiration Date

February 23, 2026

Requirements

4+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Strong years of Software Engineering experience OR equivalent (industry, training, military, education)
Hands-on experience with Python, SQL, and bash scripting for automation
Strong experience building big data pipelines using Apache Spark, Hive, Hadoop
Experience with Autosys/Airflow or similar orchestration tools
Working knowledge of REST APIs, Object Storage, Dremio, and CI/CD pipelines
Strong troubleshooting and problem‑solving capabilities
Solid foundation in data modeling (conceptual/logical/physical) and database design
Cloud-native engineering experience — serverless, managed Spark, event-driven architectures
Familiarity with containerization (Docker, K8s) and workflow operators

Job Responsibility

Lead moderately complex initiatives and deliverables within technical domain environments
Contribute to large scale planning of strategies
Design, code, test, debug, and document for projects and programs associated with technology domain, including upgrades and deployments
Review moderately complex technical challenges that require an in-depth evaluation of technologies and procedures
Resolve moderately complex issues and lead a team to meet existing client needs or potential new clients needs while leveraging solid understanding of the function, policies, procedures, or compliance requirements
Collaborate and consult with peers, colleagues, and mid-level managers to resolve technical challenges and achieve goals
Lead projects and act as an escalation point, provide guidance and direction to less experienced staff
Deliver high-quality engineering outcomes during Data Center exit migrations and DPC onboarding, ensuring validations, automation, and production readiness
Collaborate with cross-functional teams to build scalable, high‑performance data solutions using Python, SQL, Spark, Iceberg, Dremio, and Autosys
Design, build, test, deploy, and maintain large-scale structured and unstructured data pipelines using Python, SQL, Apache Spark, and modern data lake/lakehouse technologies

Fulltime

!

New

Staff Software Engineer, Backend Platform

At Harvey, we’re transforming how legal and professional services operate — not ...

Location

United States , San Francisco

Salary:

238000.00 - 290000.00 USD / Year

Harvey

Expiration Date

Until further notice

Requirements

7+ years of software engineering experience (post-BS/MS), including building scalable backend systems or internal developer platforms
Proficiency in Python (or similar languages) and deep knowledge of backend development fundamentals (APIs, data stores, concurrency, distributed systems)
Hands-on experience with web frameworks and service architectures (e.g. Flask/FastAPI, Bounded context services, microservices) and an understanding of designing clean, versioned APIs
Familiarity with caching, messaging, and database technologies (Redis, Kafka, SQL/NoSQL databases, Vector databases, etc.) and how to use them effectively for high performance and reliability
A track record of writing high-quality, well-tested code and using tools (unit/integration testing, static typing, CI) to catch issues early and ensure reliability
Strong problem-solving skills and a passion for improving developer experience — you enjoy creating tools or frameworks that make other engineers more productive
Excellent collaboration and communication skills, with the ability to work across teams and incorporate feedback

Job Responsibility

Develop and maintain Harvey’s internal backend frameworks and libraries that provide common capabilities (API routing, service lifecycle management, caching and messaging primitives, error handling interfaces, etc.), so product teams don’t have to reinvent them
Create and improve APIs, service templates, and versioned interfaces that establish consistent patterns for building new services and features
Introduce and champion modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing, continually evolving our platform for better performance and scalability
Design Harvey-specific abstractions and domain-specific frameworks—covering cross-cutting concerns (e.g., authorization, streaming) and areas like data governance and event processing—to provide product engineers with these capabilities out of the box
Embed reliability and observability into the platform by building in tracing, metrics, and automated tests (shift-left), ensuring services built on our foundation are robust and easy to monitor
Collaborate with Model Infrastructure team to tackle challenges unique to GenAI-native applications — such as supporting high-throughput model inference, managing streaming and long-running API interactions, and designing abstractions for retrieval, context handling, and prompt lifecycle
Collaborate with the Developer Experience and Infrastructure teams (who own CI/CD pipelines, build tools, and release infrastructure) to integrate our platform components seamlessly into the deployment and monitoring ecosystem
Work closely with product engineering teams to gather feedback, evangelize best practices, and make the “paved road” approach a reality — providing strong defaults and clear documentation so teams can move fast with confidence

What we offer

Offers Equity
Offers Bonus
Comprehensive health, dental and vision coverage
retirement benefits (401k match up to 4%)
flexible PTO

Fulltime

New

Member of Technical Staff - Data Platform

If you are excited by the challenge of designing distributed systems that proces...

Location

United States , Mountain View; Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
Proficiency in Python, Scala, Java, or Go
Deep Distributed Systems Knowledge: Demonstrated technical understanding of massive-scale compute engines (e.g., Apache Spark, Flink, Ray, Trino, or Snowflake)
Experience architecting Lakehouse environments at scale (using Delta Lake, Iceberg, or Hudi)
Experience building internal developer platforms or "Data-as-a-Service" APIs
Strong background in streaming technologies (Kafka, Azure EventHubs, Pulsar) and stateful stream processing
Experience with container orchestration (Kubernetes) for deploying data applications
Experience enabling AI/ML workloads (Feature Stores, Vector Databases)

Job Responsibility

Core Platform Engineering: Design and build the underlying frameworks (based on Spark/Databricks) that allow internal teams to process massive datasets efficiently
Distributed Systems Architecture: Modernize our data stack by moving from batch-heavy patterns to event-driven architectures
Unstructured AI Data Pipelines: Architect high-throughput pipelines capable of processing complex, non-tabular data (documents, code repositories, chat logs) for LLM pre-training, fine-tuning and evaluations datasets
AI Feedback Loops: Engineer the high-throughput telemetry systems that capture user interactions with Copilot
Infrastructure as Code: Treat the data platform as software. Define and deploy all storage, compute, and networking resources using IaC (Bicep/Terraform)
Data Reliability Engineering: Move beyond simple "validation checks" to build automated governance and observability systems
Compute Optimization: Deep-dive into query execution plans and cluster performance. Optimize shuffle operations, partition strategies, and resource allocation

Fulltime

New

Lead Software Engineer - AI Engineering

Join RTB House and lead our AI Engineering Lab, a team dedicated to pioneering i...

Location

Poland

Salary:

Not provided

RTB House

Expiration Date

Until further notice

Requirements

Minimum of 6 years of professional experience in Software Engineering, with a strong background in building and deploying complex, large-scale systems
Distributed Systems Expertise: Proven, hands-on experience designing, developing, and operating distributed systems at scale (e.g., microservices, event-driven architectures, stream processing)
Programming Languages: Proficiency in at least two programming languages, with Python being mandatory
AI/ML Engineering: Basic understanding of the Machine Learning lifecycle, MLOps practices, and experience in integrating ML models (especially LLMs) into production applications
Technical Leadership: Demonstrated experience in technical leadership, including defining technical roadmaps, mentoring junior engineers, leading code reviews, and driving architectural decisions
Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.

Job Responsibility

Lead, mentor, and grow a team of talented Frontend/Full Stack and Backend engineers, fostering a culture of technical excellence and high code quality
Serve as a Full Stack tech-leader (often hands-on), contributing to the design and development of key architectures and full stack solutions that support various platforms (Web, Mobile, CTV)
Define and execute the team's charter, focusing on end-to-end customer interactions and the reliable display of ads globally
Develop and oversee state-of-the-art observability systems for the Ad Display platform, tracking crucial metrics like reliability, viewability, latency, and providing deep debugging insights for ad creation teams
Provide governance for cross-team ad rollout, including defining best practices and tooling for rigorous testing and deployment strategies (A/B testing, Canary deployments)
Lead complex technical projects at massive scale, ensuring our solutions can handle millions of requests and maintain high performance worldwide
Collaborate intensely with a Staff Frontend Engineer, stakeholders from Ads layouts creation teams (designers, graphic specialists), and the core Bidding Platform backend teams.

What we offer

Projects focused on high code quality – solid code reviews are our standard
Collaboration within an interdisciplinary, self-sufficient team including: DevOps (ensuring a great Developer Experience), database experts, backend developers, product designers, and QA engineers
Hardware and software tailored to your preferences – e.g. MacBook, AI tool licenses
Access to modern technologies and the opportunity to apply them in large-scale, high-impact projects
Flexible working conditions – no core hours, fully remote cooperation.

Staff Engineer

The Staff Engineer provides technical leadership across the Value Stream and Cap...

Location

United Kingdom

Salary:

Not provided

Admiral Group Plc

Expiration Date

Until further notice

Requirements

Proven experience in a Senior or Staff Engineer role, ideally within web and mobile application development
Deep expertise in React and NestJS, including server-side rendering, state management, and API development
Experience designing and operating micro frontend (MFE) architectures, including module federation and independently deployed pipelines
Strong background in CI/CD practices, automated testing, and optimised deployment strategies
In-depth knowledge of testing frameworks and strategies across unit, integration, E2E, and non-functional domains
Extensive experience with cloud-native environments—preferably GCP and Azure
Skilled in performance optimisation techniques such as caching, code splitting, lazy loading, and real-user monitoring
Deep understanding of web and mobile security best practices, including OWASP guidelines, secure authentication and authorisation
Experience with containerisation and infrastructure tools such as Docker, Kubernetes, Helm, and Terraform
Familiarity with mobile frameworks such as Ionic Capacitor

Job Responsibility

Provide technical leadership and guidance to engineers across the Value Stream
Mentor engineers within your area of expertise to support their technical growth
Support the Principal Engineer and senior leadership team with technical risk management, strategy, and decision-making
Help shape epics and technical deliverables in alignment with roadmap goals
Own technical dependencies and contribute to planning cycles including Quarterly Alignment, Monthly Value Stream Planning, and Sprint Planning
Contribute to the detailed design, engineering quality, and technical oversight of solutions delivered within the Value Stream
Drive improvements to CI/CD pipelines, automation, testing practices, and secure delivery
Lead on resolving technical constraints, blockers, and integration challenges
Identify and address technical debt, ensuring sustainability and maintainability
Oversee vulnerability management by promoting secure development practices and robust solution design

What we offer

Eligible for up to £3,600 of free shares each year after one year of service
33 days holiday (including bank holidays) when they join us, increasing the longer you stay with us, up to a maximum of 38 days (including bank holidays)
Option to buy or sell up to an additional five days of annual leave
Financial & Mortgage Advice
24-Hour Ecare
Cycle to Work Scheme
Flexible Working
Simply Health
Private Health Cover
Critical Illness Cover

Fulltime

New