CrawlJobs Logo
LanceDB Logo LanceDB · IT - Software Development

Senior Open Source Engineer

180000.00 - 250000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

We’re looking for a Senior Open Source Engineer to help expand the reach of Lance and LanceDB within the broader data infrastructure ecosystem. You’ll work at the intersection of high-performance computing, big data, and open-source systems—driving integrations, improving distributed operations, and contributing to projects across the Apache and AI communities.

Job Responsibility

  • Driving open-source community efforts to integrate the Lance format with Spark, Hive Metastore, Presto, Trino, Ray, and other data infrastructure systems
  • Designing and maintaining efficient distributed Lance dataset operations
  • Building efficient indices to enable predicate pushdown and accelerate queries in Spark, Ray, or Trino
  • Working on table formats, data encodings, and various aspects of the Lance format in Rust
  • Operating and improving internal data processing infrastructure
  • Promoting the Lance format in open-source communities and at Big Data conferences

Requirements

  • 10+ years of experience building high-performance databases, big data systems, or large-scale data services
  • Deep understanding of internals of open-source Big Data or AI training systems (e.g., Hadoop, Spark, Flink, Ray, Iceberg, Delta Lake, Hudi, ClickHouse, Trino, Presto, PyTorch, or JAX)
  • Strong experience with high-performance computing in Java or Scala
  • Experience with Rust (or willingness to learn it)
  • Proven ability to move fast, work independently, and collaborate with a high-caliber team

Nice to have

  • Contributor, committer, or PMC member in Apache or other large open-source projects
  • Experience with Java, Rust, C++, Apache Arrow, DataFusion, Parquet, Iceberg, or Delta Lake
  • Track record of driving large features or integrations in distributed systems
  • Strong community presence and passion for open-source collaboration

What we offer

  • Medical, dental, vision, and life insurance
  • 401(k) retirement plan
  • Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA)
  • Commuter benefits
  • Generous paid time off
  • Offers Equity
  • Generous learning budget and support for open-source contributions
LanceDB - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Open Source Engineer

8 matching positions

Senior Software Development Engineer, AI Open-Source Software

AMD is looking for a principal software developer to join our growing team. As a...
Location
Location
United States , Santa Clara
Salary
Salary:
204000.00 - 306000.00 USD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years professional software development experience
  • Demonstrated capacity to technically lead and people manage junior to mid-level developers
  • Proficient in C/C++ & Python programming employing best software design practices
  • GPU software development or validation involving HIP, CUDA, or OpenCL
  • Experience with software libraries and API design
  • Exposure to Matrix/Tensor operations and numerical work
  • Software emulation to support FP numerical formats is a plus
  • Experience in software performance estimations, optimizations and debugging
  • Ability to closely interact with technical leads, developers, and test teams to maintain and release production software
Job Responsibility
Job Responsibility
  • Develop software in C++, Python, HIP, assembly, and SOTA programming technologies to enable key mathematical operations on GPU
  • Design GPU computational software libraries for AI, HPC applications
  • Aid management in planning, and delivering industry-leading software for current and future processors
  • Supervise small development team
  • Carry-out performance optimizations and projections for important use-cases to maximize hardware utilization
  • Support development of programs to sustain seamless performance analysis, and performance/functional test coverage
  • Identify and help resolve quality issues working closely with libraries development teams and other internal engineering teams
What we offer
What we offer
  • Benefits offered are described: AMD benefits at a glance
  • Fulltime
Read More
Arrow Right

Senior Staff Engineer – Cybersecurity Data Protection Engineer

GEICO’s Cybersecurity organization has an exciting opportunity for an accomplish...
Location
Location
United States , Chevy Chase; Palo Alto; Seattle
Salary
Salary:
115000.00 - 260000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with data discovery, classification, handling, access, inventory, and retention
  • Proven experience with data protection technologies, such as encryption, tokenization and data loss prevention tools
  • Familiar with programming languages such as Python, Java, or .NET
  • Experience with designing and implementing data security solutions for enterprise environments
  • Experience in managing and supervising other Data Protection Engineers
  • Experience in developing and managing data protection programs focused on data discovery, data inventory, data risk assessments, and encryption for both structured and unstructured data
  • Strong knowledge of cybersecurity laws, regulations, and best practices
  • Knowledge of data security frameworks, standards, and protocols
  • Strong understanding of data privacy laws and regulations (i.e. NYDFS, PCI, etc.)
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Develop and Implement data protection strategies and initiatives, including classification and handling, data access controls, inventory, encryption, and retention
  • Work closely with other stakeholders to enforce data protection related policy and respond to regulatory requirements
  • Develop and maintain data security policies, procedures, standards, and ensure that they are followed by the entire organization
  • Create and maintain data inventories and data flows, and manage data sharing controls
  • Drive the design and implementation of data access controls, ensuring only authorized access to sensitive data
  • CO-develop and implement data retention policy and procedures, ensure compliance with internal policy and external regulations
  • Enforce data encryption standards and strategies to secure data at rest and in transit
  • Lead incident response efforts related to data breach and work with stakeholders to mitigate impact
  • Lead and conduct regular data risk assessments to identify potential vulnerabilities and threats to the organization's data and information systems
  • Stay abreast of new developments in the field of cybersecurity and ensure that the organization's risk assessment and data security processes are aligned with industry standards and best practices
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Senior Staff Software Engineer (Impala Performance Engineer)

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of industry experience in performance related work ideally on large scale distributed systems
  • Understanding of DBMS algorithms and data structure fundamentals
  • Understanding of hardware trends and full stack systems performance: CPU, RAM, storage, network, Linux kernel, JVM, distributed systems performance
  • Deep understanding of performance measurement methodologies and performance analysis tools and techniques
  • Strong design and coding skills (Java/C++/Golang/Python preferred)
  • Ability to work in a distributed setting with team members spread across multiple geographies
  • Demonstrated ability to work on large cross-functional projects, including strong communication skills and a collaborative mindset
  • Hands-on experience with containerization and Kubernetes
  • B.S. or M.S. in Computer Science or equivalent experience
Job Responsibility
Job Responsibility
  • Work with internal development teams and the open source community to proactively drive performance improvements/optimizations across our data warehouse stack
  • Work with product managers, developers and the field team to understand performance and scale requirements and customer workload characteristics, and develop benchmarks and related performance analysis tooling based on these requirements
  • Analyze performance and scalability characteristics to identify bottlenecks in large-scale distributed systems
  • Perform root cause analysis of performance issues identified by internal testing and from customers and suggest corrective actions
  • Evaluate performance of competitor systems
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Senior Staff Software Engineer (Impala Performance Engineer)

At Cloudera, we empower people to transform complex data into clear and actionab...
Location
Location
Hungary , Budapest; Szeged; Remote
Salary
Salary:
Not provided
cloudera.com Logo
Cloudera
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of industry experience in performance related work ideally on large scale distributed systems
  • Understanding of DBMS algorithms and data structure fundamentals
  • Understanding of hardware trends and full stack systems performance: CPU, RAM, storage, network, Linux kernel, JVM, distributed systems performance
  • Deep understanding of performance measurement methodologies and performance analysis tools and techniques
  • Strong design and coding skills (Java/C++/Golang/Python preferred)
  • Ability to work in a distributed setting with team members spread across multiple geographies
  • Demonstrated ability to work on large cross-functional projects, including strong communication skills and a collaborative mindset
  • Hands-on experience with containerization and Kubernetes
  • B.S. or M.S. in Computer Science or equivalent experience
Job Responsibility
Job Responsibility
  • Work with internal development teams and the open source community to proactively drive performance improvements/optimizations across our data warehouse stack
  • Work with product managers, developers and the field team to understand performance and scale requirements and customer workload characteristics, and develop benchmarks and related performance analysis tooling based on these requirements
  • Analyze performance and scalability characteristics to identify bottlenecks in large-scale distributed systems
  • Perform root cause analysis of performance issues identified by internal testing and from customers and suggest corrective actions
  • Evaluate performance of competitor systems
What we offer
What we offer
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups
  • Fulltime
Read More
Arrow Right

Information System Security Engineer - Senior

In support of a challenging, critical, and rewarding program that provides integ...
Location
Location
United States , San Antonio
Salary
Salary:
160000.00 - 175000.00 USD / Year
amentum.com Logo
Amentum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must have active Top-Secret clearance with SCI or TS with the ability to acquire SCI
  • Experience in Splunk role while working in a Splunk Clustered Environment
  • Knowledge and experience with NESSUS/ACAS and Trellix administration
  • Must be able to work a 40-hour work week, normally Monday through Friday
  • Ability to work overtime during critical peaks and be available to meet last-minute requests for overtime if needed
  • Ability to travel (5-10%) primarily within 75 miles
  • Familiarity with MS Office applications such as Excel, Word, Outlook, SharePoint, Project, and Visio
  • Exceptional attention to detail
  • excellent verbal and written communication skills
  • strong critical thinking, organizational, time-management, and problem-solving skills
Job Responsibility
Job Responsibility
  • Experience creating custom dashboards, writing queries, building, and generating reports, and setting up alerts and notifications using all the Cyber tools (Splunk, Tenable, Trellix)
  • Demonstrated proficiency with recognizing and onboarding new data sources into the cyber tools and analyzing the data for anomalies and trends
  • Primarily responsible for maintaining the test and operational environments to include all cybersecurity tool sets and collaborating with systems and network engineers
  • Use knowledge, skills, and ability to conduct research for designing, integrating, and implementing security controls into current and future products/systems thus ensuring these systems can be accredited based on compliance with the Joint Special Access Program Implementation Guide (JSIG)
  • Recommend the components to implement system security requirements using intimate knowledge of security design best practices for information systems throughout the system development life cycle to support the generation of security engineering products
  • Assist with the design, deployment, and administration of a multi-site, distributed Splunk environment including Multi-site Clustering, Search Head Clustering, Universal Forwarders, Deployer, and Deployment Server
  • Configure, operate, and maintain Trellix and its components (ePolicy Orchestrator, Trellix Agent, Data Loss Prevention, Host Intrusion Prevention System, Policy Auditor, Asset Baseline Monitor, and Virus Scan Enterprise) on Windows and Linux creating exceptions to allow essential processes to continue uninterrupted
  • Administration/operation of information security compliance tools/platforms with a special concentration in managing Tenable Security Center and NESSUS
  • Provide Tier 1, 2, and 3 maintenance support for deployed cyber security technologies
  • Assist with periodic and regular security assessments
What we offer
What we offer
  • Health, dental, and vision insurance
  • Paid time off and holidays
  • Retirement benefits (including 401(k) matching)
  • Educational reimbursement
  • Parental leave
  • Employee stock purchase plan
  • Tax-saving options
  • Disability and life insurance
  • Pet insurance
  • Fulltime
Read More
Arrow Right

Senior Engineer, Interactive Voice Response - AI/ML

Our Service Engineering team at GEICO is revolutionizing customer service using ...
Location
Location
United States , Palo Alto, CA; New York City, NY; Chevy Chase, MD
Salary
Salary:
80000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on proficiency with modern AI/ML frameworks and tools (e.g., TensorFlow, PyTorch) and programming languages such as Python, Java, or C++
  • Proven experience designing, developing, and deploying AI or machine learning models (LLMs) in production environments, with a focus on scalability and performance
  • Strong software engineering background with expertise in building large-scale distributed systems, preferably in cloud environment (Azure or AWS)
  • Demonstrated ability to apply AI/ML solutions to real-world business problems, delivering measurable impact in areas such as natural language processing, speech recognition, recommendation systems, or intelligent automation
  • Experience in building products using micro-service-oriented architecture and extensible REST APIs
  • Experience building the architecture and design (architecture, design patterns, reliability, and scaling) of new and current systems
  • Experience with continuous delivery and infrastructure as code
  • Experience in leveraging PowerShell scripting
  • Experience in existing Operational Portals such as Azure Portal
  • Experience with application monitoring tools and performance assessments
Job Responsibility
Job Responsibility
  • Design, develop, and deploy large-scale distributed AI applications that power customer self-service across multiple communication channels (voice, IVR, chat)
  • Build and optimize multi-agent systems that enable intelligent, collaborative decision-making to improve automation and customer experience
  • Collaborate with cross-functional teams (engineering, product, data science) to translate business requirements into scalable AI/ML solutions
  • Ensure system reliability, scalability, and performance through best practices in architecture, testing, and monitoring
  • Stay at the forefront of AI and distribute systems research, bringing innovative approaches and tools into production environment
  • Utilize programming languages like Python, SQL, and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of Azure tools and services
  • Consistently share best practices and improve processes within and across teams
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Senior Engineer – (Systems Engineering, Enterprise Infra & Platform Support)

The Senior Infrastructure & Platform Support Engineer provides end-to-end techni...
Location
Location
United States , Chevy Chase
Salary
Salary:
80000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience leading engineering efforts or owning internal, enterprise-scale platforms and working directly with enterprise customers
  • Familiarity with enterprise application lifecycle (selection, deployment, user adoption, decommission, integration layers)
  • Strong background in enterprise infrastructure supporting Windows and Linux systems, including builds, configuration, hardening, and troubleshooting
  • Advanced skills with Windows Server, Active Directory, authentication protocols (Kerberos / LDAP / SAML / OAuth), and Azure AD/identity integrations
  • Solid Linux administration experience (Ubuntu, RHEL, or equivalent), with certifications preferred
  • Proficiency in automation and scripting (PowerShell, Bash, Python)
  • Strong understanding of networking fundamentals: TCP/IP, DNS, DHCP, routing, VPNs, firewalls, load balancers, VLANs, and secure connectivity
  • Hands-on experience with cloud platforms (Azure/AWS), hybrid environments, virtualization (vSphere/Hyper-V), and containers (Docker, Kubernetes)
  • Knowledge of monitoring and observability tools, such as Prometheus, Grafana, or equivalent solutions
  • Familiarity with database concepts, performance tuning, and integration of MySQL/PostgreSQL/SQL Server/Oracle with enterprise systems
Job Responsibility
Job Responsibility
  • Provide technical leadership to ensure strong engineering standards and operational excellence
  • Support, configure, and maintain both Linux and Windows server platforms, including application servers, integration components, and system services
  • Design and implement infrastructure solutions for workplace technologies including but not limited to digital mailroom, physical security & safety, and real estate facility management technology platforms—covering on-prem systems, hybrid setups, and SaaS applications
  • Build production-ready configurations emphasizing reliability, maintainability, scalability, and testability
  • Lead incident response, troubleshooting, root-cause analysis, and drive ongoing performance optimization
  • Execute DevOps activities including CI/CD pipeline management, automation scripting, monitoring setup, and Infrastructure as Code
  • Ensure platform observability through logging, alerting, dashboards, and automated health checks
  • Apply secure design practices, compliance controls, network segmentation, encryption, and access management
  • Manage platform lifecycle activities such as patching, upgrades, capacity planning, backups, disaster recovery and identifying opportunities for automation and standardization
  • Collaborate with cross-functional teams, vendors, and senior engineers, communicating clearly with technical and non-technical stakeholders
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Senior Engineer- Artificial Intelligence

We’re looking for a seasoned Senior AI Engineer to join our growing AI team. In ...
Location
Location
Canada , Toronto
Salary
Salary:
126090.00 - 140100.00 CAD / Year
tucows.com Logo
Tucows
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field
  • 5+ years of software engineering experience, with recent focus on AI/LLM systems
  • Advanced proficiency in Python and Golang
  • Strong knowledge of software design patterns (SOLID, DRY, CQRS, Saga, event-driven)
  • Deep understanding of the Software Development Life Cycle (SDLC)
  • Proven experience building distributed, highly available systems at scale
  • Strong system design expertise: APIs, async processing, backpressure, fault tolerance
  • Experience with event-driven systems (Kafka, RabbitMQ)
  • Strong engineering practices: TDD, CI/CD, code reviews, and technical debt management
  • Experience writing and communicating Architecture Decision Records (ADRs)
Job Responsibility
Job Responsibility
  • Lead the architecture and development of AI-driven features using Python and Golang
  • Own end-to-end delivery of LLM-based systems — from prototype to production — with a focus on scalability, reliability, and cost efficiency
  • Integrate and fine-tune open-source models (e.g., LLaMA, Mistral, Mixtral) and drive model selection and serving strategies
  • Research and champion emerging AI technologies aligned with product vision
  • Define and uphold architectural best practices through design and code reviews
  • Mentor junior and intermediate engineers, providing technical leadership on complex problems
  • Translate AI capabilities and constraints into clear business context for non-technical stakeholders
  • Shape responsible AI practices, including safety, privacy, and governance
  • Stay current with the open-source AI ecosystem and bring forward relevant innovations
What we offer
What we offer
  • Generous benefits
  • Fair compensation
  • Remote-first work for majority of roles
  • Reasonable accommodation for individuals with disabilities
  • Fulltime
Read More
Arrow Right