CrawlJobs Logo

Backend Software Engineer - Search, Crawler Team

· Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

We are seeking an experienced Backend Software Engineer to join our Crawler team. In this role, you will design, develop, and operate systems that ingest, process, and manage web-scale data in support of our next generation of advanced search technologies. This is a critical, high-impact engineering position, requiring expertise across both backend and frontend components of our data acquisition stack.

Job Responsibility

  • Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems
  • Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management
  • Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages
  • Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations
  • Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability

Requirements

  • Minimum of 5 years of software development experience
  • Strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go
  • Experience with large-scale web crawlers is highly desirable
  • Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services
  • Deep understanding of cloud infrastructure, with hands-on experience in Kubernetes (K8s) and AWS
  • Demonstrated passion for writing clean, efficient, and scalable systems

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Backend Software Engineer - Search, Crawler Team

8 matching positions

Senior Software Engineer, Data Acquisition

The Data Acquisition team within the Foundations organization at OpenAI is respo...
Location
Location
United States , San Francisco
Salary
Salary:
293000.00 - 385000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS/PhD in Computer Science or a related field
  • 6+ years of industry experience in software development
  • Experience with large web crawlers a plus
  • Strong expertise in large stateful distributed systems and data processing
  • Proficiency in Kubernetes, and Infrastructure-as-Code concepts
  • Willingness and enthusiasm for trying new approaches and technologies
  • Ability to handle multiple tasks and adapt to changing priorities
  • Strong communication skills, both written and verbal
Job Responsibility
Job Responsibility
  • Own and lead engineering projects in the area of data acquisition including web crawling, data ingestion, and search
  • Collaborate with other sub-teams, such as Data Processing, Architecture, and Scaling, to ensure smooth data flow and system operability
  • Work closely with the legal team to handle any compliance or data privacy-related matters
  • Develop and deploy highly scalable distributed systems capable of handling petabytes of data
  • Architect and implement algorithms for data indexing and search capabilities
  • Build and maintain backend services for data storage, including work with key-value databases and synchronization
  • Deploy solutions in a Kubernetes Infrastructure-as-Code environment and perform routine system checks
  • Conduct and analyze experiments on data to provide insights into system performance
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right

Graphic Designer

At Adapty, we make it easy for mobile apps to manage in-app purchases and paywal...
Location
Location
Salary
Salary:
Not provided
adapty.io Logo
Adapty.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of experience as a graphic designer
  • Confident command of Figma and the Adobe Suite
  • Hands-on experience with AI image-generation tools
  • Strong sense of composition, visual balance, and attention to detail
  • Adaptable, attentive, and a fast learner
Job Responsibility
Job Responsibility
  • Design ad creatives at high volume (static) for a steady stream of client campaigns
  • Build and ship web funnels on a weekly cadence
  • Use AI image-generation tools to speed up ideation and production without sacrificing quality
  • Work in Figma and the Adobe Suite to produce on-brand assets across formats and aspect ratios
  • Adapt quickly to different client brand guidelines and switch context between briefs
  • Keep output consistent, polished, and error-free under tight deadlines
  • Collaborate with the creative team and account owners to clarify briefs and deliver on time
What we offer
What we offer
  • Strong product with industry-best metrics
  • Exceptional compensation directly tied to your results
  • Direct communication and ownership
  • No bureaucracy, no politics, just impact
  • Flexible remote work
  • Professional support including Language learning, sports, health insurance, laptop coverage, and more
  • Fulltime
Read More
Arrow Right

Pharmacy Technician - Back End

Looking for a career that rewards you? As a Back-End Pharmacy Technician with Om...
Location
Location
United States , Portland
Salary
Salary:
16.00 - 28.84 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 17, 2026
Flip Icon
Requirements
Requirements
  • Certification/licensed/registered pharmacy technician or as required by state law
  • One (1) or more years of experience as a pharmacy technician or equivalent experience
Job Responsibility
Job Responsibility
  • Rotating and working in various assigned pharmacy workstations including: Packaging, Staging, Returns, Receiving, Narcotics, IV, Ekit, Compounding, Omnicell Cycle Fill, Machine Packaging
  • Receiving product deliveries, pull and stage product for distribution, rotate stock, and coordinate activities with drivers to ensure shipments are accurate and deliveries are timely
  • Performing physical inventories of medication
What we offer
What we offer
  • Medical coverage
  • Dental coverage
  • Vision coverage
  • Paid time off
  • Retirement savings options
  • Wellness programs
  • Fulltime
!
Read More
Arrow Right

Technical Support Engineer

At Adapty, we make it easy for mobile apps to manage in-app purchases and paywal...
Location
Location
Remote
Salary
Salary:
Not provided
adapty.io Logo
Adapty.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1+ year in 2nd-line (L2) support within a B2B environment
  • Basic SQL and API knowledge to navigate logs and databases
  • A patient, clear communicator who thrives in daily written customer interactions
  • English Intermediate+ with strong written English across async channels
  • Escalation discipline — you investigate before handing off.
Job Responsibility
Job Responsibility
  • Independently own the majority standard L2 support cases end to end
  • Investigate mobile subscription, SDK, and integration issues using logs, SQL, and API tools (Postman)
  • Act as the bridge to engineering — reproduce issues and write bug reports developers can act on
  • Meet response SLA (≥90%) and resolution-time targets while keeping CSAT ≥95%
  • Escalate with discipline: investigate root cause before passing anything to L3
  • Contribute to internal documentation and knowledge sharing
  • Provide reliable async coverage with clear handover notes, including night shifts.
What we offer
What we offer
  • Strong product with industry-best metrics
  • Exceptional compensation directly tied to your results
  • Direct communication and ownership
  • No bureaucracy, no politics, just impact
  • Flexible remote work
  • Professional support (Language learning, sports, health insurance, laptop coverage, and more).
  • Fulltime
Read More
Arrow Right

Pharmacy Technician

We're building a world of health around every individual — shaping a more connec...
Location
Location
United States , Louisville
Salary
Salary:
16.50 - 25.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
August 18, 2026
Flip Icon
Requirements
Requirements
  • Must comply with any state board of pharmacy requirements or laws governing the practice of pharmacy, which includes but is not limited to, age, education, and licensure/certification
  • If the state board of pharmacy does not address or mandate a minimum age requirement, must be at least 16 years of age
  • If the state board of pharmacy does not address or mandate a minimum educational requirement, must have a high school diploma or equivalent, or be actively enrolled in high school or high school equivalency program
  • State-level licensure and national certification requirements vary by state
  • Regular and predictable attendance, including nights and weekends
  • Ability to complete required training within designated timeframe
  • Attention and Focus: Ability to concentrate on a task over a period of time
  • Ability to pivot quickly from one task to another to meet patient and business needs
  • Ability to confirm prescription information and label accuracy, ensuring patient safety
  • Customer Service and Team Orientation: Actively look for ways to help people, and do so in a friendly manner
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences by showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
  • actively seeking opportunities to expand clinical and technical knowledge needed to better assist patients
  • Remaining flexible for both scheduling and business needs, while contributing to a safe, inclusive, and engaging team dynamic
  • voluntarily traveling to stores in the market to work shifts as needed by the business
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • other programs
  • Parttime
Read More
Arrow Right

Pharmacy Technician

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Brunswick
Salary
Salary:
17.10 - 27.10 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
August 01, 2026
Flip Icon
Requirements
Requirements
  • Must comply with any state board of pharmacy requirements or laws governing the practice of pharmacy, which includes but is not limited to, age, education, and licensure/certification
  • If the state board of pharmacy does not address or mandate a minimum age requirement, must be at least 16 years of age
  • If the state board of pharmacy does not address or mandate a minimum educational requirement, must have a high school diploma or equivalent, or be actively enrolled in high school or high school equivalency program
  • State-level licensure and national certification requirements vary by state
  • Register and certification requirements according to the State's Board of Pharmacy guidelines
  • Complete a rigorous company training program
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences by showing empathy and genuine care: creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Contributing to a high-performing team, embracing a growth mindset, and being receptive to feedback
  • actively seeking opportunities to expand clinical and technical knowledge needed to better assist patients
  • Remaining flexible for both scheduling and business needs, while contributing to a safe, inclusive, and engaging team dynamic
  • voluntarily traveling to stores in the market to work shifts as needed by the business
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • other programs
  • Parttime
Read More
Arrow Right

Staff Accountant

We are looking for a detail-oriented Staff Accountant to support day-to-day acco...
Location
Location
United States , Rochester Hills
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Accounting or a closely related field
  • Previous experience in a staff accounting, accounts payable, or similar accounting support role is preferred
  • Working knowledge of accounts payable, accounts receivable, general ledger activity, journal entries, and month-end close processes
  • Experience completing bank reconciliations and maintaining accurate financial documentation
  • Proficiency with accounting platforms such as NetSuite, Oracle, QuickBooks, or SAP
  • Strong understanding of fundamental accounting principles and financial controls
  • Excellent attention to detail, organizational ability, and time management skills
  • Ability to work collaboratively, manage competing deadlines, and investigate issues effectively
Job Responsibility
Job Responsibility
  • Process vendor invoices, verify supporting documentation, and ensure payments are completed accurately and on schedule
  • Reconcile supplier statements, research discrepancies, and resolve payment-related issues through timely follow-up
  • Support month-end close activities by preparing account reconciliations, recording journal entries, and reviewing transactions for accuracy
  • Maintain complete and reliable financial records by updating accounting data and monitoring accounts payable and related ledger activity
  • Respond to vendor and internal stakeholder questions with clear communication and effective problem-solving
  • Assist with accounts receivable tasks, bank reconciliations, and general ledger maintenance as needed to support the broader accounting team
  • Review accounting transactions across multiple systems to help ensure consistency, compliance, and accurate reporting
  • Collaborate with finance colleagues to improve workflow efficiency and meet reporting deadlines in a deadline-driven setting
What we offer
What we offer
  • Medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) or deferred compensation plan (if eligible)
  • paid time off for vacation, personal needs, and sick time
  • paid holidays
  • Choice Time Off (CTO): up to 13 days per year
  • up to 10 paid holidays per calendar year
  • Fulltime
Read More
Arrow Right

Pharmacy Manager

We're building a world of health around every individual — shaping a more connec...
Location
Location
United States , Kalamazoo
Salary
Salary:
65.00 - 85.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
August 10, 2026
Flip Icon
Requirements
Requirements
  • Active Pharmacist License in the state where the Store is located
  • Active National Provider Identifier (NPI)
  • Not on the DEA Excluded Parties list
  • 1-2 years of experience as a Pharmacist
Job Responsibility
Job Responsibility
  • Lead and develop a pharmacy team that provides exceptional patient care by promoting best practices and leading through change while identifying and addressing performance opportunities
  • Support novel program awareness, onboard newly hired pharmacy team members, and recognize colleagues for their success
  • Consistently exhibit best practices when working the bench, including quarterbacking the team, providing patients with meaningful counseling, and abiding by all legal and regulatory guidelines
  • Manage and improve patient health through safe and appropriate dispensing, counseling, and immunizing practices
  • Oversee the pharmacy team during bench shifts, including strengthening pharmacy performance measures through effective coaching and consistent follow-up of pharmacy team members
  • Support safe and accurate prescription fulfillment by following pharmacy workflow procedures and utilizing safety guardrails
  • Contribute to positive patient experiences by showing empathy and genuine care, and coaching the pharmacy team
  • Proactively offer and deliver immunizations
  • Support effective management of pharmacy inventory
  • Conduct new Technician and Pharmacist onboarding for the store and district
What we offer
What we offer
  • Medical, dental, and vision coverage
  • Paid time off
  • Retirement savings options
  • Wellness programs
  • CVS Health bonus, commission or short-term incentive program
  • Fulltime
Read More
Arrow Right