CrawlJobs Logo

OpenSearch Architect

India, Hyderabad · Job Posted January 19, 2026
Apply Position
Job Link Share

Job Description

SoftClouds LLC is seeking a highly experienced OpenSearch Architect to lead the design, implementation, and optimization of large-scale, mission-critical search and analytics platforms. The ideal candidate will have extensive hands-on experience in real-time, production-grade OpenSearch environments, including cluster architecture, performance tuning, index optimization, and end-to-end data migration from on-premises systems to cloud platforms. This role requires strong technical expertise and strategic vision to ensure scalability, high availability, resilience, and operational excellence across enterprise search, logging, and observability systems.

Job Responsibility

  • Architect and operate high-availability OpenSearch clusters serving mission-critical datasets
  • Lead on-prem to cloud migration projects, optimizing for availability, scalability, and cost efficiency
  • Design and implement indexing, sharding, and replication strategies for diverse search and log analytics workloads
  • Build and enhance data ingestion pipelines using Logstash, Fluentd, Filebeat, or custom data connectors
  • Configure and optimize NLP models for advanced text processing and analysis use cases
  • Schedule indexing jobs and manage data synchronization across different nodes in the cluster
  • Establish and enforce best practices for cluster monitoring, scaling, alerting, and capacity planning
  • Collaborate with data engineers and DevOps teams to integrate OpenSearch with streaming and analytics platforms
  • Implement robust security and compliance frameworks, including role-based access, encryption, and IAM integration
  • Conduct performance analysis, root cause investigations, and system optimization initiatives
  • Stay abreast of emerging trends in OpenSearch and related open-source search technologies

Requirements

  • 10+ years of experience in enterprise search or data infrastructure, with at least 5 years in OpenSearch/Elasticsearch architecture
  • Proven experience managing large, complex clusters and ensuring high uptime in production environments
  • Hands-on expertise in cluster design, index lifecycle management (ILM), snapshot/restore, and replication strategies
  • Practical experience with cloud-native deployments using AWS OpenSearch Service, EKS, or Kubernetes
  • Strong programming and automation skills in Python, Bash, and Terraform
  • Solid understanding of distributed systems, data ingestion, and real-time analytics architecture
  • Proficiency with observability and monitoring solutions such as Prometheus, Grafana, and OpenTelemetry
  • Deep expertise in advanced NLP model configuration and integration within search ecosystems
  • Experience designing and implementing robust data ingestion pipelines at scale
  • Excellent communication and documentation skills for technical stakeholder engagement
  • Strong problem-solving abilities and attention to detail in a fast-paced environment
  • Bachelor's degree or Master's degree in Computer Science, Engineering, or related discipline

Nice to have

  • Experience with Kubernetes operators for OpenSearch cluster management
  • Proficiency in Infrastructure-as-Code (IaC) practices and tools beyond Terraform
  • Certification in cloud platforms (AWS, GCP, or Azure)
  • Prior experience with large-scale data migration projects
  • Knowledge of advanced security frameworks and compliance standards (HIPAA, SOC2, PCI-DSS)
  • Contributions to open-source search or observability projects

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

OpenSearch Architect

8 matching positions

Staff Software Engineer : Storage, Search, & Data Platforms

The Storage, Search, and Data (SSD) group is the custodian of Uber's digital int...
Location
Location
United States , Seattle; San Francisco; Sunnyvale
Salary
Salary:
232000.00 - 258000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of software engineering experience, with a proven history of designing and operating massive-scale distributed data systems
  • Elite engineering skills in Go, Java, C++, or Rust. You are comfortable deep-diving into database internals, kernel-level optimizations, and complex distributed consensus protocols
  • Proven experience leading technical strategy across multiple teams or organizations, turning high-level business goals into concrete technical realities
  • Extensive experience managing Tier-0, mission-critical systems with 99.99% availability and global blast-radius constraints
Job Responsibility
Job Responsibility
  • Define and execute the multi-year roadmap to transition Uber from Data Storage to a Cloud-Native Data Provider, solving for cross-region latency, global metadata consistency, and exabyte-scale cost efficiency
  • Partner with Uber's AI/ML leadership to architect the Data-to-GPU pipeline. You will design the one-stop storage APIs that allow researchers to leverage high-performance data access across multi-cloud regions and vendors seamlessly
  • Drive the next generation of our core engines: Docstore (NoSQL), Vitess (Sharded MySQL), Apache Pinot (Real-time Analytics), and OpenSearch (Discovery)
  • You will represent Uber in the global community as a leader in key open source technologies including Apache, Hudi, Iceberg and many others
What we offer
What we offer
  • Eligible to participate in Uber's bonus program
  • May be offered an equity award & other types of comp
  • Eligible to participate in a 401(k) plan
  • Various benefits
  • Fulltime
Read More
Arrow Right

Senior Search Engineer - Search and Browse Core

Join the Search Retrieval Team, the engine driving product and content discovery...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
zalando.se Logo
Zalando Sverige
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep Search Expertise: Extensive experience building large-scale, preferably e-commerce, search engines. While our stack is built on Elasticsearch, we highly value equivalent expertise in Lucene, OpenSearch, Solr, or other distributed search systems.
  • Real-Time Data Pipeline Experience: Proven ability to design and build high-throughput data ingestion pipelines using Kafka and/or Flink or equivalent stream-processing frameworks.
  • Strong Backend Foundation: High proficiency in a JVM language (Java, Kotlin, or Scala) and a deep understanding of distributed systems architecture, concurrency, and performance optimization.
  • Cross-Functional Collaboration: Excellent communication skills. You thrive when working closely with fellow engineers, applied scientists, and product partners, and you possess a knack for translating complex product requirements into reusable, reliable platform capabilities.
Job Responsibility
Job Responsibility
  • Architect the Future of Search: Lead the design and implementation of our next-generation, AI-driven search engine, integrating Neural Search on top of our Elasticsearch platform.
  • Build for Hyperscale: Modernize and scale our real-time data ingestion systems using technologies like Kafka and Flink to handle millions of updates.
  • Drive Platform Innovation: Develop core platform capabilities that enable teams across Zalando to build rich, personalized discovery experiences for our customers.
  • Drive Operational Excellence and Cost Efficiency: Lead platform-wide infrastructure projects, such as consolidating multi-lingual search indices, mitigating critical risks by migrating core services, and supporting system readiness for high-traffic events like Cyber Week.
What we offer
What we offer
  • Employee shares program
  • 40% off fashion and beauty products sold and shipped by Zalando, 30% off Zalando Lounge, discounts from external partners
  • 2 paid volunteering days a year
  • Hybrid working model with 60% (or more) remote per week, actual practice is up to each team to best support their collaboration
  • Work from abroad for up to 30 working days a year
  • 27 days of vacation a year (for Zalando SE)
  • Relocation assistance available (subject to prior agreement)
  • Family services, including counseling and support
  • Health and wellbeing options (including Gympass)
  • Mental health support and coaching available
  • Fulltime
Read More
Arrow Right

Unix - Senior Cloud - Digital Engineering Sr. Staff Engineer

Location
Location
India , Noida
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Should have a minimum of 8 to 10 years of experience as a Linux/Unix System Administrator. Should have expertise on at least 2 flavors of Unix. Linux is a must!
  • Should have a deep level of understanding of Linux OS & should be able to handle day to day admin tasks.
  • Should be well versed shell scripting.
  • Expert in Unix-Linux, AWS Cloud Administration, OS/server administration, patching, maintenance, and troubleshooting.
  • Proficient in operating and troubleshooting AWS services like EC2, networking, RDS, backups, storage (EBS, EFS, S3, Glacier), and security (Well-Architected framework).
  • Possesses a strong understanding of networking concepts for configuring secure VPCs, subnets, landing zones, ACLs, and security groups.
  • Experience in end-to-end cloud migrations, including strategy, assessment, design, architecture, and execution on AWS.
  • Skilled in identifying and migrating suitable applications and workloads, gathering migration requirements, and collaborating with stakeholders.
  • Good knowledge of various AWS services like Lambda, SNS, SQS, DynamoDB, OpenSearch, Transfer Family, CloudWatch, EC2, EFS, EKS, Step Functions, ELB, ACM, Directory Services, and networking.
  • Hands-on expertise in designing, architecting, deploying, and supporting hybrid cloud environments.
Job Responsibility
Job Responsibility
  • Perform installation, customization and maintenance of the UNIX-LINUX Server operating system and system software products in support of business processing requirements for both On-premise and Cloud environment
  • Evaluate and integrate new operating system versions, drivers and hardware.
  • Provides in-depth diagnosis for operating systems software/hardware failures and develops solutions.
  • Monitors and tunes the system to achieve optimum performance levels in standalone and multi-tiered environments.
  • Conducts system analysis, configuration management and develops improvements for system software performance, availability and reliability.
  • Implements appropriate levels of system security. Maintain security patching and remediating vulnerabilities, propose solutions for the same.
  • Perform incident resolution, problem determination and root cause analysis in accordance with service level. Knowledge of ITIL.
  • Recommend and implement modifications to the server environment, Innovation, Ideas to improve
  • Preparation of Standard Documents and periodically review them for modifications
  • Identifies opportunities for process and procedure enhancements to drive efficiency and customer service levels.
  • Fulltime
Read More
Arrow Right

Technical Lead / Engineering Manager, Full Stack - Gen AI

At Codvo, we are committed to building scalable, future-ready data platforms tha...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of overall professional experience in software engineering, with a clear progression into technical leadership
  • 3+ years of experience in a formal technical leadership or engineering management role (e.g., Tech Lead, Architect, or EM)
  • 5+ years of hands-on-keyboard experience in backend, AI, or full-stack engineering
  • Expert-level proficiency in a primary backend language (e.g., Python, Node.js) and object-oriented design principles
  • 4+ years of experience architecting, developing, and delivering AI/ML or cloud-native solutions on AWS
  • Bachelor's degree in Computer Science, Engineering, or a related technical field
  • Proven experience in leading, mentoring, and growing engineering teams
  • Demonstrable experience owning end-to-end project delivery, managing technical risks, and ensuring timely execution of milestones
  • Excellent communication and interpersonal skills
  • Demonstrable expertise in system design and architecture of complex, scalable, and secure distributed systems
  • Fulltime
Read More
Arrow Right

Key Account Director

As Key Account Director, North America, you will own the commercial relationship...
Location
Location
United States , Austin
Salary
Salary:
Not provided
aiven.io Logo
Aiven Deutschland GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant experience in B2B technology sales having managed strategic or named accounts of similar scale and complexity ($1M+ ARR per account, multi-stakeholder enterprise organizations)
  • Proven track record of driving expansion revenue within existing accounts
  • Experience managing accounts where you've navigated matrixed organizations with distributed decision-making
  • Demonstrated success in consumption-based or usage-based revenue models where revenue scales with adoption
  • Ability to build and maintain executive relationships at VP and C-level
  • Experience multi-threading across buying centers: platform engineering, data engineering, infrastructure, DevOps, procurement, IT governance, and line-of-business technology teams
  • Understanding of enterprise procurement, legal, and vendor management functions
  • Track record of developing internal champions who advocate for expansion within their organizations
  • Familiarity with open-source data infrastructure: Apache Kafka, PostgreSQL, OpenSearch, ClickHouse, or similar technologies
  • Understanding of cloud infrastructure and managed services: AWS, OCI, GCP, Azure ecosystem, and how customers make build-vs-buy decisions for data platform components
Job Responsibility
Job Responsibility
  • Own Expansion Revenue Outcomes: Deliver net new expansion ARR annually across 6 named strategic accounts through new workloads, new services, new business units, and competitive displacement
  • Protect and retain existing ARR with 100% gross retention
  • Build and maintain 3.5x qualified pipeline coverage against expansion targets using rigorous MEDDPICC standards for every opportunity
  • Achieve ±10% forecast accuracy at commit with evidence-based qualification
  • Drive consumption growth through adoption initiatives that expand usage of contracted services
  • Build & Execute Strategic Account Plans: Develop 12-month account plans for each of the 6 accounts with documented whitespace analysis, stakeholder maps, competitive positioning, and prioritized expansion plays
  • Identify and qualify growth vectors: new Aiven services not yet deployed, new cloud regions, new business units, workloads on self-managed infrastructure, competitive displacement opportunities
  • Map organizational structure and decision-making authority across platform engineering, data engineering, infrastructure, DevOps, and line-of-business technology teams
  • Maintain living account intelligence: executive changes, organizational restructures, strategic initiatives, M&A activity, technology roadmap shifts that create expansion opportunities or retention risk
  • Present quarterly business reviews internally with account health assessment, pipeline status, risk register, and resource requirements
What we offer
What we offer
  • Competitive base salary + commission structure aligned to expansion targets with accelerators for overachievement
  • Participate in Aiven's equity plan
  • Hybrid work policy
  • Needed equipment
  • Learning platforms
  • Annual learning budget
  • Holistic wellbeing support through global Employee Assistance Program
  • Contribute to open-source projects through Plankton program
  • 5 days per year to volunteer
  • Team member resource groups
  • Fulltime
Read More
Arrow Right

Ai Technical Architect

Location
Location
United States , Auburn Hills
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 20+ years in software engineering with 5+ years focused on AI/ML systems
  • 3+ years hands-on experience architecting and shipping production LLM and agentic AI applications
  • Demonstrated success leading enterprise-scale AI platform builds with measurable business outcomes
  • Track record architecting scalable cloud-native systems on AWS in regulated or large-enterprise environments
  • Experience leading technical teams, mentoring engineers, and engaging executive stakeholders
  • Bachelor's or Master's degree in Computer Science, AI/ML, or a related technical field
  • Expert proficiency with LangGraph, LangChain, and agent orchestration frameworks
  • Deep experience with Amazon Bedrock, SageMaker, and Amazon Q, including Bedrock Agents and Knowledge Bases
  • Hands-on experience with Model Context Protocol (MCP), function calling, tool use, and structured output patterns
  • Strong command of prompt engineering, evaluation harnesses, fine-tuning, and model optimization
Job Responsibility
Job Responsibility
  • Design the enterprise AI platform architecture spanning the LLM API gateway, GPU and compute allocation pools, sandbox provisioning, model registry, and security gate automation
  • Define infrastructure standards, API gateway patterns, and reference architectures consumed by all AI delivery towers and partner integrations
  • Establish guardrails for token metering, rate limiting, audit logging, DLP validation, SAST, DAST, dependency scanning, and model card review embedded in CI/CD
  • Review security posture across all AI workloads with mapping to NIST AI RMF, AWS Well-Architected (including the Machine Learning Lens), and applicable enterprise compliance baselines
  • Architect multi-agent systems using LangGraph, LangChain, and Model Context Protocol (MCP) for complex workflow orchestration, planning, and tool use
  • Define patterns for ReAct, Chain-of-Thought, Tree-of-Thoughts, and agent-to-agent coordination across enterprise and customer-facing use cases
  • Design and optimize Retrieval-Augmented Generation (RAG) systems, embedding strategies, and semantic search across structured and unstructured enterprise data
  • Establish MLOps and AgentOps practices for deployment, evaluation, observability, and continuous improvement of agents and models in production
  • Architect solutions on Amazon Bedrock, Amazon SageMaker, Amazon Q, Bedrock Agents, and Bedrock Knowledge Bases
  • Define infrastructure patterns using Amazon EKS, AWS Lambda, ECS Fargate, API Gateway, EventBridge, SNS/SQS, Kinesis, S3, DynamoDB, Aurora, Redshift, Athena, OpenSearch, and Kendra
  • Fulltime
Read More
Arrow Right

Ai Aws Architect

Location
Location
United States , Parsippany
Salary
Salary:
165000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in Software Development & ML engineering, including 4+ years in Solution architecture or AI architecture delivering production-grade systems
  • Strong hands-on expertise in Python (workflow orchestration, model evaluation), Node.js, and experience working with agent-based frameworks such as AutoGen, LangChain, or ADK. Solid knowledge of prompt engineering techniques and tool-calling mechanisms
  • Deep understanding of retrieval-augmented systems, including embeddings, chunking strategies, ranking mechanisms, and Vector databases such as Qdrant and MongoDB Atlas with vector search capabilities
  • Extensive experience in MLOps practices, including CI/CD pipelines for ML models, model registry management, and containerized deployments using Kubernetes
  • Strong cloud expertise in AWS, with hands-on experience in services such as Amazon Bedrock, SageMaker, AWS Lambda, and Amazon EKS
  • Demonstrated experience in implementing Responsible AI practices, security best practices (encryption, secrets management, network isolation), and FinOps strategies for AI workloads, including cost and latency optimization
Job Responsibility
Job Responsibility
  • Architect and design an end-to-end solution for an AI-driven Retrieval-Augmented system
  • Define and implement the embedding strategy, document chunking methodology, and ranking techniques to ensure high-quality retrieval
  • Evaluate, select, and integrate appropriate Large Language Models (LLMs) using Amazon Bedrock
  • Design and implement a scalable vector database solution (such as OpenSearch, Qdrant, or MongoDB Atlas with vector search)
  • Architect and deploy the cloud infrastructure leveraging AWS services including Amazon Bedrock (LLM), SageMaker, AWS Lambda, and Amazon EKS
  • Establish MLOps best practices by designing CI/CD pipelines for model deployment and managing model registry updates
  • Apply FinOps principles to balance cost and performance, optimizing model size, inference latency, and caching strategies
  • Design secure access controls and implement secrets management using AWS Secrets Manager
  • Fulltime
Read More
Arrow Right

Middle AI/ML Engineer (GenAI, AWS)

Provectus is an AWS Premier Consulting Partner and AI consultancy featured in Fo...
Location
Location
Colombia , Medellín; Bogotá; Bucaramanga; Cali; Barranquilla
Salary
Salary:
Not provided
provectus.com Logo
Provectus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Machine Learning
  • Deep learning hands-on experience: CNNs, RNNs, Transformers
  • Depth in at least one domain: NLP, Computer Vision, Recommendation, or Time Series
  • Experience building LLM apps with OpenAI, Anthropic, or Hugging Face APIs
  • Hands-on RAG design
  • Familiarity with vector databases (OpenSearch, Pinecone, Chroma, FAISS)
  • Understanding of prompt engineering and LLM evaluation
  • Proficient with AI coding tools (Claude Code, Cursor, Copilot, etc.)
  • Experience building tool-using, stateful agents with an orchestration framework
  • Understanding of Model Context Protocol (MCP)
Job Responsibility
Job Responsibility
  • Build and deliver ML pipelines from experimentation to production
  • Build and optimize models — supervised, unsupervised, and generative AI
  • Write clean, tested, modular Python code
  • Deploy and monitor models
  • track performance and prevent drift
  • Contribute to LLM applications: RAG systems and agent workflows
  • Use AI coding tools on every task
  • Use Claude Code or similar AI tools to deliver client projects
  • Build with agent frameworks (Bedrock AgentCore, Strands, CrewAI, or similar)
  • Integrate or build MCP servers
What we offer
What we offer
  • Competitive salary based on competencies and market rates
  • Premium AI tooling: Claude Code, Cursor, and Provectus AI toolkit
  • Mentorship from Senior ML Engineers and Tech Leads
  • Clear growth path: Mid-Level → Senior ML Engineer → Tech Lead
  • Learning budget for courses, certifications, and conferences
  • Remote-first culture
  • work on projects across LATAM, North America, and Europe
  • Health benefits
  • Fulltime
Read More
Arrow Right