This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
SoftClouds LLC is seeking a highly experienced OpenSearch Architect to lead the design, implementation, and optimization of large-scale, mission-critical search and analytics platforms. The ideal candidate will have extensive hands-on experience in real-time, production-grade OpenSearch environments, including cluster architecture, performance tuning, index optimization, and end-to-end data migration from on-premises systems to cloud platforms. This role requires strong technical expertise and strategic vision to ensure scalability, high availability, resilience, and operational excellence across enterprise search, logging, and observability systems.
Job Responsibility:
Architect and operate high-availability OpenSearch clusters serving mission-critical datasets
Lead on-prem to cloud migration projects, optimizing for availability, scalability, and cost efficiency
Design and implement indexing, sharding, and replication strategies for diverse search and log analytics workloads
Build and enhance data ingestion pipelines using Logstash, Fluentd, Filebeat, or custom data connectors
Configure and optimize NLP models for advanced text processing and analysis use cases
Schedule indexing jobs and manage data synchronization across different nodes in the cluster
Establish and enforce best practices for cluster monitoring, scaling, alerting, and capacity planning
Collaborate with data engineers and DevOps teams to integrate OpenSearch with streaming and analytics platforms
Implement robust security and compliance frameworks, including role-based access, encryption, and IAM integration
Conduct performance analysis, root cause investigations, and system optimization initiatives
Stay abreast of emerging trends in OpenSearch and related open-source search technologies
Requirements:
10+ years of experience in enterprise search or data infrastructure, with at least 5 years in OpenSearch/Elasticsearch architecture
Proven experience managing large, complex clusters and ensuring high uptime in production environments
Hands-on expertise in cluster design, index lifecycle management (ILM), snapshot/restore, and replication strategies
Practical experience with cloud-native deployments using AWS OpenSearch Service, EKS, or Kubernetes
Strong programming and automation skills in Python, Bash, and Terraform
Solid understanding of distributed systems, data ingestion, and real-time analytics architecture
Proficiency with observability and monitoring solutions such as Prometheus, Grafana, and OpenTelemetry
Deep expertise in advanced NLP model configuration and integration within search ecosystems
Experience designing and implementing robust data ingestion pipelines at scale
Excellent communication and documentation skills for technical stakeholder engagement
Strong problem-solving abilities and attention to detail in a fast-paced environment
Bachelor's degree or Master's degree in Computer Science, Engineering, or related discipline
Nice to have:
Experience with Kubernetes operators for OpenSearch cluster management
Proficiency in Infrastructure-as-Code (IaC) practices and tools beyond Terraform
Certification in cloud platforms (AWS, GCP, or Azure)
Prior experience with large-scale data migration projects
Knowledge of advanced security frameworks and compliance standards (HIPAA, SOC2, PCI-DSS)
Contributions to open-source search or observability projects