Senior Big Data Infra Engineer Job at Rackspace

Applications Development Senior Group Manager

This role will be part of the Risk Data team and is a senior management level po...

Location

United Kingdom , London

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Strong academic record, ideally with a Bachelor’s or Master’s degree in Computer Science or engineering or related technical discipline
Proven experience in enterprise application development with full stack technologies
Strong Architect and hands on technical experience in implementing large volume real time complex solutions in Big Data Platforms & Public Cloud platforms
Experience in Data architecture, strong Software development fundamentals, data structures, design patterns, object-oriented principles
Experience in design and delivery of multi-tiered applications and high performance server side components
Skills on system performance tuning, high performance, low latency, multithreading and experience with Java server side programming
Preferred experience in Handling high volumes of data and working with In-memory databases and Caching solutions
Experience of building and leading teams, ideally with a global resource profile and demonstrated ability to deliver large projects efficiently and on time
Significant experience in large Financial Services Technology services companies is expected for this position
Hands-on development, architecture and leadership experience in real-time data engineering platforms implementation

Job Responsibility

Lead the efforts in Institutional Data Platform (ICG) that span multiple businesses, products and functions
Delivery of Price Risk related Data initiatives and Capital reporting (GSIB) related deliverables
Establish strong relationships with the global business stakeholders and ensure transparency of project deliveries
Actively identify and manage risks and issues, working with disparate teams to create mitigation plans and follow-through to resolution
Adhere to all key Project Management (PMQC) & Engineering Excellence standards
Ensure timely communications to Senior Technology Management and Business Partners in Front Office, Middle Office & other Operations functions
Drive the design and development of system architecture, work with end-users of the systems, and enhance the quality of deliverables
Ensure staff follows Citi documented policy and procedures as well as maintain desktop procedures and supporting documentation for filings on a current basis and in comprehensive manner
Ensure change is managed with appropriate controls, documentation, and approvals including implementation of new and revised regulatory reporting requirements
Manage and maintain all disaster recovery plans, oversee appropriate testing, and provide permit-to-operate for new applications

What we offer

27 days annual leave (plus bank holidays)
A discretional annual performance related bonus
Private Medical Care & Life Insurance
Employee Assistance Program
Pension Plan
Paid Parental Leave
Special discounts for employees, family, and friends
Access to an array of learning and development resources

Fulltime

Senior Software Engineer

Are you interested in building the next state-of-the-art AI infrastructure to fu...

Location

India , Hyderabad

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Experience working on large‑scale big data systems such as Cosmos, Hadoop, Magnetar, or equivalent platforms
Experience building or operating streaming data pipelines (e.g., real‑time or near‑real‑time processing systems)
Experience with Apache Spark and Scala technologies
Bachelor's Degree in Computer Science OR related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, OR Python OR Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience

Job Responsibility

Design, implement, and ship infrastructure related features related to enable ads metrics alerting, diagnostics and monitoring
Optimize data processing pipelines and evolve architectures to maximize performance and minimize cost
Enhance flight analysis infra to optimize CTS and add new business metrics
Deep dive into data to find key insights that drive technical design and feature roadmaps
Work with partner ads and Bing teams to light-up different ads scenarios, and leverage their work
Operational support for the product to fix bugs and mitigate/resolve livesites

Fulltime

Intermediate / Senior Machine Learning Engineer

We are seeking passionate Senior Machine Learning Engineers to design, develop, ...

Location

India , Chennai

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or related field (PhD is a plus)
5+ years of experience in machine learning engineering, MLOps, or large-scale AI/DS systems
Strong foundations in data structures, algorithms, and distributed systems
Proficient in Python (scikit-learn, PyTorch, TensorFlow, XGBoost, etc.) and SQL
Hands-on experience building and deploying ML models at scale in cloud environments (GCP Vertex AI, AWS SageMaker, Azure ML)
Experience with containerization (Docker, Kubernetes) and orchestration (Airflow, TFX, Kubeflow)
Familiarity with CI/CD pipelines, infrastructure-as-code (Terraform/Helm), and configuration management
Experience with big data and streaming technologies (Spark, Flink, Kafka, Hive, Hadoop)
Practical exposure to model observability tools (Prometheus, Grafana, EvidentlyAI) and governance (WatsonX)
Strong understanding of statistical methods, ML algorithms, and deep learning architectures

Job Responsibility

Design, deploy, and maintain production-ready ML models and pipelines for real-world applications
Build and scale ML pipelines using Vertex AI Pipelines, Kubeflow, Airflow, and manage infra-as-code with Terraform/Helm
Implement automated retraining, drift detection, and re-deployment of ML models
Develop CI/CD workflows (GitHub Actions, GitLab CI, Jenkins) tailored for ML
Implement model monitoring, observability, and alerting across accuracy, latency, and cost
Integrate and manage feature stores, knowledge graphs, and vector databases for advanced ML/RAG use cases
Ensure pipelines are secure, compliant, and cost-optimized
Drive adoption of MLOps best practices: develop and maintain workflows to ensure reproducibility, versioning, lineage tracking, governance
Mentor junior engineers and contribute to long-term ML platform architecture design and technical roadmap
Stay current with the latest ML research and apply new tools pragmatically to production systems

Senior Product Manager

Microsoft AI (MAI) team builds innovative and responsible AI-powered personalize...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree AND 5+ years experience in product/service/program management or software development OR equivalent experience
Experience in driving big cross organization initiatives in deep technical area such as search
Understand scaling challenges with open-source technologies like HDFS, Spark & Kafka
Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
4+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn)
Experience in LLM evals, metrics, quality is a big plus
Has successfully built and ran large scale cloud/distributed compute, storage and inferencing systems and products
Experience with inventory and capacity management understanding the demand, supply and engineering dependencies, compliance and security related activities

Job Responsibility

Define product vision and strategy by understanding of customer needs, leadership vision and competitive market
Identifies short-and long-term investment opportunities, evaluates tradeoffs, and drives the product roadmap
Drive innovation in search and grounding for Bing, Copilot and Office users by working closely with engineering, product and leadership
Make personalized News, Web, image, and video recommendations to millions of users, globally
Empower hundreds of scientists to quickly and safely experiment and continually improve the product
Evolve multi-tenant platforms for infra for Storage & Inferencing such as ObjectStore, HDFS, Spark and Kafka for Big Data and NRT processing
Do inventory and capacity management of the complex fleet of CPU and GPU running these large systems

Fulltime

New

Senior Software Developer - Curam/Case Management

Do you have 6 years of Curam knowledge and experience? Do you have experience in...

Location

Canada , North York

Salary:

543.70 - 579.46 CAD / Hour

Randstad

Expiration Date

April 18, 2026

Requirements

Curam knowledge and experience (6 years)
Curam development
Technical solutioning and support for project leads and team
Experience in programming and analysis
specialized software package support at the specified experience level
Ability to collaborate with IT Professionals throughout the Software Development Life Cycle
Experience in structured methodologies for the development, design, implementation and maintenance of applications
Experience in design, code, test, debug and document applications
Experience in the use of object and/or third generation language development tools
Experience in one or more programming languages

Job Responsibility

Designing, developing and implementing front end code including user interface interactions and effective user interfaces Software Upgrade planning and implementation
Required to translate technical systems specifications into working, tested applications, which includes: developing detailed programming specifications writing and/or generating code compiling data-driven programs, maintaining, and conducting unit tests
Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations

What we offer

Earn a competitive rate within the industry
Potential for extension

New

Senior Test Lead

We are seeking a Senior Test Lead with a deep specialization in Data Engineering...

Location

Canada , North York

Salary:

Not provided

Randstad

Expiration Date

April 13, 2026

Requirements

Databricks Expertise: Extensive experience in Databricks pipeline testing, notebook-based automation, and Parquet/JSON inspection
Advanced SQL: Mastery of SQL for querying large datasets, performing complex joins, and verifying relational database integrity (Oracle, SQL Server)
Data Engineering QA: Proven track record in CDC validation and verifying structured/unstructured data formats (XML, FHIR JSON)
Warehousing Concepts: Strong background in Data Modeling, Data Warehousing methodologies, and Data Governance standards
Tooling Proficiency: Expert-level experience with Azure DevOps for test management and defect tracking
Compliance Knowledge: Understanding of AODA testing requirements and security best practices for sensitive data handling
Seniority: 10+ years of experience in the full SDLC, with at least 5 years in a leadership or strategic planning capacity for data-centric projects

Job Responsibility

Strategic Data Testing: Lead the design and development of end-to-end test strategies specifically tailored for data projects, including Databricks pipeline testing and CDC (Change Data Capture) validation
Technical Validation: Perform deep-dive inspections of Parquet files and validate complex FHIR JSON structures to ensure interoperability and data accuracy
Pipeline Automation: Leads the architectural design and maintenance of automated test frameworks for ETL/pipelines using Databricks notebooks and industry-standard tools like Selenium
Data Governance & Integrity: Act as a quality advocate by implementing data profiling and data quality assessments
ensure rigorous adherence to data lineage, compliance, and lineage standards
Risk Management: Proactively identify and mitigate quality-related risks in distributed systems, collaborating with architects to embed security testing into the lifecycle
Team Leadership: Mentor and coach a team of QA professionals, fostering a culture of continuous learning and high performance within an Agile environment
Stakeholder Liaison: Develop and implement data quality metrics and KPIs, providing clear status reports and summary documentation to project leadership and stakeholders

What we offer

Cutting-Edge Data Stack: Lead the quality vision for a modern data environment utilizing Databricks, Azure DevOps, and FHIR standards
Strategic Influence: Shape the "shift-left" culture of an organization, moving beyond simple execution to strategic quality architecture
High-Impact Projects: Oversee the data integrity for massive enterprise transformations that directly influence operational feasibility and decision-making
Professional Mentorship: Play a defining role in upskilling a team of testers in modern data engineering QA techniques

New

Senior Systems Testing/QA Specialist

We are seeking a Senior Systems Testing/QA Specialist with over 8 years of exper...

Location

Canada , North York

Salary:

Not provided

Randstad

Expiration Date

April 03, 2026

Requirements

8+ years of professional experience as a Software QA Tester
5+ years of experience testing Commercial Off-the-Shelf applications
Proven experience testing Siebel CRM
Hands-on experience testing Adobe Experience Manager (AEM)
Proficiency with Jira or Azure DevOps
Ability to write SQL queries, understand data models, and interpret Java or JavaScript code for automation purposes
Strong understanding of both Agile and Waterfall project management frameworks and the full SDLC
Knowledge of AODA standards and regulations for web application testing

Job Responsibility

Provide expert advice on testing strategies, selecting appropriate tools, and identifying resources for large-scale projects
Create comprehensive test plans, test cases, and manual/automated test scripts for functional, non-functional, and integration testing
Lead testing efforts for Oracle Siebel CRM and Adobe Experience Manager (AEM), including the validation of specialized modules
Manage the end-to-end defect life cycle using tools like Jira or Azure DevOps, ensuring all issues are documented, tracked, and resolved
Support business stakeholders through User Acceptance Testing, providing technical guidance and validating that system behavior meets business requirements
Organize and execute specialized tests, including stress, load, and performance testing, to ensure system scalability
Participate in all phases of the SDLC, from initial analysis and design through to implementation and ongoing support

What we offer

Specialized Technical Scope: Gain experience with high-level Siebel modules, Partner Portals, and Campaign Management
Career Growth: Lead testing efforts for complex, multi-platform systems in a senior-level advisory capacity
Automation Exposure: Opportunity to work with GUI and API automation tools in an enterprise environment

New

Senior Business Analyst

We are seeking a Senior Business Analyst to join a high-performing team focused ...

Location

Canada , North York

Salary:

Not provided

Randstad

Expiration Date

April 13, 2026

Requirements

Extensive experience writing and refining user stories and managing product backlogs within a fast-paced Agile environment
Strong understanding of system design for web-based technologies and specific experience with Cúram or similar enterprise COTS platforms
Proven ability to conduct user research and translate findings into actionable personas and journey maps
10+ years of experience in systems analysis, requirements definition, and troubleshooting complex technical issues
Hands-on experience implementing or managing AI-driven tools to improve business processes
Background in Business Analysis, Computer Science, or a related field
familiarity with SDLC and ITIL-based incident management

Job Responsibility

Agile Product Ownership Support: Define and manage user stories, lead backlog refinement, and facilitate sprint planning and reviews to ensure technical solutions reflect true business value
User Experience (UX) Research: Conduct deep-dive user research, develop detailed personas, and create comprehensive customer journey maps to identify pain points and optimize system usability
Systems Analysis & Design: Perform feasibility studies and system analysis for web-based technologies, providing functional specifications and prototypes for stakeholder consultation
Incident & Issue Management: Collaborate closely with technical teams to triage software issues and manage incident resolution, ensuring minimal disruption to service delivery
AI Optimization: Implement and optimize AI-driven solutions to enhance operational efficiency and provide data-backed insights for decision-making
Stakeholder Leadership: Facilitate workshops with cross-functional teams to gather requirements and build consensus on system enhancements
Technical Documentation: Prepare high-quality system documentation, user manuals, training plans, and business cases for diverse audiences

What we offer

Innovation Leadership: Drive the adoption of AI technologies within a large-scale enterprise environment
User-Centric Impact: Directly influence the quality of service delivery by advocating for the end-user through journey mapping and research
Technical Breadth: Gain exposure to complex system integrations and enterprise-grade COTS tools
Collaboration: Work in a high-visibility, onsite environment that fosters direct interaction with architects, developers, and business leaders

Fulltime

Senior Big Data Infra Engineer

Rackspace

Location:
Vietnam

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:
January 05, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Big Data Infra Engineer