CrawlJobs Logo
Rackspace Logo Rackspace · IT - Software Development

Big Data Engineer - AWS

Egypt, Giza · Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

As a full spectrum AWS integrator, we assist hundreds of companies to realize the value, efficiency, and productivity of the cloud. We take customers on their journey to enable, operate, and innovate using cloud technologies – from migration strategy to operational excellence and immersive transformation. Our Big Data Engineers are experienced technologists with technical depth and breadth, along with strong interpersonal skills. In this role, you will work directly with customers and our team to help enable innovation through continuous, hands-on, deployment across technology stacks. You will work to build data pipelines and by developing data engineering code (as well as writing complex data queries and algorithms).

Job Responsibility

  • Build complex ETL code
  • Build complex SQL queries using MongoDB, Oracle, SQL Server, MariaDB, MySQL
  • Work on Data and Analytics Tools in the Cloud
  • Develop code using Python, Scala, R languages
  • Work with technologies such as Spark, Databricks, Hadoop, Kafka, etc
  • Build complex Data Engineering workflows
  • Create complex data solutions and build data pipelines
  • Establish credibility and build impactful relationships with our customers to enable them to be cloud advocates
  • Capture and share industry best practices amongst the community
  • Attend and present valuable information at Industry Events

Requirements

  • 3+ years design & implementation experience with distributed applications
  • 2+ years of experience in database architectures and data pipeline development
  • Demonstrated knowledge of software development tools and methodologies
  • Presentation skills with a high degree of comfort speaking with executives, IT management, and developers
  • Excellent communication skills with an ability to right level conversations
  • Technical degree required
  • Computer Science or Math background desired
  • Demonstrated ability to adapt to new technologies and learn quickly
  • AWS, GCP And/Or Azure Public Cloud skills and experience
Rackspace - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Big Data Engineer - AWS

8 matching positions

Data Engineer (Big Data, Cloud - AWS, Databricks) - Assistant Vice President

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Scala, Spark/Pyspark is must, Hadoop ( BIG Data ), + AWS,Databricks
  • 8 to 11 years’ experience implementing data-intensive solutions using agile methodologies
  • Experience of relational databases and using SQL for data querying, transformation and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • An inclination to mentor
  • an ability to lead and deliver medium sized components independently
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer, Big Data

The Zillow Group’s Housing Trends Data Engineering team brings innovative analys...
Location
Location
United States
Salary
Salary:
152900.00 - 257100.00 USD / Year
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in Python programming
  • Hands-on experience with big data ecosystems, architectures and modern data platforms, including AWS cloud data services and Lakehouse/Lakebase platforms
  • Hands-on experience with Databricks is a significant advantage
  • Proven ability to design, build, and orchestrate batch and real-time data pipelines, processing large-scale datasets from diverse sources
  • Practical experience with cutting-edge data engineering technologies such as SparkSQL and Spark Streaming, PostgreSQL, EKS, and Kubernetes
  • Familiarity with Agile/DevOps software development processes and tools such as GitLab and CI/CD
  • A good understanding of data science concepts, fundamental machine learning algorithms/libraries, and development lifecycle is a must-to-have
  • Familiarity with LLM and Agentic AI technologies and engineering patterns is a big advantage
  • Strong ability in performing root cause analysis to address operational issues and identify opportunities for improvement
  • Exceptional communication skills to drive effective customer engagement, collaborate with cross-functional teams, and clearly articulate technical concepts to technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Build data systems to link raw data and concrete Housing Trends insights
  • Build and extend our internal forecasting model development framework
  • Develop and maintain scalable data products and deliver pipelines built for speed, accuracy, and consistency that will scale as our stakeholders’ need
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance, etc
  • Collaborate with data scientists to understand their data requirements and build systems/tools that enable efficient model training and experimentation
  • Implement feature stores and ETL pipelines to streamline feature engineering and model development
  • Build and maintain infrastructure for deploying machine learning models into production environments
  • Be a trusted partner for our stakeholders, such as Forecasting, Zestimates, and the ML teams within the AI organization to assist them for data investigation/publication, ML model development and infrastructure support
What we offer
What we offer
  • Eligible for equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer, Big Data

This role will be responsible for developing and supporting data platform infras...
Location
Location
Mexico , Mexico City
Salary
Salary:
Not provided
Zillow
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in software development with one or more programming languages such as Python, Java, C++, etc.
  • Proficiency in developing and supporting services with cloud infrastructure such as AWS
  • Experience with and ability to debug/troubleshoot container orchestration platforms like Kubernetes
  • Experience with data infrastructure systems like Databricks, Spark, Hive, Airflow, Trino, Kafka, and Flink
  • Experience in setting up and optimizing data pipelines
  • Experience in developing scalable processes for supporting multiple user groups and teams
  • Familiarity and Experience with running on-call operational responsibilities for data platform systems
Job Responsibility
Job Responsibility
  • Developing and supporting data platform infrastructure
  • Collaborating to provide Data Platform Environments that empower internal Zillow Group customers to deliver high-quality data solutions
What we offer
What we offer
  • Competitive base salary and benefits
  • Equity awards based on factors such as experience, performance and location
  • Fulltime
Read More
Arrow Right

Senior Big Data Engineer

Start.io is a mobile marketing and audience platform. Start.io empowers the mobi...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
start.io Logo
Start.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.Sc. or M.Sc. in Computer Science, Software Engineering, or other equivalent fields.
  • 5+ years of hands-on experience in backend or ML engineering
  • Strong Python skills and experience working with distributed systems and parallel data processing frameworks such as Spark (using PySpark or Scala), Dask, or similar technologies. Familiarity with Scala is a strong advantage, especially in performance-critical environments.
  • Proven track record in designing and scaling ML infrastructure
  • Deep understanding of ML workflows and lifecycle management
  • Experience in cloud environments (AWS, GCP, OCI) and containerized deployment (Kubernetes)
  • Understanding databases and SQL for data retrieval.
  • Strong communication skills and ability to drive initiatives independently
  • A passion for clean code, elegant architecture, and measurable impact
  • Monitoring and alerting tools (e.g. Grafana, Kibana)
Job Responsibility
Job Responsibility
  • Design and implement large-scale, distributed ML training pipelines
  • Build scalable infrastructure for data preprocessing, feature engineering, and model evaluation
  • Lead the technical design and development of new ML systems: from architecture to production
  • Collaborate cross-functionally with DS, infra teams, Product, BA and Engineering teams to define and deliver impactful solutions
  • Own the full lifecycle of ML infra: tooling, versioning, monitoring, automation, measuring results and quickly responding to critical issues.
  • Continuously research and adopt best-in-class practices in MLOps, performance tuning, and distributed systems
Read More
Arrow Right

AWS Big Data Architect III

We are seeking a hands-on AWS Big Data Architect with strong Hadoop and Spark ex...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Data Processing, or equivalent practical experience
  • Strong experience in data management, data access, and enterprise data warehousing
  • Hands-on experience with Big Data technologies including Hadoop and Spark
  • Proficiency in SQL, including Spark SQL and DataFrames
  • Experience with modern data warehousing and analytics platforms (e.g., Redshift, Spark, Hadoop, web services)
  • Experience in data architecture, data assembly, and data integration
  • Working knowledge of data governance and data security principles
  • Experience with AWS services, including: EMR, EC2, S3
  • Redshift, Athena
  • Aurora
Job Responsibility
Job Responsibility
  • Design and develop scalable Big Data Warehouse solutions spanning the full data lifecycle
  • Extend, enhance, and optimize enterprise Data Lake platforms
  • Architect and implement solutions for metadata management and data governance
  • Design and execute strategies for real-time data analysis and decision support
  • Solve complex data integration challenges across multiple systems and data sources
  • Collaborate with data science teams to improve accessibility and usability of actionable data
  • Support and promote data quality, security, and governance initiatives
  • Create and maintain technical and user-facing documentation, including: Data models and schemas
  • Data dictionaries and business glossaries
  • Architecture diagrams and data flow documentation
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

AWS Big Data Architect III

We are seeking a hands-on AWS Big Data Architect with strong Hadoop and Spark ex...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Processing, or equivalent practical experience
  • Strong experience in data management, data access, and enterprise data warehousing
  • Hands-on experience with Big Data technologies including Hadoop and Spark
  • Proficiency in SQL, including Spark SQL and DataFrames
  • Experience with modern data warehousing and analytics platforms (e.g., Redshift, Spark, Hadoop, web services)
  • Experience in data architecture, data assembly, and data integration
  • Working knowledge of data governance and data security principles
  • Experience with AWS services, including: EMR, EC2, S3, Redshift, Athena, Aurora
  • Programming experience with Java and framework development
  • At least 2 years of Python development experience
Job Responsibility
Job Responsibility
  • Design and develop scalable Big Data Warehouse solutions spanning the full data lifecycle
  • Extend, enhance, and optimize enterprise Data Lake platforms
  • Architect and implement solutions for metadata management and data governance
  • Design and execute strategies for real-time data analysis and decision support
  • Solve complex data integration challenges across multiple systems and data sources
  • Collaborate with data science teams to improve accessibility and usability of actionable data
  • Support and promote data quality, security, and governance initiatives
  • Create and maintain technical and user-facing documentation, including data models and schemas, data dictionaries and business glossaries, architecture diagrams and data flow documentation
  • Partner with management, architects, analysts, and engineers across teams
  • Demonstrate curiosity and willingness to learn and adopt new tools and skills
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Senior Big Data Engineer

Senior Big Data Engineer - Assistant Vice President is accountable for developin...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • First Class Degree in Engineering/Technology (4-year graduate course)
  • 8 to 11 years’ experience implementing data-intensive solutions using agile methodologies
  • Experience of relational databases and using SQL for data querying, transformation and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • An inclination to mentor
  • an ability to lead and deliver medium sized components independently
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Fulltime
Read More
Arrow Right

Big Data Engineer - ML Analytics & Search

We train models on petabyte-scale automotive sensor data, but training is only h...
Location
Location
Germany , Munich
Salary
Salary:
Not provided
bmw.de Logo
BMW
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • University degree in Computer Science, Engineering, or a related field
  • 3–5 years of experience in big data or data engineering with a focus on analytics and search over very large datasets
  • Strong Python and SQL skills, with experience in at least one distributed compute framework
  • Experience with columnar or analytical storage and query optimisation at PB scale
  • Familiarity with search and indexing technologies, including full-text search, vector/embedding search or metadata catalogues
  • Production experience with Kubernetes and AWS / Azure / Google Cloud, as well as hands-on experience with infrastructure-as-code
  • Experience with automotive measurement data (MDF4/ASAM MDF or MCAP) as well as with embedding-based retrieval, dataset management tools, stream processing, or graph-based metadata systems
Job Responsibility
Job Responsibility
  • Design and build high-performance search and query pipelines over PB-scale MDF4 and MCAP data lakes, enabling ML engineers to find relevant driving scenarios, sensor conditions, and edge cases across billions of records in seconds
  • Build and operate indexing and cataloguing systems for automotive sensor data, including metadata extraction, signal-level indexing, scene tagging, and embedding-based similarity search
  • Implement distributed compute pipelines for large-scale data evaluation, such as batch statistics, distribution analysis, annotation coverage reports, and data-quality scoring
  • Build fast analytical queries that enable interactive exploration on top of raw data
  • Develop dataset assembly pipelines that automatically assemble, version, and register training and evaluation datasets
  • Optimise for cost and performance through intelligent partitioning, tiered storage, caching strategies, and query pushdown to minimise scan volumes over PB-scale data
  • Operate observability stacks for data pipelines, including query latency dashboards, pipeline health, and data freshness monitors
What we offer
What we offer
  • Challenging projects with which we shape the mobility of tomorrow together
  • Wide range of personal and professional development opportunities
  • Attractive, fair and performance-related remuneration
  • High level of job security
  • Annual special payments such as vacation pay, Christmas bonus, and profit sharing
  • Flexible working hours including six weeks annual leave and overtime compensation
  • Discounted BMW & MINI conditions
Read More
Arrow Right