CrawlJobs Logo

Data Engineer II

rackspace.com Logo

Rackspace

Location Icon

Location:
India , Gurgaon

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

The Data Engineer is responsible for managing, operating, and supporting cloud-based data platforms. This role involves close collaboration with customers and internal teams to ensure stable, secure, and efficient operations of the cloud data ecosystem. The engineer will work across multiple technologies, including Azure Data Lake Storage, Databricks, Azure Data Factory, Azure Synapse Analytics, Snowflake, Azure Event Hub, Tidal, Pyramid, Collibra, Power BI, Tableau, MicroStrategy (MSTR), and Alteryx, ensuring reliable data ingestion, processing, analytics, and reporting.

Job Responsibility:

  • Resolve data pipeline issues and perform proactive monitoring for sensitive and critical batch processes
  • Conduct Root Cause Analysis (RCA) and retrospectives for incidents and operational issues
  • Create, update, and maintain operational runbooks and manage entitlements as required
  • Implement configuration changes to batch processes and underlying cloud infrastructure
  • Manually control and manage pipeline executions during scheduled maintenance windows
  • Perform on-demand operational changes based on instructions provided by the Data Engineering (L3) team
  • Handle user service requests
  • for non-runbook-based requests, coordinate effectively with the L3 team
  • Participate in Disaster Recovery (DR) testing activities (twice a year)
  • Support development and production data synchronization activities
  • Represent the team in weekly change management board meetings

Requirements:

  • Strong hands-on experience with: Azure Data Lake Storage
  • Azure Databricks
  • Azure Data Factory
  • Azure Synapse Analytics
  • Snowflake
  • Azure Event Hub
  • Tidal Scheduler
  • Pyramid, Collibra
  • Power BI, Tableau, MicroStrategy (MSTR), Alteryx
  • Ability to read, write, and troubleshoot SQL queries and stored procedures
  • Proven experience in configuring, managing, and troubleshooting cloud data platforms
  • Strong analytical and problem-solving skills
  • Excellent written and verbal communication skills, with the ability to clearly explain technical concepts to non-technical stakeholders
  • Ability to work effectively in small teams while promoting collaboration and inclusiveness
  • Bachelor’s degree in Computer Science or a related field
  • 3–6 years of hands-on experience in configuring and managing Azure-based data analytics solutions
  • Prior experience working in Azure cloud environments is strongly preferred

Additional Information:

Job Posted:
January 05, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Rackspace - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer II

Data Engineer II

As a Data Engineer II on our Core Engineering Data Team, you will focus on build...
Location
Location
United States , Boston
Salary
Salary:
93200.00 - 136600.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 2+ years of experience in software engineering, data engineering, or a related field
  • Foundational knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Experience with ETL/ELT, schema design, and datalake technologies
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Develop and maintain efficient and reliable ETL/ELT data pipelines from product and service data sources to our centralized analytical platforms
  • Implement and monitor data pipeline orchestration using tools like Airflow or Dagster to ensure timely and accurate data delivery
  • Collaborate with senior engineers and analysts to understand requirements and implement technical solutions for data workflows
  • Perform routine monitoring of pipeline performance and reliability, assisting with troubleshooting and optimizing for efficiency
  • Contribute to the optimization of table structures and data storage to support various query and usage patterns
  • Support and maintain data discovery, catalog, and analytics tooling for internal teams
  • Assist in implementing data security measures and ensuring compliance with data governance policies
  • Write and maintain data quality validation checks and unit tests to ensure the integrity and reliability of data pipelines
  • Participate in team-wide discussions to help develop and refine team norms and engineering best practices
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right

Data Engineer II

We’re looking for a Data Engineer II to join our Decisions & Insights team — the...
Location
Location
United States , San Francisco
Salary
Salary:
101250.00 - 162000.00 USD / Year
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience as a Data Engineer, Analytics Engineer, or similar hybrid role
  • Advanced SQL skills with strong understanding of schema design and analytical database patterns
  • Strong Python experience for data manipulation, scripting, and automation
  • Strong analytical mindset, attention to detail, and a passion for turning complex datasets into clear insights
  • Solid Git experience for collaboration and version control
  • Experience integrating and analyzing data from AWS services (e.g., Redshift, S3, APIs)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain automated ETL/ELT pipelines and analytical models in Redshift using SQL, dbt, or SQLMesh
  • Build clean, structured datasets that enable fast, self-serve insights for PMs, analysts, and operational agents
  • Create dashboards and analytical tools (e.g., Tableau) that make insights intuitive and actionable
  • Optimize SQL queries, schemas, and table designs for high-volume analytics workloads
  • Partner with product managers, data scientists, and engineering teams to deliver analysis that supports product and operational decisions
  • Use Python to automate processing, improve pipeline reliability, and support advanced analytical workflows
  • Apply best practices for Git-based version control, testing, documentation, and data quality monitoring
  • Participate in design reviews for new analytical features and data systems
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary paid time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Mental Wellness support
  • Learning & Development programs
  • Snacks in our offices
  • Fulltime
Read More
Arrow Right

Senior Data Engineer II

We are looking for a skilled Data Engineer to join our growing team. You will pl...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
alterdomus.com Logo
Alter Domus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
  • 3+ years of experience as a Data Engineer or in a similar role working with cloud-based data platforms
  • Technical Skills: Cloud & Orchestration: Airflow (self-managed or managed services like Amazon MWAA) for workflow orchestration, DAG development, and scheduling
  • Familiarity with best practices for Airflow DAG structure, dependency management, and error handling
  • AWS Expertise: Hands-on experience with AWS Lake Formation, S3, Athena, and related services (e.g., Lambda, Glue, IAM)
  • Snowflake: Proficient in setting up data warehouses, configuring security, and optimizing queries on Snowflake
  • Data Ingestion & Transformation: Experience with Airbyte or similar tools for data ingestion
  • dbt or other SQL-based transformation frameworks for modular data processing
  • Programming: Proficiency in Python and/or Java/Scala for building data pipelines and custom integrations
  • Query Languages: Advanced knowledge of SQL for data manipulation and analysis
Job Responsibility
Job Responsibility
  • Data Pipeline Orchestration: Design, build, and maintain end-to-end data pipelines using Airflow (including managed services like Amazon MWAA) to orchestrate, schedule, and monitor batch/streaming workflows
  • Implement DAGs (Directed Acyclic Graphs) with retry logic, error handling, and alerting to ensure data quality and pipeline reliability
  • Data Ingestion & Transformation: Integrate data from various sources using Airbyte for ingestion and dbt for transformations in a scalable and modular fashion
  • Collaborate with Data Analysts and Data Scientists to implement transformations and business logic, ensuring data is analytics-ready
  • Data Modeling & Warehousing: Design and implement efficient data models for both structured and semi-structured data in AWS S3 (data lake) and Snowflake (data warehouse)
  • Ensure data schemas and transformations support advanced analytics, BI reporting, and machine learning use cases
  • Data Governance & Security: Utilize AWS Lake Formation APIs and best practices to maintain data security, access controls, and compliance
  • Work closely with IT security to establish robust encryption standards, audit trails, and identity/role-based access
  • Performance Optimization: Optimize AWS Athena queries and configurations (e.g., data partitioning) for performance and cost efficiency
  • Monitor and tune Airflow DAGs, Snowflake queries, and data transformations to improve throughput and reliability
What we offer
What we offer
  • Support for professional accreditations
  • Flexible arrangements, generous holidays, plus an additional day off for your birthday
  • Continuous mentoring along your career progression
  • Active sports, events and social committees across our offices
  • 24/7 support available from our Employee Assistance Program
  • The opportunity to invest in our growth and success through our Employee Share Plan
  • Plus additional local benefits depending on your location
Read More
Arrow Right

Data Engineer II

The purpose of the Data Engineer is to migrate and convert data from foreign dat...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
sspinnovations.com Logo
SSP Innovations
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Information Technology or related field
  • 1+ year of experience with managed telecommunications databases
  • 3+ years of experience in data conversion, data mapping, and data analysis
  • 3+ years of experience using ESRI, FME, or a combination of both
  • Intermediate database experience including SQL relationship statements
  • Intermediate Programming/Report Analysis experience
  • Communication skills, both oral and written
  • Strong organizational skills and attention to detail
  • Deadline driven, ability to work independently as well as a team player
Job Responsibility
Job Responsibility
  • responsible for supporting data migrations and data conversions from disparate systems into the 3-GIS Data Model
  • oversee data mapping exercises and work closely with customers to understand their data models and to provide mapping between systems
  • employ a variety of tools including but not limited to Python Scripting, Database Scripting languages such as SQL, advanced knowledge of ESRI applications, FME workbenches and internally developed tools, as the assignment dictates
  • exhibit strong communication skills to ensure customer understanding of data migrations and conversions and must work with various team members such as Solutions Engineers, Data Technicians, Sales Executives and Project Managers to ensure project success
  • must be detail oriented and maintain proper time management as projects generally have specific timelines and milestones required for project success
  • ability to provide references for users by writing and maintaining documentation
  • design, develop, and test data transformation, extraction, and migration activities
  • prepare technical reports by collecting, analyzing, and summarizing information
  • perform tasks efficiently while validating methodology
  • interact directly (face-to-face and remotely) with clients and project teams
  • Fulltime
Read More
Arrow Right

Data Engineer - II

The Data Engineer will design, develop, and maintain scalable data pipelines and...
Location
Location
India , Pune
Salary
Salary:
Not provided
aticaglobal.com Logo
Atica Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, Mathematics, a related field, or equivalent practical experience
  • 3-5 years of experience in data engineering or a similar mid-level role
  • Proficiency in Python and SQL
  • experience with Java is a plus
  • Hands-on experience with AWS, Airbyte, DBT, PostgreSQL, MongoDB, Airflow, and Spark
  • Familiarity with data storage solutions such as PostgreSQL, MongoDB
  • Experience with BigQuery (setup, management and scaling)
  • Strong understanding of data modeling, ETL/ELT processes, and database systems
  • Experience with data extraction, batch processing and data warehousing
  • Excellent problem-solving skills and a keen attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines and ETL/ELT processes using tools like Airflow, Airbyte and PySpark
  • Collaborate with software engineers and analysts to ensure data availability and integrity for various applications
  • Design and implement robust data pipelines to extract, transform, and load (ETL) data from various sources
  • Utilize Airflow for orchestrating complex workflows and managing data pipelines
  • Implement batch processing techniques using Airflow/PySpark to handle large volumes of data efficiently
  • Develop ELT processes to optimize data extraction and transformation within the target data warehouse
  • Leverage AWS services (e.g., S3, RDS, Lambda) for data storage, processing, and orchestration
  • Ensure data security, reliability, and performance when utilizing AWS resources
  • Work closely with developers, analysts, and other stakeholders to understand data requirements and provide the necessary data infrastructure
  • Assist in troubleshooting and optimizing existing data workflows and queries
What we offer
What we offer
  • Competitive salary and benefits package
  • Comprehensive Health Care benefits (best in the country, includes IPD+OPD, covers Employee, Spouse and two children)
  • Growth and advancement opportunities within a rapidly expanding company
  • Fulltime
Read More
Arrow Right

Data Engineer II

You will be part of a world-class Data Engineering team, where you will influenc...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s / Masters degree (or equivalent work experience) in a STEM field
  • 2+ Years of Experience in Data Engineering or related fields
  • Expertise in Python or other modern programming language development experience
  • Knowledge of advanced level capabilities in SQL and relational databases experience
  • Solid working knowledge of ETL (ELT), Data modeling, DataQuality, and Data Visualization/Dashboarding
  • Experience working with product analytics
Job Responsibility
Job Responsibility
  • influence product teams
  • inform Data Science and Analytics Platform teams
  • partner closely with data consumers and producers to ensure quality and usefulness of data assets
  • Defining metrics
  • Instrumenting logging
  • Acquiring/ingesting data
  • Architecting & modeling data
  • Transforming data
  • Ensuring data quality, governance, and enablement
  • Alerting, visualization, and reporting
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineer II

You will be part of a world-class Data Engineering team, where you will influenc...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s / Masters degree (or equivalent work experience) in a STEM field
  • 2+ Years of Experience in Data Engineering or related fields
  • Expertise in Python or other modern programming language development experience
  • Knowledge of advanced level capabilities in SQL and relational databases experience
  • Solid working knowledge of ETL (ELT), Data modeling, DataQuality, and Data Visualization/Dashboarding
  • Experience working with product analytics
Job Responsibility
Job Responsibility
  • influence product teams
  • inform Data Science and Analytics Platform teams
  • partner closely with data consumers and producers to ensure quality and usefulness of data assets
  • Defining metrics
  • Instrumenting logging
  • Acquiring/ingesting data
  • Architecting & modeling data
  • Transforming data
  • Ensuring data quality, governance, and enablement
  • Alerting, visualization, and reporting
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineer II

As a data engineer in the People DE team, you will have the opportunity to apply...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 2 years professional experience as a software engineer or data engineer
  • A BS in Computer Science or equivalent experience
  • Strong programming skills (some combination of Python, Java, and Scala preferred)
  • Experience with data modeling
  • Experience in modern software development practices (Agile, TDD, CICD)
  • Knowledge of data warehousing concepts
  • Experience writing SQL, structuring data, and data storage practices
  • Experience building data pipelines, platforms, micro services, and REST APIs
  • Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
  • A willingness to accept failure, learn and try again
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Poland Jobs Ireland Jobs Germany Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy