CrawlJobs Logo
Astronomer Logo Astronomer · IT - Software Development

Solutions Engineer - Data Engineering

India, Hyderabad · Job Posted March 10, 2026
Apply Position
Job Link Share

Job Description

As a Solutions Engineer, you will be part of the Global Services Delivery Team and will be involved in the delivery of the various use cases in which Airflow is implemented across our customers. These organizations range from seed-stage startups to Fortune 500 enterprises. Although these organizations are in different phases of their data journey, they all can benefit from your expertise as a Solutions Engineer to implement Apache Airflow in a manner that follows best practices and allows continued growth. In this role, you will come to have a deep understanding of both Apache Airflow and Astronomer Products. Every Solutions Engineer will grow to become an Airflow expert and a trusted advisor to organizations looking to put their data in motion.

Job Responsibility

  • Maintain and continuously improve your technical expertise
  • Work with customers to educate and guide them regarding Airflow best practices
  • Perform Airflow code refactoring assessments as a trusted expert for new and existing customers
  • Collaborate with team members to design, prototype, and implement engineering solutions for internal and external use
  • Act as a liaison by collecting feedback and identifying Airflow/Astronomer improvements through client interactions and relaying these recommendations back to the Product team
  • Review and optimize customer data workflows and Airflow system configurations for improved performance

Requirements

  • 3–6 years of data engineering experience
  • 3+ years of hands-on experience with Apache Airflow in production environments
  • Strong experience building and maintaining DAGs, writing Python, and developing custom Airflow operators and hooks
  • Excitement about implementing ETL/ELT pipelines, knowledge of applying Data transformations, optimizing and monitoring data pipelines
  • Experience with related market products such as Cloudera, Databricks, Snowflake, DBT, AWS, Azure, Google Cloud, ETL Technologies or other analytics solutions
  • Empathetic, driven and team-oriented
  • Great prioritization skills and ability to execute on customer-facing activities
  • A strong verbal and written communicator interacting with assigned customers over a variety of mediums (slack, email, knowledge transfer, and pair programming sessions)
  • Highly data-driven and intrigued by the challenge of delivering an awesome Astronomer experience to hundreds of customers

Nice to have

  • Experienced with Production implementation of ETL/ELT processes using Modern Data Stack
  • Experience building and maintaining CI/CD pipelines
  • Experience working on short and long-term Customer engagements
  • Experience with infrastructure tools like Docker and Kubernetes
Astronomer - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Solutions Engineer - Data Engineering

8 matching positions

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right

Senior Solutions Engineer – Big Data & Data Infrastructure

This is a great opportunity to be part of one of the fastest-growing infrastruct...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
vastdata.com Logo
VAST Data
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2–4 years in software / solution or infrastructure engineering
  • 2–4 years focused on building / maintaining large-scale data pipelines / storage & database solutions
  • Proficiency in Trino, Spark (Structured Streaming & batch) and solid working knowledge of Apache Kafka
  • Coding background in Python (must-have)
  • Deep understanding of data storage architectures including SQL, NoSQL, and HDFS
  • Solid grasp of DevOps practices, including containerization (Docker), orchestration (Kubernetes), and infrastructure provisioning (Terraform)
  • Experience with distributed systems, stream processing, and event-driven architecture
  • Hands-on familiarity with benchmarking and performance profiling for storage systems, databases, and analytics engines
  • Excellent communication skills
Job Responsibility
Job Responsibility
  • Build distributed data pipelines using technologies like Kafka, Spark (batch & streaming), Python, Trino, Airflow, and S3-compatible data lakes
  • Design, deploy, and troubleshoot hybrid cloud/on-prem environments using Terraform, Docker, Kubernetes, and CI/CD automation tools
  • Implement event-driven and serverless workflows
  • Create technical guides, architecture docs, and demo pipelines
  • Integrate data validation, observability tools, and governance directly into the pipeline lifecycle
  • Own end-to-end platform lifecycle: ingestion → transformation → storage (Parquet/ORC on S3) → compute layer (Trino/Spark)
  • Benchmark and tune storage backends (S3/NFS/SMB) and compute layers for throughput, latency, and scalability using production datasets
  • Work cross-functionally with R&D to push performance limits across interactive, streaming, and ML-ready analytics workloads
  • Operate and debug object store–backed data lake infrastructure
Read More
Arrow Right

Software Engineer / Senior Software Engineer - Data Engineering GitHub

As a Software Engineer at GitHub, you will enhance the collaboration experience ...
Location
Location
Czech Republic , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND experience in Data Engineering and coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python OR equivalent experience.
  • Master's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR Bachelor's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR equivalent experience.
Job Responsibility
Job Responsibility
  • Design, develop, test and ship high-quality technical solutions that scale across multiple GitHub services.
  • Collaborate with cross-functional teams to define and implement innovative solutions.
  • Provide technical leadership, mentorship, pairing opportunities, and code reviews to encourage the growth of others.
  • Own and advocate for the health and quality of the systems that the team builds, including participating in on-call and first responder rotations
  • Write architecture briefs and proposals, carry out code experiments, and build prototypes to learn how we can achieve planetary scale with our systems.
  • Design and implement APIs to facilitate seamless integration between software components.
  • Utilize CI/CD tools to set up automated pipelines for continuous integration and delivery.
  • Become intimately familiar with the systems you build and take pride in writing maintainable code.
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Staff Engineer Data Engineering

You will join the Public Intelligence team, whose mission is to leverage public ...
Location
Location
France , Paris
Salary
Salary:
Not provided
gitguardian.com Logo
GitGuardian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in data engineering, with a strong track record building and operating large-scale, production-grade data pipelines
  • Strong expertise in distributed systems and real-time architectures (streaming, event-driven systems)
  • Strong experience with AWS, Terraform, Docker, and Kubernetes in production environments
  • Strong experience with ClickHouse or similar large-scale analytical databases
  • Hands-on engineering mindset: ability to contribute directly to production code on critical systems, not just design
  • Proven experience redesigning or refactoring existing production architectures
  • Strong ownership mindset: you proactively identify problems and drive solutions end-to-end
  • Experience mentoring engineers and raising the technical level of a team
  • Excellent communication skills and ability to work effectively with backend, ML, Data and Product teams
  • Fluent English in an international environment
Job Responsibility
Job Responsibility
  • Design and implement the end-to-end data architecture
  • Build real-time systems, from design through production deployment
  • Be hands-on on the most complex and critical technical challenges
  • Design monitoring, maintenance, and alerting systems around the data pipeline
  • Mentor and raise the technical bar within the team through code reviews and knowledge sharing
  • Structure engineering processes and facilitate collaboration across backend, ML, Data, and product teams
  • Contribute to the technical roadmap in close collaboration with the Engineering Manager and Product Manager
What we offer
What we offer
  • Package that includes BSPCE
  • Lunch voucher (Swile, 9€ at 50%)
  • Sponsored Wellpass (gymlib)
  • Non-charged health insurance for children (Sidecare / Generali)
  • Up to €300 to improve your home office set-up
  • Yearly holiday allowance
  • Referral bonus of 4000€ for any new Guardian we might hire thanks to you
  • Team building: monthly budget dedicated to each employee that you can spend as you wish, with colleagues (latest examples to date: Michelin star restaurant, karaoke, stand-up show, kitesurfing week-end, ...)
Read More
Arrow Right

Technology Data Solutions Engineer - Vice President

The Full Stack Engineer at iCapital will work end-to-end on new features, enhanc...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
icapital.com Logo
iCapital Network
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years software engineering experience building enterprise SaaS cloud-based solutions
  • 7+ years of Python development experience
  • 7+ years of hands-on experience with Typescript
  • Demonstrated understanding of relational database concepts and modeling practices
  • Familiarity with cloud-based technologies – K8S, AWS etc.
  • Ability to work in an Agile / Kanban methodology
  • Ability to work independently or as part of a group effort, as required
  • Solid problem-solving ability
  • Excellent communication skills
  • Collaborative approach to software development
Job Responsibility
Job Responsibility
  • Web application development in Typescript as front end and Python as a backend
  • Strong grasp of system design, architecture, and trade-offs. Able to mentor junior engineers effectively
  • Participate in architecture reviews and technical design
  • Active participation in daily stand-up meetings
  • Active participation in Peer Code Reviews as part of our standard SDLC and Change
What we offer
What we offer
  • Competitive salary
  • annual performance bonus
  • equity for all full-time employees
  • healthcare with 100% employer-paid health and dental insurance
  • generous paid time off (PTO)
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Data Engineering

As a Principal Software Engineer at GitHub, you will enhance the collaboration e...
Location
Location
Czech Republic , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, Go, Ruby, Rust, Python, JavaScript, C, C++, C#, Java
  • Experience with designing a data strategy and leading the development of its core components by building and optimizing scalable data pipelines, integrations, and robust data models that solve complex business challenges
  • Experience working closely with product management, design, and other engineering teams to drive cross-functional projects and deliver high-quality products
Job Responsibility
Job Responsibility
  • Design, develop, test and ship high-quality technical solutions that scale across multiple GitHub services and become intimately familiar with the systems you build and take pride in writing maintainable code
  • Provide technical leadership, mentorship, pairing opportunities, and code reviews to encourage the growth of others
  • support teams in producing extensible and maintainable code, ensuring integration with downstream dependencies and adherence to quality standards
  • Own and advocate for the health and quality of the systems that the team builds, including participating in on-call for first responder rotations and live incidents
  • Write architecture briefs and proposals and carry out code experiments
  • Design and implement APIs to facilitate seamless integration between software components
  • Utilize CI/CD tools to set up automated pipelines for continuous integration and delivery
  • Collaborate with cross-functional teams and partner with stakeholders and lead discussions for technical solutions, including design and cost considerations
  • Create and guide others in 1) developing clear testing plans to assure solution quality, reliability, and performance
  • 2) defining success metrics
  • Fulltime
Read More
Arrow Right

Senior Data Solutions Engineer

Piper Companies is currently looking for an experienced Senior Data Solutions En...
Location
Location
United States , Charlotte
Salary
Salary:
140000.00 - 180000.00 USD / Year
pipercompanies.com Logo
Piper Companies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or master’s degree in computer science, Mathematics, Statistics, Economics, Management Information Systems, or a related field
  • Strong proficiency in SQL for querying and data transformation
  • Experience using Python for backend development and/or data processing
  • Proven experience building or operating enterprise data platforms supporting complex analytics and diverse datasets
  • Hands-on experience with modern data platforms such as Snowflake or Databricks
  • Experience working with cloud platforms, preferably Azure, including compute, storage, and security concepts
  • Understanding of data governance and master data management concepts
  • Strong communication skills with the ability to collaborate across technical and non-technical teams
Job Responsibility
Job Responsibility
  • Acting as Technical Lead for client-facing data analytics engagements, guiding solution design, delivery approach, and technical decision-making
  • Leading discovery and data assessment activities to evaluate data availability, quality, and feasibility for analytics, reporting, and data management initiatives
  • Designing, modeling, and onboarding new datasets into the enterprise Data Platform while ensuring alignment with platform standards and client requirements
  • Developing and overseeing custom analytics solutions including reports, dashboards, semantic models, queries, and views to support advanced data consumption
  • Defining and implementing data quality rules and validation checks beyond standard platform capabilities
  • Reviewing solution designs to ensure scalability, reliability, maintainability, and alignment with long-term platform strategy
  • Serving as the primary technical point of contact for clients, translating business needs into actionable technical solutions and managing expectations
  • Balancing client requests with platform integrity, security, and sustainability while representing company best interests
What we offer
What we offer
  • Comprehensive benefits package
  • Fulltime
Read More
Arrow Right