CrawlJobs Logo
3Pillar Global Logo 3Pillar Global · IT - Software Development

Sr. Data Engineer - AWS

India, Noida · Job Posted February 01, 2026
Apply Position
Job Link Share

Job Description

Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on crafting cutting-edge technologies that revolutionize industries. As a Software Engineer, you'll play a vital role in our dynamic team, contributing to exciting projects that redefine urban living, establish new media channels for enterprise companies, or drive innovation in healthcare. This opportunity goes beyond code – it's about creating epic solutions that leave a lasting impression in the market. If your passion for programming fuels your drive to make a real-world impact, consider this your pass to the captivating world of Product Development! We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in building and maintaining robust data ingestion pipelines. The ideal candidate will have a strong foundation in data engineering principles, AWS technologies, and Python programming.

Job Responsibility

  • Develop, Maintain and Enhance ETL Pipelines
  • Craft client code that is not just efficient, but also performant, testable, scalable, secure, and of the highest quality
  • Provide accurate status tracking, reporting, and estimation using project methods and tools
  • Gather requirements, validate their understanding amongst the team, create and maintain relevant documentation
  • Execute activities within current methodology and upholding the highest quality standards
  • Foster collaboration with fellow engineers, designers, and managers to comprehend user pain points and iterate on solutions that drive client success
  • Take ownership of projects, from technical design to a successful launch

Requirements

  • Minimum 5 years of experience in data engineering or a related field
  • Strong proficiency in Python programming language
  • Deep understanding of AWS services, including Kinesis, S3, Athena, Redshift, DynamoDB, and Lambda
  • Experience with data ingestion pipelines, ETL processes, and data warehousing concepts
  • Proficiency in SQL and NoSQL databases
  • Experience with data modeling and schema design
  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration skills
  • Experience with data security and privacy best practices

What we offer

  • Imagine a flexible work environment – whether it's the office, your home, or a blend of both
  • From interviews to onboarding, we embody a remote-first approach
  • You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday
  • Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams
  • We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing
  • Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best
  • Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries
  • We are an equal opportunity employer
  • It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally
3Pillar Global - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Sr. Data Engineer - AWS

8 matching positions

Sr. Data Engineer - AWS

Location
Location
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • How many years of experience do you have as AWS Data Engineer?
  • How many years of experience do you have working with Core Python and its libraries?
  • Please list the AWS services you have used (Skills level should be intermediate /expertise)
  • Please share your current CTC and expected CTC.
  • Please share your official notice period
  • Fulltime
Read More
Arrow Right

Sr. AWS Data Engineer

We are looking for a Data Operations Engineer to support and oversee the automat...
Location
Location
United States , Atlanta
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6–10 years of experience in data operations, data engineering, or data support roles
  • Experience with ETL/ELT orchestration tools
  • Hands‑on experience with AWS services such as S3, Glue, Lambda, CloudWatch, Redshift, or similar
  • Strong SQL skills (joins, aggregations, troubleshooting data discrepancies)
  • Working knowledge of Python for scripting and data validation
  • Experience troubleshooting automated data pipelines
  • Familiarity with structured and semi‑structured data formats (CSV, JSON, Parquet)
  • Strong analytical and problem‑solving skills
  • Comfortable interacting with customers in technical discussions
  • Experience working in a healthcare or pharmaceutical environment
Job Responsibility
Job Responsibility
  • Monitor automated batch and streaming data pipelines in AWS
  • Identify, troubleshoot, and resolve data processing failures
  • Investigate file‑level errors, schema mismatches, and transformation issues
  • Perform root‑cause analysis and document resolutions
  • Ensure data integrity, completeness, and timeliness across environments
  • Escalate architectural or systemic issues to the Data Engineering team
  • Collaborate directly with customers to understand their file formats and data structures
  • Create and maintain mapping templates to align customer data to a normalized data model
  • Validate sample files and run tests on ingestion workflows
  • Configure ingestion parameters within predefined frameworks
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Read More
Arrow Right

Data Engineer Sr (AWS)

Data Engineers are responsible for designing, building, and maintaining the syst...
Location
Location
Mexico , GDL
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6 - 8 years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects
  • 2+ years of experience leading a team supporting data related projects to develop end-to-end technical solutions
  • Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server)
  • Experience with data pipeline tools (e.g., Apache Airflow, Luigi, Prefect)
  • Proficiency with at least one programming language (Python, Java, or Scala)
  • Experience with cloud platforms (AWS) and their data services (e.g., Redshift, BigQuery, Snowflake, Databricks)
  • Familiarity with data modeling, warehousing, and schema design
  • Understanding of data governance, privacy, and security best practices
Job Responsibility
Job Responsibility
  • Design and implement tailored data solutions to meet customer needs and use cases
  • Provide thought leadership by recommending the most appropriate technologies and solutions
  • Demonstrate proficiency in coding skills to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations
  • Collaborate seamlessly across diverse technical stacks
  • Develop and deliver detailed presentations to effectively communicate complex technical concepts
  • Generate comprehensive solution documentation
  • Adhere to Agile practices throughout the solution development process
  • Design, build, and deploy databases and data stores to support organizational requirements
  • Ensure data quality, consistency and governance across multiple sources
Read More
Arrow Right

Sr. Data Engineer – Clinical Data Foundation

The Sr. Data Engineer is responsible for designing, building, maintaining, analy...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s /Bachelor’s degree with 9-12 years of experience in Computer Science, IT or related field
  • Hands on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing
  • Hands on experience with various Python/R packages for data analysis, feature engineering and machine learning model training
  • Proficiency in data analysis tools (eg. SQL) and experience with data visualization tools
  • Excellent problem-solving skills and the ability to work with large, complex datasets
  • Strong understanding of data governance frameworks, tools, and best practices.
  • Knowledge of data protection regulations and compliance requirements (e.g., GDPR, CCPA)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate with Data Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines to meet fast paced business needs across geographic regions
Read More
Arrow Right
New

Sr Data Engineer

As a Senior Data Engineer at Amgen, you will be responsible for managing and opt...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master's degree with 8 - 13 years of experience in Computer Science, IT or related field
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Excellent analytical and troubleshooting skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Engineering for Biotech or Pharma functional knowledge of R&D
  • Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture
  • Optimize big data processing frameworks using Apache Spark, Hadoop, or similar distributed computing technologies to ensure high availability and cost efficiency
  • Work with metadata management and data lineage tracking tools to enable enterprise-wide data discovery and governance
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop CI/CD pipelines for automated data pipeline deployments, version control, and monitoring
  • Implement data virtualization techniques to provide seamless access to data across multiple storage systems
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement of Enterprise Data Fabric architectures
  • Fulltime
Read More
Arrow Right
New

Sr. Data Engineer

We are seeking a highly skilled Data Engineer with strong backend engineering ex...
Location
Location
United States , Boston
Salary
Salary:
Not provided
solomonpage.com Logo
Solomon Page
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in Data Engineering, Backend Engineering, or related roles
  • Strong hands-on experience with Python development
  • Extensive experience with PostgreSQL and advanced SQL optimization
  • Experience building and maintaining ETL/ELT pipelines and data integration workflows
  • Strong knowledge of data engineering concepts, data modeling, and data architecture
  • Experience working with Parquet file formats and large-scale datasets
  • Hands-on experience with AWS services including EKS, Lambda, and cloud-native architectures
  • Experience developing APIs and microservices using FastAPI or similar frameworks
  • Strong data testing, validation, troubleshooting, and performance tuning skills
  • Excellent organizational skills with the ability to manage timelines, priorities, and status reporting
Job Responsibility
Job Responsibility
  • Design, develop, optimize, and maintain scalable data pipelines and ETL/ELT workflows
  • Refactor and enhance existing data processing frameworks to improve performance and reliability
  • Perform extensive data validation, testing, and quality assurance across data platforms
  • Optimize SQL queries, database structures, and table performance within PostgreSQL environments
  • Implement and support backend services and APIs using Python and FastAPI
  • Develop and maintain data solutions leveraging AWS services including EKS and Lambda
  • Work with Parquet files and large-scale datasets to support analytics and reporting requirements
  • Improve overall data architecture, operational stability, and system performance
  • Maintain detailed task tracking, status reporting, and execution transparency through Excel-based project tracking
  • Proactively identify risks, communicate project status, and manage timelines effectively
What we offer
What we offer
  • medical
  • dental
  • 401(k)
  • direct deposit
  • commuter benefits
Read More
Arrow Right

Sr Data Engineer

Designing, building, maintaining, analyzing, and interpreting data to provide ac...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s / Master’s degree and 8 to 13 years of Computer Science, IT or related field experience
  • Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing
  • Proficiency in data analysis tools (e.g. SQL) and experience with data visualization tools
  • Excellent problem-solving skills and the ability to work with large, complex datasets
  • Strong understanding of data governance frameworks, tools, and best practices
  • Excellent critical-thinking and problem-solving skills
  • Strong communication and collaboration skills
  • Demonstrated awareness of how to function in a team setting
  • Demonstrated presentation skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate and communicate effectively with product teams
  • Fulltime
Read More
Arrow Right

Sr Engineer, Data

This role is essential for designing and developing data architectures across on...
Location
Location
United States , Bothell
Salary
Salary:
105100.00 - 189600.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree plus 5 years of related work experience OR Advanced degree with 3 years of related experience (Required)
  • Acceptable areas of study include Computer Engineering, Computer Science, a related subject area (Required)
  • 4-7 years Developing cloud solutions using data series
  • experience with cloud platforms (Amazon Web Services, Azure, or Google Cloud) (Required)
  • 4-7 years Hands-on development using and migrating data to cloud platforms (Required)
  • 4-7 years Experience in SQL, NoSQL, and/or relational database design and development (Required)
  • 4-7 years Advanced knowledge and experience in building complex data pipelines with Python, Experience in languages such as SQL, DAX Python, Java, Scala, and/or Go (Required)
  • Cloud Computing (Required)
  • Collaboration (Required)
  • Data Analysis (Required)
Job Responsibility
Job Responsibility
  • Develop data engineering solutions that enable data pipelines, visualization, and analytical tools to support business requirements
  • Design and develop data architectures across on-premise, cloud, and hybrid platforms to ensure scalable data infrastructure
  • Architect, build, and maintain reliable data pipelines that ingest, transform, and deliver data from diverse customer and business data sources into enterprise data lake, warehouse, and analytics platforms
  • Design reusable data models and standardized schemas, including Customer 360 and customer behavioral data structures, to support consistent metric definitions and trusted downstream use by analytics, marketing, and AI/ML teams
  • Perform data wrangling, exploration, and discovery of heterogeneous data to generate new business insights
  • Embed data quality practices into pipeline development, including automated checks for completeness, accuracy, timeliness, and governance alignment
  • Build and curate self-service data products, metadata, and documentation that improve data discoverability and enable approved users to access trusted datasets efficiently
  • Partner with analytics, marketing, AI/ML, and business stakeholders to understand data needs, define data contracts, and support scalable customer data use cases
  • Contribute to team knowledge sharing and drive the advancement of new data engineering capabilities
  • Mentor team members to build and enhance their data engineering skillsets and professional growth
What we offer
What we offer
  • Medical, dental and vision insurance
  • flexible spending account
  • 401(k)
  • employee stock grants
  • employee stock purchase plan
  • paid time off
  • up to 12 paid holidays
  • paid parental and family leave
  • family building benefits
  • back-up care
  • Fulltime
Read More
Arrow Right