Sr. Data Engineer

Sr. Data Engineer - AWS

Embark on an exciting journey into the realm of software development with 3Pilla...

Location

India , Noida

Salary:

Not provided

3Pillar Global

Expiration Date

Until further notice

Requirements

Minimum 5 years of experience in data engineering or a related field
Strong proficiency in Python programming language
Deep understanding of AWS services, including Kinesis, S3, Athena, Redshift, DynamoDB, and Lambda
Experience with data ingestion pipelines, ETL processes, and data warehousing concepts
Proficiency in SQL and NoSQL databases
Experience with data modeling and schema design
Strong problem-solving and analytical skills
Excellent communication and collaboration skills
Experience with data security and privacy best practices

Job Responsibility

Develop, Maintain and Enhance ETL Pipelines
Craft client code that is not just efficient, but also performant, testable, scalable, secure, and of the highest quality
Provide accurate status tracking, reporting, and estimation using project methods and tools
Gather requirements, validate their understanding amongst the team, create and maintain relevant documentation
Execute activities within current methodology and upholding the highest quality standards
Foster collaboration with fellow engineers, designers, and managers to comprehend user pain points and iterate on solutions that drive client success
Take ownership of projects, from technical design to a successful launch

What we offer

Imagine a flexible work environment – whether it's the office, your home, or a blend of both
From interviews to onboarding, we embody a remote-first approach
You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday
Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams
We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing
Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best
Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries
We are an equal opportunity employer
It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally

Fulltime

Sr. AWS Data Engineer

We are looking for a Data Operations Engineer to support and oversee the automat...

Location

United States , Atlanta

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

6–10 years of experience in data operations, data engineering, or data support roles
Experience with ETL/ELT orchestration tools
Hands‑on experience with AWS services such as S3, Glue, Lambda, CloudWatch, Redshift, or similar
Strong SQL skills (joins, aggregations, troubleshooting data discrepancies)
Working knowledge of Python for scripting and data validation
Experience troubleshooting automated data pipelines
Familiarity with structured and semi‑structured data formats (CSV, JSON, Parquet)
Strong analytical and problem‑solving skills
Comfortable interacting with customers in technical discussions
Experience working in a healthcare or pharmaceutical environment

Job Responsibility

Monitor automated batch and streaming data pipelines in AWS
Identify, troubleshoot, and resolve data processing failures
Investigate file‑level errors, schema mismatches, and transformation issues
Perform root‑cause analysis and document resolutions
Ensure data integrity, completeness, and timeliness across environments
Escalate architectural or systemic issues to the Data Engineering team
Collaborate directly with customers to understand their file formats and data structures
Create and maintain mapping templates to align customer data to a normalized data model
Validate sample files and run tests on ingestion workflows
Configure ingestion parameters within predefined frameworks

What we offer

medical
vision
dental
life and disability insurance
company 401(k) plan

Data Engineer Sr (AWS)

Data Engineers are responsible for designing, building, and maintaining the syst...

Location

Mexico , GDL

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

6 - 8 years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects
2+ years of experience leading a team supporting data related projects to develop end-to-end technical solutions
Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server)
Experience with data pipeline tools (e.g., Apache Airflow, Luigi, Prefect)
Proficiency with at least one programming language (Python, Java, or Scala)
Experience with cloud platforms (AWS) and their data services (e.g., Redshift, BigQuery, Snowflake, Databricks)
Familiarity with data modeling, warehousing, and schema design
Understanding of data governance, privacy, and security best practices

Job Responsibility

Design and implement tailored data solutions to meet customer needs and use cases
Provide thought leadership by recommending the most appropriate technologies and solutions
Demonstrate proficiency in coding skills to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations
Collaborate seamlessly across diverse technical stacks
Develop and deliver detailed presentations to effectively communicate complex technical concepts
Generate comprehensive solution documentation
Adhere to Agile practices throughout the solution development process
Design, build, and deploy databases and data stores to support organizational requirements
Ensure data quality, consistency and governance across multiple sources

Sr. Data Engineer – Clinical Data Foundation

The Sr. Data Engineer is responsible for designing, building, maintaining, analy...

Location

India , Hyderabad

Salary:

Not provided

Amgen

Expiration Date

Until further notice

Requirements

Master’s /Bachelor’s degree with 9-12 years of experience in Computer Science, IT or related field
Hands on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing
Hands on experience with various Python/R packages for data analysis, feature engineering and machine learning model training
Proficiency in data analysis tools (eg. SQL) and experience with data visualization tools
Excellent problem-solving skills and the ability to work with large, complex datasets
Strong understanding of data governance frameworks, tools, and best practices.
Knowledge of data protection regulations and compliance requirements (e.g., GDPR, CCPA)

Job Responsibility

Design, develop, and maintain data solutions for data generation, collection, and processing
Be a key team member that assists in design and development of the data pipeline
Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
Implement data security and privacy measures to protect sensitive data
Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
Collaborate with Data Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines to meet fast paced business needs across geographic regions

Sr Data Engineer

As a Senior Data Engineer at Amgen, you will be responsible for managing and opt...

Location

India , Hyderabad

Salary:

Not provided

Amgen

Expiration Date

Until further notice

Requirements

Bachelor’s or Master's degree with 8 - 13 years of experience in Computer Science, IT or related field
Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
Proficiency in workflow orchestration, performance tuning on big data processing
Strong understanding of AWS services
Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
Ability to quickly learn, adapt and apply new technologies
Strong problem-solving and analytical skills
Excellent communication and teamwork skills
Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
Excellent analytical and troubleshooting skills

Job Responsibility

Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Engineering for Biotech or Pharma functional knowledge of R&D
Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture
Optimize big data processing frameworks using Apache Spark, Hadoop, or similar distributed computing technologies to ensure high availability and cost efficiency
Work with metadata management and data lineage tracking tools to enable enterprise-wide data discovery and governance
Ensure data security, compliance, and role-based access control (RBAC) across data environments
Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
Develop CI/CD pipelines for automated data pipeline deployments, version control, and monitoring
Implement data virtualization techniques to provide seamless access to data across multiple storage systems
Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
Stay up to date with emerging data technologies and best practices, ensuring continuous improvement of Enterprise Data Fabric architectures

Fulltime

We are seeking a highly skilled Data Engineer with strong backend engineering ex...

Location

United States , Boston

Salary:

Not provided

Solomon Page

Expiration Date

Until further notice

Requirements

6+ years of experience in Data Engineering, Backend Engineering, or related roles
Strong hands-on experience with Python development
Extensive experience with PostgreSQL and advanced SQL optimization
Experience building and maintaining ETL/ELT pipelines and data integration workflows
Strong knowledge of data engineering concepts, data modeling, and data architecture
Experience working with Parquet file formats and large-scale datasets
Hands-on experience with AWS services including EKS, Lambda, and cloud-native architectures
Experience developing APIs and microservices using FastAPI or similar frameworks
Strong data testing, validation, troubleshooting, and performance tuning skills
Excellent organizational skills with the ability to manage timelines, priorities, and status reporting

Job Responsibility

Design, develop, optimize, and maintain scalable data pipelines and ETL/ELT workflows
Refactor and enhance existing data processing frameworks to improve performance and reliability
Perform extensive data validation, testing, and quality assurance across data platforms
Optimize SQL queries, database structures, and table performance within PostgreSQL environments
Implement and support backend services and APIs using Python and FastAPI
Develop and maintain data solutions leveraging AWS services including EKS and Lambda
Work with Parquet files and large-scale datasets to support analytics and reporting requirements
Improve overall data architecture, operational stability, and system performance
Maintain detailed task tracking, status reporting, and execution transparency through Excel-based project tracking
Proactively identify risks, communicate project status, and manage timelines effectively

What we offer

medical
dental
401(k)
direct deposit
commuter benefits

Sr Data Engineer

Designing, building, maintaining, analyzing, and interpreting data to provide ac...

Location

India , Hyderabad

Salary:

Not provided

Amgen

Expiration Date

Until further notice

Requirements

Bachelor’s / Master’s degree and 8 to 13 years of Computer Science, IT or related field experience
Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing
Proficiency in data analysis tools (e.g. SQL) and experience with data visualization tools
Excellent problem-solving skills and the ability to work with large, complex datasets
Strong understanding of data governance frameworks, tools, and best practices
Excellent critical-thinking and problem-solving skills
Strong communication and collaboration skills
Demonstrated awareness of how to function in a team setting
Demonstrated presentation skills

Job Responsibility

Design, develop, and maintain data solutions for data generation, collection, and processing
Be a key team member that assists in design and development of the data pipeline
Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
Implement data security and privacy measures to protect sensitive data
Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
Collaborate and communicate effectively with product teams

Fulltime

Sr Engineer, Data

This role is essential for designing and developing data architectures across on...

Location

United States , Bothell

Salary:

105100.00 - 189600.00 USD / Year

T-Mobile

Expiration Date

Until further notice

Requirements

Bachelor's Degree plus 5 years of related work experience OR Advanced degree with 3 years of related experience (Required)
Acceptable areas of study include Computer Engineering, Computer Science, a related subject area (Required)
4-7 years Developing cloud solutions using data series
experience with cloud platforms (Amazon Web Services, Azure, or Google Cloud) (Required)
4-7 years Hands-on development using and migrating data to cloud platforms (Required)
4-7 years Experience in SQL, NoSQL, and/or relational database design and development (Required)
4-7 years Advanced knowledge and experience in building complex data pipelines with Python, Experience in languages such as SQL, DAX Python, Java, Scala, and/or Go (Required)
Cloud Computing (Required)
Collaboration (Required)
Data Analysis (Required)

Job Responsibility

Develop data engineering solutions that enable data pipelines, visualization, and analytical tools to support business requirements
Design and develop data architectures across on-premise, cloud, and hybrid platforms to ensure scalable data infrastructure
Architect, build, and maintain reliable data pipelines that ingest, transform, and deliver data from diverse customer and business data sources into enterprise data lake, warehouse, and analytics platforms
Design reusable data models and standardized schemas, including Customer 360 and customer behavioral data structures, to support consistent metric definitions and trusted downstream use by analytics, marketing, and AI/ML teams
Perform data wrangling, exploration, and discovery of heterogeneous data to generate new business insights
Embed data quality practices into pipeline development, including automated checks for completeness, accuracy, timeliness, and governance alignment
Build and curate self-service data products, metadata, and documentation that improve data discoverability and enable approved users to access trusted datasets efficiently
Partner with analytics, marketing, AI/ML, and business stakeholders to understand data needs, define data contracts, and support scalable customer data use cases
Contribute to team knowledge sharing and drive the advancement of new data engineering capabilities
Mentor team members to build and enhance their data engineering skillsets and professional growth

What we offer

Medical, dental and vision insurance
flexible spending account
401(k)
employee stock grants
employee stock purchase plan
paid time off
up to 12 paid holidays
paid parental and family leave
family building benefits
back-up care

Fulltime

Select Country

Sr. Data Engineer - AWS

Requirements

Looking for more opportunities?

Sr. Data Engineer - AWS

Sr. Data Engineer - AWS

Sr. AWS Data Engineer

Data Engineer Sr (AWS)

Sr. Data Engineer – Clinical Data Foundation

Sr Data Engineer

Sr. Data Engineer

Sr Data Engineer

Sr Engineer, Data

Our AI answers in your language