CrawlJobs Logo

Senior Python Data Engineer

· Job Posted February 01, 2026
Apply Position
Job Link Share

Job Description

At 3Pillar Global, we specialize in building impactful software products that power digital businesses. We are looking for a talented Senior Data Python + AWS Engineer who will not only write code but also deliver exceptional product capabilities for our clients. Your contributions will play a pivotal role in achieving our passion for client success, solidifying our position as a leading product development services company.

Job Responsibility

  • Develop and refine strategies for acquiring research data from scientific laboratory instruments
  • Engineer and operationalize custom file parsers to handle diverse instrument output formats—including .xlsx, .pdf, .txt, .raw, .fid, and a variety of proprietary vendor binaries
  • Architect and implement robust data models, along with scalable data pipelines, comprehensive unit and integration tests, and modular utility libraries
  • Perform comparative analysis of datasets generated by similar instruments or workflows to design shared, extensible data model components
  • Create visualizations, reports, and interactive dashboards leveraging platforms such as Streamlit, Tableau, Jupyter Notebook, and others

Requirements

  • 5+ years of building solutions as a Data Engineer or similar fields
  • 3+ years working in Python and SQL with a focus on data
  • Experience with data plotting dashboarding tools like Streamlit, Tableau, Jupyter Notebook is a plus
  • Excellent communication skills, attention to detail, and the confidence to take control of project delivery
  • Quickly understand a highly technical product and effectively communicate with product management and engineering

Nice to have

  • Passionate about data problems and using AI and LLM to come up with creative ideas
  • A degree in biology or chemistry or relevant fields OR > 3 years of work experience in pharmaceutical or biotech industry in scientific data engineering, data modeling, or data analytics
  • Exposure to DevOps practices in cloud environments

What we offer

  • Career growth and development
  • Physical and mental wellbeing: as a company, we spend a whole trimester in our annual cycle focused on wellbeing
  • Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging unlimited PTO to take some needed time off

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Python Data Engineer

8 matching positions

Senior Python Data Engineer

At 3Pillar Global, we specialize in building impactful software products that po...
Location
Location
Costa Rica
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of building solutions as a Data Engineer or similar fields
  • 3+ years working in Python and SQL with a focus on data
  • Experience with data plotting dashboarding tools like Streamlit, Tableau, Jupyter Notebook is a plus
  • Excellent communication skills, attention to detail, and the confidence to take control of project delivery
  • Quickly understand a highly technical product and effectively communicate with product management and engineering
Job Responsibility
Job Responsibility
  • Develop and refine strategies for acquiring research data from scientific laboratory instruments
  • Engineer and operationalize custom file parsers to handle diverse instrument output formats—including .xlsx, .pdf, .txt, .raw, .fid, and a variety of proprietary vendor binaries
  • Architect and implement robust data models, along with scalable data pipelines, comprehensive unit and integration tests, and modular utility libraries
  • Perform comparative analysis of datasets generated by similar instruments or workflows to design shared, extensible data model components
  • Create visualizations, reports, and interactive dashboards leveraging platforms such as Streamlit, Tableau, Jupyter Notebook, and others
What we offer
What we offer
  • Medical Insurance benefits as per company policy
  • Life Insurance as per company policy
  • 12 days of paid vacation, sick leave and paid holidays as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Sick leave and paid holidays as per local law
  • Christmas bonus as per local law
  • Saving Fund “Asociacion Solidarista”
  • Beach house (Managed by the Asociacion Solidarista)
  • Discounts in local shops
  • Fulltime
Read More
Arrow Right

Senior Python Data Engineer

At 3Pillar Global, we specialize in building impactful software products that po...
Location
Location
Mexico
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of building solutions as a Data Engineer or similar fields
  • 3+ years working in Python and SQL with a focus on data
  • Experience with data plotting dashboarding tools like Streamlit, Tableau, Jupyter Notebook is a plus
  • Excellent communication skills, attention to detail, and the confidence to take control of project delivery
  • Quickly understand a highly technical product and effectively communicate with product management and engineering
Job Responsibility
Job Responsibility
  • Develop and refine strategies for acquiring research data from scientific laboratory instruments
  • Engineer and operationalize custom file parsers to handle diverse instrument output formats—including .xlsx, .pdf, .txt, .raw, .fid, and a variety of proprietary vendor binaries
  • Architect and implement robust data models, along with scalable data pipelines, comprehensive unit and integration tests, and modular utility libraries
  • Perform comparative analysis of datasets generated by similar instruments or workflows to design shared, extensible data model components
  • Create visualizations, reports, and interactive dashboards leveraging platforms such as Streamlit, Tableau, Jupyter Notebook, and others
What we offer
What we offer
  • Medical Insurance benefits as per company policy
  • Life Insurance as per company policy
  • 15 days of paid vacation plus additional days based on tenure
  • Vacation bonus as per local law
  • Sick leave and paid holidays as per local law
  • Profit sharing as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Christmas bonuses as per local law
  • Work from home allowance as per company policy
  • Fulltime
Read More
Arrow Right

Senior Python Data Engineer

At 3Pillar Global, we specialize in building impactful software products that po...
Location
Location
Guatemala
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of building solutions as a Data Engineer or similar fields
  • 3+ years working in Python and SQL with a focus on data
  • Experience with data plotting dashboarding tools like Streamlit, Tableau, Jupyter Notebook is a plus
  • Excellent communication skills, attention to detail, and the confidence to take control of project delivery
  • Quickly understand a highly technical product and effectively communicate with product management and engineering
Job Responsibility
Job Responsibility
  • Develop and refine strategies for acquiring research data from scientific laboratory instruments
  • Engineer and operationalize custom file parsers to handle diverse instrument output formats—including .xlsx, .pdf, .txt, .raw, .fid, and a variety of proprietary vendor binaries
  • Architect and implement robust data models, along with scalable data pipelines, comprehensive unit and integration tests, and modular utility libraries
  • Perform comparative analysis of datasets generated by similar instruments or workflows to design shared, extensible data model components
  • Create visualizations, reports, and interactive dashboards leveraging platforms such as Streamlit, Tableau, Jupyter Notebook, and others
What we offer
What we offer
  • Medical Insurance benefits as per company policy
  • Life Insurance as per company policy
  • 15 days of paid vacation, sick leave and paid holidays as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Sick leave and paid holidays as per local law
  • Christmas and Middle year bonuses as per local law
  • Monthly productivity bonus as per local law
  • Discounts in local shops
  • Direct deposit of payroll
  • Fulltime
Read More
Arrow Right

Senior Python Data Engineer

At 3Pillar Global, we specialize in building impactful software products that po...
Location
Location
Romania
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of building solutions as a Data Engineer or similar fields
  • 3+ years working in Python and SQL with a focus on data
  • Experience with data plotting dashboarding tools like Streamlit, Tableau, Jupyter Notebook is a plus
  • Excellent communication skills, attention to detail, and the confidence to take control of project delivery
  • Quickly understand a highly technical product and effectively communicate with product management and engineering
Job Responsibility
Job Responsibility
  • Develop and refine strategies for acquiring research data from scientific laboratory instruments
  • Engineer and operationalize custom file parsers to handle diverse instrument output formats—including .xlsx, .pdf, .txt, .raw, .fid, and a variety of proprietary vendor binaries
  • Architect and implement robust data models, along with scalable data pipelines, comprehensive unit and integration tests, and modular utility libraries
  • Perform comparative analysis of datasets generated by similar instruments or workflows to design shared, extensible data model components
  • Create visualizations, reports, and interactive dashboards leveraging platforms such as Streamlit, Tableau, Jupyter Notebook, and others
What we offer
What we offer
  • Career growth and development
  • Physical and mental wellbeing: fitness offerings, mental health plans (country-dependent), unlimited PTO
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Senior Data Engineer, Python

Senior Data Engineer, Python. Do you love building and pioneering in the technol...
Location
Location
United States , McLean; Plano; Wilmington; Richmond
Salary
Salary:
147100.00 - 184600.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 3 years of experience in application development (Internship experience does not apply)
  • At least 1 year of experience in big data technologies
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Python, Java, Scala, and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • Fulltime
Read More
Arrow Right

Senior Generalist (Python, Data) Engineer - Healthcare AI Platform

We are looking for a senior hands-on engineer to own and maintain a sophisticate...
Location
Location
United States
Salary
Salary:
Not provided
provectus.com Logo
Provectus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of hands-on engineering experience with production systems
  • Generalist mindset, comfortable across backend development, data pipelines, and cloud infrastructure
  • Strong production Python skills and solid software engineering fundamentals
  • Hands-on experience with AWS (S3, Lambda, ECS, SQS, Bedrock, RDS or similar)
  • Experience with analytical data pipelines (SQL, Spark) and data processing at scale
  • Experience with Infrastructure as Code (Terraform, CDK, or CloudFormation)
  • Experience with AI-assisted development workflows (Claude Code or alternatives), not just autocomplete
  • Experience maintaining and scaling systems in production, not just building POCs
  • Autonomous working style, you don't need a project manager to tell you what to do next
  • US-based, required due to project compliance and data security constraints
Job Responsibility
Job Responsibility
  • Maintain, improve, and extend an AI platform already running in production
  • Handle a mix of backend development, data engineering, DevOps, and infrastructure work
  • Translate business and product requirements into technical decisions independently
  • Work directly with internal stakeholders and consumer teams
  • Establish and maintain engineering best practices for the platform
  • Identify and resolve technical issues as the first line of defense
What we offer
What we offer
  • Full ownership of a production AI platform
  • Remote-first, fully flexible work environment
  • Annual performance bonus
  • Health, dental, vision, 401(k) with company match, unlimited PTO
  • Long-term engagement
  • this role extends beyond the initial project
Read More
Arrow Right

Senior Data Engineer with Python

Intellectsoft is a software development company delivering innovative solutions ...
Location
Location
India , Bengaluru; Gurugram
Salary
Salary:
Not provided
intellectsoft.net Logo
Intellectsoft
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL
  • Proficiency in Python for data processing and automation
  • Knowledge of PySpark, distributed computing, analytical databases and other big data technologies
  • Expertise in designing and managing ETL pipelines and distributed data processing frameworks
  • Strong knowledge of database systems, data modeling, and analytical databases
  • Hands-on experience with workflow orchestration tools such as Apache Airflow
  • Familiarity with cloud platforms like AWS, GCP, or Azure
  • Solid understanding of software development lifecycles, including coding standards, version control, and testing
Job Responsibility
Job Responsibility
  • Design and build highly reliable and scalable data pipelines using PySpark and big data technologies
  • Collaborate with the data science team to develop new features that enhance model accuracy and performance
  • Create standardized data models to improve consistency across various deployments
  • Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows
  • Conduct POCs to evaluate new technologies and integrate additional data sources
  • Follow and promote best practices for software development, ensuring high-quality solutions that meet requirements and deadlines
  • Document development updates and maintain clear technical documentation
What we offer
What we offer
  • Awesome projects with an impact
  • Udemy courses of your choice
  • Team-buildings, events, marathons & charity activities to connect and recharge
  • Workshops, trainings, expert knowledge-sharing that keep you growing
  • Clear career path
  • Absence days for work-life balance
  • Flexible hours & work setup - work from anywhere and organize your day your way
  • Fulltime
Read More
Arrow Right