CrawlJobs Logo

Data Engineer with Python

· Job Posted January 01, 2026
Apply Position
Job Link Share

Job Description

We seek a senior data engineer with Python knowledge to join one of our Apple projects. This engineer will analyze data to generate business insights using Python and new and relevant technologies. They will also help create and maintain the analytic data pipelines that empower the analytics and reporting key to decision-making across retail while leveraging large and complex data sources. Our new colleague will partner with cross-functional teams to identify, create, and maintain metrics and data pipelines to support analytics, reporting, and key decisions on various topics, including product launches, customer experience, and operational performance.

Job Responsibility

  • Perform Data Analysis to generate business insights
  • Design, create, refine, and maintain data pipelines and ingestion processes for modeling, analysis, and reporting
  • Support Critical data processes running in production
  • Collaborate with other data scientists, analysts, and engineers to build full-service data solutions
  • Work with cross-functional business partners and vendors to acquire and transform raw data sources
  • Develop a deep understanding of our retail customer base and purchase choices and contribute to developing tools to improve business efficiency and productivity

Requirements

  • Minimum 4 years of production experience working with Python
  • Experience building robust and scalable data processes and pipelines for modeling, analysis, and reporting
  • Experience with microservices, Apache Spark, Ray, REST, Docker, Kubernetes, Redis, AWS Cloud, S3, RDBMS (such as PostgreSQL), NoSQL, Vector DB
  • Solid knowledge of Fast API/Django/Flask, Pydantic, Matplotlib, and Plotly
  • Extensive experience with building highly scalable and available REST APIs
  • Experience in using workflow systems such as Airflow is a plus
  • Experience with Kubernetes, CI/CD deployment, Helm, and monitoring systems such as Prometheus and Grafana
  • Knowledge of Graph Database, LLM/RAG, Tensor, LangChain is a plus

Nice to have

  • Experience in using workflow systems such as Airflow is a plus
  • Knowledge of Graph Database, LLM/RAG, Tensor, LangChain is a plus

What we offer

  • Open office policy - Work from Anywhere and Utilities expenses coverage
  • Extra days off & Bi-monthly team lunch / activities
  • Stock options
  • Offers for dental and optical clinics & health subscription & sports discounts
  • Access to learning platforms & Bookster subscription
  • Good coffee and snacks at the office & discounts at coffee shops nearby

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer with Python

8 matching positions

Senior Data Engineer with Python

Intellectsoft is a software development company delivering innovative solutions ...
Location
Location
India , Bengaluru; Gurugram
Salary
Salary:
Not provided
intellectsoft.net Logo
Intellectsoft
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL
  • Proficiency in Python for data processing and automation
  • Knowledge of PySpark, distributed computing, analytical databases and other big data technologies
  • Expertise in designing and managing ETL pipelines and distributed data processing frameworks
  • Strong knowledge of database systems, data modeling, and analytical databases
  • Hands-on experience with workflow orchestration tools such as Apache Airflow
  • Familiarity with cloud platforms like AWS, GCP, or Azure
  • Solid understanding of software development lifecycles, including coding standards, version control, and testing
Job Responsibility
Job Responsibility
  • Design and build highly reliable and scalable data pipelines using PySpark and big data technologies
  • Collaborate with the data science team to develop new features that enhance model accuracy and performance
  • Create standardized data models to improve consistency across various deployments
  • Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows
  • Conduct POCs to evaluate new technologies and integrate additional data sources
  • Follow and promote best practices for software development, ensuring high-quality solutions that meet requirements and deadlines
  • Document development updates and maintain clear technical documentation
What we offer
What we offer
  • Awesome projects with an impact
  • Udemy courses of your choice
  • Team-buildings, events, marathons & charity activities to connect and recharge
  • Workshops, trainings, expert knowledge-sharing that keep you growing
  • Clear career path
  • Absence days for work-life balance
  • Flexible hours & work setup - work from anywhere and organize your day your way
  • Fulltime
Read More
Arrow Right

Senior Data Engineer (with Data Analyst skills)

As a Senior Data Engineer (with Data Analyst skills), your primary task will be ...
Location
Location
Ukraine
Salary
Salary:
Not provided
n-ix.com Logo
N-iX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You have 4+ years of relevant work experience as a Data Analytics Engineer
  • You are analytical, curious, and detail-oriented
  • You get energy from diverse work and solving complex data questions
  • You have extensive knowledge of SQL or other languages. Preferably experience with GTM, A/B testing, and dashboarding
  • Strong communication skills - you can explain insights and analytical solutions to technical and non-technical stakeholders
  • High motivation, proactiveness, and a genuine enthusiasm for data and product analytics
  • English level - at least Upper-Intermediate, both spoken and written
Job Responsibility
Job Responsibility
  • Migrating dashboards and underpinning analytics models from (Snowflake, dbt, Qlik) to (AWS, python) data platform
  • Measuring the effectiveness of a new feature on the platform
  • Analyzing and advising on the customer journey (of B2B and B2C customers)
  • Analyzing the effectiveness of website personalization
  • Maintaining the tag management system and Snowplow data models in DBT/SQL
What we offer
What we offer
  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits
Read More
Arrow Right

Senior Data Engineer with Data Bricks

About the Role: Senior Data Engineer with Data Bricks position at Cigres Technol...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
cigres.com Logo
Cigres
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Databricks and experience with Spark for big data processing
  • Strong experience with Power BI, particularly in building reports and dashboards using DAX
  • Solid programming skills in Python or Scala for developing data pipelines
  • Knowledge of SQL and experience with relational databases and data warehousing concepts
  • Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing
  • Understanding of data modeling, ETL processes, and data integration methodologies
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration abilities to work effectively in a team-oriented environment
  • Experience: 5 to 9 Years
Job Responsibility
Job Responsibility
  • Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes
  • Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives
  • Optimize data storage and retrieval processes to enhance performance and reduce latency
  • Ensure data quality and integrity by implementing best practices for data governance and validation
  • Mentor junior data engineers and contribute to knowledge sharing within the team
  • Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs
  • Fulltime
Read More
Arrow Right

Data Engineer - Big Data, Python, Databricks

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4 - 6 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Proficient in Big DataTechnologies - Cloudera, Hive, Python, Java/PySpark, Data Bricks
  • Proficient in Data analysis and data modelling
  • Good understanding of ETL concepts
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Data Engineer (Big Data, Python, Databricks) - Assistant Vice President

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai, Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant handson experience in Big Data technologies like Cloudera, Python, HQL, Java/PySpark
  • Knowledge on Machine Learning, AI would be added advantage
  • Experience in systems analysis, data analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , McLean, Virginia; Chicago, Illinois
Salary
Salary:
179400.00 - 225100.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 4 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
  • Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
  • Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
  • Optimize information system for end-user and downstream application consumers by using sound data design practices
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Data Engineer - Python, AI

We are looking for a mid-level Python Developer with combined experience in Data...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10–12 years of hands-on Python programming experience
  • Strong fundamentals in Python, OOP, and design patterns
  • Experience with NLP libraries such as Flair, BERT, HuggingFace Transformers, or similar
  • Solid experience with PySpark, Pandas, PyArrow, and distributed data pipelines
  • Experience building APIs using Flask (FastAPI is a plus)
  • Experience with MLflow for model tracking and deployment
  • Good understanding of CI/CD practices and Git workflows
  • Experience working with Redis or similar in-memory stores
  • Experience with Autosys JILs for job scheduling
  • Comfortable with Linux command line and shell scripting
Job Responsibility
Job Responsibility
  • Develop and optimize ETL/data processing jobs using PySpark, Pandas, PyArrow, and related libraries
  • Build and maintain NLP pipelines using Flair, BERT, and LLM-based models
  • Develop scalable ingestion and data transformation pipelines for AI and analytics use cases
  • Build and maintain Flask-based APIs for model inference and service integrations
  • Use regular expressions for text cleaning, parsing, and NLP preprocessing
  • Integrate caching and fast lookups using Redis
  • Manage and deploy ML models using MLflow for tracking and versioning
  • Support CI/CD workflows using GitHub, LightSpeed Enterprise, and deployment pipelines
  • Create and maintain Autosys JILs for job scheduling and automation
  • Use basic Linux commands for troubleshooting, operations, and deployment tasks
  • Fulltime
Read More
Arrow Right