CrawlJobs Logo

Senior Python Data Engineer

comcastadvertising.com Logo

Comcast Advertising

Location Icon

Location:
United States , Chicago ▼

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

129515.93 - 203525.03 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

Senior Software Engineer to drive the design, performance, and evolution of FreeWheel’s data pipeline and ingestion systems. This role emphasizes data pipeline performance, distributed system design, and technical leadership, while partnering closely with platform, data, and product teams. You will play a key role in defining ingestion standards, leading architectural decisions, and ensuring that pipelines scale reliably across FreeWheel’s ad‑tech ecosystem.

Job Responsibility:

  • Design, build, and optimize high-throughput data ingestion pipelines supporting large-scale advertising data
  • Improve pipeline performance, reliability, and observability across distributed systems
  • Lead architectural decisions for unified ingestion frameworks across FreeWheel platforms
  • Develop and maintain Python-based microservices supporting real-time and batch ingestion
  • Serve as a technical leader, driving best practices in system design, performance tuning, and scalability
  • Author and review technical design documents for complex distributed systems
  • Mentor engineers and raise the technical bar across the team
  • Collaborate cross-functionally with data engineering, platform, and product partners
  • Work with Snowflake as a distributed data platform to support downstream analytics and reporting
  • Optimize ingestion patterns for analytics-ready data models
  • Ensure data quality, consistency, and traceability across ingestion layers

Requirements:

  • 7+ years of experience building data pipelines or distributed backend systems using Python
  • Strong proficiency in Python and microservices-based architectures
  • Hands-on experience with AWS cloud infrastructure
  • Production experience with CI/CD, Terraform, and Kubernetes
  • Experience working with distributed data systems (Snowflake or Spark strongly preferred)
  • SQL querying
  • Proven ability to lead design discussions and influence architectural decisions
  • Strong understanding of system performance, scalability, and fault tolerance

Nice to have:

  • Snowpark or DataBricks experience
  • Experience in ad tech, media, or data-intensive platforms
  • Familiarity with both batch and streaming ingestion patterns
  • Experience unifying or standardizing ingestion across multiple teams or platforms
  • Background in performance monitoring, observability, and cost optimization in cloud environments
What we offer:
  • Paid Time off
  • Physical Wellbeing benefits
  • Financial Wellbeing benefits
  • Emotional Wellbeing benefits
  • Life Events + Family Support benefits

Additional Information:

Job Posted:
April 05, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Comcast Advertising - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Python Data Engineer

Senior Data Engineer

Join a leading global live-entertainment discovery tech platform. As a Senior Da...
Location
Location
Spain , Madrid
Salary
Salary:
Not provided
https://feverup.com/fe Logo
Fever
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You have a strong background in at least two of: data engineering, business intelligence, software engineering
  • You are an expert in Python3 and its data ecosystem
  • You have proven experience working with SQL languages
  • You have worked with complex data pipelines
  • You are a collaborative team player with strong communication skills
  • You are proactive, driven, and bring positive energy
  • You possess strong analytical and problem-solving abilities backed by solid software engineering skills
  • You are proficient in business English.
Job Responsibility
Job Responsibility
  • Own critical data pipelines of our data warehouse
  • Ideate and implement tools and processes to exploit data
  • Work closely with other business units to create structured and scalable solutions
  • Contribute to the development of a complex data and software ecosystem
  • Build trusted data assets
  • Build automatizations to create business opportunities
  • Design, build and support modern data infrastructure.
What we offer
What we offer
  • Attractive compensation package with potential bonus
  • Stock options
  • 40% discount on all Fever events and experiences
  • Home office friendly
  • Responsibility from day one
  • Great work environment with a young international team
  • Health insurance
  • Flexible remuneration with 100% tax exemption through Cobee
  • English lessons
  • Gympass membership
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Atlassian is looking for a Senior Data Engineer to join our Go-To Market Data En...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A BS in Computer Science or equivalent experience
  • At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
  • Strong programming skills (Python, Java or Scala preferred)
  • Experience writing SQL, structuring data, and data storage practices
  • Experience with data modeling
  • Knowledge of data warehousing concepts
  • Experience building data pipelines, platforms, micro services, and REST APIs
  • Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
  • Experience in modern software development practices (Agile, TDD, CICD)
  • Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies
Job Responsibility
Job Responsibility
  • Help our stakeholder teams ingest data faster into our data lake
  • Make our data pipelines more efficient
  • Build micro-services, architect, design, and enable self-serve capabilities at scale
  • Work on an AWS-based data lake backed by open source projects such as Spark and Airflow
  • Identify ways to make our platform better and improve user experience
  • Apply strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Atlassian is looking for a Senior Data Engineer to join our Go-To Market Data En...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A BS in Computer Science or equivalent experience
  • At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
  • Strong programming skills (Python, Java or Scala preferred)
  • Experience writing SQL, structuring data, and data storage practices
  • Experience with data modeling
  • Knowledge of data warehousing concepts
  • Experience building data pipelines, platforms, micro services, and REST APIs
  • Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
  • Experience in modern software development practices (Agile, TDD, CICD)
  • Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies
Job Responsibility
Job Responsibility
  • Help our stakeholder teams ingest data faster into our data lake
  • Make our data pipelines more efficient
  • Build micro-services
  • Architect, design, and enable self-serve capabilities at scale
  • Apply your strong technical experience building highly reliable services
  • Manage and orchestrate a multi-petabyte scale data lake
  • Transform vague requirements into solid solutions
  • Solve challenging problems creatively
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Atlassian is looking for a Senior Data Engineer to join our Go-To Market Data En...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 7+ years of professional experience as a software engineer or data engineer
  • A BS in Computer Science or equivalent experience
  • Strong programming skills (some combination of Python, Java, and Scala)
  • Experience writing SQL, structuring data, and data storage practices
  • Experience with data modeling
  • Knowledge of data warehousing concepts
  • Experienced building data pipelines and micro services
  • Experience with Spark, Airflow and other streaming technologies to process incredible volumes of streaming data
  • A willingness to accept failure, learn and try again
  • An open mind to try solutions that may seem impossible at first
Job Responsibility
Job Responsibility
  • Help our partner teams ingest data faster into our data lake
  • Make our data products more efficient
  • Build self-serve data engineering within the company
  • Build micro-services, architecting, designing, and promoting self serve capabilities at scale
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Atlassian is looking for a Senior Data Engineer to join their Go-To Market Data ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A BS in Computer Science or equivalent experience
  • At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer
  • Strong programming skills (Python, Java or Scala preferred)
  • Experience writing SQL, structuring data, and data storage practices
  • Experience with data modeling
  • Knowledge of data warehousing concepts
  • Experience building data pipelines, platforms, micro services, and REST APIs
  • Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
  • Experience in modern software development practices (Agile, TDD, CICD)
  • Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies
Job Responsibility
Job Responsibility
  • Help our stakeholder teams ingest data faster into our data lake
  • Make our data pipelines more efficient
  • Build micro-services, architecting, designing, and enabling self serve capabilities at scale
  • Apply your strong technical experience in building highly reliable services on managing and orchestrating a multi-petabyte scale data lake
  • Transform vague requirements into solid solutions
  • Identify ways to make our platform better and improve our users' experience
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Fulltime
Read More
Arrow Right

Senior Data Engineering Manager

Data is a big deal at Atlassian. We ingest billions of events each month into ou...
Location
Location
United States , San Francisco
Salary
Salary:
168700.00 - 271100.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • stellar people management skills and experience in leading an agile software team
  • thrive when developing phenomenal people, not just great products
  • worked closely Data Science, analytics and platform teams
  • expertise in building and maintaining high-quality components and services
  • able to drive technical excellence, pushing for innovation and quality
  • at least 10 years experience in a software development role as an individual contributor
  • 4+ years of people management experience
  • deep understanding of data challenges at scale challenges and the eco-system
  • experience with solution building and architecting with public cloud offerings such as Amazon Web Services, DynamoDB, ElasticSearch, S3, Databricks, Spark/Spark-Streaming, GraphDatabases
  • experience with Enterprise Data architectural standard methodologies
Job Responsibility
Job Responsibility
  • build and lead a team of data engineers through hiring, coaching, mentoring, and hands-on career development
  • provide deep technical guidance in a number of aspects of data engineering in a scalable ecosystem
  • champion cultural and process improvements through engineering excellence, quality and efficiency
  • work with close counterparts in other departments as part of a multi-functional team, and build this culture in your team
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Our Data Engineering Team is comprised of data experts. We build world-class dat...
Location
Location
India
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS in Computer Science or equivalent experience with 8+ years as a Senior Data Engineer or similar role
  • Strong programming skills using Python
  • Working knowledge of relational databases and query authoring (SQL)
  • Experience designing data models for optimal storage and retrieval to meet product and business requirements
  • Experience building scalable data pipelines using Spark (SparkSQL) with Airflow scheduler/executor framework or similar scheduling tools
  • Experience working with AWS data services or similar Apache projects (Spark, Flink, Hive, and Kafka)
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
  • Well versed in modern software development practices (Agile, TDD, CICD)
Job Responsibility
Job Responsibility
  • Develop backend systems and data models to serve the needs of insights
  • Help build Atlassian’s data-driven culture
  • Partner with the data analytics and data scientist team to build data solutions
  • Work with different stakeholders to understand their needs and build the data models and data applications to address those requirements
  • Add new sources, code business rules, and produce new metrics
  • Improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Atlassian is looking for a Senior Data Engineer to join our Data Engineering Tea...
Location
Location
United States , San Francisco
Salary
Salary:
135600.00 - 217800.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS in Computer Science or equivalent experience with 5+ years as Data Engineer or similar role
  • Programming skills in Python & Java (good to have)
  • Design data models for storage and retrieval to meet product and requirements
  • Build scalable data pipelines using Spark, Airflow, AWS data services (Redshift, Athena, EMR), Apache projects (Spark, Flink, Hive, and Kafka)
  • Familiar with modern software development practices (Agile, TDD, CICD) applied to data engineering
  • Enhance data quality through internal tools/frameworks detecting DQ issues
  • Working knowledge of relational databases and SQL query authoring
Job Responsibility
Job Responsibility
  • Collaborating with partners, you will design data models, acquisition processes, and applications to address needs
  • Lead business growth and enhance product experiences
  • Collaborate with Technology Teams, Global Analytical Teams, and Data Scientists across programs
  • Extracting/cleaning data, understanding generating systems
  • Improve data quality by adding sources, coding rules, and producing metrics as requirements evolve
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right
Remote jobs Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog Salaries About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy