CrawlJobs Logo

Data Engineer

India, Pune · Job Posted May 03, 2026
Apply Position
Job Link Share

Job Description

The Data Engineer is responsible for building and maintaining the technical backbone that powers PublicRelay’s analytics, measurement, and narrative intelligence products. You will design and operate robust data pipelines, analytical systems, and derived metrics that enable our Insights & Analytics teams to deliver sophisticated, business-aligned analytics at scale for global communications and reputation leaders. You will work at the intersection of data engineering, applied data science, and AI/agentic tooling, with a mandate to ensure our data is clean, reliable, and production-ready while continually pushing the frontier of what our analytics stack can do. This role is approximately 70% engineering and systems development and 30% applied analytics and experimentation in partnership with Insights teams.

Job Responsibility

  • Design, build, and maintain end-to-end data pipelines for media, reputation, and stakeholder datasets, from ingestion and scraping through preprocessing, normalization, and storage
  • Implement and enforce data hygiene standards so analytical datasets are cleanly integrated, well-documented, and easily accessible across the Insights & Analytics team
  • Operationalize and productionize advanced analytics workflows in Python and SQL including feature engineering, model scoring, and metric computation
  • Develop and maintain derived metrics and indices that can be reused across clients and products
  • Architect and monitor analytics systems ensuring accuracy, reliability, and performance at scale
  • Integrate third-party analytics tools and media data sources (e.g., social media APIs, alternative datasets) into the PublicRelay analytics stack
  • Implement rigorous logging, monitoring, and alerting for data pipelines and analytics services to catch issues early and minimize downtime
  • Apply core statistics and data science methods (regression, classification, clustering, time-series analysis, sampling, A/B testing) to support new metrics, models, and analytics features
  • Build and maintain ML workflows (training, evaluation, deployment) for tasks such as NLP, sentiment analysis, topic modeling, classification, and entity-level analytics
  • Design and implement AI- and LLM-powered agents to automate repetitive analytics tasks, data enrichment, tagging, and insight surfacing across large-scale media datasets
  • Experiment with agentic workflows (e.g., orchestrating multi-step pipelines, tool-using agents, retrieval-augmented systems) to increase speed, reliability, and sophistication of analytics outputs
  • Collaborate with data scientists and insights strategists to translate experimental models and prototypes into robust, production-grade systems
  • Build and optimize Tableau-ready data models that power client-facing dashboards and internal analytics tools
  • Ensure datasets are structured, documented, and performant for self-serve analysis in Tableau and SQL by non-engineering stakeholders
  • Partner with Visualization and Reporting teams to maintain consistent data definitions, metric logic, and calculation standards across dashboards and reports
  • Contribute to internal templates and component libraries (data sources, calculated fields, parameter patterns) that speed up dashboard development and maintain consistency
  • Master PublicRelay’s proprietary platforms and data schemas to design systems that fit seamlessly into existing workflows
  • Partner closely with Insights, Reporting, Engineering, and Client Success teams to understand how they use analytics and translate those needs into scalable data solutions
  • Participate in design reviews and technical scoping for new analytics capabilities, providing recommendations on architecture, data models, and feasibility
  • Act as a go-to technical partner for Insights teams during experiments and pilots, helping them test new metrics, methodologies, and frameworks rapidly and safely
  • Deliver all projects within agreed timelines while maintaining high standards for code quality, testing, and documentation
  • Conduct regular QA on source data, transformations, and metrics to ensure accuracy, completeness, and consistency across systems
  • Proactively identify technical and process bottlenecks
  • propose and implement improvements that increase the speed, reliability, and scalability of analytics delivery
  • Communicate status, risks, and tradeoffs clearly to technical and non-technical stakeholders
  • flag issues early with proposed options

Requirements

  • Has deep expertise in data scraping, ingestion, preprocessing, normalization, and data management best practices in a production environment
  • Demonstrates strong command of Python and SQL, with experience building and maintaining data pipelines and analytics services
  • Applies statistical and data science methods confidently (e.g., regression, classification, clustering, time-series, sampling, hypothesis testing)
  • Has hands-on experience with ML and NLP in real-world settings (e.g., classification, sentiment analysis, topic modeling, entity extraction, summarization)
  • Is fluent with AI/LLM and agentic tools (e.g., using APIs, orchestration frameworks, or workflow engines) and is eager to experiment with new approaches
  • Is comfortable building Tableau-ready data models and collaborating with dashboard developers to ensure performance and usability
  • Is an innovative and creative thinker who enjoys connecting disparate data sources and systems into cohesive analytics solutions
  • Has a strong ability to explain technical concepts to a non-technical audience
  • Thrives in collaborative environments and partners effectively with insights professionals, analysts, and client-facing teams
  • Takes an ownership mindset, holds a high bar for quality, and is motivated by building systems that others can rely on
  • 5-10 years of experience in data engineering, analytics engineering, or applied data science roles, ideally in analytics-heavy, product, or consulting environments
  • Advanced proficiency in Python (pandas, NumPy, SQLAlchemy or similar) and SQL (data modeling, performance optimization, complex queries)
  • Experience with modern data stack components (e.g., workflow/orchestration tools, cloud data warehouses, version control, CI/CD) in production settings
  • Practical experience with ML and statistics in Python (e.g., scikit-learn, statsmodels, NLP libraries) and deploying models into production workflows
  • Experience preparing data for Tableau or similar BI tools
  • understanding of best practices for semantic layers, extracts, and performance tuning
  • Strong understanding of data architecture fundamentals, including schema design, ETL/ELT patterns, and data quality frameworks
  • Excellent communication skills with the ability to explain complex technical concepts clearly to non-technical partners
  • Bachelor’s degree in Computer Science, Engineering, Statistics, Data Science, or a related field
  • advanced degree is a plus

Nice to have

advanced degree is a plus

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

Microsoft’s mission is to empower every person and every organization on the pla...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Formulate business problems and translate them into actionable data science projects
  • Explore, analyze, and centralize data to supply meaningful insights and create a single version of the truth
  • Design, prototype, implement, and test descriptive, predictive, forecasting, and causal inference models
  • Identify and action IT operations return to capacity success improvement
  • perform defect analysis, quantify opportunities, and set targets
  • Partner and collaborate with teams to identify opportunities for machine learning and predictive analysis
  • Build and deploy visualizations that deliver insights to decision-makers at all organizational levels
  • Communicate effectively with technical and non-technical audiences, contributing modeling expertise as a team player
  • Influence across disciplines to ensure data-driven decisions and solve critical problems for customers
  • Mentor others and foster a culture of continuous learning
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer to design and build scalable data pipelines and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in cloud environments (AWS and/or Azure)
  • Hands‑on experience with Databricks, Apache Spark, and Delta Lake
  • Strong skills in Python / PySpark and SQL
  • Experience with data pipelines, ETL/ELT, and data modeling
  • Familiarity with orchestration tools (Airflow or similar) and modern data architectures
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services
  • Develop and optimize ETL/ELT workflows for batch and streaming data across AWS and Azure environments
  • Build and manage data models, data lakes, and warehousing solutions for analytics and AI use cases
  • Ensure data quality, reliability, and governance across the data lifecycle
  • Collaborate with data science, analytics, and platform teams to deliver data solutions
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to join a real estate and property organizati...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Microsoft Fabric and/or Azure Data Factory, including building and optimizing pipelines
  • Proven background working with Azure data services and cloud-based data architecture
  • Advanced experience with data modeling, complex querying, and performance tuning in enterprise data platforms
  • Solid programming skills in Python, Java, Scala, or a comparable language used in data engineering
  • Experience with ETL development, relational databases, and data warehousing concepts
  • Familiarity with technologies such as Apache Spark, Hadoop, or Kafka in support of large-scale data processing
  • Ability to work effectively as an individual contributor in a lean team environment with high accountability
  • Exposure to Power BI or Tableau, along with the ability to align technical solutions with business needs
Job Responsibility
Job Responsibility
  • Design, build, and enhance end-to-end data pipelines using Microsoft Fabric and/or Azure Data Factory for production use
  • Manage and improve the data environment with a strong ownership mindset, ensuring performance, reliability, and maintainability
  • Integrate data from varied sources such as APIs, databases, and flat files into structured, usable datasets
  • Develop data models and schema designs that support reporting, analytics, and downstream business needs
  • Monitor data quality and implement validation checks, troubleshooting issues through root cause analysis and continuous optimization
  • Create scalable cloud-based data solutions within Azure that support long-term operational and analytical goals
  • Partner with cross-functional stakeholders to translate business questions into practical data engineering solutions
  • Contribute to orchestration, automation, and ongoing support of data workflows using modern engineering tools and programming languages
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

We’re on the lookout for a Data Engineer to join us on a 12-month fixed-term con...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
45000.00 GBP / Year
microlise.com Logo
Microlise
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Strong experience building SQL-based pipelines and transformations
  • Solid understanding of data modelling and structured datasets
  • Experience working with data quality, governance, or metadata concepts
  • A collaborative mindset with the ability to translate business needs into data solutions
  • Someone who thrives in a fast-paced, delivery-focused environment
Job Responsibility
Job Responsibility
  • Build and maintain robust data pipelines and transformations
  • Create curated, analytics-ready datasets aligned to business logic
  • Translate business requirements into data structures and reusable models
  • Apply and monitor data quality checks and validation rules
  • Support data governance, metadata and lineage standards
  • Collaborate with stakeholders to understand data usage and requirements
  • Deliver datasets that directly support Analytics & AI teams
What we offer
What we offer
  • 37.5 hour week with flexible working opportunities
  • Access to our salary sacrifice EV Car Scheme
  • Private medical insurance with Vitality Health including rewards
  • 25 days holiday, excluding bank holidays, increasing with service
  • Invested in employee health and well-being with over 20 mental health first aiders
  • Employee Assistance Programmes
  • Free Costco membership, 20% off EE mobile and line rental, and other local discounts
  • Great staff extras: Easter eggs, yearly BBQ, Christmas gifts and annual staff awards
  • Free Microlise Cresswell Racing Tickets
  • Executive Box at Motorpoint Arena Nottingham
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to join a growing financial services organiza...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-8 years of experience in data engineering or a closely related field
  • Strong hands-on background in building and supporting ETL or data pipeline solutions
  • Proven experience working with Snowflake in a production environment
  • Proficiency in Python for scripting, automation, and data processing tasks
  • Familiarity with modern cloud platforms
  • Experience with data ingestion technologies such as Fivetran or similar platforms
  • Ability to work through imperfect or incomplete data while communicating clearly with technical and business partners
Job Responsibility
Job Responsibility
  • Design and support data workflows that collect, refine, and deliver information across a contemporary cloud ecosystem
  • Develop and enhance scalable data pipelines using Python and automated ingestion platforms such as Fivetran or comparable tools
  • Model and transform datasets within Snowflake to enable reliable analytics and downstream business intelligence reporting
  • Collaborate closely with the data architect to expand and improve the organization’s overall data infrastructure
  • Contribute to reporting readiness by preparing curated datasets for visualization tools including Power BI and Sigma
  • Monitor pipeline performance and resolve data issues to maintain accuracy, consistency, and dependable delivery
  • Assess emerging technologies and recommend practical additions to the data stack as business needs evolve
  • Work effectively in a fast-paced team environment where priorities can shift and new tooling may be introduced regularly
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

We are seeking experienced Data Engineers to join our team. This role is focused...
Location
Location
United States , Tampa
Salary
Salary:
60.00 - 70.00 USD / Hour
apexsystems.com Logo
Apex Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in SQL, T-SQL, stored procedures, and complex transformation logic
  • Proven experience with ETL processes and data modeling
  • Proficiency with the Snowflake platform, including an understanding of SnowSQL, tasks, streams, and stored procedures
  • Experience with Python for data-related tasks
  • Familiarity with GitLab for code management
  • Strong analytical background and problem-solving skills
  • Experience with Jira
Job Responsibility
Job Responsibility
  • Develop and maintain ETL processes for Snowflake data warehousing
  • Write data transformation processes that align with Snowflake fact and dimensions, including slowly-changing dimensions
  • Rework SSIS packages into Snowflake and support the migration of approximately 300 reports
  • Utilize Python for tasks such as zipping and encrypting locally stored files
  • Use GitLab to manage code through development, testing, and production environments
  • Optimize data warehousing concepts for reporting capabilities within the Snowflake platform
  • Gather requirements and collaborate with business teams to create documentation
  • Perform SQL performance tuning and manage complex transformation logic
What we offer
What we offer
  • Medical, dental, vision, life, disability, and other insurance plans
  • Employee stock purchase program (ESPP)
  • 401K program with company match after 12 months of tenure
  • Health Savings Account (HSA) on the HDHP plan
  • SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions
  • Corporate discount savings program and other discounts
  • On-demand training program
  • Access to certification prep and library of technical and leadership courses/books/seminars once you have 6+ months of tenure
  • Certification discounts and other perks to associations that include CompTIA and IIBA
  • Dedicated customer service team for Consultants
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Lamb Weston is pursuing a modernization of its data assets and analytics environ...
Location
Location
United States , Eagle
Salary
Salary:
86380.00 - 129570.00 USD / Year
lambweston.com Logo
Lamb Weston
Expiration Date
August 09, 2026
Flip Icon
Requirements
Requirements
  • Minimum BS in Computer Science or related field or combination of education and experience sufficient to perform duties at an experienced level
  • Minimum of 3 years experience in a technical environment with data warehouse design and implementation
  • 3 years of programming experience in SQL, Java or Python
  • In depth knowledge of Snowflake
  • Knowledge of Informatica
  • 1 year+ working as a DBA
  • Demonstrated ability to work in a team and collaborative environment
  • Strong communication and interpersonal skills
  • Love of learning new technologies and having fun
  • Ability to travel 10% of the time
Job Responsibility
Job Responsibility
  • Design, build and maintain data warehouses (existing and from scratch) using Kimball and modern data methodologies
  • Debug support issues with the legacy environment and support our business users
  • Design and implement efficient data pipelines (ETLs) to integrate data from a variety of sources into Data Warehouse as well as data model changes that align with warehouse standards and backfill or other warehouse data management processes
  • Evaluates data design, database architecture, metadata and repositories for performance and effective design
  • Develop scalable ETL data pipelines with python, SQL, and AWS cloud tools
  • Optimization of existing SQL queries to improve reliability and performance
  • Develop and execute testing strategies to ensure high quality warehouse data
  • Provide documentation, training, and consulting for data warehouse users
  • Work with cross functional stakeholders to design and architect data warehouse and analytics solutions
  • Perform requirement and data analysis in order to support warehouse project definition
What we offer
What we offer
  • Health Insurance Benefits - Medical, Dental, Vision
  • Flexible Spending Accounts for Health and Dependent Care, and Health Reimbursement Accounts
  • Well-being programs including companywide events and a wellness incentive program
  • Paid Time Off
  • Financial Wellness – Industry leading 401(k) plan with generous company contributions, Financial Planning Services, Employee Stock purchase program, and Health Savings Accounts, Life and Accident insurance
  • Family-Friendly Employee events
  • Employee Assistance Program services – mental health and other concierge type services
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We’re looking for an experienced Data Engineer to design, build and support high...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
fortnumandmason.com Logo
Fortnum & Mason
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years in data engineering / data development
  • Strong Python and SQL
  • Azure Data Services (Synapse, Data Lake, Fabric, Databricks)
  • Power BI reporting & data modelling
  • ETL/ELT pipeline development and data architecture
Job Responsibility
Job Responsibility
  • Design, build and support high-quality data solutions that power reporting and analytics across the business
  • Translate business needs into scalable technical solutions
  • Develop ETL/ELT pipelines, data warehouses and lake solutions
  • Ensure strong data quality, monitoring and performance
  • Lead on BI initiatives and collaborate with stakeholders to deliver impactful insights
What we offer
What we offer
  • Competitive salary
  • A generous store and restaurant discount of up to 40%
  • 25 days holidays (excluded bank holidays) and an extra day off for your birthday
  • A fantastic subsidised staff restaurant which uses Fortnum’s ingredients
  • A range of opportunities to develop and grow personally and professionally
  • Excellent pension scheme
  • Fulltime
Read More
Arrow Right