CrawlJobs Logo

Data Engineer 3

India, Chennai · Job Posted January 16, 2026
Apply Position
Job Link Share

Job Description

Responsible for designing, building and overseeing the deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources. Establishes and builds processes and structures based on business and technical requirements to channel data from multiple inputs, route appropriately and store using any combination of distributed (cloud) structures, local databases, and other applicable storage forms as required.

Job Responsibility

  • Design, build and oversee deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data
  • Establish and build processes and structures to channel data from multiple inputs
  • Develop technical tools and programming that leverage AI, machine learning and big-data techniques to cleanse, organize and transform data
  • Create and establish design standards and assurance processes for software, systems and applications development
  • Review internal and external business and product requirements for data operations
  • Work with data modelers/analysts to understand business problems and create or augment data assets
  • Develop data structures and pipelines to organize, collect, standardize and transform data
  • Ensure data quality during ingest, processing and final load
  • Create standard ingestion frameworks for structured and unstructured data
  • Create standard methods for end users to consume data (database views, extracts, APIs)
  • Develop and maintain information systems (data warehouses, data lakes)
  • Participate in implementation of solutions via data architecture on on-prem and Cloud platforms
  • Determine appropriate storage platform based on privacy, access and sensitivity
  • Understand data lineage and transformation rules
  • Collaborate with technology partners to optimize data sourcing and processing
  • Develop strategies for data acquisition, archive recovery, and database implementation
  • Manage data migrations/conversions and troubleshoot data processing issues
  • Apply data privacy rules consistently
  • Identify and react to system notifications to ensure quality standards
  • Solve critical issues and share knowledge
  • Work nights and weekends, variable schedule(s) as necessary

Requirements

  • Bachelor's Degree
  • 5-7 Years Relevant Work Experience
  • In-depth experience, knowledge and skills in own discipline
  • Experience in designing, building and overseeing deployment and operation of technology architecture, solutions and software for data
  • Experience in developing data structures and pipelines
  • Experience with data acquisition, archive recovery, and database implementation
  • Experience with on-prem platforms like Kubernetes and Teradata
  • Experience with Cloud platforms like Databricks, AWS S3, Redshift
  • Understanding of data lineage and transformation rules
  • Understanding of data sensitivity and customer data privacy rules and regulations

What we offer

  • Paid Time off
  • Physical Wellbeing benefits
  • Financial Wellbeing benefits
  • Emotional Wellbeing benefits
  • Life Events + Family Support benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer 3

8 matching positions

Systems Analyst 3 - Data Engineer

Sammons Financial Group is seeking a Systems Analyst – Data Engineer to design, ...
Location
Location
United States , Sioux Falls; West Des Moines; Chicago
Salary
Salary:
82654.00 - 172197.00 USD / Year
sammonsfinancialgroup.com Logo
Sammons Financial Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • College Degree in the field of computer science, information science, management information systems Preferred
  • Minimum 8 years' IT development experience or equivalent Preferred
  • Effective verbal and written communications skills and the ability to communicate with business partners and other IT staff
  • Problem solving skills sufficient to perform research and recommend a proposed solution to problems
  • Able to work on multiple tasks and meet established deadlines
  • Able to effectively direct and coordinate the work of other team members on a project without having HR management responsibility for them
  • Knowledge of computer programming languages as required for the system
  • Criminal background check required
Job Responsibility
Job Responsibility
  • Design, develop, and implement scalable data ingestion, integration, and processing pipelines across cloud platforms (Azure, Snowflake/ and similar EDW/Lakehouse platforms , AWS)
  • Develop and manage data orchestration workflows using tools such as Azure Data Factory (ADF), Azure Data Lake (ADLS), dbt, and comparable technologies
  • Ingest and process large volumes of structured, semi-structured, and unstructured data, including compressed formats (e.g., .tar), and automate extraction, transformation, and loading processes
  • Design and implement modern data lakehouse architectures, including Iceberg (or similar table formats), to support scalable and high-performance analytics
  • Develop and maintain data models that accurately represent complex relationships within life insurance and policy administration domains
  • Integrate enterprise data platforms with internal and external systems (e.g., APIs, Kafka, MuleSoft) to enable real-time and batch data exchange
  • Collaborate with product owners, architects, analysts, and developers to translate business, functional, and non-functional requirements into scalable technical solutions
  • Establish and enforce data engineering standards, best practices, and governance controls across ingestion, transformation, and storage layers
  • Implement data quality validation, reconciliation processes, and error handling to ensure accuracy, consistency, and reliability of data pipelines
  • Monitor pipeline performance, reliability, scalability, and cost efficiency
What we offer
What we offer
  • Comprehensive health coverage for you and your family, including Medical, Dental, Vision, HSA & FSA options, and term life insurance
  • Competitive compensation with a performance-based incentive program tied to clear goals and individual and/or company success
  • Invest in your future with our 100% company-funded Employee Stock Ownership Plan (ESOP), plus automatic enrollment in our 401(k)
  • Work–life balance that means something. Friday afternoons off year-round, generous paid time off, and paid holidays
  • Commit to your growth with paid development time, tuition reimbursement, and professional development opportunities across industry, individual, and leadership programs
  • Make an impact beyond the workplace through volunteer time off, and our company nonprofit matching gift program, supporting the causes that matter most to you
  • An ownership culture that inspires
  • join a connected, values-driven workplace where employees take accountability, support one another, and are empowered to do their best work—together shaping our future shared success
  • Fulltime
Read More
Arrow Right

Level 3 Data Engineer

The purpose of the Level 3 Data Engineer position is to leverage their technical...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 04, 2026
Flip Icon
Requirements
Requirements
  • 10yrs Data Engineering/Data Analyst experience
  • Bachelor’s or Master’s degree in Computer Science, Data Science, Information Technology, or a related field with a focus on data engineering or data analytics
  • Strong proficiency in programming languages such as Python, SQL, Java, or Scala for data processing and analysis
  • Experience with data modeling, ETL processes, data warehousing, data integration, and data pipeline development
  • Proficiency in relational databases (e.g., SQL, PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra)
  • Working knowledge of cloud platforms such as Snowflake, AWS, Azure, or Google Cloud Platform for data storage and processing
  • Experience with data visualization tools (e.g., Power BI) to create meaningful insights from data
  • Understanding of data quality principles, data governance, and data validation processes
  • Ability to analyze complex data sets, identify trends, patterns, and insights to drive data-driven decision-making
  • Proficiency in troubleshooting data-related issues, identifying root causes, and implementing solutions
Job Responsibility
Job Responsibility
  • Build data pipelines using standard patterns with Streamsets, Kestra, dbt, Git
  • Design and implement data storage and processing solutions employing Snowflake
  • Utilize AWS services for cloud-based platform tooling infrastructure including Lambda, ECS, MSK, RDS, EC2, Secrets Manager, ALB, Cloud Watch, Event Bridge
  • Utilize Terraform for AWS and Azure deployments
  • Leverage and integrate APIs for data access and manipulation
  • Write Python scripts for data common processing and automation tasks
  • Leverage Platform APIs and Web Applications to enforce Platform Security
  • Develop with Go, SQL, C#, .net, JavaScript, shell scripts and container platforms like Docker
  • Integrate with timeseries source systems: Honeywell Plant Historian Database, OSI Pi
  • Implement authentication mechanisms including OAuth 2.0, OIDC, Microsoft Entra, Key Pair Authentication, Certificate based authentication, SAML based SSO
What we offer
What we offer
  • Commitment to your ongoing development, including on the job opportunities and formal programs
  • Inclusive parental leave entitlements for both parents
  • Values led culture
  • Flexible work options
  • Generous annual leave, sick leave and casual leave
  • Cultural and religious leave with flexible public holiday opportunities
  • Competitive remuneration package featuring performance based incentives with uncapped Employer Provident Fund
  • Fulltime
Read More
Arrow Right

ML / Data Engineer – Data Science Enablement

This role will report to the Data Science Enablement Manager and support the Rar...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s in Computer Science, Data Engineering, or related technical field
  • 3–5 years of experience in ML engineering, data engineering, or related roles
  • Strong programming skills in Python and SQL
  • Experience with data pipeline development and distributed computing (e.g., Spark/PySpark)
  • Working knowledge of Databricks and at least one cloud platform (AWS, Azure, or GCP)
  • Experience with ML lifecycle tools (e.g., MLflow, Git, CI/CD pipelines)
  • Understanding of model deployment, monitoring, and reproducibility practices
Job Responsibility
Job Responsibility
  • Build and maintain scalable data and ML pipelines to support patient finding use cases across the patient journey
  • Productionize machine learning models by developing deployment workflows, APIs, and batch/real-time scoring pipelines
  • Design and implement model evaluation, validation, and monitoring frameworks (performance tracking, drift detection, alerting)
  • Enable end-to-end ML lifecycle management, including training, versioning, deployment, and retraining workflows
  • Partner with RDBU data science teams to translate analytical solutions into production-ready systems
  • Develop ML-ready datasets and feature pipelines, ensuring data quality, consistency, and reusability
  • Support model tracking and experiment management using standardized tools and frameworks
  • Build tools and utilities to monitor, track, and operationalize model outputs for downstream consumption
  • Collaborate with enterprise data and platform teams to ensure compliance with data governance, security, and architecture standards
  • Follow engineering best practices for code quality, documentation, testing, and CI/CD integration
Read More
Arrow Right

Senior Data Engineer (Data Warehouse)

Plaud is building the next generation intelligence infrastructure and interfaces...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
plaud.ai Logo
Plaud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master’s degree in a technical field (Computer Science, Engineering or a related field
  • At least 3 years of experience in data warehouse development, including big data development, data warehouse modeling
  • Strong understanding of data warehouse architecture and principles
  • Proficient in at least 2 programming languages (e.g. SQL, Python, Scala, Java, Go)
Job Responsibility
Job Responsibility
  • Design and develop data warehouse systems, including data modeling, ETL process development, and data quality assurance
  • Collaborate with business teams and data analysts to understand business needs and deliver warehouse solutions
  • Continuously optimize data processing performance to improve platform stability and efficiency
  • Research emerging technologies to drive the next-generation upgrade of the data platform
What we offer
What we offer
  • Market-competitive compensation, global exposure, and a vibrant, creativity-fueled work atmosphere
  • Fulltime
Read More
Arrow Right

Data Engineer (Enterprise Data & Intelligence)

As a Data Engineer on the Enterprise Data & Intelligence team, you will design, ...
Location
Location
Bulgaria , Sofia
Salary
Salary:
Not provided
hotschedules.com Logo
HotSchedules Corporate
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years in data engineering or a closely related role
  • Bachelor's degree in Computer Science, Data Engineering, or a related field
  • Strong T-SQL skills and working proficiency in PySpark or Python for data processing
  • Hands-on experience with MS Azure Storage Explorer and SSMS
  • Hands-on experience with cloud-based data engineering services and orchestration tools (e.g., Azure Data Factory, Microsoft Fabric)
  • Practical experience building ETL/ELT pipelines and dimensional or analytical data models
  • Familiarity with CI/CD practices in data engineering, including version control (Git) and automated testing
  • Active use of AI productivity tools (e.g., ChatGPT, Claude, Copilot, Cursor) as an integrated part of development, testing, documentation, and day-to-day engineering workflows
  • Ability to work collaboratively with both technical and non-technical stakeholders
  • Good documentation habits and a willingness to communicate technical concepts clearly
Job Responsibility
Job Responsibility
  • Design, build, and maintain the data pipelines and models that underpin Fourth’s single source of truth
  • Gather and translate business requirements into reliable, well-tested data solutions on our Azure-based cloud platform
  • Collaborate closely with analytics engineers and business stakeholders to scope, prioritise, and deliver data products that serve FP&A, Commercial, Product, and AI teams
  • Build, maintain, and optimise scalable ETL/ELT pipelines (batch and near-real-time) on Azure Data Cloud Platform
  • Develop and refine data models to support BI reporting, analytics, and ML/AI use cases
  • Write efficient, well-documented T-SQL and PySpark code following team coding standards
  • Implement automated testing, data validation, and monitoring (SLAs, alerts) to ensure pipeline reliability
  • Contribute to data governance practices, including lineage tracking, metadata management, and quality controls
  • Support CI/CD pipelines for data assets, ensuring version control and reproducibility
  • Partner with Analytics Engineers to scope, refine, and prioritise data requirements from business stakeholders
What we offer
What we offer
  • 25+ days off, as well as birthday day off and 4 charity days off per year
  • Flexible start and end of the working day and hybrid working mode, including a combination remote and in the office
  • Team-centric atmosphere
  • Encouraging healthy lifestyle and work-life balance including supplemental health insurance
  • New parents bonus scheme
  • Fulltime
Read More
Arrow Right

Senior Data Engineer, Big Data

This role is essential for designing and developing data architectures across on...
Location
Location
United States , New York; Philadelphia
Salary
Salary:
105100.00 - 189600.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree plus 5 years of related work experience OR Advanced degree with 3 years of related experience
  • 4-7 years Developing cloud solutions using data series
  • experience with cloud platforms (Amazon Web Services, Azure, or Google Cloud)
  • 4-7 years Hands-on development using and migrating data to cloud platforms
  • 4-7 years Experience in SQL, NoSQL, and/or relational database design and development
  • 4-7 years Advanced knowledge and experience in building complex data pipelines with Python, Experience in languages such as SQL, DAX Python, Java, Scala, and/or Go
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Develop data engineering solutions that enable data pipelines, visualization, and analytical tools to support business requirements
  • Design and develop data architectures across on-premise, cloud, and hybrid platforms to ensure scalable data infrastructure
  • Perform data wrangling, exploration, and discovery of heterogeneous data to generate new business insights
  • Contribute to team knowledge sharing and drive the advancement of new data engineering capabilities
  • Mentor team members to build and enhance their data engineering skillsets and professional growth
  • Assist management in project definition, including estimating, planning, and scoping work to meet objectives
  • Also responsible for other duties/projects as assigned by business management as needed
What we offer
What we offer
  • Medical, dental and vision insurance
  • Flexible spending account
  • 401(k)
  • Employee stock grants
  • Employee stock purchase plan
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Family building benefits
  • Back-up care
  • Fulltime
Read More
Arrow Right

Senior Data Engineer, Big Data

This role is essential for designing and developing data architectures across on...
Location
Location
United States , New York; Philadelphia
Salary
Salary:
105100.00 - 189600.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree plus 5 years of related work experience OR Advanced degree with 3 years of related experience
  • 4-7 years Developing cloud solutions using data series
  • experience with cloud platforms (Amazon Web Services, Azure, or Google Cloud)
  • 4-7 years Hands-on development using and migrating data to cloud platforms
  • 4-7 years Experience in SQL, NoSQL, and/or relational database design and development
  • 4-7 years Advanced knowledge and experience in building complex data pipelines with Python, Experience in languages such as SQL, DAX Python, Java, Scala, and/or Go
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Develop data engineering solutions that enable data pipelines, visualization, and analytical tools to support business requirements
  • Design and develop data architectures across on-premise, cloud, and hybrid platforms to ensure scalable data infrastructure
  • Perform data wrangling, exploration, and discovery of heterogeneous data to generate new business insights
  • Contribute to team knowledge sharing and drive the advancement of new data engineering capabilities
  • Mentor team members to build and enhance their data engineering skillsets and professional growth
  • Assist management in project definition, including estimating, planning, and scoping work to meet objectives
  • Also responsible for other duties/projects as assigned by business management as needed
What we offer
What we offer
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • free, year-round money coaches
  • medical insurance
  • dental insurance
  • vision insurance
  • flexible spending account
  • paid time off
  • up to 12 paid holidays
  • Fulltime
Read More
Arrow Right

Distinguished Data Engineer - Enterprise Data Technology

Distinguished Data Engineers are individual contributors who strive to be divers...
Location
Location
United States , McLean; San Francisco
Salary
Salary:
269100.00 - 335100.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 7 years of experience in data engineering
  • At least 3 years of experience in data architecture
  • At least 2 years of experience building applications in AWS
  • At least 5 years of experience of Python, SQL or Scala
  • At least 3 years of experience developing AI and ML algorithms or technologies
Job Responsibility
Job Responsibility
  • Lead the design and implementation of highly scalable, fault-tolerant, and cost-effective data architectures that seamlessly integrate Databricks (for complex processing,ML) and Snowflake (for warehousing,ETL)
  • Drive performance engineering and optimization for large-scale data ingestion and processing workloads across the Databricks,Snowflake,AWS data pipeline
  • Provide technical leadership for the design, development, testing and deployment of agentic workflows across Capital One
  • Deep technical experts and thought leaders that help accelerate adoption of the very best engineering practices, while maintaining knowledge on industry innovations, trends and practices
  • Evangelists, both internally and externally, helping to elevate the Distinguished Engineering community and establish themselves as a go-to resource on given technologies and technology-enabled capabilities
  • Build awareness, increase knowledge and drive adoption of modern technologies, sharing consumer and engineering benefits to gain buy-in
  • Strike the right balance between lending expertise and providing an inclusive environment where others’ ideas can be heard and championed
  • leverage expertise to grow skills in the broader Capital One team
  • Promote a culture of engineering excellence, using opportunities to reuse and innersource solutions where possible
  • Operate as a trusted advisor for a specific technology, platform or capability domain, helping to shape use cases and implementation in an unified manner
What we offer
What we offer
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Fulltime
Read More
Arrow Right