CrawlJobs Logo
MDOTM Ltd Logo MDOTM Ltd · IT - Software Development

Data Engineer

· Job Posted June 28, 2026
Apply Position
Job Link Share

Job Description

We are looking for a Data Engineer to play a key role in shaping and scaling our platform as the organization grows in complexity and data maturity. In this role, you will be responsible for designing and evolving the core data infrastructure that powers analytics, machine learning, and critical business decisions. You will take ownership of how data flows across the company, from ingestion to consumption, ensuring it is reliable, well-modeled, and accessible to a wide range of stakeholders.

Job Responsibility

  • Design, build, and maintain production-grade data pipelines and data-intensive systems
  • Configure, schedule, and monitor data pipeline execution to ensure reliability, maintainability, and timely delivery across all data processes
  • Deploy and manage data infrastructure on AWS or on-premises, ensuring scalability, security, and cost-efficiency
  • Monitor and optimize relational and NoSQL database performance (e.g., MySQL, PostgreSQL, MongoDB) to ensure efficient querying, indexing, and data access at scale
  • Ensure reliable ingestion, transformation, and availability of large-scale and time-series financial data, considering financial-specific data quality characteristics
  • Implement and maintain data quality, validation, and monitoring mechanisms across data workflows
  • Define and evolve data models and storage structures across relational and NoSQL systems
  • Collaborate with Data Scientists and Analysts to ensure accurate and efficient data access for analytics and modeling use cases
  • Optimize data processing workflows for performance, reliability, and operational stability
  • Troubleshoot complex data issues and drive root cause analysis
  • Contribute to technical decision-making and help define the roadmap for data infrastructure

Requirements

  • Degree in Computer Science, Engineering, or a related field
  • Strong programming skills in Java or Python (or other JVM-based languages)
  • Strong understanding of data modeling, SQL, and NoSQL databases
  • Strong focus on data quality, validation, and monitoring practices
  • Experience working with large-scale and time-series datasets in financial contexts, with an understanding of their structure and common data quality challenges
  • Experience building and maintaining production data pipelines or data-intensive systems, with focus on reliability and performance
  • Ability to troubleshoot and optimize production data systems
  • Experience with workflow orchestration and data pipeline scheduling tools
  • Solid understanding of financial data structures and concepts, with the ability to model and validate financial data accurately
  • Strong problem-solving skills and attention to detail
  • Professional proficiency in English

Nice to have

  • Experience with monitoring and visualization tools (e.g., dashboards)
  • Exposure to machine learning workflows and related data requirements
MDOTM Ltd - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

This position will play a key role in strengthening an established Microsoft Fab...
Location
Location
United States , Westchester
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building and maintaining solutions within Microsoft Fabric
  • Strong knowledge of data modeling concepts and layered architecture patterns, including Bronze, Silver, and Gold frameworks
  • Experience working in Azure-based data environments and delivering cloud-oriented data engineering solutions
  • Demonstrated ability to apply independent judgment to data design decisions rather than simply executing predefined requests
  • Background in ingesting, transforming, and modeling Salesforce data for analytics or reporting purposes
  • Familiarity with legacy reporting or warehousing environments, including spreadsheet-heavy processes and older platform patterns
  • Experience with tools and technologies such as Python, Apache Spark, ETL processes, and related big data or streaming concepts
  • Strong communication skills and confidence working directly with business partners to clarify needs and explain technical recommendations
Job Responsibility
Job Responsibility
  • Expand and enhance an existing Microsoft Fabric data platform to improve performance, consistency, and downstream usability
  • Develop layered data solutions using Bronze, Silver, and Gold design principles, with particular attention to delivering trusted and analytics-ready Gold datasets
  • Create and refine data models that support accurate reporting by evaluating data relationships, structure, quality, and business context
  • Build ingestion and transformation pipelines for Salesforce data along with additional source systems used across the organization
  • Contribute to the evolution of reporting and warehousing practices by reducing dependence on legacy approaches and spreadsheet-driven processes
  • Work autonomously on technical deliverables while providing clear updates on milestones, design decisions, dependencies, and potential issues
  • Partner with business stakeholders to understand reporting needs and translate them into effective data structures that support analytics and visualization tools
  • Use data engineering technologies such as Python, Spark, ETL frameworks, and related platform capabilities to deliver scalable solutions
  • Support report-oriented data design by preparing curated datasets that align with Power BI and other business intelligence use cases
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a talented Data Engineer to join our team in Miami, Florida. ...
Location
Location
United States , Miami
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in data engineering with expertise in Snowflake, Python, and ETL processes
  • Strong knowledge of data warehouse design and optimization
  • Proficiency in working with Apache Spark, Hadoop, and Kafka
  • Solid understanding of data modeling, transformation, and integration techniques
  • Familiarity with data security, privacy, and compliance standards
  • Ability to troubleshoot and solve complex data-related issues
  • Excellent communication and collaboration skills to work effectively with cross-functional teams
  • Bachelor's degree in Computer Science, Information Technology, or a related field
Job Responsibility
Job Responsibility
  • Design and implement scalable data pipelines using Snowflake, Python, and other relevant tools
  • Collaborate with stakeholders to gather and refine data requirements, ensuring alignment with business needs
  • Develop and maintain data models to support analytics, reporting, and operational processes
  • Optimize data warehouse performance by tuning queries and managing resources effectively
  • Ensure data quality through rigorous testing and governance protocols
  • Implement security and compliance measures to protect sensitive data
  • Research and integrate emerging technologies to enhance system capabilities
  • Support ETL processes for data extraction, transformation, and loading
  • Work with technologies such as Apache Spark, Hadoop, and Kafka to manage and process large datasets
  • Provide technical guidance and support to team members and stakeholders
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

Robert Half is seeking a Contract Data Engineer to support our client’s data and...
Location
Location
United States , Nashville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Data Engineer or in a similar role
  • Strong proficiency in SQL and Python (or similar languages)
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Hands-on experience with ETL / ELT tools (Airflow, dbt, Fivetran, Matillion, Glue, ADF, etc.)
  • Experience with data warehousing platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Familiarity with streaming and big data tools (Kafka, Spark, Databricks, Hadoop) is a plus
  • Strong understanding of data modeling, performance tuning, and pipeline optimization
  • Experience with version control systems (Git) and agile development practices
  • Excellent problem-solving, analytical, and communication skills
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources
  • Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs
  • Work within cloud environments such as AWS, Azure, or GCP to deploy and manage data solutions
  • Design and support enterprise data warehouses using platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Develop solutions using big data technologies such as Spark, Databricks, Kafka, and Hadoop when required
  • Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency
  • Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability
  • Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions
  • Maintain detailed documentation for pipelines, data flows, and system architecture
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer who is passionate about building scalable dat...
Location
Location
United States , Irving
Salary
Salary:
75168.00 - 130500.00 USD / Year
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of overall experience in data engineering or related fields
  • 3+ years of experience building data pipelines using PySpark, Django, or similar frameworks, with strong proficiency in Python or Java/Scala
  • 2+ years of advanced SQL experience, including database modeling and query optimization
  • Hands‑on experience with Apache Spark, Kafka, and distributed data processing technologies
  • Experience deploying data platforms in cloud environments such as AWS, Google Cloud, or Azure
  • Strong Python experience, including libraries such as NumPy and pandas for data loading and transformation
  • Experience scheduling and orchestrating workflows using tools like Apache Airflow or dbt
  • Practical experience with MLOps concepts and supporting ML model lifecycle workflows
  • Working knowledge of relational and non‑relational databases, including data modeling principles
  • Experience collaborating within Agile/Scrum teams and participating in sprint ceremonies
Job Responsibility
Job Responsibility
  • Design and build robust, scalable data pipelines to ingest structured and unstructured data from diverse sources
  • Develop and optimize data storage solutions, including relational databases, NoSQL systems, and data lakes
  • Implement data validation, automated testing, and monitoring to ensure accuracy, reliability, and compliance
  • Partner with Data Scientists, Product Managers, and Software Engineers to build infrastructure that supports ML models, analytics, and BI dashboards
  • Participate in feature discussions, help prioritize work, and guide teams toward consensus
  • Develop prototypes to validate concepts and accelerate solution design
  • Identify root causes of data issues, assess business impact, and propose effective solutions
  • Solve complex problems related to data quality, object identity, and error handling
  • Support MLOps workflows and contribute to model deployment and data integration processes
  • Work as part of an Agile/Scrum team and participate in related ceremonies
What we offer
What we offer
  • Medical, dental, and vision insurance with an employer contribution
  • Flexible spending or health savings account
  • Life and AD&D insurance
  • Short- and long-term disability coverage
  • Paid time off
  • Employee assistance
  • Participation in a 401k program with company match
  • Additional voluntary or legally-required benefits
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to help strengthen enterprise data capabiliti...
Location
Location
United States , San Diego
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of hands-on experience in data engineering, data integration, or a closely related technical discipline
  • Strong background working with cloud data ecosystems and modern integration frameworks in production environments
  • Advanced SQL expertise, including query optimization, troubleshooting, and performance improvement
  • Proven experience creating and supporting production ETL or ELT pipelines across multiple data sources
  • Solid understanding of dimensional modeling and the design of analytics-focused datasets
  • Hands-on experience with Python, Apache Spark, or similar technologies used for large-scale data processing
  • Ability to communicate clearly, solve complex technical problems, and work effectively with both business and engineering teams
  • A bachelor’s degree in computer science, information systems, or a related field is preferred
  • relevant cloud or data certifications are a plus
Job Responsibility
Job Responsibility
  • Build and maintain robust data pipelines that move and transform information from diverse platforms into usable analytical datasets
  • Develop and support end-to-end integration workflows across multiple systems to ensure consistent and timely data delivery
  • Design data models and reporting structures that improve usability, performance, and accessibility for downstream analytics needs
  • Track data quality and platform performance, investigating issues and resolving reliability concerns before they affect business operations
  • Collaborate with cross-functional partners to translate reporting and analytics needs into scalable technical solutions
  • Maintain clear documentation and contribute to governance practices that promote accuracy, consistency, and operational discipline
  • Assist with validation, release activities, and continuous enhancements to improve the overall effectiveness of the data platform
  • Contribute to cloud-based data engineering efforts using tools such as Azure Data Factory, Azure Data Lake, Microsoft Fabric, Spark, Kafka, and Hadoop where appropriate
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • enrollment in our company 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data Engineer is a seasoned subject matter expert, responsible for the trans...
Location
Location
Thailand , Bangkok
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Seasoned knowledge of the definition and management of scoping requirements, definition and prioritization activities
  • Seasoned understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
  • Seasoned expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
  • Seasoned understanding of data architecture landscape between physical and logical data models
  • Analytical mindset with excellent business acumen skills
  • Problem-solving aptitude with the ability to communicate effectively, both written and verbal
  • Ability to build effective relationships at all levels within the organization
  • Seasoned expert in programing languages (Perl, bash, Shell Scripting, Python, etc.)
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Relevant certifications preferred such as SAP, Microsoft Azure etc.
Job Responsibility
Job Responsibility
  • Creates data models in a structured data format to enable analysis thereof
  • Designs and develops scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints
  • Interprets installation standards to meet project needs and produce database components as required
  • Creates test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Accountable for running data migrations across different databases and applications, for example MS Dynamics, Oracle, SAP and other ERP systems
  • Works across multiple IT and business teams to define and implement data table structures and data models based on requirements
  • Accountable for analysis, and development of ETL and migration documentation
  • Collaborates with various stakeholders to evaluate potential data requirements
  • Accountable for the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a highly motivated expert Data Engineer to design and develop...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration and performance tuning on big data processing
  • Strong understanding of AWS services
  • Ability to quickly learn, adapt, and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Experience with streaming technologies such as Apache Kafka, Debezium, or similar platforms for real-time data processing and integration
  • Master’s /Bachelor’s degree and 5-8 years of Computer Science, IT, or related field experience
Job Responsibility
Job Responsibility
  • Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets
  • Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains
  • Design and implement solutions to enable unified data access, governance, and interoperability across hybrid cloud environments
  • Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms
  • Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring
  • Innovate, explore, and implement new tools and technologies to enhance efficient data processing
  • Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
  • Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value
  • Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories
  • Support continuous improvement, test automation, and DevOps practices in the data engineering lifecycle
Read More
Arrow Right

Data Engineer

We are looking for a skilled Data Engineer to join our team on a long-term contr...
Location
Location
United States , New York
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in implementing and managing Snowflake and Palantir platforms
  • Strong proficiency in programming languages such as Python for data manipulation and analysis
  • Expertise in working with Apache Spark, Hadoop, and Kafka for large-scale data processing
  • In-depth knowledge of ETL processes and tools to handle complex data workflows
  • Familiarity with building and optimizing data pipelines and architectures
  • Ability to troubleshoot and resolve data system issues in a timely manner
  • Excellent problem-solving skills and attention to detail
  • Strong communication skills to collaborate effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data pipelines to support efficient data integration and processing
  • Implement and manage Snowflake-based data repositories to centralize and secure organizational data
  • Utilize Palantir to standardize and analyze data across multiple divisions, ensuring consistency and accuracy
  • Develop ETL processes to extract, transform, and load data from various sources into centralized systems
  • Collaborate with stakeholders to define data requirements and optimize system performance
  • Leverage tools like Apache Spark, Hadoop, and Kafka to build scalable data solutions
  • Monitor and troubleshoot data systems to ensure reliability and address any issues promptly
  • Deploy advanced analytics and AI models to drive operational efficiencies
  • Document processes and provide technical support to ensure smooth implementation and usage of data systems
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Read More
Arrow Right