This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are looking for a skilled Data Engineer to join our team on a long-term contract basis in Houston, Texas. In this role, you will design, develop, and maintain data pipelines and systems that support critical business operations within the manufacturing industry. Your expertise in data engineering technologies and frameworks will be key to ensuring efficient data processing and integration.
Job Responsibility:
Develop, optimize, and maintain scalable data pipelines to process large datasets efficiently
Implement ETL processes to extract, transform, and load data from various sources into centralized systems
Leverage Apache Spark, Hadoop, and Kafka to design solutions for real-time and batch data processing
Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions
Monitor and troubleshoot data systems to ensure reliability and performance
Document data workflows and processes to ensure clarity and maintainability
Conduct testing and validation of data systems to ensure accuracy and quality
Apply Python programming to automate data tasks and streamline workflows
Stay updated on industry trends and emerging technologies to propose innovative solutions
Ensure compliance with data security and privacy standards in all engineering efforts
Requirements:
Proficiency in Apache Spark for distributed data processing
Strong knowledge of Python programming and its application in data engineering
Experience with Apache Hadoop for big data management
Familiarity with Apache Kafka for real-time data streaming
Hands-on experience in designing and implementing ETL processes
Ability to work collaboratively in a team environment and communicate effectively
Solid understanding of data security and privacy practices
Bachelor's degree in Computer Science, Information Technology, or a related field
What we offer:
medical, vision, dental, and life and disability insurance