This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are looking for an experienced Data Engineer to join our dynamic team in El Segundo, California. In this role, you will play a key part in designing, developing, and optimizing data pipelines and architectures to support business operations and analytics. This position offers the opportunity to work on cutting-edge technologies, including AI and machine learning applications.
Job Responsibility:
Develop, test, and maintain scalable data pipelines and architectures to support business intelligence and analytics needs
Collaborate with cross-functional teams to integrate data from diverse sources, including D365 Commerce and Adobe Experience Platform
Utilize Python, PySpark, and Azure data services to transform and orchestrate datasets
Implement and manage Kafka-based systems for real-time data streaming
Ensure compliance with data governance, security, and privacy standards
Optimize data storage solutions, leveraging medallion architecture and modern data modeling practices
Prepare datasets for AI/ML applications and advanced analytical models
Monitor, troubleshoot, and improve the performance of data systems
Design semantic models and dashboards using Power BI to support decision-making
Stay updated on emerging technologies and best practices in data engineering
Requirements:
Minimum of 3 years of experience in data engineering or a related field
Proficiency in Python, PySpark, and SQL for data transformation and analysis
Hands-on experience with Apache Spark and Kafka for data processing and streaming
Familiarity with Azure Data Lake and other cloud-based data services
Strong understanding of medallion architecture and lakehouse paradigms
Knowledge of Power BI and semantic modeling is a plus
Ability to prepare data for AI/ML applications and advanced analytics
Excellent problem-solving skills and ability to work independently in a fast-paced environment
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.