CrawlJobs Logo

Lead ETL Data Integration Developer

United States, Los Angeles Employment contract 121056.00 - 199742.00 USD / Year · Job Posted June 15, 2026
Apply Position
Job Link Share

Job Description

The Lead ETL Data Integration Developer is responsible for the design, develop, test and implement of current and future data warehouse, business intelligence solutions and data migration projects. This position is responsible for leading the Extract, Transform, and Load (ETL) development activities and ensuring quality of ETL code. The Lead ETL Data Integration developer guides and mentors other developers as well as work collaboratively with other team members. The Lead ETL Data Integration Developer collaborates with data architects, BI architects to design and develop robust and scalable data solutions. This position is responsible for the daily workflow and leading the work of assigned staff. The Lead will mentor, coach, act as a resource and provide feedback on performance of assigned staff. Perform as the expert at identifying opportunities that improve and optimize their data environment for maximum value.

Job Responsibility

  • Responsible for the requirement analysis, design, development, architecture, implementation and support of enterprise-wide databases
  • Participates in requirements gathering sessions with business and technical staff to distill technical requirements from business requests
  • Present ETL documentation and designs to team members and convey complex information in a clear and concise manner
  • Leads the work of assigned staff
  • regularly assigns and checks the work of others, providing guidance, training and feedback on performance to department management
  • Oversees the daily office workflow, develops and recommends enhancements to process and procedures
  • Contributes to the technical decisions, working with managers to provide coaching, counseling and feedback on technical performance and implementations on projects members
  • Provide detailed plans and estimates for all phases of a project
  • Delivers data integration through the implementation of shared databases, modification and optimization of current systems, managing the exchange and storing of data, and making recommendations when upgrades or changes are needed to maintain smooth operations
  • Optimizes data warehouse performance by dealing with any data conflicts that arise and keeping data definitions up to date
  • Updates knowledge of best practices for senior data integration position by keeping track of new technologies and strategies for ETL, partaking in workshops and other educational opportunities, widening personal networks and reading industry publications
  • Leads the technical planning & requirements gathering phases including estimate, develop, test, manage projects, architect and deliver the projects by applying Systems Development Life Cycle (SDLC) standards
  • Manages complex and critical projects, engaging and updating key stakeholders, developing timelines, leads others to complete deliverables on time and ensures implementation upon approval
  • Leads the defect review meetings with business team and Quality Assurance (QA) leads to prioritize development tasks around project milestones
  • Collaborate with Quality Assurance resources to debug ETL development and ensure the timely delivery of products
  • Provide detailed plans and estimates for all phases of a project
  • Provides technical support or leadership in the development and continual improvement of service
  • Tune and optimize ETL and database processes and framework
  • Ensures adherence to data management/governance policies, processes, and standards and responsible for fixing data quality issues by working together with data analyst and data architect
  • Conduct analysis to determine size of effort and resource requirements
  • Provide technical support in outlining and managing Agile sprints
  • Automate the processes using UNIX shell and python scripts for business needs
  • Perform other duties as assigned

Requirements

  • Bachelor's Degree in Computer Science or Related fields
  • like: Statistics, Math, or Business Systems
  • At least 6 years of experience designing, developing, and testing ETL interfaces aligned with defined requirements preferably in a healthcare, or analytical or technological industries
  • At least 3 years of leading process, program, or staff experience
  • Experience in software development and design with strong emphasis on Data warehousing concepts, database design patterns, ETL methodologies, Processing and Transforming massive quantities of Data, Data cleansing, Data quality and Performance Tuning of ETL and database processes
  • Experience with Erwin data modeling toolset
  • Extensive experience in strategizing roadmap projects, data modeling, designing ETL framework and data mart life cycle development and providing technical supervision on implementation of large end-to-end Data Warehouse applications
  • Experience in UNIX Shell / Python Scripting for automation of batch and ETL jobs
  • Strong technical skill to learn, certified and lead team to EDM technology roadmap
  • The Enterprise Data Platforms includes Cloud based Informatica tool, IICS
  • Amazon AWS, Snowflake cloud technology
  • Demonstrated ability in success executing I.T. strategies to meet and exceed
  • Strong knowledge and ability in identifying strategic business objectives
  • Strong project management skills
  • Strong ability to demonstrate success in selling I.T. ideas and solutions to business
  • Strong ability to present ETL documentation and designs to team members and convey complex information in a clear and concise manner
  • Ability to demonstrate effectiveness in developing successful business relationships with I.T. internal and business personnel
  • Ability to engage key decision makers when it is required
  • Ability to articulate and sell complex solutions to I.T. and Business leaders
  • Proven consultative and strategic skills
  • Outstanding inter personal and presentation skills
  • Excellent written and verbal/ telephonic communication skills
  • Demonstrated ability in providing high level technical expertise

What we offer

  • Paid Time Off (PTO)
  • Tuition Reimbursement
  • Retirement Plans
  • Medical, Dental and Vision
  • Wellness Program
  • Volunteer Time Off (VTO)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead ETL Data Integration Developer

8 matching positions

Lead Data Integration Engineer

Are you an expert in MS SQL Server & SSIS development who learned python and clo...
Location
Location
United States , Saint Petersburg; Memphis
Salary
Salary:
Not provided
raymondjames.com Logo
Raymond James
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep expertise in Microsoft SQL Server, SSIS, and SQL development
  • Strong proficiency in writing and optimizing complex stored procedures, functions, and packages
  • Hands-on experience with Python for data manipulation, automation, and pipeline development
  • Familiarity with Oracle databases and PL/SQL development is required for cross-platform data integration
  • Experience in implementing CI/CD pipelines and DevOps practices for data solutions
  • Understanding data warehousing concepts, ETL methodologies, and data modeling techniques
  • Experience with Unix and Shell scripting
  • Experience with job scheduler tools such as BMC Control-M
  • Proven track record working in both waterfall and agile SDLC frameworks
  • Knowledge of the Financial Services industry including middle and back-office functions
Job Responsibility
Job Responsibility
  • Maintain and support our critical Pre-trade clearance system
  • Working on re-engineering our entire data stack into AWS using python
  • Fulltime
Read More
Arrow Right

Lead Data Integration Engineer

A highly experienced and technically adept Senior Integration Engineer to join o...
Location
Location
India , Pune; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
  • 10+ years of progressive experience in data integration, data engineering, or a similar role, with at least 4 years in a technical leadership or senior capacity
  • Demonstrable experience within the financial services or banking industry, specifically with wealth management or lending platforms
  • Extensive hands-on experience with end-to-end design, development, coding, and deployment of complex data integration solutions
  • Proficiency in designing, developing, and managing data access integration layers, ensuring data consistency, efficient extraction, and robust schema management
  • Strong background in source system data profiling, data discovery, data quality assessments, and driving remediation strategies. With knowledge of wholesale Lending domain
  • Skilled in defining and implementing intricate data transformation, standardization, and mapping rules
  • Hands-on experience with leading data integration platforms, ETL/ELT tools, message queuing systems, and API management solutions
  • Solid understanding and hands-on RDBMS (SQL, PL/SQL) + knowledge of NoSQL databases
  • Practical experience with AI-assisted development tools and modern authentication frameworks to enhance productivity, code quality, testing, and documentation
Job Responsibility
Job Responsibility
  • Owning overall data integration strategy, design, development, & delivery across Wealth lending platforms
  • Providing technical leadership to integration developers, and actively contributing to the design, development, and implementation of integration pipelines
  • Design & Develop integration patterns, including batch, real-time and event-based integrations with robust error handling, monitoring & replay mechanisms
  • Design, Build, & Manage data access integration layer, ensuring consistent data extracts & schema management
  • Perform & oversee source system data profiling, data discovery and data quality assessments, identifying gaps and driving remediation strategies
  • Define, Implement and validating complex transformation, standardization, and mapping rules for data integration
  • Champion and utilize AI assisted development tools and authentication frameworks to improve developer productivity, code quality, testing & documentation across the engineering team
  • Provide technical leadership and delivery ownership, guiding the team on architecture decisions, best practices, and ensuring high quality delivery of features and platform enhancements
  • Identify problems, analyze information, and make evaluative judgments to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Fulltime
Read More
Arrow Right

EDW ETL Developer - Azure Data Engineer

We are seeking a Senior Azure Data Engineer to help design, build, and operate o...
Location
Location
United States , Springfield
Salary
Salary:
50.00 - 53.00 USD / Hour
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep hands-on expertise with Azure Data Factory: pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and all three Integration Runtime types (Azure, Selfhosted, SSIS)
  • Strong Experience in Data Bricks and PySpark
  • Production experience with one or more of: Azure Synapse Analytics (Dedicated and Serverless SQL Pools, Spark Pools) OR Azure Databricks (Delta Lake, Unity Catalog) OR Microsoft Fabric (Warehouse, Lakehouse, OneLake)
  • Strong working knowledge of Azure Data Lake Storage Gen2 (hierarchical namespace, RBAC + ACLs, lifecycle management, security)
  • Experience with Azure Key Vault, Azure AD / Entra ID (including managed identities and service principals), and private networking (VNet integration, private endpoints)
  • Monitoring and troubleshooting with Azure Monitor, Log Analytics, and KQL
  • Advanced SQL — window functions, CTEs, query optimization, execution plan analysis, performance tuning
  • Strong Python for data engineering — pandas, PySpark, REST API integration, unit testing (pytest)
  • Proficient in T-SQL
  • familiarity with Spark SQL, KQL, PowerShell, and Bash shell scripting
Job Responsibility
Job Responsibility
  • Design and build robust, reusable, parameter-driven ingestion and transformation pipelines using Azure Data Factory, Synapse Pipelines, Data Bricks and/or Microsoft Fabric Data Factory
  • Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming patterns
  • Build performant ELT workflows that leverage pushdown to source systems (Synapse Dedicated SQL Pool, Azure SQL, Teradata) where appropriate
  • Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark
  • Design dimensional models (Kimball star/snowflake) and data vault patterns for analytics consumption
  • Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns
  • Tune distributed SQL workloads in Synapse Dedicated SQL Pool / Fabric Warehouse, including distribution keys, partitioning, and clustered column store indexes
  • Implement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environments
  • Instrument pipelines with robust logging, auditing, and monitoring using Azure Monitor, Log Analytics, and KQL
  • Define and enforce coding standards, code review practices, branching strategies, and release management
  • Fulltime
Read More
Arrow Right

Senior Data Engineer ETL Lead

The Sr Data Engineer ETL Lead is a senior level position responsible for establi...
Location
Location
United States , Irving
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree in Computer Science or equivalent /University degree or equivalent experience
  • Data Warehouse/ETL design and development methodologies knowledge and experience required
  • ETL expertise on AbInitio tool (EME, GDE, Co-op) bringing together all components like Unix, Oracle, Storage
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • Medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages including vacation, sick leave and paid holidays
  • Fulltime
Read More
Arrow Right

Fullstack Big Data Developer Application Development Technical Lead Analyst Vice President

Discover your future at Citi. Working at Citi is far more than just a job. A car...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of Application development experience
  • 6+ years of experience in full stack development, with a focus on Bigdata and Python/Scala
  • 6+ years experience with big data technologies such as Python, Pyspark, Hadoop, Kafka, etc.
  • Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns
  • Commendable in Data Structures and Algorithms
  • Worked on Core Application Development of complex size encompassing all areas of Java/J2EE
  • Thorough knowledge and hands on experience in following technologies Hadoop, Map Reduce Framework, Spark, YARN, Sqoop, Pig , Hue, Unix, Java, Sqoop, Impala, Cassandra on Mesos
  • Should have implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications
  • Exposure to ETL and BI tools
  • Work in an agile environment following through the best practices of agile Scrum
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Design, develop, and maintain scalable and robust architecture for the project using Java/Python/Scala and other full stack technologies
  • Manage big data technologies such as python, pyspark to ensure seamless data integration, storage, and analysis
  • Fulltime
Read More
Arrow Right

Data Analytics Lead - Data Scientist - Vice President

The Data Analytics Lead / Data Scientist is a strategic professional who stays a...
Location
Location
India , Chennai; Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10-15 years of relevant experience in Data Analytics, Data Science, or Advanced Analytics roles
  • Advanced proficiency in SQL and relational database concepts
  • Strong programming experience in Python (required)
  • PySpark preferred
  • Hands-on experience building and deploying machine learning models (supervised and unsupervised)
  • Experience with ML libraries such as scikit-learn, XGBoost, TensorFlow, or PyTorch
  • Strong knowledge of statistical modeling, feature engineering, and model validation techniques
  • Experience with BI tools such as Tableau or Power BI
  • Familiarity with MLOps practices (model deployment, monitoring, versioning) is strongly preferred
  • Experience working with large-scale enterprise or financial datasets
Job Responsibility
Job Responsibility
  • Integrates subject matter and industry expertise within a defined area
  • Contributes to data analytics standards around which others will operate
  • Applies in-depth understanding of how data analytics collectively integrate within the sub-function as well as coordinate and contribute to the objectives of the entire function
  • Employs developed communication and diplomacy skills are required in order to guide, influence and convince others, in particular colleagues in other areas and occasional external customers
  • Resolves occasionally complex and highly variable issues
  • Produces detailed analysis of issues where the best course of action is not evident from the information available, but actions must be recommended/ taken
  • Responsible for volume, quality, timeliness and delivery of data science projects along with short-term planning resource planning
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Lead the design and execution of complex data analysis and AI/ML initiatives across large, structured, and unstructured datasets
  • Develop and deploy predictive, classification, clustering, and forecasting models to support business strategy and risk management
  • Fulltime
Read More
Arrow Right

Successfactor Data Lead

We are seeking an experienced, elite-level SuccessFactors Data Lead to take comp...
Location
Location
Singapore , Singapore
Salary
Salary:
19000.00 - 21000.00 SGD / Year
https://www.randstad.com Logo
Randstad
Expiration Date
August 06, 2026
Flip Icon
Requirements
Requirements
  • Minimum 8+ years of hands-on HR technology experience with expert-level proficiency in HR data architecture, schema mapping, and master data management within the SAP SuccessFactors ecosystem
  • Deep functional, hands-on command of the SuccessFactors Employee Central (EC) data structure, including Foundation Objects, Position Management mechanics, and complex employment record schemas
  • Proven experience leading the data track for massive, multi-instance global HR transformation programs, managing automated ETL cycles from legacy landscapes into SuccessFactors
  • Practical experience with dedicated HR migration and profiling utilities (e.g., Spinifex, OpenText) or expert-level data manipulation scripting capabilities
  • Demonstrable knowledge of implementing data privacy controls, access masking, and cross-border routing rules in compliance with GDPR and PDPA mandates
  • Bachelor’s or Master’s degree in Computer Science, Data Architecture, Information Systems Management, Business Analytics, or a related technical/quantitative discipline
  • Outstanding consultative, workshop facilitation, and stakeholder management skills, with a proven ability to align competing priorities across global corporate divisions
Job Responsibility
Job Responsibility
  • Define and own the enterprise HR data strategy across multiple SuccessFactors instances and legacy platforms, crafting target-state data schemas, position hierarchies, corporate taxonomies, and strict master data standards
  • Drive multi-instance data harmonization across global clusters, ensuring complete data consistency across Foundation Objects, custom fields, and picklist values
  • Design a unified global master data framework that seamlessly accommodates regional legal entity nuances, joint venture structures, and cross-cluster reporting analytics frameworks
  • Blueprint, sequence, and execute large-scale data migration cycles using specialized tools such as Spinifex, OpenText, or cloud ETL platforms
  • Formulate comprehensive mapping rules, structural transformation logic, automated validation scripts, and custom Excel data manipulation routines to bridge legacy data stores with SuccessFactors
  • Design and deploy automated data quality profiling and deduplication frameworks, establishing clear data health KPIs and collaborating with regional business teams to correct anomalies at the source
  • Enforce strict data profiling thresholds to guarantee that processed employee records achieve the structural data maturity required for secure GenAI and agentic workflows
  • Establish and lead global data governance forums, defining clear data ownership boundaries, data steward accountabilities, centralized data dictionaries, and corporate business glossaries
  • Define, configure, and audit strict localized data privacy controls, cross-border data transfer rules, and data masking protocols within SuccessFactors data models to ensure absolute compliance with GDPR and PDPA laws during testing and migration
  • Partner tightly with the Integration & Reporting Lead to define structural data contracts, API payload definitions, and master data synchronization paths between Employee Central and downstream systems
  • Fulltime
Read More
Arrow Right

Qa Lead – Integration & Systems Testing

Location
Location
Canada , Toronto
Salary
Salary:
Not provided
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of QA experience with 2+ years in a lead capacity
  • Experience testing APIs, integrations, ETL processes, and event-driven systems
  • Strong REST API testing experience using Postman, RestAssured, or similar tools
  • Experience validating Kafka or messaging-based integrations
  • Strong SQL skills for data validation and reconciliation
  • Experience with Jira, Zephyr, or similar test management tools
  • Strong data mapping and integration testing expertise
Job Responsibility
Job Responsibility
  • Define and own the overall test strategy across functional, integration, regression, and non-functional testing
  • Design test scenarios for APIs, ETL pipelines, Kafka event flows, and cloud-based integrations
  • Lead QA activities across SIT, UAT support, and regression testing
  • Develop traceability between requirements, test cases, and defects
  • Validate source-to-target data mappings and data integrity
  • Manage test data, environments, entry/exit criteria, and quality gates
  • Partner with BSAs and Technical Leads to identify risks early
  • Manage defect lifecycle and escalate quality risks appropriately
Read More
Arrow Right