CrawlJobs Logo
Citi Logo Citi · IT - Software Development

Senior ETL Developer

United States, Tampa Employment contract 96960.00 - 145440.00 USD / Year · Job Posted June 16, 2026
Apply Position
Job Link Share

Job Description

Senior ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems. Developer will collaborate with data engineers, analysts, and business stakeholders to process, transform and drive insights and data driven decisions.

Job Responsibility

  • Design and Implement of Spark applications to process and transform large datasets in HDFS
  • Develop ETL Pipelines in Spark using Python for data Ingestion, cleaning, aggregation, and transformations
  • Optimize Spark jobs for efficiency, reducing run time and resource usage
  • Finetune memory management, caching, and partitioning strategies for Optimal performance
  • Load data from different sources into HDFS, ensuring data accuracy and integrity
  • Integrate Spark Applications with Hadoop frameworks like Hive, Sqoop etc.
  • Troubleshoot and debug Spark Job failures, monitor job logs, and Spark UI to Identify Issues

Requirements

  • 5-8 years of relevant experience in Software Development
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience

What we offer

  • Medical, dental & vision coverage
  • 401(k)
  • Life, accident, and disability insurance
  • Wellness programs
  • Paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
Citi - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior ETL Developer

8 matching positions

Senior ETL Developer

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Design, develop, and maintain ETL pipelines
  • Develop and optimize Informatica mappings, workflows, and sessions
  • Write and maintain PL/SQL scripts, stored procedures, and performance-tuned queries
  • Java / Python scripting
  • Perform data validation, reconciliation, and troubleshooting
  • Work with UNIX/Linux environments
  • Monitor ETL jobs, analyze failures, and implement fixes
  • Experience in managing and implementing successful projects
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Fulltime
Read More
Arrow Right

Senior ETL Developer

Embark on a transformative journey as a Senior ETL Developer at Barclays, where ...
Location
Location
United States , Whippany
Salary
Salary:
120000.00 - 175000.00 USD / Year
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Designing and building large-scale, highly optimized data warehouses and data marts
  • Python, SQL, Informatica, and shell scripting
  • Writing and optimizing multi-layered SQL queries for performance and scalability
  • Overseeing large-scale batch processing and job scheduling using tools like Autosys
  • Supporting production environments and navigating the change management lifecycle
Job Responsibility
Job Responsibility
  • Development and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Medical, dental and vision coverage
  • 401(k)
  • life insurance
  • other paid leave for qualifying circumstances
  • incentive award eligibility
  • Fulltime
Read More
Arrow Right

Senior ETL Developer (DataStage)

This engagement supports our clients Security Office as part of the modernizatio...
Location
Location
Canada , Montreal
Salary
Salary:
Not provided
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Senior-level experience in ETL development
  • Strong hands-on experience with IBM DataStage
  • Experience in BI modeling and development
  • Dashboard design and data integration experience
  • Bilingual (French & English) – mandatory
  • Financial services or banking experience preferred
Job Responsibility
Job Responsibility
  • Design, develop, and maintain end-to-end ETL/data integration workflows
  • Develop BI models, ETL solutions, and dashboards
  • Work closely with business and technical stakeholders to ensure data accuracy and compliance
  • Support data quality, reporting, and transformation initiatives tied to core banking modernization
  • Contribute to secure, scalable, and compliant data solutions
Read More
Arrow Right

Senior Software Developer - ETL

We are seeking an expert Senior Software Developer - ETL to lead critical data m...
Location
Location
Canada , Toronto
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 25, 2026
Flip Icon
Requirements
Requirements
  • 5+ years of proven professional experience in a dedicated ETL Developer role, possessing an advanced grasp of ingestion design patterns, data cleansing, enrichment, and normalization
  • High proficiency navigating Azure Synapse Workspaces, Azure SQL Databases, Blob Storage, Key Vaults, and Azure Data Lake Storage (ADLS)
  • Demonstrated hands-on experience extracting and manipulating backend data structures mapped out of Dynamics 365 CE & F&O environments
  • Expert-level mastery of data manipulation languages (T-SQL/PL-SQL) alongside practical programming skills in Python and cloud automation via PowerShell or Azure CLI
  • Extensive experience using SQL Server Management Studio (SSMS), XRM Toolbox, and enterprise data modeling suites
  • Valid Microsoft credentials such as Azure Data Engineer Associate (DP-203), Azure Database Administrator Associate, or Azure Fundamentals are highly desirable
Job Responsibility
Job Responsibility
  • Data Lakehouse Engineering: Analyze business requirements to design and construct robust data assets within an Azure data lakehouse framework across multi-layered data stores (Bronze, Silver, and Golden layers)
  • Pipeline Automation & Orchestration: Build, automate, and orchestrate scalable enterprise ETL pipelines within Azure Synapse Workspaces utilizing triggers, data flows, integration runtimes, and performance monitors
  • Dynamics 365 Data Integration: Extract, transform, and ingest structured data from Dynamics 365 Customer Engagement (CE) and Dynamics 365 Finance & Operations (F&O) using Dataverse, Common Data Service (CDS), Data Entities, and native APIs
  • OpenText Document Migration: Define and implement automated ETL workflows to safely extract and migrate high-sensitivity digital files from legacy systems into an enterprise OpenText document management solution
  • Advanced Data Modeling: Design relational, physical, and logical data models that align with the organization's Minimum Viable Product (MVP) analytical and reporting needs
  • Query Performance Optimization: Write complex T-SQL/PL-SQL scripts, profile data streams, and perform deep database tuning to optimize query execution and overall lakehouse processing efficiency
  • Data Security & Governance: Implement strict data masking, column-level security controls, and encryption mechanisms to safeguard sensitive data within Azure SQL databases, Data Lakes, and Power BI dashboards
  • DevOps & CI/CD Deployment: Manage analytics source code within Azure Repos, log project deliverables in Azure DevOps, and construct continuous integration/continuous deployment (CI/CD) release pipelines for Synapse workspaces
  • Executive Visualization & Reporting: Develop precise data dashboards and Power BI reports, verifying data accuracy, profiling integrity, and compliance with public-sector architecture standards
What we offer
What we offer
  • Enterprise Migration Ownership: Command full technical delivery over a highly visible migration portfolio spanning big data pipelines and specialized enterprise document storage (OpenText)
  • Modern Architecture Stack: Broaden your cloud profile by manipulating raw data into refined, analytics-ready multi-tier data structures (Bronze/Silver/Gold) inside Azure Synapse
  • Long-Term Continuity: Benefit from a stable 10-month contract framework with potential extensions structured through a multi-year VOR master service agreement
  • Stable Schedule: Operate under a reliable, standard daytime corporate schedule within an elite public sector-aligned data team based in downtown Toronto
  • Fulltime
Read More
Arrow Right

Senior Software Developer - ETL

We are seeking an expert Senior Software Developer - ETL to lead critical data m...
Location
Location
Canada , Toronto
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 25, 2026
Flip Icon
Requirements
Requirements
  • 5+ years of proven professional experience in a dedicated ETL Developer role, possessing an advanced grasp of ingestion design patterns, data cleansing, enrichment, and normalization
  • High proficiency navigating Azure Synapse Workspaces, Azure SQL Databases, Blob Storage, Key Vaults, and Azure Data Lake Storage (ADLS)
  • Demonstrated hands-on experience extracting and manipulating backend data structures mapped out of Dynamics 365 CE & F&O environments
  • Expert-level mastery of data manipulation languages (T-SQL/PL-SQL) alongside practical programming skills in Python and cloud automation via PowerShell or Azure CLI
  • Extensive experience using SQL Server Management Studio (SSMS), XRM Toolbox, and enterprise data modeling suites
  • Valid Microsoft credentials such as Azure Data Engineer Associate (DP-203), Azure Database Administrator Associate, or Azure Fundamentals are highly desirable
Job Responsibility
Job Responsibility
  • Data Lakehouse Engineering: Analyze business requirements to design and construct robust data assets within an Azure data lakehouse framework across multi-layered data stores (Bronze, Silver, and Golden layers)
  • Pipeline Automation & Orchestration: Build, automate, and orchestrate scalable enterprise ETL pipelines within Azure Synapse Workspaces utilizing triggers, data flows, integration runtimes, and performance monitors
  • Dynamics 365 Data Integration: Extract, transform, and ingest structured data from Dynamics 365 Customer Engagement (CE) and Dynamics 365 Finance & Operations (F&O) using Dataverse, Common Data Service (CDS), Data Entities, and native APIs
  • OpenText Document Migration: Define and implement automated ETL workflows to safely extract and migrate high-sensitivity digital files from legacy systems into an enterprise OpenText document management solution
  • Advanced Data Modeling: Design relational, physical, and logical data models that align with the organization's Minimum Viable Product (MVP) analytical and reporting needs
  • Query Performance Optimization: Write complex T-SQL/PL-SQL scripts, profile data streams, and perform deep database tuning to optimize query execution and overall lakehouse processing efficiency
  • Data Security & Governance: Implement strict data masking, column-level security controls, and encryption mechanisms to safeguard sensitive data within Azure SQL databases, Data Lakes, and Power BI dashboards
  • DevOps & CI/CD Deployment: Manage analytics source code within Azure Repos, log project deliverables in Azure DevOps, and construct continuous integration/continuous deployment (CI/CD) release pipelines for Synapse workspaces
  • Executive Visualization & Reporting: Develop precise data dashboards and Power BI reports, verifying data accuracy, profiling integrity, and compliance with public-sector architecture standards
What we offer
What we offer
  • Enterprise Migration Ownership: Command full technical delivery over a highly visible migration portfolio spanning big data pipelines and specialized enterprise document storage (OpenText)
  • Modern Architecture Stack: Broaden your cloud profile by manipulating raw data into refined, analytics-ready multi-tier data structures (Bronze/Silver/Gold) inside Azure Synapse
  • Long-Term Continuity: Benefit from a stable 10-month contract framework with potential extensions structured through a multi-year VOR master service agreement
  • Stable Schedule: Provide essential technical value under a reliable, standard daytime corporate schedule within an elite public sector-aligned data team based in downtown Toronto
  • Fulltime
Read More
Arrow Right

Senior Full-Stack Developer (ETL & Integration)

The Senior Full-Stack Developer will perform advanced analysis and programming w...
Location
Location
United States , Austin, TX
Salary
Salary:
Not provided
dutechsystems.com Logo
Dutech Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15 years – Creating ETL processes
  • transporting and aggregating large datasets between systems
  • 15 years – SQL Server or Oracle stored procedures, PL/SQL, Dynamic SQL, and exception handling
  • 10 years – Object-oriented framework such as .NET Core or Java
  • 10 years – XML, JSON, API Testing, JavaScript, JQuery
  • 10 years – Experience in mid-to-large scale, complex enterprise-level SDLC projects
  • 2 years – Experience with Texas state agencies
Job Responsibility
Job Responsibility
  • Performing technical analysis by reviewing user requirements and creating design documents
  • Writing high-quality code that adheres to TEA and industry standards, best practices, and customer requirements
  • Conducting thorough testing to ensure deliverables meet requirements
  • Preparing and maintaining technical documentation (design docs, process flows, object/data models, project plans, environment diagrams, test plans, etc.)
  • Collaborating with the project team during sprints/releases for effort estimation, architecture/design discussions, triaging and resolving defects, and providing regular status updates
  • Supporting the design, integration, and governance framework necessary to establish the ECIDS system for the State of Texas
  • Fulltime
Read More
Arrow Right

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...
Location
Location
United States , Southlake, TX or Austin, TX
Salary
Salary:
55.92 - 62.13 USD / Hour
aquent.com Logo
Aquent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
  • 8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
  • Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
  • Proficiency in Python and SQL for data processing and automation
  • Extensive experience with ETL processes and data pipeline design
  • Excellent problem-solving skills and meticulous attention to detail
  • Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
  • Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
  • Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
  • Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
  • Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
  • Implement and uphold best practices for data quality, data governance, and data security
  • Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
  • Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
  • Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
  • Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
  • Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity
What we offer
What we offer
  • subsidized health, vision, and dental plans
  • paid sick leave
  • retirement plans with a match
Read More
Arrow Right

Technical Lead / Senior Developer

Our confidential banking client, in Toronto, is seeking a hands-on Technical Lea...
Location
Location
Canada , Toronto
Salary
Salary:
Not provided
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of software development experience
  • Minimum 2 years in a Technical Lead or Senior Lead Developer capacity
  • Strong experience with AWS services including Lambda, API Gateway, S3, DynamoDB, MSK/Kafka, or similar technologies
  • Experience building and consuming REST APIs
  • Hands-on ETL development experience
  • Strong proficiency in Java, Python, or Node.js
  • Experience with Kafka or similar messaging/event-streaming platforms
  • Ability to balance technical leadership with stakeholder engagement responsibilities
Job Responsibility
Job Responsibility
  • Provide technical leadership across architecture, design, and development activities
  • Lead development of APIs, integrations, ETL pipelines, and event-driven solutions
  • Validate technical requirements and user stories
  • Collaborate with Business Systems Analysts, Architects, and delivery stakeholders
  • Participate in program governance and technical planning activities
  • Mentor development team members and support delivery best practices
Read More
Arrow Right