This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with U.S. Bank gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and discover what you excel at—all from Day One.
Job Responsibility:
Guide team to migrate from on Prem Cloudera to Azure cloud environment
Designed and implemented scalable data lake solutions using Snowflake and Databricks
Developed and optimized data pipelines for ingestion, transformation, and storage
Managed data governance, quality, and security across cloud environments
Implemented performance tuning, automation, and CI/CD for data workflows
Collaborated with cross-functional teams to support cloud migration activities
Install, configure, manage, and monitor Cloudera Hadoop clusters, ensuring high availability, performance, and security
Tune Hadoop, Hive, and Spark jobs and configurations for optimal performance, efficiency, and resource utilization
Diagnose and resolve issues related to Linux servers, networks, cluster health, job failures, and performance bottlenecks
Implement and manage security measures within the Cloudera environment, including Kerberos, Apache Ranger, and Atlas
Setup and manage HashiCorp Vault for secure keys and secrets management
Utilize CyberArk for privileged access management
Migrate Hadoop, Hive, and Spark data and applications to Azure cloud services
Develop scripts (e.g., shell, Ansible, Python) for automating administrative tasks, deployments, and monitoring
Create and maintain documentation for system configurations, operational procedures, and troubleshooting knowledge bases
Work closely with the Cloudera vendor to stay current with the latest releases, perform upgrades, and address vulnerabilities
Requirements:
Advanced degree in Computer Science, Engineering, or related field
Deep expertise in Data Engineering and Management technologies, synthetic data, automation, advanced analytics
7+ years of hands-on experience in Data engineering, Cloud platform management, and performance optimization
Hands-on experience with Hadoop, Hive, Spark, and migration of Big Data into Azure cloud services
Working knowledge and hands-on experience in Data Integration and Data Lake Architectures with Databricks and Snowflake platforms
Working knowledge of Microsoft Azure cloud and big data migration to cloud platforms
Proficiency in Linux, clustering, and distributed systems
Expertise in Hive and Spark for data processing and analytics
Expertise in Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, and Sqoop
Proficiency in languages such as shell, Python, Pyspark for automating workflows, deployments, and monitoring
Expertise in Linux, Network, Python scripting, DNS, Kerberos, LDAP/AD, JupyterHub
Experience in creating and maintaining documentation for system configurations, operational procedures, and troubleshooting knowledge bases
Strong problem-solving skills and the ability to diagnose and resolve system failures and performance bottlenecks
Excellent communication and collaboration skills to work effectively with cross-functional teams
Nice to have:
Strong experience with Cloudera Hadoop distribution administration
Deep understanding of banking, operations, risk, and compliance—pairing technical fluency with business and regulatory acumen
Experience on change management process and addressing PCI and PII data requirements
Experience in cloud-native architectures (Azure/AWS), Kubernetes, Docker, and containerized workflows
Experience in implementing secure systems with secure API design, IAM integration, Kerberos, Active Directory, and Azure SSO
What we offer:
Healthcare (medical, dental, vision)
Basic term and optional term life insurance
Short-term and long-term disability
Pregnancy disability and parental leave
401(k) and employer-funded retirement plan
Paid vacation (from two to five weeks depending on salary grade and tenure)
Up to 11 paid holiday opportunities
Adoption assistance
Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year