CrawlJobs Logo

Senior Python Lead and Developer

nttdata.com Logo

NTT DATA

Location Icon

Location:
United States , Auburn Hills

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Senior Python Lead and Developer will play a crucial role in delivering data engineering initiatives. The ideal candidate will have 8-10 years of experience in building data pipelines using Python and PySpark, with expertise in Airflow and CI/CD processes. A bachelor’s degree in Computer Science or Data Analytics is required. This position involves mentoring junior engineers and collaborating with cross-functional teams to ensure high-quality solutions.

Job Responsibility:

  • Design, develop, and optimize scalable data pipelines using Python and PySpark for batch and streaming workloads
  • Build, schedule, and monitor complex workflows using Airflow, ensuring reliability and maintainability
  • Architect and implement CI/CD pipelines for data engineering projects using GitHub, Docker, and cloud-native solutions
  • Apply test-driven development (TDD) practices and automate unit/integration tests for data pipelines
  • Implement secure coding best practices and design patterns throughout the development lifecycle
  • Work closely with Data Architects, QA teams, and business stakeholders to translate requirements into technical solutions
  • Create and maintain technical documentation, including process/data flow diagrams and system design artifacts
  • Lead and mentor junior engineers, providing guidance on coding, testing, and deployment best practices
  • Analyze and resolve technical issues across the data stack, including pipeline failures and performance bottlenecks

Requirements:

  • Minimum 8-10 years of practical experience
  • 8+ years of experience building production-grade data pipelines using Python and PySpark
  • Proven track record of designing, deploying, and managing Airflow DAGs in enterprise environments
  • Ability to build and maintain CI/CD pipelines for data engineering workflows
  • Experience with containerization (Docker) and cloud platforms (GCP) for data engineering workloads
  • Ability to write object-oriented Python code, manage dependencies and follow industry best practices
  • Proficiency with Git for source code management and collaboration
  • 5+ years of experience with Unix/Linux: Strong command-line skills
  • 5+ years of experience SQL: Solid understanding of SQL for data ingestion and analysis
  • Comfortable with code reviews, pair programming and using remote collaboration tools effectively
  • Writes code with an eye for maintainability and testability
  • Bachelor’s or graduate degree in Computer Science, Data Analytics or related field, or equivalent work experience
  • Minimum of 10+ years overall IT experience
  • Experienced in waterfall, iterative, and agile methodologies

Nice to have:

A high tolerance for OpenShift, Cloudera, Tableau, Confluence, Jira, and other enterprise tools

Additional Information:

Job Posted:
January 26, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Python Lead and Developer

Senior Technology Development Lead

The Senior Technology Development Lead is a senior level position responsible fo...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in technology and development
  • Technical skillset required: (1) Language: Java or Python (2) Experience with BigData/Hadoop/Spark/Kafka (3) Experience with APIs and microservices architecture (4) UI Development and integration experience would be a plus
  • Domain experience required: Candidate must have prior experience working in a capital market domain
  • Experience in Regulatory reporting or reconciliations (Tech) would be a big plus
  • Proven track record of delivering large scale projects with globally distributed teams
  • Strong experience in applications development, design paradigms
  • Previous experience with data domain would be a plus
  • Experience in stakeholder management and managing global technology team is a must
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Manage multiple teams of professionals spread across various regions
  • Represent various functions and global teams in the meetings with stakeholders
  • Work with various leads within the group and outside to liaise the work efforts
  • Participate in technical design discussion, production support issues and development activities
  • Influence and negotiate with senior leaders across functions, as well as communicate with external parties as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • Best-in-class benefits
  • Global Benefits
  • Fulltime
Read More
Arrow Right

Senior Python Software Developer

We are seeking a highly skilled Senior Python Software Developer to join our inn...
Location
Location
United States
Salary
Salary:
Not provided
sixfeetup.com Logo
Six Feet Up
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or related field
  • 15+ years of professional Python development experience
  • Proficient in Django, Flask, or similar frameworks
  • Strong understanding of software development principles and methodologies
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Leading development projects
  • Mentoring junior developers
  • Ensuring the successful delivery of our software solutions
Read More
Arrow Right

Senior Python Architect and Tech Lead

Six Feet Up is looking for a Senior Python Architect and Tech Lead to work with ...
Location
Location
United States , Fishers
Salary
Salary:
Not provided
sixfeetup.com Logo
Six Feet Up
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years experience in technical leadership and project management
  • Strong understanding of software development best practices and methodologies
  • Excellent communication skills and the ability to interact effectively with both technical and non-technical stakeholders
  • Experience working with project management tools and methodologies (e.g., Agile, Scrum)
  • Ability to troubleshoot technical issues and make informed decisions to keep projects on track
  • Adept at managing and prioritizing multiple tasks in a fast-paced environment
Job Responsibility
Job Responsibility
  • Develop a technical approach that meets the client objectives
  • Develop technical diagrams, user stories, requirements, tasks, etc.
  • Plan and estimate the work
  • Be a resource to developers throughout the implementation phase
  • Organize the work in sprints/milestones based on priorities, dependencies, and resource availabilities
  • Conduct standup meetings and ticket grooming sessions to maintain project momentum
  • Facilitate pit stops and retrospectives to continuously improve team performance
  • Monitor for errors using tools like Sentry and ensure timely updates and patches
  • Ensure that the development team is adhering to our best practices in software development
  • Oversee ticket management processes to optimize workflow efficiency
Read More
Arrow Right

Senior Security Engineer, Sailpoint Development Lead - IAM

We are seeking an experienced and motivated Sr. Engineer to lead the Sailpoint d...
Location
Location
United States , Bethesda
Salary
Salary:
108300.00 - 176300.00 USD / Year
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, information systems, cybersecurity or a related field or equivalent experience/certification
  • 7+ years of progressive Information Technology/Information Security experience in engineering and development of IGA features & Application integration including at least 4 years of experience in SailPoint IIQ Implementation, Configuration, Customization, and deployment in an enterprise environment
  • 4 + years of experience in technologies such as Java, JavaScript, JSON, XML, Python and REST development
  • 4 + years of experience in writing and troubleshooting rules, workflows, custom connectors
  • 4 + years of developing/understanding of requirements, design, implementation, integration, testing
  • 2+ years’ experience working in agile methodologies
Job Responsibility
Job Responsibility
  • Makes decisions on the architecture and design of software projects, validating that the system design meets scalability, reliability, and performance requirements
  • Provides technical direction, mentoring, and support to team members
  • Solves complex technical issues and functions as an escalation for the team in problem-solving
  • Leads code reviews to ensure high-quality, maintainable, and efficient code
  • Establishes and ensures compliance with coding standards
  • Exercises strong interpersonal/relationship/communication skills, with the ability to convey technical concepts to non-technical stakeholders
  • Contributes to the codebase, particularly for critical or complex components
  • Participates in project planning, including estimation of tasks, defining milestones, and ensuring realistic timelines
  • Assigns tasks to team members based on their skills and project requirements
  • Monitors progress and adjusting plans as necessary
What we offer
What we offer
  • Bonus program
  • Comprehensive health care benefits
  • 401(k) plan with up to 5% company match
  • Employee stock purchase plan at 15% discount
  • Accrued paid time off (including sick leave where applicable)
  • Life insurance
  • Group disability insurance
  • Travel discounts
  • Adoption assistance
  • Paid parental leave
  • Fulltime
Read More
Arrow Right

Senior Software Developer, Backend Platform

Join us in building the future of finance. Our mission is to democratize finance...
Location
Location
Canada , Toronto
Salary
Salary:
145000.00 - 170000.00 CAD / Year
robinhood.com Logo
Robinhood
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant experience building scalable backend systems in Go and/or Python
  • Deep familiarity with server-side frameworks such as Django or Go-based systems
  • Strong track record designing or maintaining internal developer platforms or shared infrastructure
  • Experience mentoring engineers, guiding technical decisions, and contributing to team-wide strategies
  • Passion for developer productivity, quality engineering practices, and thoughtful abstraction
Job Responsibility
Job Responsibility
  • Design and lead high-impact projects to improve frameworks, common libraries, and the backend development lifecycle
  • Own and evolve core tooling used across the monorepo — including static analysis, code formatting, and project scaffolding
  • Build delightful developer experiences with enhanced IDE plugins (VSCode, Goland, PyCharm) and interface definition tools like Protobuf
  • Drive best practices in backend architecture through standardization, automation, and opinionated defaults
  • Mentor engineers across the org and champion team values like “Start with Why” and “Easy to Make the Right Choice”
  • Collaborate with cross-functional stakeholders to align on tooling investments, migration strategies, and security improvements
What we offer
What we offer
  • bonus opportunities
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Application Development Lead

This role is for a application dev lead within the FI Data team, responsible for...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of demonstrable and relevant experience in software development, with at least 3-5 years in a leadership role within a high-performing technical team
  • strong understanding of Java and/or Python 3.6, with the ability to guide and review complex solutions
  • solid understanding of REST API development, including best practices for design, security, and scalability
  • demonstrable experience in driving the creation of reusable, testable, and efficient code with proper error and exception handling, and establishing coding standards
  • extensive experience with the design and implementation of cloud-native applications and deployment via Kubernetes / Openshift, including strategic decision-making on cloud architecture
  • expertise in big data computation platforms (Flink, Spark, Apache Beam) or big data distribution platforms (Hadoop, Druid, Pinot, Trino, Ignite), and a track record of leading teams leveraging these technologies
  • hands-on experience in handling various data structures, and the ability to guide complex data modeling decisions
  • proven leadership in establishing and maturing Continuous Integration and Continuous Delivery environments
  • familiarity with TeamCity, Sonarqube, and Jenkins
  • extensive experience with the SDLC lifecycle and in leading and coaching within an Agile environment (Scrum/Kanban)
Job Responsibility
Job Responsibility
  • Lead and oversee the design and development of high-performance green-field data analytics products for a Tier 1 bank, ensuring architectural excellence and alignment with business goals
  • collaborate strategically with other dev leads in US and Canada, translating complex business requirements into technical roadmaps and fostering a partnership approach to deliver impactful solutions
  • drive innovation within the team, encouraging the exploration and implementation of cutting-edge data visualization and analytics solutions
  • mentor and guide team members in applying an engineering mindset, fostering deep understanding of use-cases, developing robust estimation techniques for volume and compute velocity, and openly addressing implementation limitations
  • lead the evaluation and development of Proof-of-Concepts (POCs) for new strategic initiatives, guiding the team to convert successful prototypes into robust enterprise solutions
  • foster a culture of continuous learning and growth within the team, empowering members to research, learn, and recommend emerging technologies
  • provide leadership and strategic direction for post-release support, collaborating closely with business, development, and support groups to ensure operational stability and client satisfaction
  • manage team performance, including goal setting, performance reviews, career development, and providing regular feedback to foster professional growth
  • participate in hiring processes, attracting, interviewing, and onboarding top talent to grow the team's capabilities
  • facilitate effective communication within the team and across different stakeholders, ensuring transparency and alignment.
  • Fulltime
Read More
Arrow Right

Senior Software Developer

Senior Software Developer role at Hewlett Packard Enterprise focused on AI and m...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, engineering, data science, machine learning, artificial intelligence, or closely related quantitative discipline
  • Typically 4-7 years' experience
  • Deep understanding of machine learning algorithms (linear regression, decision trees, support vector machines, random forests, deep learning models, reinforcement learning)
  • Strong foundation in mathematics and statistics (linear algebra, calculus, probability theory)
  • Proficiency in programming languages such as Python, R, or Java
  • Experience with software engineering best practices and version control systems (Git)
  • Knowledge of libraries and frameworks like TensorFlow, PyTorch, sci-kit, Keras
  • Advanced knowledge in deep learning and neural network architectures
  • Proficiency in using agentic frameworks like langGraph
  • Knowledge of evaluation of traditional AI/ML and Gen-AI based applications
Job Responsibility
Job Responsibility
  • Conduct advanced research in AI and machine learning
  • Design and architect AI solutions for complex problems
  • Provide technical guidance and mentorship to junior team members
  • Work with stakeholders to translate requirements into technical solutions
  • Drive continuous improvement and innovation in AI/ML practices
  • Evaluate and integrate third-party tools or services
  • Facilitate design review sessions
  • Collaborate with engineering manager and team lead
  • Prepare and deliver presentations to stakeholders
  • Design and develop solutions to complex application problems
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive benefits suite supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Applications Development Senior Programmer Analyst

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 8 - 12 years of experience
  • Strong hands-on experience in coding (Java, Python, or any modern programming language)
  • Deep expertise in system design and microservices architecture
  • Experience with trunk-based development, feature flags, and progressive delivery strategies
  • Proficiency in TDD, BDD, and automation-first mindset to ensure high test coverage and reliability
  • Strong understanding of CI/CD pipelines, and DevOps practices
  • Experience conducting code reviews, vulnerability assessments, and secure coding
  • Familiarity with modern cloud-native technologies (AWS, Kubernetes, Docker)
  • Excellent problem-solving skills and ability to work in fast-paced, agile environments
  • Strong communication and collaboration skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust, scalable, and high-performance applications
  • Implement trunk-based development practices to enable continuous integration and rapid delivery
  • Develop clean, maintainable, and testable code following SOLID principles and software design best practices
  • Ensure high levels of unit test coverage, test-driven development (TDD), and behavior-driven development (BDD)
  • Actively contribute to hands-on coding, code reviews, and refactoring to maintain high engineering standards
  • Drive the adoption of modern engineering ways of working, including Agile, DevOps, and CI/CD
  • Advocate for automated testing, infrastructure as code, and continuous monitoring to enhance software reliability
  • Apply Behavior-Driven Development (BDD), Test-Driven Development (TDD), and unit testing to ensure code quality and functionality
  • Conduct thorough code reviews, ensuring adherence to best practices in readability, performance, and security
  • Implement and enforce secure coding practices, performing vulnerability assessments and ensuring compliance with security standards
  • Fulltime
Read More
Arrow Right