CrawlJobs Logo

Senior Python Lead and Developer

nttdata.com Logo

NTT DATA

Location Icon

Location:
United States , Auburn Hills

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The Senior Python Lead and Developer will play a crucial role in delivering data engineering initiatives. The ideal candidate will have 8-10 years of experience in building data pipelines using Python and PySpark, with expertise in Airflow and CI/CD processes. A bachelor’s degree in Computer Science or Data Analytics is required. This position involves mentoring junior engineers and collaborating with cross-functional teams to ensure high-quality solutions.

Job Responsibility:

  • Design, develop, and optimize scalable data pipelines using Python and PySpark for batch and streaming workloads
  • Build, schedule, and monitor complex workflows using Airflow, ensuring reliability and maintainability
  • Architect and implement CI/CD pipelines for data engineering projects using GitHub, Docker, and cloud-native solutions
  • Apply test-driven development (TDD) practices and automate unit/integration tests for data pipelines
  • Implement secure coding best practices and design patterns throughout the development lifecycle
  • Work closely with Data Architects, QA teams, and business stakeholders to translate requirements into technical solutions
  • Create and maintain technical documentation, including process/data flow diagrams and system design artifacts
  • Lead and mentor junior engineers, providing guidance on coding, testing, and deployment best practices
  • Analyze and resolve technical issues across the data stack, including pipeline failures and performance bottlenecks

Requirements:

  • Minimum 8-10 years of practical experience
  • 8+ years of experience building production-grade data pipelines using Python and PySpark
  • Proven track record of designing, deploying, and managing Airflow DAGs in enterprise environments
  • Ability to build and maintain CI/CD pipelines for data engineering workflows
  • Experience with containerization (Docker) and cloud platforms (GCP) for data engineering workloads
  • Ability to write object-oriented Python code, manage dependencies and follow industry best practices
  • Proficiency with Git for source code management and collaboration
  • 5+ years of experience with Unix/Linux: Strong command-line skills
  • 5+ years of experience SQL: Solid understanding of SQL for data ingestion and analysis
  • Comfortable with code reviews, pair programming and using remote collaboration tools effectively
  • Writes code with an eye for maintainability and testability
  • Bachelor’s or graduate degree in Computer Science, Data Analytics or related field, or equivalent work experience
  • Minimum of 10+ years overall IT experience
  • Experienced in waterfall, iterative, and agile methodologies

Nice to have:

A high tolerance for OpenShift, Cloudera, Tableau, Confluence, Jira, and other enterprise tools

Additional Information:

Job Posted:
January 26, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Python Lead and Developer

Senior Technology Development Lead

The Senior Technology Development Lead is a senior level position responsible fo...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in technology and development
  • Technical skillset required: (1) Language: Java or Python (2) Experience with BigData/Hadoop/Spark/Kafka (3) Experience with APIs and microservices architecture (4) UI Development and integration experience would be a plus
  • Domain experience required: Candidate must have prior experience working in a capital market domain
  • Experience in Regulatory reporting or reconciliations (Tech) would be a big plus
  • Proven track record of delivering large scale projects with globally distributed teams
  • Strong experience in applications development, design paradigms
  • Previous experience with data domain would be a plus
  • Experience in stakeholder management and managing global technology team is a must
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Manage multiple teams of professionals spread across various regions
  • Represent various functions and global teams in the meetings with stakeholders
  • Work with various leads within the group and outside to liaise the work efforts
  • Participate in technical design discussion, production support issues and development activities
  • Influence and negotiate with senior leaders across functions, as well as communicate with external parties as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • Best-in-class benefits
  • Global Benefits
  • Fulltime
Read More
Arrow Right

Senior Python Software Developer

We are seeking a highly skilled Senior Python Software Developer to join our inn...
Location
Location
United States
Salary
Salary:
Not provided
sixfeetup.com Logo
Six Feet Up
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or related field
  • 15+ years of professional Python development experience
  • Proficient in Django, Flask, or similar frameworks
  • Strong understanding of software development principles and methodologies
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Leading development projects
  • Mentoring junior developers
  • Ensuring the successful delivery of our software solutions
Read More
Arrow Right

Senior technical lead - python - azure devops

Are you a highly experienced Technical Architect or Senior Software Engineer wit...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • Minimum of 10 years of professional experience in software engineering, technical leadership, or technical architecture
  • Deep expertise in Python, the Django framework, CI/CD pipelines (specifically Azure DevOps), and Git version control
  • Strong understanding of complex enterprise integration patterns and delivering robust cloud-based solutions
  • Proven ability to translate complex business requirements and security standards into technically sound and efficient architectural solutions
  • Must be based in Europe with the ability to travel visa-free to Spain
Job Responsibility
Job Responsibility
  • Architectural Guidance: Provide senior-level advice on technical design, architecture, and best practices, specifically for the Python/Django application stack
  • Performance Optimization: Support the team in troubleshooting complex issues and lead performance tuning efforts during both development and deployment phases
  • Standards & Compliance: Ensure the application adheres to strict security, scalability, and integration standards within the enterprise landscape
  • Technical Collaboration: Act as the technical liaison, collaborating closely with vendor technical leads, engineers, and internal Nestlé teams to resolve challenging technical roadblocks
Read More
Arrow Right

Senior technical lead - python - azure devops

Randstad Digital Switzerland is looking for an exceptional professional to lead ...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • Minimum 10 years of professional experience in software engineering, technical leadership, or technical architecture
  • Deep expertise in Python, the Django framework, CI/CD pipelines (specifically Azure DevOps), and Git version control
  • Strong understanding of complex enterprise integration patterns and delivering robust cloud-based solutions
  • Proven ability to translate complex business requirements and security standards into technically sound and efficient architectural solutions
  • Based in Europe with the ability to travel visa-free to Spain
Job Responsibility
Job Responsibility
  • Architectural Guidance: Provide senior-level advice on technical design, architecture, and best practices, specifically for the Python/Django application stack
  • Performance Optimization: Support the team in troubleshooting complex issues and lead performance tuning efforts during both development and deployment phases
  • Standards & Compliance: Ensure the application adheres to strict security, scalability, and integration standards within the enterprise landscape
  • Technical Collaboration: Act as the technical liaison, collaborating closely with vendor technical leads, engineers, and internal Nestlé teams to resolve challenging technical roadblocks
Read More
Arrow Right

Senior Python Architect and Tech Lead

Six Feet Up is looking for a Senior Python Architect and Tech Lead to work with ...
Location
Location
United States , Fishers
Salary
Salary:
Not provided
sixfeetup.com Logo
Six Feet Up
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years experience in technical leadership and project management
  • Strong understanding of software development best practices and methodologies
  • Excellent communication skills and the ability to interact effectively with both technical and non-technical stakeholders
  • Experience working with project management tools and methodologies (e.g., Agile, Scrum)
  • Ability to troubleshoot technical issues and make informed decisions to keep projects on track
  • Adept at managing and prioritizing multiple tasks in a fast-paced environment
Job Responsibility
Job Responsibility
  • Develop a technical approach that meets the client objectives
  • Develop technical diagrams, user stories, requirements, tasks, etc.
  • Plan and estimate the work
  • Be a resource to developers throughout the implementation phase
  • Organize the work in sprints/milestones based on priorities, dependencies, and resource availabilities
  • Conduct standup meetings and ticket grooming sessions to maintain project momentum
  • Facilitate pit stops and retrospectives to continuously improve team performance
  • Monitor for errors using tools like Sentry and ensure timely updates and patches
  • Ensure that the development team is adhering to our best practices in software development
  • Oversee ticket management processes to optimize workflow efficiency
Read More
Arrow Right

Senior Security Engineer, Sailpoint Development Lead - IAM

We are seeking an experienced and motivated Sr. Engineer to lead the Sailpoint d...
Location
Location
United States , Bethesda
Salary
Salary:
108300.00 - 176300.00 USD / Year
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, information systems, cybersecurity or a related field or equivalent experience/certification
  • 7+ years of progressive Information Technology/Information Security experience in engineering and development of IGA features & Application integration including at least 4 years of experience in SailPoint IIQ Implementation, Configuration, Customization, and deployment in an enterprise environment
  • 4 + years of experience in technologies such as Java, JavaScript, JSON, XML, Python and REST development
  • 4 + years of experience in writing and troubleshooting rules, workflows, custom connectors
  • 4 + years of developing/understanding of requirements, design, implementation, integration, testing
  • 2+ years’ experience working in agile methodologies
Job Responsibility
Job Responsibility
  • Makes decisions on the architecture and design of software projects, validating that the system design meets scalability, reliability, and performance requirements
  • Provides technical direction, mentoring, and support to team members
  • Solves complex technical issues and functions as an escalation for the team in problem-solving
  • Leads code reviews to ensure high-quality, maintainable, and efficient code
  • Establishes and ensures compliance with coding standards
  • Exercises strong interpersonal/relationship/communication skills, with the ability to convey technical concepts to non-technical stakeholders
  • Contributes to the codebase, particularly for critical or complex components
  • Participates in project planning, including estimation of tasks, defining milestones, and ensuring realistic timelines
  • Assigns tasks to team members based on their skills and project requirements
  • Monitors progress and adjusting plans as necessary
What we offer
What we offer
  • Bonus program
  • Comprehensive health care benefits
  • 401(k) plan with up to 5% company match
  • Employee stock purchase plan at 15% discount
  • Accrued paid time off (including sick leave where applicable)
  • Life insurance
  • Group disability insurance
  • Travel discounts
  • Adoption assistance
  • Paid parental leave
  • Fulltime
Read More
Arrow Right

Senior Software Developer, Backend Platform

Join us in building the future of finance. Our mission is to democratize finance...
Location
Location
Canada , Toronto
Salary
Salary:
145000.00 - 170000.00 CAD / Year
robinhood.com Logo
Robinhood
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant experience building scalable backend systems in Go and/or Python
  • Deep familiarity with server-side frameworks such as Django or Go-based systems
  • Strong track record designing or maintaining internal developer platforms or shared infrastructure
  • Experience mentoring engineers, guiding technical decisions, and contributing to team-wide strategies
  • Passion for developer productivity, quality engineering practices, and thoughtful abstraction
Job Responsibility
Job Responsibility
  • Design and lead high-impact projects to improve frameworks, common libraries, and the backend development lifecycle
  • Own and evolve core tooling used across the monorepo — including static analysis, code formatting, and project scaffolding
  • Build delightful developer experiences with enhanced IDE plugins (VSCode, Goland, PyCharm) and interface definition tools like Protobuf
  • Drive best practices in backend architecture through standardization, automation, and opinionated defaults
  • Mentor engineers across the org and champion team values like “Start with Why” and “Easy to Make the Right Choice”
  • Collaborate with cross-functional stakeholders to align on tooling investments, migration strategies, and security improvements
What we offer
What we offer
  • bonus opportunities
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Application Development Lead

This role is for a application dev lead within the FI Data team, responsible for...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of demonstrable and relevant experience in software development, with at least 3-5 years in a leadership role within a high-performing technical team
  • strong understanding of Java and/or Python 3.6, with the ability to guide and review complex solutions
  • solid understanding of REST API development, including best practices for design, security, and scalability
  • demonstrable experience in driving the creation of reusable, testable, and efficient code with proper error and exception handling, and establishing coding standards
  • extensive experience with the design and implementation of cloud-native applications and deployment via Kubernetes / Openshift, including strategic decision-making on cloud architecture
  • expertise in big data computation platforms (Flink, Spark, Apache Beam) or big data distribution platforms (Hadoop, Druid, Pinot, Trino, Ignite), and a track record of leading teams leveraging these technologies
  • hands-on experience in handling various data structures, and the ability to guide complex data modeling decisions
  • proven leadership in establishing and maturing Continuous Integration and Continuous Delivery environments
  • familiarity with TeamCity, Sonarqube, and Jenkins
  • extensive experience with the SDLC lifecycle and in leading and coaching within an Agile environment (Scrum/Kanban)
Job Responsibility
Job Responsibility
  • Lead and oversee the design and development of high-performance green-field data analytics products for a Tier 1 bank, ensuring architectural excellence and alignment with business goals
  • collaborate strategically with other dev leads in US and Canada, translating complex business requirements into technical roadmaps and fostering a partnership approach to deliver impactful solutions
  • drive innovation within the team, encouraging the exploration and implementation of cutting-edge data visualization and analytics solutions
  • mentor and guide team members in applying an engineering mindset, fostering deep understanding of use-cases, developing robust estimation techniques for volume and compute velocity, and openly addressing implementation limitations
  • lead the evaluation and development of Proof-of-Concepts (POCs) for new strategic initiatives, guiding the team to convert successful prototypes into robust enterprise solutions
  • foster a culture of continuous learning and growth within the team, empowering members to research, learn, and recommend emerging technologies
  • provide leadership and strategic direction for post-release support, collaborating closely with business, development, and support groups to ensure operational stability and client satisfaction
  • manage team performance, including goal setting, performance reviews, career development, and providing regular feedback to foster professional growth
  • participate in hiring processes, attracting, interviewing, and onboarding top talent to grow the team's capabilities
  • facilitate effective communication within the team and across different stakeholders, ensuring transparency and alignment.
  • Fulltime
Read More
Arrow Right