CrawlJobs Logo

Data Engineer (Python/AI)

India, Pune · Job Posted June 29, 2026
Apply Position
Job Link Share

Job Description

We are looking for a mid-level Python Developer with combined experience in Data Engineering and AI/NLP engineering. The candidate will build NLP pipelines using libraries such as Flair, BERT, and LLM frameworks, and will also work on large-scale data processing using PySpark, Pandas, and related data tools. The role includes developing APIs, integrating with platform services, and supporting CI/CD deployments using GitHub and LightSpeed Enterprise.

Job Responsibility

  • Develop and optimize ETL/data processing jobs using PySpark, Pandas, PyArrow, and related libraries
  • Work with Parquet files using FastParquet or pyarrow.parquet for efficient data processing
  • Implement data parsing and serialization using json, ujson, or orjson for high-performance JSON handling
  • Build and maintain NLP pipelines using Flair, BERT, and LLM-based models
  • Develop scalable ingestion and data transformation pipelines for AI and analytics use cases
  • Build and maintain Flask-based APIs for model inference and service integrations
  • Use regular expressions for text cleaning, parsing, and NLP preprocessing
  • Integrate caching and fast lookups using Redis
  • Manage and deploy ML models using MLflow for tracking and versioning
  • Support CI/CD workflows using GitHub, LightSpeed Enterprise, and deployment pipelines
  • Create and maintain Autosys JILs for job scheduling and automation
  • Use basic Linux commands for troubleshooting, operations, and deployment tasks
  • Monitor application and system health using ITRS Geneos
  • Write unit tests and improve automation test coverage (PyTest/unittest)
  • Work with REST APIs, microservices, and basic shell scripting
  • Work with cloud services (ECS), including boto3

Requirements

  • 8+ years of hands-on Python programming experience
  • Strong fundamentals in Python, OOP, and design patterns
  • Experience with NLP libraries such as Flair, BERT, HuggingFace Transformers, or similar
  • Solid experience with PySpark, Pandas, PyArrow, and distributed data pipelines
  • Proficient in working with Parquet using FastParquet or pyarrow.parquet
  • Familiarity with fast JSON parsing libraries (json, ujson, orjson)
  • Experience building APIs using Flask (FastAPI is a plus)
  • Experience with MLflow for model tracking and deployment
  • Good understanding of CI/CD practices and Git workflows
  • Experience working with Redis or similar in-memory stores
  • Experience with Autosys JILs for job scheduling
  • Comfortable with Linux command line and shell scripting
  • Strong debugging, problem-solving, and teamwork skills
  • Exposure to cloud services
  • AWS boto3 experience is an asset

Nice to have

  • Experience with Polars or Dask for high-performance data processing
  • Experience with PyTorch or TensorFlow for model training
  • Experience with Docker, Kubernetes, or containerized deployments
  • Experience with monitoring tools such as ITRS Geneos
  • Experience with FastAPI, Airflow, or Prefect

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer (Python/AI)

8 matching positions

Senior Python/AI Engineer

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
United States , Rutherford
Salary
Salary:
121200.00 - 181800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in building robust, scalable, and maintainable applications with development experience, preferably in the Capital Markets Technology industry
  • Hands-on experience in Python based data and code analysis to enable RAG automation and attribution mapping for client queries
  • Experience with Agile software development processes with a strong emphasis on test driven development
  • Strong knowledge of CI/CD pipelines and experience in tools such as JIRA, BlackDuck, SONAR etc.
  • Ability to evaluate design trade-offs and document choices effectively
  • Demonstrated capacity to build sophisticated tooling for development and production team use
  • Expertise in Object Oriented Analysis & Design, and Design Patterns
  • Design, development and implementation of applications using Python, Core Java
  • Test Driven Development (TDD) including mock & regression tests and continuous integration (Jenkins, CruiseControl)
  • Software Configuration Management (GIT)
Job Responsibility
Job Responsibility
  • Provide technical and analytical expertise in support of the Data and Code Lineage exercise to support Pre Settlement Risk and RWA calculation for wholesale products/asset classes
  • Develop systems and functionalities to calculate the potential exposure, Exposure at default and Risk weight
  • Collaborate with internal stakeholders including Quantitative Analytics, Risk Analytics & Model Risk Management teams and provide technical guidance & assistance with regard to existing functionalities and improvements
  • Update, optimize and maintain applications required for back-testing, impact studies and stress testing
  • Develop technical components across sub-projects and coordinate activities between infrastructure team for application/infrastructure setup
  • Implement control and risk implementation procedures, and adhere standards and processes defined by organization
  • Use AI Tools such as GitHub CoPilot and Devin to automate code generation and generate efficiency in product delivery
  • Build software applications using Python and automate the build using Lightspeed or Artifactory
  • Use Agile/Scrum methodology in executing projects
  • Develop, Test, Debug and Manage application using VSCode, IntelliJ, JIRA, Visual VM, Unix, Oracle SQL Developer, Autosys, and caching solutions like Gridgain
What we offer
What we offer
  • Discretionary and formulaic incentive and retention awards
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right
New

Mobile Associate, Store-in-Store - Retail Sales

Store-in-Store Mobile Associates are the face of T-Mobile inside a warehouse/clu...
Location
Location
United States , North Little Rock
Salary
Salary:
18.00 - 23.00 USD / Hour
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma/GED (Required)
  • 6 months of customer service and/or sales experience, retail environment (Preferred)
  • Customer satisfaction: Focused customer advocate who loves having fun with our customers. Effective at balancing customer experience and performance goals (Required)
  • Team building: Desire to be a part of the groundbreaking T-Mobile store team. Willingness to work alongside peers and store leaders, learning and sharing knowledge, while serving customers and providing resolutions to issues (Required)
  • Retail sales: Competitive drive and confidence to succeed in a fast-paced sales environment (Required)
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Proactively engages with a broad range of customers in a highly-traffic retail environment. You will use digital tools, communicate effectively, educate customers, and showcase the value of T-Mobile's warehouse/club member benefits
  • Complete training on the T-Mobile store-in-store experience, new skills, products, and processes, and knowledge of systems and reference resources. You will continuously learn and improve your skills to provide the best possible experience for our customers! Will perform skills practicing, knowledge sharing, and store operations
  • At T-Mobile, we are passionate about providing excellent customer experiences, being friendly, and engaging with customers. We can connect on a personal level, match the pace of the customer, establish rapport, trust, and loyalty with every interaction. As a member of our team, you are committed to providing exceptional service, and to exceeding customer expectations. You will proactively attract potential customers to further drive sales activity in your location. You can follow up with customers, collect referrals, handle Be Back processes, and form relationships with new and existing customers
What we offer
What we offer
  • Medical, dental and vision insurance
  • Flexible spending account
  • 401(k)
  • Employee stock grants
  • Employee stock purchase plan
  • Paid time off and up to 12 paid holidays
  • Paid parental and family leave
  • Family building benefits
  • Back-up care
  • Enhanced family support
  • Parttime
Read More
Arrow Right
New

Bilingual Human Resources Generalist

A well-established roofing and construction company is seeking a Bilingual Human...
Location
Location
United States , Elfin Forest
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bilingual English/Spanish required
  • 2–4 years of Human Resources Generalist experience
  • Strong knowledge of California labor laws and employment regulations
  • Experience supporting payroll administration and employee lifecycle processes
  • PHR, SHRM-CP, SHRM-SCP, or equivalent HR certification required
  • Experience within construction, roofing, manufacturing, or skilled trades environments preferred
  • Proficiency with Microsoft Office Suite and HRIS platforms
Job Responsibility
Job Responsibility
  • Serve as a resource for employees and managers regarding HR policies and procedures
  • Support employee relations matters and assist with workplace investigations when needed
  • Maintain employee records and personnel documentation
  • Coordinate onboarding, new hire orientation, and employee offboarding activities
  • Assist with benefits administration and leave management
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Architect III – Enterprise Cloud Solutions

Architect III – Enterprise Cloud Solutions. Irving, TX. Date Added: June 23, 202...
Location
Location
United States , Irving
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of related experience
  • Bachelor's degree in related field required
  • Previous leadership experience preferred
  • Intermediate knowledge of general Financial Services or Banking is preferred
  • Intermediate knowledge of applicable regulatory and legal compliance obligations, rules and regulations, industry standards and practices
  • Advanced experience working in an architecture function with knowledge & experience developing reference architectures & patterns and supporting governance functions related to: Application Development, Cloud Compute, Storage and Networking technologies. IaaS, PaaS, SaaS, Serverless, Containers, Automation, Security
  • Advanced understanding of product management, agile principles and development methodologies and capability of supporting agile and DevOps teams by providing advice and guidance on opportunities, impact and risks, taking account of technical and architectural debt
  • Proficiency with the Azure Cloud ecosystem including: Cloud Compute, Storage & Networking, IaaS / PaaS / SaaS, Serverless, Containers, Azure Resource Manager, and Entra is required
  • Experience with networking in Azure including Virtual Networks, DNS, Load Balancing, Firewalls, Routers, and Proxies is required
  • Experience with Identity & Access Management and security design patterns leveraging Entra, Azure Defender, Azure Sentinel, & Cloudflare is required
Job Responsibility
Job Responsibility
  • Define and lead architectural priorities that advance the business and technology strategy of the organization in a specific domain
  • Participate in the Architecture Standards Board (ASB) and Technology Review Board (TRB) governance forums
  • Manage the business capability inventory for their specific domain
  • Develop applicable standards and patterns for the domain and bring it forward to ASB for review and approval
  • Be accountable for the design and documentation of solution architecture relating to applications and capabilities within a specific domain
  • Work with the business, product, and IT teams to ensure the designs are safe, secure, compliant, and reliable
  • Review the solution architecture design in TRB and ensure the design aligns to approved standards and patterns
  • Act as an advocate & evangelist of architecture principles, standards, and patterns across the organization
  • Identify, propose, & lead opportunities to advance, & make more effective, capabilities for the domain through use of new technology
  • Facilitate proof of concepts and pilots on new/emerging technology to gauge value and assess implementation complexity
What we offer
What we offer
  • Medical coverage
  • Dental coverage
  • Vision coverage
  • 401(k) with company match
  • Short-term disability
  • Life insurance with AD&D
  • Fulltime
Read More
Arrow Right
New

Sales Executive

We are looking for an experienced Sales Executive to join the team at Vertu Skod...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
27000.00 - 45000.00 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently working as a Sales Executive in the automotive industry (minimum 12 months)
  • Excellent interpersonal and communication skills
  • Commitment to providing exceptional customer service
  • Excellent organisational skills
  • Ability to work flexible hours, including weekends
  • Full UK driver's licence (Manual and Automatic)
Job Responsibility
Job Responsibility
  • Guide customers through a seamless and enjoyable car buying experience, from the first point of contact to the final handshake
  • Organize the end-to-end customer journey
  • Represent the dealership and set the standard for integrity
  • Ensure products and services offered genuinely meet customer needs, protect them from harm and encourage long-term loyalty
What we offer
What we offer
  • 25 days holiday rising to 29 with length of service - plus bank holidays
  • Access to online rewards platform giving cash back and discounts for multiple retailers
  • Preferential Service Rates
  • Company Car
  • Colleague Purchase Scheme
  • Share Incentive Scheme
  • Pension
  • Enhanced Maternity and Paternity
  • Fulltime
Read More
Arrow Right
New

Mobile Associate, Store-in-Store - Retail Sales

Mobile Associates, Store-in-Store are an integral part of the Retail Team respon...
Location
Location
United States , Vestal
Salary
Salary:
18.00 - 20.00 USD / Hour
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma/GED (Required)
  • 6 months of customer service and/or sales experience, Retail environment preferred. (Required)
  • Customer Satisfaction Passionate customer advocate with the desire to be yourself when connecting and having fun with our customers. Effective at balancing customer experience and performance goals. (Required)
  • Team Building Desire to be a part of the game-changing T-Mobile store team. Willingness to work alongside peers and store leaders, learning and sharing best practices, while serving customers and providing resolutions to issues. (Required)
  • Retail Sales Competitive drive and confidence to succeed in a fast-paced sales environment. (Required)
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Proactively engages with a broad range of customers in a highly-traffic retail environment. You will use digital tools, communicate effectively, educate customers, and showcase the value of T-Mobile solutions.
  • As a Mobile Associate, you will consistently leverage digital self-serve tools during customer interactions and the onboarding process. You will identify customer needs and use solution-based selling techniques to fully demonstrate the value of T-Mobile products and services. By recommending wireless solutions, and an onboarding solution centric to helping customers understand how to self-serve and utilize the T-Mobile app for wireless needs, you will deepen relationships with customers and ensure their satisfaction.
  • Complete training on the T-Mobile in-store experience, new skills, products and processes, and knowledge of systems and reference resources. Review your personal results, current promotions, and updates on the Hub to be Customer Ready at all times. You will continuously learn and improve your skills to provide the best possible experience for our customers. Partner with nearby store locations to properly/fully on-board customers. Will perform skills practicing, knowledge sharing, store operations, opening and closing procedures. As part of these procedures, you will carry keys to the kiosk cabinets, lock/secure kiosk and assets, and report any lost keys or assets to your manager.
  • Customer obsessed. You are passionate, friendly, and engaging with customers. You are able to connect on a personal level, match the pace of the customer, build rapport, trust, and loyalty with every interaction. You are committed to providing exceptional service, and to exceeding customer expectations. You will proactively reach out to potential customers to further drive sales activity in your location. You are able to follow up with customers, capture referrals, manage Be Back processes, and build relationships with new and existing customers. As part of your role, you will have the ability to perform price overrides for our specialty offers specific to National Retail.
  • Builds relationships with nearby leadership and teams to help support the customer experience from account set up, to device support and account servicing.
What we offer
What we offer
  • competitive base salary
  • annual stock grant
  • employee stock purchase plan
  • 401(k)
  • access to free, year-round money coaches
  • medical insurance
  • dental insurance
  • vision insurance
  • flexible spending account
  • paid time off
  • Parttime
Read More
Arrow Right
New

Manager in Training

As a Manager in Training, you’ll be preparing to take on a leadership role withi...
Location
Location
United Kingdom , London Docklands
Salary
Salary:
13.08 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong organisational and prioritisation skills
  • Excellent customer service and communication abilities
  • Experience in leading or managing people
  • Motivational and confident in coaching others
  • Able to work at pace and adapt to changing demands
  • Flexible availability, including evenings and weekends
  • Right to work in the relevant location
  • This role involves periods of standing, lifting, carrying, and reaching. You may also work in hot environments (near ovens) and cold environments (walk-in fridges) and occasionally outdoors (e.g. refuse disposal, deliveries).
Job Responsibility
Job Responsibility
  • Lead and organise the team to deliver excellent service and operational standards
  • Motivate your team to delight customers with quality, speed and friendliness
  • Support team members through coaching and training to meet the highest standards
  • Deliver 5-star operational excellence across all areas of the store
  • Monitor and drive performance against key targets
  • Provide outstanding customer service and resolve issues confidently
  • Prioritise tasks and manage time effectively in a fast-paced environment
  • Maintain a clean, safe and welcoming store environment
What we offer
What we offer
  • Competitive hourly pay (with opportunities for progression)
  • 28 days paid holiday per year (includes BH, pro rata for part time)
  • Flexible working hours to suit your lifestyle
  • Staff discount on our delicious food
  • Staff meals (conditions apply)
  • Company pension scheme (where eligible)
  • Family Leave policies in place
  • Paid training and clear career progression pathway with linked pay increases
  • Supportive, inclusive, and fun team environment
  • Employee recognition opportunities
Read More
Arrow Right
New

Project Manager – Compass

Software Resources has an immediate, contract job opportunity for a Project Mana...
Location
Location
United States , Glendale
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of applicable project management experience in a technology environment, preferably for a large company
  • Proven experience with at least 5 years of experience in leading technology, multidisciplinary efforts across a large-scale matrix organization
  • Experience in leading technology projects or multi-threaded efforts
  • Able to lead project meetings and workshops driving commitments, accountability, and deliverables
  • Demonstrated critical thinking, and planning skills
  • Demonstrated experience developing and managing software development project plans
  • Exposure to software development lifecycle methodologies (focused on Agile, Lean)
  • Demonstrated analytical and problem-solving skills to achieve business results
  • Strong interpersonal, organizational, and communication skills and the ability to work effectively across a wide range of constituencies in a diverse corporate and client environment
  • Proven ability to deliver projects on time and on budget while communicating with teams and leadership
Job Responsibility
Job Responsibility
  • Managing enterprise-level projects and initiatives within the Enterprise Technology & Data portfolio
  • Working closely with various project owners to define the project team and assign responsibilities
  • Developing a consolidated view of the project, and for project deliverables including calendars, cross-project dependencies, risk analysis, stakeholder coordination, and regular communication of status
  • Guiding process development at a project team level and managing high-risk, high-impact, strategic projects across a multi-disciplinary, multi-function group of technologists and business professionals
  • Managing projects, multiple projects, or a program with Engineering teams on development and implementation of products or solutions
  • Influencing product solutions/development process
  • Working with clients to understand business objectives and translate them into technical execution plans
  • Collaborating on configuration/development of system processes
  • Suggesting/evaluating system architecture options
  • Framing problems, designing solutions, alternatives and product strategy for development teams
What we offer
What we offer
  • Medical, dental, and vision coverage
  • 401(k) with company match
  • Short-term disability
  • Life insurance with AD&D
  • Fulltime
Read More
Arrow Right