CrawlJobs Logo
Intellectsoft Logo Intellectsoft · IT - Software Development

Senior Data Engineer with Python

India, Bengaluru · Job Posted January 31, 2026
Apply Position
Job Link Share

Job Description

Intellectsoft is a software development company delivering innovative solutions since 2007. We operate across North America, Latin America, the Nordic region, the UK, and Europe.We specialize in industries like Fintech, Healthcare, EdTech, Construction, Hospitality, and more, partnering with startups, mid-sized businesses, and Fortune 500 companies to drive innovation and scalability. Our clients include Jaguar Motors, Universal Pictures, Harley-Davidson, and many more where our teams are making daily impactTogether, our team delivers solutions that make a difference. Learn more at www.intellectsoft.net. Our customer's product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions to deliver cutting-edge solutions.

Job Responsibility

  • Design and build highly reliable and scalable data pipelines using PySpark and big data technologies
  • Collaborate with the data science team to develop new features that enhance model accuracy and performance
  • Create standardized data models to improve consistency across various deployments
  • Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows
  • Conduct POCs to evaluate new technologies and integrate additional data sources
  • Follow and promote best practices for software development, ensuring high-quality solutions that meet requirements and deadlines
  • Document development updates and maintain clear technical documentation

Requirements

  • 4+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL
  • Proficiency in Python for data processing and automation
  • Knowledge of PySpark, distributed computing, analytical databases and other big data technologies
  • Expertise in designing and managing ETL pipelines and distributed data processing frameworks
  • Strong knowledge of database systems, data modeling, and analytical databases
  • Hands-on experience with workflow orchestration tools such as Apache Airflow
  • Familiarity with cloud platforms like AWS, GCP, or Azure
  • Solid understanding of software development lifecycles, including coding standards, version control, and testing

Nice to have

  • Bachelor’s or master’s degree in Computer Science or a related field
  • Familiarity with the data science and machine learning development process
  • Understanding of Machine Learning pipelines or frameworks

What we offer

  • Awesome projects with an impact
  • Udemy courses of your choice
  • Team-buildings, events, marathons & charity activities to connect and recharge
  • Workshops, trainings, expert knowledge-sharing that keep you growing
  • Clear career path
  • Absence days for work-life balance
  • Flexible hours & work setup - work from anywhere and organize your day your way
Intellectsoft - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Data Engineer with Python

8 matching positions

Senior Data Engineer (with Data Analyst skills)

As a Senior Data Engineer (with Data Analyst skills), your primary task will be ...
Location
Location
Ukraine
Salary
Salary:
Not provided
n-ix.com Logo
N-iX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You have 4+ years of relevant work experience as a Data Analytics Engineer
  • You are analytical, curious, and detail-oriented
  • You get energy from diverse work and solving complex data questions
  • You have extensive knowledge of SQL or other languages. Preferably experience with GTM, A/B testing, and dashboarding
  • Strong communication skills - you can explain insights and analytical solutions to technical and non-technical stakeholders
  • High motivation, proactiveness, and a genuine enthusiasm for data and product analytics
  • English level - at least Upper-Intermediate, both spoken and written
Job Responsibility
Job Responsibility
  • Migrating dashboards and underpinning analytics models from (Snowflake, dbt, Qlik) to (AWS, python) data platform
  • Measuring the effectiveness of a new feature on the platform
  • Analyzing and advising on the customer journey (of B2B and B2C customers)
  • Analyzing the effectiveness of website personalization
  • Maintaining the tag management system and Snowplow data models in DBT/SQL
What we offer
What we offer
  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits
Read More
Arrow Right

Senior Data Engineer with Data Bricks

About the Role: Senior Data Engineer with Data Bricks position at Cigres Technol...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
cigres.com Logo
Cigres
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Databricks and experience with Spark for big data processing
  • Strong experience with Power BI, particularly in building reports and dashboards using DAX
  • Solid programming skills in Python or Scala for developing data pipelines
  • Knowledge of SQL and experience with relational databases and data warehousing concepts
  • Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing
  • Understanding of data modeling, ETL processes, and data integration methodologies
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration abilities to work effectively in a team-oriented environment
  • Experience: 5 to 9 Years
Job Responsibility
Job Responsibility
  • Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes
  • Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives
  • Optimize data storage and retrieval processes to enhance performance and reduce latency
  • Ensure data quality and integrity by implementing best practices for data governance and validation
  • Mentor junior data engineers and contribute to knowledge sharing within the team
  • Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs
  • Fulltime
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Senior Data Engineer (with AI)

Provectus is a leading AI consultancy and AWS Premier Consulting Partner with 15...
Location
Location
Poland , Wroclaw Metropolitan Area
Salary
Salary:
Not provided
provectus.com Logo
Provectus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of hands-on engineering experience with production systems
  • Full-stack mindset, comfortable across AI, Backend development, Data, and cloud infrastructure
  • Autonomous working style
  • Experience adopting AI tools in day-to-day workflows (e.g. Claude Code, GitHub Copilot, or similar)
  • Strong sense of ownership and proactivity
  • Openness to broadening skills into adjacent areas
  • B2+ English, comfortable collaborating across distributed, multicultural teams
  • Strong Python and SQL skills and solid software engineering fundamentals
  • Hands-on experience with Apache Spark for large-scale data processing
  • Proficiency with cloud data warehouse technologies: Snowflake, Redshift, or ClickHouse
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust data pipelines and ML systems for production environments
  • Develop and deploy ML and LLM-based solutions addressing real client business challenges
  • Build and maintain ETL/ELT workflows using modern orchestration and distributed computing tools
  • Implement MLOps practices: CI/CD, automated testing, model monitoring, and experiment tracking
  • Architect and implement cloud-native data and AI/ML solutions, primarily on AWS
  • Collaborate closely with Data Scientists, AI/ML Engineers, Backend Engineers, and client stakeholders
  • Participate in code reviews, contribute to technical documentation, and share knowledge within the team
  • Engage in client-facing discussions to understand requirements and propose technical solutions
What we offer
What we offer
  • Impactful work: projects span GenAI, MLOps, and NextGen data platforms for global enterprises across multiple industries
  • Senior-calibre peers: collaborate with top ML and Data professionals across North America, LATAM, and EMEA
  • Career growth: a clear path toward Tech Lead if you have the ambition — we actively develop our engineers
  • Recognised expertise: AWS Premier Consulting Partner featured in Forrester’s AI Technical Services Landscape
Read More
Arrow Right

Senior Data Engineer with Databricks

At KMD, we build digital solutions used by millions of people around the world. ...
Location
Location
Poland , Warsaw
Salary
Salary:
160.00 - 180.00 PLN / Hour
kmd.net Logo
KMD Poland
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of commercial experience in implementing, developing, or maintaining data load systems (ETL/ELT)
  • Strong programming skills in Python, with a deep understanding of data-related challenges
  • Hands-on experience with Apache Spark and Databricks
  • Familiar with MSSQL databases
  • Experience working with distributed systems on a cloud platform
  • Worked on large-scale systems and understands performance optimization
  • Comfortable with Git and CI/CD practices, and can design or implement deployment processes for data pipelines
  • Proactive, solution-oriented, and has a strong can-do attitude
  • Communicates fluently in English and Polish, both written and spoken
  • Team player with excellent collaboration and communication skills
Job Responsibility
Job Responsibility
  • Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python
  • Have end-to-end responsibility for the full lifecycle of features you develop
  • Design technical solutions for business requirements from the product roadmap
  • Ensure optimal performance
  • Refactor existing code and enhance system architecture to improve maintainability and scalability
  • Design and evolve the test automation strategy, including technology stack and solution architecture
  • Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development
What we offer
What we offer
  • KMD (an NEC company) is committed to providing equal opportunities. Hence, we invite all qualified interested applicants to apply for career opportunities. At KMD all aspects of employment and cooperation including the decision to hire/cooperate with will be based on merit, competence, performance, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other status protected under local anti-discrimination legislation
Read More
Arrow Right

Senior Data Engineer, Python

Senior Data Engineer, Python. Do you love building and pioneering in the technol...
Location
Location
United States , McLean; Plano; Wilmington; Richmond
Salary
Salary:
147100.00 - 184600.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 3 years of experience in application development (Internship experience does not apply)
  • At least 1 year of experience in big data technologies
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Python, Java, Scala, and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • Fulltime
Read More
Arrow Right

Senior Python Data Engineer

At 3Pillar Global, we specialize in building impactful software products that po...
Location
Location
Costa Rica
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of building solutions as a Data Engineer or similar fields
  • 3+ years working in Python and SQL with a focus on data
  • Experience with data plotting dashboarding tools like Streamlit, Tableau, Jupyter Notebook is a plus
  • Excellent communication skills, attention to detail, and the confidence to take control of project delivery
  • Quickly understand a highly technical product and effectively communicate with product management and engineering
Job Responsibility
Job Responsibility
  • Develop and refine strategies for acquiring research data from scientific laboratory instruments
  • Engineer and operationalize custom file parsers to handle diverse instrument output formats—including .xlsx, .pdf, .txt, .raw, .fid, and a variety of proprietary vendor binaries
  • Architect and implement robust data models, along with scalable data pipelines, comprehensive unit and integration tests, and modular utility libraries
  • Perform comparative analysis of datasets generated by similar instruments or workflows to design shared, extensible data model components
  • Create visualizations, reports, and interactive dashboards leveraging platforms such as Streamlit, Tableau, Jupyter Notebook, and others
What we offer
What we offer
  • Medical Insurance benefits as per company policy
  • Life Insurance as per company policy
  • 12 days of paid vacation, sick leave and paid holidays as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Sick leave and paid holidays as per local law
  • Christmas bonus as per local law
  • Saving Fund “Asociacion Solidarista”
  • Beach house (Managed by the Asociacion Solidarista)
  • Discounts in local shops
  • Fulltime
Read More
Arrow Right

Senior Python Data Engineer

At 3Pillar Global, we specialize in building impactful software products that po...
Location
Location
Mexico
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of building solutions as a Data Engineer or similar fields
  • 3+ years working in Python and SQL with a focus on data
  • Experience with data plotting dashboarding tools like Streamlit, Tableau, Jupyter Notebook is a plus
  • Excellent communication skills, attention to detail, and the confidence to take control of project delivery
  • Quickly understand a highly technical product and effectively communicate with product management and engineering
Job Responsibility
Job Responsibility
  • Develop and refine strategies for acquiring research data from scientific laboratory instruments
  • Engineer and operationalize custom file parsers to handle diverse instrument output formats—including .xlsx, .pdf, .txt, .raw, .fid, and a variety of proprietary vendor binaries
  • Architect and implement robust data models, along with scalable data pipelines, comprehensive unit and integration tests, and modular utility libraries
  • Perform comparative analysis of datasets generated by similar instruments or workflows to design shared, extensible data model components
  • Create visualizations, reports, and interactive dashboards leveraging platforms such as Streamlit, Tableau, Jupyter Notebook, and others
What we offer
What we offer
  • Medical Insurance benefits as per company policy
  • Life Insurance as per company policy
  • 15 days of paid vacation plus additional days based on tenure
  • Vacation bonus as per local law
  • Sick leave and paid holidays as per local law
  • Profit sharing as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Christmas bonuses as per local law
  • Work from home allowance as per company policy
  • Fulltime
Read More
Arrow Right