CrawlJobs Logo

Senior Data Engineer with Data Bricks

India, Bengaluru · Job Posted January 07, 2026
Apply Position
Job Link Share

Job Description

About the Role: Senior Data Engineer with Data Bricks position at Cigres Technologies Private Limited in Bengaluru.

Job Responsibility

  • Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes
  • Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives
  • Optimize data storage and retrieval processes to enhance performance and reduce latency
  • Ensure data quality and integrity by implementing best practices for data governance and validation
  • Mentor junior data engineers and contribute to knowledge sharing within the team
  • Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs

Requirements

  • Proficiency in Databricks and experience with Spark for big data processing
  • Strong experience with Power BI, particularly in building reports and dashboards using DAX
  • Solid programming skills in Python or Scala for developing data pipelines
  • Knowledge of SQL and experience with relational databases and data warehousing concepts
  • Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing
  • Understanding of data modeling, ETL processes, and data integration methodologies
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration abilities to work effectively in a team-oriented environment
  • Experience: 5 to 9 Years

Nice to have

  • Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field
  • Previous experience in a similar data engineering role, particularly within a corporate environment
  • Knowledge of additional BI tools and data visualization platforms is a plus

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer with Data Bricks

8 matching positions

Senior Data Engineer - Platform Team

Our team of dedicated Data Engineers delivers comprehensive data engineering sol...
Location
Location
Israel , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree or master’s degree in computer science, Math, Software Engineering, Computer Engineering, or related field
  • At least 6+ years’ experience in business analytics, data science, data modelling OR/AND Data Engineering work
  • Architecting, building, and maintaining end-to-end, high-throughput data systems and their supporting services
  • Designing efficient data structures and database schemas and working with distributed systems architecture
  • Experience working with large data sets using SQL/Azure Data Lake/Spark/Data bricks, etc., to derive actionable insights is highly desirable
  • Experience in Building AI \ ML-OPS tools for data platforms
  • Developing for continuous integration and automated deployments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data pipelines, ETL workflows, and back-end services for real-time decisioning, reporting, optimization, data collection, and related functions
  • Develop AI \ ML workflows to support queries and automate data driven processes
  • Experiment with and recommend new technologies that simplify or improve the tech stack
  • Participate in an on-call rotation and work occasional off-hours
  • Mentor data engineers, guide complex design decisions, and foster a culture of engineering excellence, and continuous learning across the organization
  • Fulltime
Read More
Arrow Right

Data Engineer - Big Data, Python, Databricks

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4 - 6 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Proficient in Big DataTechnologies - Cloudera, Hive, Python, Java/PySpark, Data Bricks
  • Proficient in Data analysis and data modelling
  • Good understanding of ETL concepts
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Senior Data Scientist II

Role: Senior Data Scientist – Conversational AI, LLM Location: Bangalore Experie...
Location
Location
India , Bangalore, Kolkata
Salary
Salary:
Not provided
inxiteout.ai Logo
InXiteOut
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ Years
  • Large Language Models (LLMs) & NLP
  • RAG, agents, and multi-agent orchestration
  • Prompt engineering & LLM evaluation frameworks
  • Vector databases
  • Python (advanced proficiency)
  • FastAPI / Flask
  • Asynchronous & modular application design
  • Databricks & PySpark
  • MongoDB (schema design, indexing, optimization)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain enterprise-grade Conversational AI systems using modern architectural patterns
  • Build context-aware AI applications leveraging LLMs, vector databases, and multi-agent orchestration frameworks
  • Develop and optimize prompt engineering strategies for reliability, evaluation, and performance tuning
  • Implement LLM interaction workflows including RAG, tool usage, and agent-to-agent communication
  • Design and integrate Knowledge Graphs to enhance contextual intelligence and reasoning
  • Develop graph-based solutions using enterprise Neo4j with strong proficiency in Cypher query language and graph algorithms
  • Implement graph traversal, inference, and graph analytics for AI use cases
  • Build modular, scalable, and maintainable Python-based AI applications
  • Develop high-performance REST APIs using Fast / Flask framework
  • Implement asynchronous processing and orchestration workflows
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

In this vital role you will identify trends, root causes, and potential improvem...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s / Bachelor’s degree in Data Science, Statistics, Computer Science, Biomedical Engineering, or a related field and 8 to 12 years of experience with one or more analytic software tools or languages (e.g., SAS, SPSS, Python)
  • Experience with data visualization tools like Square Two (S2), Spotfire, BioConnect, Tableau, Power BI, Smartsheet, or similar
  • Demonstrated skill in the use of applied analytics, descriptive statistics, feature extraction and predictive analytics on industrial datasets
  • Experience in statistical techniques and hypothesis testing, experience with regression analysis, clustering and classification
  • Experience in analyzing time-series data for forecasting and trend analysis
  • Experience with Data Bricks platform for data analytics
  • Experience working with healthcare data, including patient complaints, product feedback, and regulatory requirements
  • Fluency in verbal and written English to be able to understand & articulate technical concepts
Job Responsibility
Job Responsibility
  • Collect, clean, and run large datasets related to product performance and patient complaints
  • Ensure data integrity, accuracy, and accessibility for further analysis
  • Develop and maintain databases and data systems for storing patient complaints and product feedback
  • Analyze data to identify patterns, trends, and correlations in patient complaints and product issues
  • Use advanced statistical methods and machine learning techniques to uncover insights and root causes
  • Develop analytics or predictive models to foresee potential product issues and patient concerns to address customer needs and opportunities
  • Prepare comprehensive reports and visualizations to communicate findings to collaborators
  • Present insights and recommendations to multi-functional teams, including product development, quality assurance, and customer service
  • Collaborate with regulatory and compliance teams to ensure consistency to healthcare standards and regulations
  • See opportunities for product enhancements and process improvements based on data analysis
What we offer
What we offer
  • Competitive and comprehensive Total Rewards Plans that are aligned with local industry standards
Read More
Arrow Right

Senior Test Engineer

As Padran Information Technologies, we are looking for teammates who are focused...
Location
Location
Turkey , İstanbul/İzmir
Salary
Salary:
Not provided
padran.com Logo
Padran Information Technologies Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Engineering, Software Engineering, or related fields
  • a Master's degree is preferred
  • At least 5 years of experience in test engineering
  • In-depth knowledge and experience with AWS services (EC2, S3, Lambda, RDS, API Gateway), web programming languages (JavaScript, HTML, CSS), and RESTful APIs
  • In-depth knowledge and experience with mobile applications (Flutter, Android, iOS)
  • Advanced experience with Python and Bash scripting languages
  • Advanced experience with Jira Xray or similar test management tools
  • Experience with SQL and NoSQL databases
  • Experience working with Agile/Scrum methodologies
  • Experience in performance and load testing
Job Responsibility
Job Responsibility
  • Prepare and execute functional and manual test scenarios for mobile (Flutter-based Android and iOS) applications
  • Conduct testing processes on cloud solutions, web interfaces, and APIs
  • Develop and execute test scenarios on platforms like Tableau and Data Bricks
  • Manage and report test processes using Jira Xray
  • Utilize internal automation tools developed by our automation team and develop Python and Bash scripts when needed
  • Suggest improvements and increase automation in test processes
  • Actively participate in CI/CD processes
  • Mentor team members and share knowledge
What we offer
What we offer
  • Opportunity to work with leading companies in Turkey
  • Opportunity to use industry-leading technologies with our business partners Microsoft, IBM, AWS and Open Text
  • Career development and certification opportunities as an ISTQB accredited training center
  • Fulltime
Read More
Arrow Right

Senior Advanced Cloud Engineer

We are ACES Strategic team (Advanced Cloud Engineering & Supportability) - Globa...
Location
Location
Romania , Bucharest
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in engineering, Computer Science, or related field AND Solid Experience in Software industry experience related to technology OR equivalent experience
  • Hands-on demonstrated IT experience supporting and troubleshooting enterprise level, mission-critical applications resolving complex issues/situations and driving technical resolution across cross-functional organization
  • Proven experience working on cloud computing technologies
  • Extensive experience in an external customer / client facing role
  • Experience with being on-call
  • Technical Skills: Cloud computing technologies. Demonstrated hands on experience in one or more of the following: Core IaaS: Compute, Storage, Networking, High Availability
  • Data Platform and Bigdata: SQL Server, Azure SQL DB, HDInsight/Hadoop, Machine Learning, Azure Stream Analytics, Azure Data Factory / Data Bricks,etc
  • Azure PaaS Services: Redis Cache, Service Bus, Event Hub, Cloud Service, IoT suite, Mobile Apps, etc.
  • Experience in Monitoring related technologies like Azure Monitor, Log Analytics, Resource Graph, Azure Alerts, Network Watcher, Grafana, Ambari, Prometheus, Datadog, Confluent, etc
  • Experience in deploying, configuring, and operating enterprise Monitoring solutions
Job Responsibility
Job Responsibility
  • Track customer incidents, engage with strategic customers and partners to understand issues, contribute to troubleshooting through diagnostics, communicate progress and next steps to customers with a focus on reducing time taken to mitigate critical incidents
  • Use engineering and support tools, customer telemetry and/or direct customer input to detect and flag trends/patterns of issues in the products or products misuse across customers. Develop and share insights and best practices with customers
  • Recommend and help develop training/readiness modules (e.g., mentoring, leading triages, content creation, brown bag sessions, blogs, quality assurance checks). Acts as a mentor, shares knowledge, and contributes to the content and readiness strategy for the team
  • Serve as a connecting point between the product team and customers throughout the engagement lifecycle, engage with customers to understand their business and availability needs, develop and offer proactive guidance on designing configurations and deploying solutions on Azure
  • Handle complex escalations on customer issues from the customer or support or field teams, conduct impact analysis, help customers with answers to their technical questions, and serve as an escalation resource in areas of subject matter expertise
  • Conduct in-depth root cause analysis of issues and translates findings into opportunities for improvement and track and drive them as repair items
  • Act as voice of customers and synthesize product feedback from strategic customers to provide input on business plans developed by the product groups. Identify customer usage patterns and drive resolutions on reoccurring issues with product groups. Close the feedback loop with the customers on product features
  • Partner with other teams (e.g., program managers, software engineers, product, customer service support teams), prioritize, unblock, and resolve critical customer issues
  • Collaborate with stakeholders to deliver solutions to strategic customers and develop mechanisms that improve customer health and reduce the turnover time
  • Embody our culture and values.
Read More
Arrow Right

Senior Customer Experience Engineer

As a customer focused Senior Advanced Cloud Engineer, you are the primary suppor...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Engineering, Computer Science, Information Technology (IT), Data Analytics/Science, Artificial Intelligence (AI), or related field AND 4+ years experience in technology industry, cloud, technical support, and/or customer experience engineering
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • 4 years of demonstrated IT experience supporting and troubleshooting enterprise level, mission-critical applications resolving complex issues/situations and driving technical resolution across cross-functional organizations
  • Japanese language skill – this person will be part of our virtual team focused on supporting Japanese customers and needs to be conversant in the language
  • Ability to speak, understand, read and write Japanese language
  • 2+ years of experience with being on - call and driving mitigation for mission critical incidents
  • Demonstrated hands on experience in one or more of the following: Core IaaS: Compute, Storage, Networking, High Availability, Azure Kubernetes Service
  • Data Platform and Bigdata: SQL Server, Azure SQL DB, HDInsight/Hadoop, Machine Learning, Azure Stream Analytics, Azure Data Factory / Data Bricks, Cosmos DB
  • Azure PaaS Services: App Services, Azure Functions, Redis Cache, and Event Hub
Job Responsibility
Job Responsibility
  • Track customer incidents, engage with strategic customers and partners to understand issues, contribute to troubleshooting through diagnostics, communicate progress and next steps to customers with a focus on reducing time taken to mitigate critical incidents
  • Use engineering and support tools, customer telemetry and/or direct customer input to detect and flag trends/patterns of issues in the products or products misuse across customers
  • Develop and share insights and best practices with customers
  • Recommend and help develop training/readiness modules (e.g., mentoring, leading triages, content creation, brown bag sessions, blogs, quality assurance checks)
  • Acts as a mentor, shares knowledge, and contributes to the content and readiness strategy for the team
  • Serve as a connecting point between the product team and customers throughout the engagement lifecycle, engage with customers to understand their business and availability needs, develop and offer proactive guidance on designing configurations and deploying solutions on Azure
  • Handle complex escalations on customer issues from the customer or support or field teams, conduct impact analysis, help customers with answers to their technical questions, and serve as an escalation resource in areas of subject matter expertise
  • Conduct in-depth root cause analysis of issues and translates findings into opportunities for improvement and track and drive them as repair items
  • Acts as a voice of customers and leverages customers' feedback to provide input on business plans developed by the relevant product and business groups
  • Identifies customer usage patterns and driving resolutions on reoccurring customer issues with engineering and product and business groups
  • Fulltime
Read More
Arrow Right

Senior Azure ACE Engineer - Sovereign Cloud

As a customer focused Advanced Cloud Engineer, you are the primary engineering c...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree Engineering, Computer Science, Information Technology (IT), Data Analytics/Science, Artificial Intelligence (AI), or related field AND relevant experience in technology industry, cloud, technical support, and/or customer experience engineering OR equivalent experience.
  • Demonstrated experience supporting and troubleshooting enterprise level, mission-critical applications and infrastructure resolving complex issues/situations and driving technical resolution across cross-functional organizations.
  • Familiarity with operating in regulated or restricted‑access environments, such as sovereign cloud, high‑security, or compliance‑driven workloads is an advantage.
  • Experience with being on-call and driving mitigation for mission critical incidents.
  • Demonstrated hands-on experience with expertise in one or more of the following Cloud technologies: Core IaaS: Compute (Windows/Linux), Storage, Networking, Kubernetes, High Availability
  • Data Platform and Bigdata: Azure SQL DB, Cosmos DB, PostgreSQL on Azure, Azure Data Bricks, Azure Data Factory, AI/ML
  • Azure PaaS Services: App Services, Azure Functions, Redis Cache, and Event Hub.
  • Monitoring technologies: Azure Monitor, Log Analytics, Grafana, Datadog, Confluent and similar technologies.
  • Communication skills: ability to empathize with customers and convey confidence. Able to explain highly technical issues to varied audiences. Able to prioritize and advocate customer’s needs to the proper channels. Take ownership and work towards a resolution.
  • Customer Obsession: Passion for customers and focus on delivering the right customer experience.
Job Responsibility
Job Responsibility
  • With minimal oversight, track customer incidents, engage with strategic customers and partners to understand issues, contribute to troubleshooting through diagnostics, communicate progress and next steps to customers with a focus on reducing time taken to mitigate critical incidents.
  • Use engineering and support tools, customer telemetry and/or direct customer input to detect and flag issues in the products or with the customer usage of the products.
  • Help customers stay current with best practices by sharing content.
  • Identify and leverage developmental opportunities across product areas and business processes (e.g., mentorships, shadowing, trainings) for professional growth and to develop technical skills to resolve customer issues.
  • With minimal guidance, serve as a connecting point between the product team and customers throughout the engagement life cycle, engage with customers to understand their business and availability needs, develop and offer proactive guidance on designing configurations and deploying solutions on Azure with support from subject matter experts.
  • Handle critical escalations on customer issues from the customer or support or field teams, conduct impact analysis, help customers with answers to their technical questions, and serve as an escalation resource in areas of subject matter expertise.
  • Conduct in-depth root cause analysis of issues and translates findings into opportunities for improvement and track and drive them as repair items.
  • Act as the voice of customers and channel product feedback from strategic customers to product groups. Identify customer usage patterns and drive resolutions on reoccurring issues with product groups. Close the feedback loop with the customers on product features.
  • With minimal guidance, partner with other teams (e.g., program managers, software engineers, product, customer service support teams), prioritize, unblock, and resolve critical customer issues.
  • Collaborate with stakeholders to support delivery of solutions to strategic customers and resolving customer issues.
  • Fulltime
Read More
Arrow Right