CrawlJobs Logo

Senior Data Engineer with Data Bricks

cigres.com Logo

Cigres

Location Icon

Location:
India , Bengaluru

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

About the Role: Senior Data Engineer with Data Bricks position at Cigres Technologies Private Limited in Bengaluru.

Job Responsibility:

  • Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes
  • Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives
  • Optimize data storage and retrieval processes to enhance performance and reduce latency
  • Ensure data quality and integrity by implementing best practices for data governance and validation
  • Mentor junior data engineers and contribute to knowledge sharing within the team
  • Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs

Requirements:

  • Proficiency in Databricks and experience with Spark for big data processing
  • Strong experience with Power BI, particularly in building reports and dashboards using DAX
  • Solid programming skills in Python or Scala for developing data pipelines
  • Knowledge of SQL and experience with relational databases and data warehousing concepts
  • Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing
  • Understanding of data modeling, ETL processes, and data integration methodologies
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration abilities to work effectively in a team-oriented environment
  • Experience: 5 to 9 Years

Nice to have:

  • Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field
  • Previous experience in a similar data engineering role, particularly within a corporate environment
  • Knowledge of additional BI tools and data visualization platforms is a plus

Additional Information:

Job Posted:
January 07, 2026

Employment Type:
Fulltime
Icon
Cigres - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Data Engineer with Data Bricks

Senior Data Engineer - Platform Team

Our team of dedicated Data Engineers delivers comprehensive data engineering sol...
Location
Location
Israel , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree or master’s degree in computer science, Math, Software Engineering, Computer Engineering, or related field
  • At least 6+ years’ experience in business analytics, data science, data modelling OR/AND Data Engineering work
  • Architecting, building, and maintaining end-to-end, high-throughput data systems and their supporting services
  • Designing efficient data structures and database schemas and working with distributed systems architecture
  • Experience working with large data sets using SQL/Azure Data Lake/Spark/Data bricks, etc., to derive actionable insights is highly desirable
  • Experience in Building AI \ ML-OPS tools for data platforms
  • Developing for continuous integration and automated deployments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data pipelines, ETL workflows, and back-end services for real-time decisioning, reporting, optimization, data collection, and related functions
  • Develop AI \ ML workflows to support queries and automate data driven processes
  • Experiment with and recommend new technologies that simplify or improve the tech stack
  • Participate in an on-call rotation and work occasional off-hours
  • Mentor data engineers, guide complex design decisions, and foster a culture of engineering excellence, and continuous learning across the organization
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

In this vital role you will identify trends, root causes, and potential improvem...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s / Bachelor’s degree in Data Science, Statistics, Computer Science, Biomedical Engineering, or a related field and 8 to 12 years of experience with one or more analytic software tools or languages (e.g., SAS, SPSS, Python)
  • Experience with data visualization tools like Square Two (S2), Spotfire, BioConnect, Tableau, Power BI, Smartsheet, or similar
  • Demonstrated skill in the use of applied analytics, descriptive statistics, feature extraction and predictive analytics on industrial datasets
  • Experience in statistical techniques and hypothesis testing, experience with regression analysis, clustering and classification
  • Experience in analyzing time-series data for forecasting and trend analysis
  • Experience with Data Bricks platform for data analytics
  • Experience working with healthcare data, including patient complaints, product feedback, and regulatory requirements
  • Fluency in verbal and written English to be able to understand & articulate technical concepts
Job Responsibility
Job Responsibility
  • Collect, clean, and run large datasets related to product performance and patient complaints
  • Ensure data integrity, accuracy, and accessibility for further analysis
  • Develop and maintain databases and data systems for storing patient complaints and product feedback
  • Analyze data to identify patterns, trends, and correlations in patient complaints and product issues
  • Use advanced statistical methods and machine learning techniques to uncover insights and root causes
  • Develop analytics or predictive models to foresee potential product issues and patient concerns to address customer needs and opportunities
  • Prepare comprehensive reports and visualizations to communicate findings to collaborators
  • Present insights and recommendations to multi-functional teams, including product development, quality assurance, and customer service
  • Collaborate with regulatory and compliance teams to ensure consistency to healthcare standards and regulations
  • See opportunities for product enhancements and process improvements based on data analysis
What we offer
What we offer
  • Competitive and comprehensive Total Rewards Plans that are aligned with local industry standards
Read More
Arrow Right

Senior Software Engineering Manager

Are you interested in working for on cutting-edge cloud security products? Would...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Candidates must have an active TS/SCI and be willing and eligible to upgrade to TS/SCI (with polygraph)
  • This position requires verification of U.S. citizenship due to citizenship-based legal restrictions
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 2+ years people management experience
  • Experience Kubernetes, and the Kubernetes satellite technologies
  • Proficient in at least one scripting language but knows when to move solutions into managed code
  • Experience in Spark, Data Lake or big data platform pipeline development (Ex. Azure Data Factory, Data Explorer/Kusto, Data Bricks, Spark)
  • Expereince with Azure DevOps and GitHub tooling
  • Data mining or data science experiences utilizing Big Data and\or relational database technologies
Job Responsibility
Job Responsibility
  • Lead, mentor, coach, and grow a diverse team of talented engineers delivering world-class services in high-pressure situations
  • Collaborate closely with engineering and research teams to ensure services and systems are highly stable, performant, and meet customer expectations
  • Provide technical leadership for the engineering team responsible for Microsoft Defender for Endpoint in Sovereign Clouds
  • Foster a learn-it-all, curious, and data-driven culture within a fast-paced, highly technical, and constantly evolving environment
  • Maintain a strong customer focus and deep understanding of cloud design principles to address cyber-threats and attacks
  • Ensure operational excellence by supporting live site operations and participating in a 24x7 incident management model
  • Drive continuous improvement and innovation in cloud security solutions, leveraging state-of-the-art technologies to protect sensitive government environments
  • Fulltime
Read More
Arrow Right

Senior Customer Experience Engineer

As a customer focused Senior Advanced Cloud Engineer, you are the primary suppor...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Engineering, Computer Science, Information Technology (IT), Data Analytics/Science, Artificial Intelligence (AI), or related field AND 4+ years experience in technology industry, cloud, technical support, and/or customer experience engineering
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • 4 years of demonstrated IT experience supporting and troubleshooting enterprise level, mission-critical applications resolving complex issues/situations and driving technical resolution across cross-functional organizations
  • Japanese language skill – this person will be part of our virtual team focused on supporting Japanese customers and needs to be conversant in the language
  • Ability to speak, understand, read and write Japanese language
  • 2+ years of experience with being on - call and driving mitigation for mission critical incidents
  • Demonstrated hands on experience in one or more of the following: Core IaaS: Compute, Storage, Networking, High Availability, Azure Kubernetes Service
  • Data Platform and Bigdata: SQL Server, Azure SQL DB, HDInsight/Hadoop, Machine Learning, Azure Stream Analytics, Azure Data Factory / Data Bricks, Cosmos DB
  • Azure PaaS Services: App Services, Azure Functions, Redis Cache, and Event Hub
Job Responsibility
Job Responsibility
  • Track customer incidents, engage with strategic customers and partners to understand issues, contribute to troubleshooting through diagnostics, communicate progress and next steps to customers with a focus on reducing time taken to mitigate critical incidents
  • Use engineering and support tools, customer telemetry and/or direct customer input to detect and flag trends/patterns of issues in the products or products misuse across customers
  • Develop and share insights and best practices with customers
  • Recommend and help develop training/readiness modules (e.g., mentoring, leading triages, content creation, brown bag sessions, blogs, quality assurance checks)
  • Acts as a mentor, shares knowledge, and contributes to the content and readiness strategy for the team
  • Serve as a connecting point between the product team and customers throughout the engagement lifecycle, engage with customers to understand their business and availability needs, develop and offer proactive guidance on designing configurations and deploying solutions on Azure
  • Handle complex escalations on customer issues from the customer or support or field teams, conduct impact analysis, help customers with answers to their technical questions, and serve as an escalation resource in areas of subject matter expertise
  • Conduct in-depth root cause analysis of issues and translates findings into opportunities for improvement and track and drive them as repair items
  • Acts as a voice of customers and leverages customers' feedback to provide input on business plans developed by the relevant product and business groups
  • Identifies customer usage patterns and driving resolutions on reoccurring customer issues with engineering and product and business groups
  • Fulltime
Read More
Arrow Right

Senior Azure ACE Engineer - Sovereign Cloud

As a customer focused Advanced Cloud Engineer, you are the primary engineering c...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree Engineering, Computer Science, Information Technology (IT), Data Analytics/Science, Artificial Intelligence (AI), or related field AND relevant experience in technology industry, cloud, technical support, and/or customer experience engineering OR equivalent experience.
  • Demonstrated experience supporting and troubleshooting enterprise level, mission-critical applications and infrastructure resolving complex issues/situations and driving technical resolution across cross-functional organizations.
  • Familiarity with operating in regulated or restricted‑access environments, such as sovereign cloud, high‑security, or compliance‑driven workloads is an advantage.
  • Experience with being on-call and driving mitigation for mission critical incidents.
  • Demonstrated hands-on experience with expertise in one or more of the following Cloud technologies: Core IaaS: Compute (Windows/Linux), Storage, Networking, Kubernetes, High Availability
  • Data Platform and Bigdata: Azure SQL DB, Cosmos DB, PostgreSQL on Azure, Azure Data Bricks, Azure Data Factory, AI/ML
  • Azure PaaS Services: App Services, Azure Functions, Redis Cache, and Event Hub.
  • Monitoring technologies: Azure Monitor, Log Analytics, Grafana, Datadog, Confluent and similar technologies.
  • Communication skills: ability to empathize with customers and convey confidence. Able to explain highly technical issues to varied audiences. Able to prioritize and advocate customer’s needs to the proper channels. Take ownership and work towards a resolution.
  • Customer Obsession: Passion for customers and focus on delivering the right customer experience.
Job Responsibility
Job Responsibility
  • With minimal oversight, track customer incidents, engage with strategic customers and partners to understand issues, contribute to troubleshooting through diagnostics, communicate progress and next steps to customers with a focus on reducing time taken to mitigate critical incidents.
  • Use engineering and support tools, customer telemetry and/or direct customer input to detect and flag issues in the products or with the customer usage of the products.
  • Help customers stay current with best practices by sharing content.
  • Identify and leverage developmental opportunities across product areas and business processes (e.g., mentorships, shadowing, trainings) for professional growth and to develop technical skills to resolve customer issues.
  • With minimal guidance, serve as a connecting point between the product team and customers throughout the engagement life cycle, engage with customers to understand their business and availability needs, develop and offer proactive guidance on designing configurations and deploying solutions on Azure with support from subject matter experts.
  • Handle critical escalations on customer issues from the customer or support or field teams, conduct impact analysis, help customers with answers to their technical questions, and serve as an escalation resource in areas of subject matter expertise.
  • Conduct in-depth root cause analysis of issues and translates findings into opportunities for improvement and track and drive them as repair items.
  • Act as the voice of customers and channel product feedback from strategic customers to product groups. Identify customer usage patterns and drive resolutions on reoccurring issues with product groups. Close the feedback loop with the customers on product features.
  • With minimal guidance, partner with other teams (e.g., program managers, software engineers, product, customer service support teams), prioritize, unblock, and resolve critical customer issues.
  • Collaborate with stakeholders to support delivery of solutions to strategic customers and resolving customer issues.
  • Fulltime
Read More
Arrow Right
New

Apps Dev Tech Lead Analyst - Vice President

As a key member of our global development team, you will: Innovate & Develop: Pa...
Location
Location
United States , Irving
Salary
Salary:
125760.00 - 188640.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6-10 years of progressive experience in systems analysis and programming of software applications
  • Strong proficiency in Java application technologies, including deep experience with TDD (Test-Driven Development), Spring framework, and Microservices architecture
  • Extensive hands-on experience with PySpark and advanced Python programming skills
  • Proven experience with Big Data ecosystems, including Cloudera and/or Data Bricks
  • Hands-on experience with distributed query engines like Starburst (Trino/Presto)
  • Proficient in designing and managing complex workflows using scheduling tools, particularly Apache Airflow
  • Strong expertise in SQL and experience with relational and non-relational databases
  • Excellent knowledge of algorithms and data structures, design patterns
  • Strong Java experience: Java core, collections, concurrency, streams
  • Frameworks and APIs: Spring (Core, Batch, Integration, MVC, Boot, Data), Hibernate, Jackson, JAX RS, JPA, JAXB
Job Responsibility
Job Responsibility
  • Innovate & Develop: Partner closely with project managers, business stakeholders, and senior managers to translate complex business requirements into well-architected technical solutions
  • Drive cross-functional collaboration with diverse management teams
  • Proactively identify, define, and implement necessary system enhancements
  • Complex Problem Resolution: Lead the resolution of high-impact problems and critical projects
  • Consult with users, clients, and other technology groups on issues
  • Technical Architecture & Standards Leadership: Serve as a subject matter expert in application programming
  • Leverage an advanced understanding of system flow to develop and enforce robust standards for coding, testing, debugging, and implementation
  • Mentorship & Talent Development: Act as a trusted advisor and coach for mid-level developers and analysts
  • Provide technical guidance, mentorship, and code reviews to junior data engineers
  • Operational Excellence: Ensure adherence to best practices and essential procedures
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right

Senior Advanced Cloud Engineer

We are ACES Strategic team (Advanced Cloud Engineering & Supportability) - Globa...
Location
Location
Romania , Bucharest
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in engineering, Computer Science, or related field AND Solid Experience in Software industry experience related to technology OR equivalent experience
  • Hands-on demonstrated IT experience supporting and troubleshooting enterprise level, mission-critical applications resolving complex issues/situations and driving technical resolution across cross-functional organization
  • Proven experience working on cloud computing technologies
  • Extensive experience in an external customer / client facing role
  • Experience with being on-call
  • Technical Skills: Cloud computing technologies. Demonstrated hands on experience in one or more of the following: Core IaaS: Compute, Storage, Networking, High Availability
  • Data Platform and Bigdata: SQL Server, Azure SQL DB, HDInsight/Hadoop, Machine Learning, Azure Stream Analytics, Azure Data Factory / Data Bricks,etc
  • Azure PaaS Services: Redis Cache, Service Bus, Event Hub, Cloud Service, IoT suite, Mobile Apps, etc.
  • Experience in Monitoring related technologies like Azure Monitor, Log Analytics, Resource Graph, Azure Alerts, Network Watcher, Grafana, Ambari, Prometheus, Datadog, Confluent, etc
  • Experience in deploying, configuring, and operating enterprise Monitoring solutions
Job Responsibility
Job Responsibility
  • Track customer incidents, engage with strategic customers and partners to understand issues, contribute to troubleshooting through diagnostics, communicate progress and next steps to customers with a focus on reducing time taken to mitigate critical incidents
  • Use engineering and support tools, customer telemetry and/or direct customer input to detect and flag trends/patterns of issues in the products or products misuse across customers. Develop and share insights and best practices with customers
  • Recommend and help develop training/readiness modules (e.g., mentoring, leading triages, content creation, brown bag sessions, blogs, quality assurance checks). Acts as a mentor, shares knowledge, and contributes to the content and readiness strategy for the team
  • Serve as a connecting point between the product team and customers throughout the engagement lifecycle, engage with customers to understand their business and availability needs, develop and offer proactive guidance on designing configurations and deploying solutions on Azure
  • Handle complex escalations on customer issues from the customer or support or field teams, conduct impact analysis, help customers with answers to their technical questions, and serve as an escalation resource in areas of subject matter expertise
  • Conduct in-depth root cause analysis of issues and translates findings into opportunities for improvement and track and drive them as repair items
  • Act as voice of customers and synthesize product feedback from strategic customers to provide input on business plans developed by the product groups. Identify customer usage patterns and drive resolutions on reoccurring issues with product groups. Close the feedback loop with the customers on product features
  • Partner with other teams (e.g., program managers, software engineers, product, customer service support teams), prioritize, unblock, and resolve critical customer issues
  • Collaborate with stakeholders to deliver solutions to strategic customers and develop mechanisms that improve customer health and reduce the turnover time
  • Embody our culture and values.
Read More
Arrow Right

Senior Test Engineer

As Padran Information Technologies, we are looking for teammates who are focused...
Location
Location
Turkey , İstanbul/İzmir
Salary
Salary:
Not provided
padran.com Logo
Padran Information Technologies Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Engineering, Software Engineering, or related fields
  • a Master's degree is preferred
  • At least 5 years of experience in test engineering
  • In-depth knowledge and experience with AWS services (EC2, S3, Lambda, RDS, API Gateway), web programming languages (JavaScript, HTML, CSS), and RESTful APIs
  • In-depth knowledge and experience with mobile applications (Flutter, Android, iOS)
  • Advanced experience with Python and Bash scripting languages
  • Advanced experience with Jira Xray or similar test management tools
  • Experience with SQL and NoSQL databases
  • Experience working with Agile/Scrum methodologies
  • Experience in performance and load testing
Job Responsibility
Job Responsibility
  • Prepare and execute functional and manual test scenarios for mobile (Flutter-based Android and iOS) applications
  • Conduct testing processes on cloud solutions, web interfaces, and APIs
  • Develop and execute test scenarios on platforms like Tableau and Data Bricks
  • Manage and report test processes using Jira Xray
  • Utilize internal automation tools developed by our automation team and develop Python and Bash scripts when needed
  • Suggest improvements and increase automation in test processes
  • Actively participate in CI/CD processes
  • Mentor team members and share knowledge
What we offer
What we offer
  • Opportunity to work with leading companies in Turkey
  • Opportunity to use industry-leading technologies with our business partners Microsoft, IBM, AWS and Open Text
  • Career development and certification opportunities as an ISTQB accredited training center
  • Fulltime
Read More
Arrow Right
Remote jobs Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog Salaries Tools About Us FAQ Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy