Senior Azure Data Engineer with Databricks Job at DCG Sp. z o. o.

Senior Azure Data Engineer with Fabric

Senior Azure Data Engineer with Microsoft Fabric Experience

Location

United States , Newark

Salary:

130000.00 USD / Year

Realign

Expiration Date

Until further notice

Requirements

Minimum 10+ years experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Microsoft Fabric etc.
Azure experience is preferred over other cloud platforms
Minimum 10 + years of proven experience with SQL, schema design and dimensional data modelling
Solid knowledge of data warehouse best practices, development standards and methodologies
Experience with ETL/ELT tools like ADF, Azure, MS Fabric etc., and data warehousing technologies like Azure Synapse, Azure SQL, ADLS etc.
Strong experience with big data tools(Microsoft Fabric, Databricks , Spark etc..) and programming skills in PySpark and Spark SQL
Be an independent self-learner with a let s get this done approach and ability to work in Fast paced and Dynamic environment
Knowledge in Microsoft Fabric Data Platform
Expertise in designing application solution on Azure Data Platform for complex business needs
Serves as key technical expert engaged on designing, architecting, deploying and maintaining cloud solutions, Data Management & Analytics

Job Responsibility

Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function
Align with the Product Owner and Scrum Master in assessing business needs and transforming them into scalable applications
Build and maintain code to manage data received from heterogenous data formats including web- based sources, internal/external databases, flat files, heterogenous data formats (binary, ASCII)
Help build new enterprise Datawarehouse and maintain the existing one
Design and support effective storage and retrieval of very large internal and external data set and be forward think about the convergence strategy with our Azure cloud migration
Assess the impact of scaling up and scaling out and ensure sustained data management and data delivery performance

Fulltime

Senior Data Engineer with Databricks

At KMD, we build digital solutions used by millions of people around the world. ...

Location

Poland , Warsaw

Salary:

160.00 - 180.00 PLN / Hour

KMD Poland

Expiration Date

Until further notice

Requirements

5+ years of commercial experience in implementing, developing, or maintaining data load systems (ETL/ELT)
Strong programming skills in Python, with a deep understanding of data-related challenges
Hands-on experience with Apache Spark and Databricks
Familiar with MSSQL databases
Experience working with distributed systems on a cloud platform
Worked on large-scale systems and understands performance optimization
Comfortable with Git and CI/CD practices, and can design or implement deployment processes for data pipelines
Proactive, solution-oriented, and has a strong can-do attitude
Communicates fluently in English and Polish, both written and spoken
Team player with excellent collaboration and communication skills

Job Responsibility

Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python
Have end-to-end responsibility for the full lifecycle of features you develop
Design technical solutions for business requirements from the product roadmap
Ensure optimal performance
Refactor existing code and enhance system architecture to improve maintainability and scalability
Design and evolve the test automation strategy, including technology stack and solution architecture
Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development

What we offer

KMD (an NEC company) is committed to providing equal opportunities. Hence, we invite all qualified interested applicants to apply for career opportunities. At KMD all aspects of employment and cooperation including the decision to hire/cooperate with will be based on merit, competence, performance, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other status protected under local anti-discrimination legislation

Senior Data Engineer with Data Bricks

About the Role: Senior Data Engineer with Data Bricks position at Cigres Technol...

Location

India , Bengaluru

Salary:

Not provided

Cigres

Expiration Date

Until further notice

Requirements

Proficiency in Databricks and experience with Spark for big data processing
Strong experience with Power BI, particularly in building reports and dashboards using DAX
Solid programming skills in Python or Scala for developing data pipelines
Knowledge of SQL and experience with relational databases and data warehousing concepts
Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing
Understanding of data modeling, ETL processes, and data integration methodologies
Excellent problem-solving skills and attention to detail
Strong communication and collaboration abilities to work effectively in a team-oriented environment
Experience: 5 to 9 Years

Job Responsibility

Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes
Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders
Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives
Optimize data storage and retrieval processes to enhance performance and reduce latency
Ensure data quality and integrity by implementing best practices for data governance and validation
Mentor junior data engineers and contribute to knowledge sharing within the team
Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs

Fulltime

Senior Data Engineer (Azure)

Location

India , Bangalore

Salary:

Not provided

Mercedes-Benz AG

Expiration Date

Until further notice

Requirements

6 to 9 years of professional experience in data engineering or related roles
Proven hands-on experience with Azure Databricks and cloud-based data pipeline development
Strong knowledge of ETL/ELT tools and processes, preferably within Azure ecosystems
Expertise in data modeling (star/snowflake schema, normalization, dimensional modeling)
Advanced programming skills in PySpark, Python, and SQL
Experience working with Azure SQL Data Warehouse, Azure Synapse, and Azure Data Factory
Understanding of data governance, data quality, and security best practices
Familiarity with Power BI for report and dashboard development (preferred)
Excellent analytical, problem-solving, and communication skills
Ability to work independently and in cross-functional teams in agile environments

Job Responsibility

Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL processes on Azure cloud platform
Build and optimize data workflows using Azure Data Factory, Databricks, Azure Synapse Analytics, and related tools
Implement data ingestion from multiple sources (databases, APIs, event streams) ensuring data quality and integrity
Collaborate with cross-functional teams to understand data requirements and deliver timely solutions
Develop and maintain data models and data warehouse solutions optimized for performance and scalability
Monitor and troubleshoot data pipeline failures, ensuring high availability and reliability
Ensure data security, compliance, and governance in line with organizational policies

What we offer

Mitarbeiterrabatte möglich
Gesundheitsmaßnahmen
Mitarbeiterhandy möglich
Essenszulagen
Betriebliche Altersversorgung
Hybrides Arbeiten möglich
Mobilitätsangebote
Mitarbeiter Events
Coaching
Flexible Arbeitszeit möglich

Fulltime

New