This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are building an innovative solution, KMD Elements, on Microsoft Azure cloud dedicated to the energy distribution market (electrical energy, gas, water, utility, and similar types of business). Our customers include institutions and companies operating in the energy market as transmission service operators, market regulators, distribution service operators, energy trading, and retail companies. KMD Elements delivers components allowing implementation of the full lifecycle of a customer on the energy market: meter data processing, connection to the network, physical network management, change of operator, full billing process support, payment, and debt management, customer communication, and finishing on customer account termination and network disconnection.
Job Responsibility:
Develop and maintain the leading IT solution for the energy market using Apache Spark, Databricks, Delta Lake, and Apache Kafka
Have end-to-end responsibility for the full lifecycle of features you develop
Design technical solutions for business requirements from the product roadmap
Maintain alignment with architectural principles defined on the project and organizational level
Ensure optimal performance through continuous monitoring and code optimization.
Refactor existing code and enhance system architecture to improve maintainability and scalability.
Design and evolve the test automation strategy, including technology stack and solution architecture.
Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development.
Requirements:
Have 4+ years of Apache Spark experience and have faced various data engineering challenges in batch or streaming
Have an interest in stream processing with Apache Spark Structured Streaming on top of Apache Kafka
Have experience leading technical solution designs
Have experience with distributed systems on a cloud platform
Have experience with large-scale systems in a microservice architecture
Are familiar with Git and CI/CD practices and can design or implement the deployment process for your data pipelines
Possess a proactive approach and can-do attitude
Are excellent in English and Polish, both written and spoken
Have a higher education in computer science or a related field
Are a team player with strong communication skills
Nice to have:
Apache Spark Structured Streaming
Azure
Domain Driven Development
Docker containers and Kubernetes
Message brokers (i.e. Kafka) and event-driven architecture
Agile/Scrum
What we offer:
Flexible — this role supports on-site, hybrid, and remote arrangements, depending on your individual preferences.
Occasional on-site presence may be required — for example, onboard new team members, explore new business domains, or refine requirements in close collaboration with stakeholders or team building activities.