This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
The Software Development Advisor role at NTT DATA involves designing and optimizing large-scale data processing solutions on Azure. The ideal candidate will have strong expertise in Databricks, PySpark, Azure Data Factory, Delta Lake, and modern data engineering practices.
Job Responsibility:
Develop and maintain ETL/ELT pipelines using Azure Databricks (PySpark/Scala)
Build scalable data processing workflows for batch and streaming data
Work with Azure Data Lake, Delta Lake, and other Azure storage services
Integrate Databricks with Azure Data Factory, Azure Synapse, Azure SQL, and other Azure services
Optimize Spark jobs for performance, cost efficiency, and reliability
Implement data quality checks, validation rules, and monitoring
Collaborate with data architects, analysts, and business teams to understand requirements
Ensure adherence to data governance, security, and compliance standards
Troubleshoot production issues and support ongoing operations
Requirements:
3–8+ years of experience in Data Engineering
Strong hands-on experience with Azure Databricks
Proficiency in PySpark (preferred) or Scala
Experience with Azure Data Factory (ADF) pipelines and orchestration
Strong understanding of Delta Lake, ACID transactions, and data versioning
Experience with Azure Data Lake Storage (ADLS)
Good knowledge of SQL and performance tuning
Familiarity with CI/CD pipelines (Azure DevOps/Git)
Experience with data modeling, data warehousing concepts, and ETL frameworks
Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field
Nice to have:
Experience with Azure Synapse Analytics
Knowledge of MLflow, Databricks notebooks, and job clusters
Exposure to streaming technologies (Structured Streaming, Kafka)
Understanding of DevOps, Infrastructure-as-Code, and automation