CrawlJobs Logo

Data Engineer - Security

India, Karnātaka Employment contract · Job Posted May 15, 2026
Apply Position
Job Link Share

Job Description

We are currently seeking a Data Engineer - Security (without Kafka Experience) to join our team in Remote, Karnātaka (IN-KA), India (IN).

Requirements

  • API-first data ingestion. Strong hands-on pulling data from REST/GraphQL APIs with auth (OAuth2, API keys), pagination, rate limits, retries/backoff, and webhooks
  • strong Python skills to normalize/enrich data and land it cleanly into S3 (schema, partitioning, Parquet)
  • AWS data lake, end to end. Comfortable building/operating S3-based lakes with layered zones (raw → harmonized → conformed → modeled), Glue Data Catalog, IAM/Secrets Manager, VPC endpoints, encryption, lifecycle/versioning, and cost/perf best practices (file sizing, compaction)
  • AWS Glue + PySpark expert. Designs and optimizes Glue jobs using PySpark/DynamicFrames, bookmarks for incremental loads, dependency packaging, robust error handling, logging/metrics, and unit tests
  • knows how to tune jobs for scale and cost
  • Airflow orchestration. Writes clean, parameterized, idempotent DAGs (sensors, SLAs, retries, alerts), manages dependencies across pipelines, and uses Git-based CI/CD to promote changes safely
  • Snowflake proficiency. Builds ELT models (staging/ODS/marts), tunes performance (warehouse sizing, clustering, micro-partitions, caching), uses Streams/Tasks/Snowpipe for CDC

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer - Security

8 matching positions

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right
New

Senior Data Security Engineer

I’m working directly with the CISO of a global organisation at the forefront of ...
Location
Location
Switzerland , Geneva
Salary
Salary:
Not provided
thisisiceberg.com Logo
Iceberg Cyber Security
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Data Loss Prevention (DLP) technologies in enterprise environments
  • Strong experience with Microsoft Purview, including DLP, Information Protection and Sensitivity Labels
  • Experience implementing data classification, labelling and information protection frameworks
  • Experience securing Microsoft 365 and Azure environments
  • Experience investigating data leakage incidents and security events
  • Experience configuring, tuning and improving DLP controls and policies
  • Ability to translate business and regulatory requirements into practical technical controls
  • Strong understanding of data governance, access controls and information security principles
Job Responsibility
Job Responsibility
  • Take ownership of key data protection capabilities across the organisation, helping ensure sensitive information is identified, classified, protected and monitored throughout its lifecycle
  • Work closely with technical and business stakeholders to design, implement and continuously improve controls that reduce risk while enabling the business to operate effectively
  • Implement and optimise controls across Microsoft 365, Azure, endpoints, email and cloud platforms
  • Support investigations, improve detection capabilities and enhance the overall maturity of the organisation’s data protection programme
Read More
Arrow Right

Principal Automation Engineer (Data Security & Identity)

The Cortex Cloud Data Security Posture Management (DSPM) product is responsible ...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
paloaltonetworks.it Logo
Palo Alto Networks Italia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience QA automation developer
  • Experience in one of the following languages – Python (Must)
  • Experience with API testing
  • Experience with cloud–native technologies like DB, Bucket, SQL, GSUITE (SaaS products)
  • Experience with designing, developing, and implementing test/applicative frameworks from scratch
  • Deeply passionate about product quality with a mindset focused on continuous improvement
  • Experience with Gitlab/Jenkins (Advantage)
Job Responsibility
Job Responsibility
  • Create detailed and well–structured test plans based on requirements and features crew meetings
  • Design and writing the infrastructure for regression / progression tests
  • Develop and execute efficient and stable automated tests
  • Identifying, reporting, documenting and tracking defect/bug issues
  • Work closely with our engineering teams to understand business requirements
  • Excellent verbal and written communication skills
  • Strong focus on customer satisfaction
Read More
Arrow Right

Security Data Engineer

We are looking for a Security Data Engineer to join our team in Costa Mesa, Cali...
Location
Location
United States , Costa Mesa
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience building and supporting data pipelines in a data lake or large-scale data engineering environment
  • Strong programming skills in Python and hands-on experience with Apache Spark, Apache Hadoop, Apache Kafka, and ETL development
  • Practical knowledge of Amazon Web Services (AWS) and infrastructure automation tools such as AWS CDK and Infrastructure as Code frameworks
  • Experience maintaining pipeline reliability, troubleshooting ingestion issues, and improving operational stability in production environments
  • Ability to work directly with internal stakeholders to locate source data, obtain access, and move integrations forward
  • Familiarity with data analysis and data cleaning techniques that improve downstream usability and trust in datasets
  • Exposure to CI/CD practices and deployment automation for data engineering workflows
  • Additional programming experience in Rust or Go is preferred
Job Responsibility
Job Responsibility
  • Take ownership of the data ingestion layer for an existing data lake, ensuring steady performance and dependable delivery of incoming datasets
  • Reduce a defined backlog of pipeline work during the first 90 days by building and activating prioritized ingestion workflows
  • Assume responsibility for pipeline components transitioned from the lead engineer and continue their operational support without disrupting established foundations
  • Support and improve current ETL processes by monitoring health, resolving failures, and extending coverage where needed
  • Integrate new source systems, including platforms such as Rippling and Workday, into the broader data ecosystem
  • Coordinate with internal application and system owners to identify data sources, secure appropriate access, and obtain logs or source records required for ingestion
  • Apply data cleaning and analysis practices to improve data quality and maintain consistency across inbound datasets
  • Contribute to infrastructure and deployment workflows using AWS, AWS CDK, Infrastructure as Code, and CI/CD practices to support scalable pipeline operations
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Eligibility to enroll in company 401(k) plan
  • Free online training
Read More
Arrow Right

Data Security Engineer

Whitehall Resources currently require an experienced Data Security Engineer to w...
Location
Location
United Kingdom , Warwick
Salary
Salary:
Not provided
whitehallresources.com Logo
Whitehall Resources Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in Cybersecurity, Computer Science, or related field
  • Experience in data protection, encryption, and security frameworks
  • Proficiency in firewalls, SIEM tools, and intrusion detection systems
  • Certifications such as CISSP, CISM, or CEH preferred
  • Strong analytical, problem-solving, and communication skills.
Job Responsibility
Job Responsibility
  • Develop and implement data security policies to protect sensitive information
  • Conduct risk assessments and vulnerability testing to identify security gaps
  • Design and maintain encryption, access control, and authentication systems
  • Monitor network activity for potential security breaches and respond to incidents
  • Collaborate with IT teams to integrate security solutions into infrastructure
  • Ensure compliance with industry regulations such as GDPR, HIPAA, and ISO 27001
  • Stay updated on emerging cybersecurity threats and best practices.
Read More
Arrow Right

Lead Data Security Engineer

Our client is seeking a Lead Data Security Engineer to drive enterprise-wide dat...
Location
Location
United States , Johns Creek
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-6+ years of experience in data security or information security roles
  • Strong hands-on experience with Microsoft Purview, including DLP, data labeling, and eDiscovery
  • Deep experience with CASB solutions (Zscaler preferred)
  • Strong understanding of the data governance lifecycle
  • Experience with DLP platforms, data classification tools, and threat hunting tools
  • Knowledge of encryption and key management practices
  • Experience securing cloud platforms and hybrid environments
  • Proven ability to lead enterprise security initiatives and investigations
Job Responsibility
Job Responsibility
  • Lead enterprise data protection initiatives, including DLP and CASB strategy design and implementation
  • Architect data discovery, classification, labeling, and protection programs across cloud and on-prem environments
  • Lead DLP investigations and remediation efforts related to data loss and exfiltration risks
  • Support compliance initiatives and regulatory requirements
  • Integrate data protection telemetry into detection and monitoring platforms
  • Drive threat hunting efforts focused on data exfiltration and misuse
  • Evaluate and recommend security tools and vendors
  • Provide technical leadership and mentorship to security team members
  • Partner with cross-functional teams and executive stakeholders
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Principal Security Data Engineer

Partner with Cybersecurity leaders, risk stakeholders, and non-Cyber teams to de...
Location
Location
United States , Springfield; New York City
Salary
Salary:
Not provided
tier4group.com Logo
Tier4 Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor s degree in a relevant field (e.g., Computer Science, Data Engineering, Analytics, Information Security, or equivalent experience)
  • 8+ years of experience working in Cybersecurity, risk, or technology domains, with deep hands-on experience in data engineering, analytics, or data architecture
  • Demonstrated experience designing and building data pipelines, data models, and analytics architectures, including batch and/or streaming patterns
  • Practical experience partnering with or working on modern data platforms and tools such as Databricks, Redshift, Snowflake, Alteryx, or equivalent technologies
  • Working knowledge of Cybersecurity domains, including data privacy, data protection, and core security concepts (e.g., vulnerabilities, threats, controls, risk)
  • Strong coding proficiency (e.g., Python, SQL) with the ability to assess multiple data sources and determine feasibility, data gaps, and engineering approaches to support Cyber use cases
  • Experience collaborating closely with data engineering, platform, and architecture teams to ensure long-term operability and support
Job Responsibility
Job Responsibility
  • Partner with Cybersecurity leaders, risk stakeholders, and non-Cyber teams to define and deliver data-driven Cyber use cases, aligned to enterprise risk priorities and frameworks (e.g., NIST CSF)
  • Leverage scalable data pipelines, models, and architectures that enable Cyber analytics, AI, reporting, and advanced use cases across vulnerability management, threat exposure, control effectiveness, and risk insights
  • Work directly with data owners and platform teams to ingest, transform, normalize, and model security and IT datasets, ensuring data quality, lineage, and trust
  • Develop and operationalize analytics products including executive dashboards, strategic metrics, and operational reporting for leadership, governance forums, and front-line Cyber teams
  • Prototype and productionize integrations across Cyber tools and enterprise data platforms, partnering closely with data engineering and architecture teams to ensure sustainability, performance, and supportability
  • Apply advanced analytics, data modeling, and automation techniques to translate raw Cyber telemetry into actionable outcomes, risk indicators, and decision support
  • Leverage AI-assisted development and analytics workflows (e.g., Claude, code-generation tools, AI-augmented analysis) to accelerate engineering, insight generation, and experimentation while operating within established security and data governance controls
  • Translate complex technical findings into clear, consumable narratives for executive and non-technical stakeholders, connecting analytics outputs directly to Cyber risk, business impact, and outcomes
  • Serve as a thought partner and technical advisor, helping shape the Cyber data strategy, architecture direction, and future-state analytics capabilities
Read More
Arrow Right

Data Engineer - Security (Kafka Experience)

The Data Engineer - Security role focuses on designing and operating large-scale...
Location
Location
India , Remote
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Kafka-Strong expertise in Kafka (4-5 years), with hands-on experience designing and operating large-scale, highly available event-streaming platforms, including partitioning strategies, consumer group optimization, schema management, and performance tuning
  • API-first data ingestion. Strong hands-on pulling data from REST/GraphQL APIs with auth (OAuth2, API keys), pagination, rate limits, retries/backoff, and webhooks
  • strong Python skills to normalize/enrich data and land it cleanly into S3 (schema, partitioning, Parquet)
  • AWS data lake, end to end. Comfortable building/operating S3-based lakes with layered zones (raw → harmonized → conformed → modeled), Glue Data Catalog, IAM/Secrets Manager, VPC endpoints, encryption, lifecycle/versioning, and cost/perf best practices (file sizing, compaction)
  • AWS Glue + PySpark expert. Designs and optimizes Glue jobs using PySpark/DynamicFrames, bookmarks for incremental loads, dependency packaging, robust error handling, logging/metrics, and unit tests
  • knows how to tune jobs for scale and cost
  • Airflow orchestration. Writes clean, parameterized, idempotent DAGs (sensors, SLAs, retries, alerts), manages dependencies across pipelines, and uses Git-based CI/CD to promote changes safely
  • Snowflake proficiency. Builds ELT models (staging/ODS/marts), tunes performance (warehouse sizing, clustering, micro-partitions, caching), uses Streams/Tasks/Snowpipe for CDC, and follows solid RBAC and data governance practices
Job Responsibility
Job Responsibility
  • Designing and operating large-scale event-streaming platforms using Kafka
  • API-first data ingestion
  • Building/operating S3-based lakes
  • Designing and optimizing Glue jobs using PySpark/DynamicFrames
  • Writing clean, parameterized, idempotent DAGs
  • Building ELT models in Snowflake
  • Fulltime
Read More
Arrow Right