CrawlJobs Logo
AnaVation Logo AnaVation · IT - Software Development

Data Engineer SME

United States, Chantilly · Job Posted December 06, 2025
Apply Position
Job Link Share

Job Description

AnaVation is seeking a highly skilled Senior-level Data Engineer to join our team deliver engineering tasks to advanced analytic applications across classified environments. You will develop sophisticated data pipelines and ETL processes for desktop and web-based analytic software, facilitate the bulk analysis of relational information, and enable applications that deliver data from diverse data sources.

Job Responsibility

  • Design and implement complex data pipelines and ETL processes to support cyber investigative capabilities across multi-classification domains
  • Architect and develop ETL workflows for highly sensitive data in classified environments
  • Support IC Data Services requirements by integrating various intelligence data sources and systems
  • Develop and maintain data analytics solutions for desktop and web-based visual analytic applications
  • Establish applications that produce manageable, actionable intelligence from streams of structured and semi-structured data
  • Design strategies for enterprise database systems and set standards for operations, programming, and security
  • Construct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)
  • Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availability
  • Design and manage Elasticsearch/Opensearch clusters for fast search, indexing, and retrieval of large-scale datasets
  • Integrate new systems with existing warehouse structures and refine system performance and functionality
  • Implement CI/CD pipelines for data systems, automate monitoring/alerting, and enforce infrastructure-as-code practices
  • Provide technical leadership and mentorship to other team members
  • Participate in Program Increments (PIs) and Agile Release Train (ART) activities

Requirements

  • Bachelor's degree in Computer Science, Data Science, Engineering, or related field
  • Minimum of 10 years of experience in data engineering or related field
  • Active Top Secret (TS) clearance with eligibility for Sensitive Compartmented Information (SCI)
  • Experience with SAFe Agile framework
  • Strong understanding of forensic and investigative data requirements
  • Demonstrated experience designing and implementing data solutions in secure government environments
  • Advanced proficiency with Python for data processing, automation and ETL workflow orchestration
  • SQL (MySQL, PostgreSQL, Microsoft SQL) and query optimization
  • Elasticsearch or Opensearch (design, scaling, query optimization, cluster management)
  • Data pipeline technologies (Apache Nifi, Cribl)
  • Cross-domain ETL solutions for secure data transfer between classification levels
  • Containerization and orchestration technologies (Docker, Kubernetes)
  • Cloud platforms (AWS GovCloud, SC2S, C2S)
  • Experience handling data in accordance with IC security protocols and classification guidelines
  • IC Data Services frameworks and integration protocols
  • GraphQL: schema design, API development, query optimization, and integrations
  • DevSecOps practices and tools in classified environments
  • RabbitMQ and Redis
  • Must be a U.S. citizen and able to pass a background check and polygraph examination

Nice to have

  • Experience with Intelligence Community Data Services and standards
  • Prior work with cross-domain solutions for ETL processes
  • Knowledge of IC specific data formats, schemas and transfer protocols
  • Experience with specialized IC analytics platforms and data repositories
  • Prior work integrating intelligence data across multiple enclaves
  • Cloud certification

What we offer

  • Generous cost sharing for medical insurance for the employee and dependents
  • 100% company paid dental insurance for employees and dependents
  • 100% company paid long-term and short term disability insurance
  • 100% company paid vision insurance for employees and dependents
  • 401k plan with generous match and 100% immediate vesting
  • Competitive Pay
  • Generous paid leave and holiday package
  • Tuition and training reimbursement
  • Life and AD&D Insurance
AnaVation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer SME

8 matching positions

Data Engineer - Big Data, Python, Databricks

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4 - 6 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Proficient in Big DataTechnologies - Cloudera, Hive, Python, Java/PySpark, Data Bricks
  • Proficient in Data analysis and data modelling
  • Good understanding of ETL concepts
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Data Engineer (Big Data, Python, Databricks) - Assistant Vice President

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai, Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant handson experience in Big Data technologies like Cloudera, Python, HQL, Java/PySpark
  • Knowledge on Machine Learning, AI would be added advantage
  • Experience in systems analysis, data analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Data Engineer Big Data Technology

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-6 years of hands-on experience in Hadoop, Scala, Java, Spark, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks
  • 4+ years of experience with relational SQL and NoSQL databases: Oracle, MongoDB, HBase
  • Strong proficiency in Python and Spark Java with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc) and Scala and SQL
  • Data Integration, Migration & Large Scale ETL experience (Common ETL platforms such as PySpark/DataStage/)
  • 4-6 years of relevant experience in the Financial Service industry
  • Experienced in working with large and multiple datasets and data warehouses
  • Experience building and optimizing ‘big data’ data pipelines, architectures, and datasets
  • Strong analytic skills and experience working with unstructured datasets
  • Ability to effectively use complex analytical, interpretive, and problem-solving techniques
  • Experience with Confluent Kafka, Redhat JBPM, CI/CD build pipelines and toolchain – Git, BitBucket, Jira
Job Responsibility
Job Responsibility
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

SAOC Cybersecurity Test Engineer - SME

Astrion has an exciting opportunity for a SME Test Engineer for the 96th Cyber T...
Location
Location
United States , Bedford / Hanscom AFB
Salary
Salary:
Not provided
astrion.us Logo
Astrion
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Relevant technical Master's Degree and at least 10 years of relevant experience
  • Active US Secret Clearance with the ability to obtain a Top-Secret clearance
  • Significant understanding of Cybersecurity Test and Evaluation guidelines and practices at the DOD or Service level
  • Significant understanding of DOD acquisition and test and evaluation methodologies, processes, and activities
  • Experience developing and reviewing Test and Evaluation Master Plans, Test and Evaluation Strategies, Test Plans, and Test Procedures
Job Responsibility
Job Responsibility
  • Provide strategic test support and guidance to the integrated product teams
  • Participate in test planning, test execution, data collection, data analysis, assessing systems effectiveness, and test reporting
  • Provide guidance and support the development of test-related documentation (i.e. test plans, test procedures, Test and Evaluation Master Plans, Test Strategies, etc.) for technical rigor
  • Perform research on current cyber threats, assess systems vulnerabilities, and identify risk areas to support cybersecurity test planning
  • Participate in product development demonstrations executed by the development contractor and government organization throughout the acquisition lifecycle
  • Support the development and coordination of cybersecurity documentation to include system requirements, cybersecurity strategy, statement of work, Clinger-Cohen certification, and system authorization
  • Review system performance requirements for testability and measurability, develop test objectives, develop test methods and detailed test procedures, develop specification data requirements, identify instrumentation and test support equipment requirements, coordinate with test support agencies and ranges, and other DT&E tasks
  • Facilitate Mission Based Cyber Risk Assessments (MBCRAs) including Cyber Table Tops (CTTs) and Mission-based Risk Assessment Process for Cyber (MRAP-Cs)
  • Create cybersecurity test strategies, identify test resources, and track risk factors to facilitate program acquisition strategies
  • Support the development of overarching program test plans and roadmaps, to include the identification of risks (both technical and schedule), test resources, and schedules
What we offer
What we offer
  • Competitive salaries
  • Continuing education assistance
  • Professional development
  • Multiple healthcare benefits package options
  • 401K with employer matching
  • Competitive time off policy along with a federally recognized holiday schedule
  • Fulltime
Read More
Arrow Right

Senior AI & Data Engineer

The Senior AI & Data Engineer is an individual contributor role that acts as the...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Science, AI/ML, Engineering, Mathematics, or a related technical discipline
  • PhD is a plus
  • 7 – 10 years of hands-on experience in AI/ML engineering, applied data science, or LLM engineering roles
  • Proven track record of delivering production AI systems
  • Deep expertise with at least two major LLM platforms (Claude, GPT, Gemini, or equivalent)
  • Significant experience with Collibra or an equivalent enterprise data governance platform
  • Demonstrated experience leading cross-functional AI initiatives and mentoring junior engineers
  • Strong ML fundamentals alongside modern generative AI skills
  • Experience with responsible AI practices, including fairness auditing, explainability, and content safety, is strongly preferred
Job Responsibility
Job Responsibility
  • Serve as the dual AI & data SME for the team and organization
  • Define and uphold engineering standards, design patterns, and best practices across both AI and data engineering disciplines
  • Lead technical discovery for new AI and data use cases
  • Participate in and lead cross-functional initiatives where AI and data strategy intersect
  • Mentor and upskill the Applied AI Engineer and AI Data Engineer
  • Architect and deliver complex agentic AI systems
  • Design and implement advanced RAG architectures
  • Lead LLM evaluation frameworks
  • Assess and implement LLM fine-tuning and alignment strategies
  • Own LLM integration architecture
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
Read More
Arrow Right

Data Engineer (Bigdata/Databricks)

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-8 years of total experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Job Responsibility
Job Responsibility
  • Strong knowledge in Bigdata or Databricks ecosystem
  • Excellent Programming Language expertise in Spark, Scala, Python, Hive, Iceberg
  • Must have good understanding of CI/CD Pipeline and SDLC cycle & Agile model
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Fulltime
Read More
Arrow Right

Pyspark Data Engineer

The Pyspark Data Engineer is responsible for participation in the establishment ...
Location
Location
Canada , Mississauga
Salary
Salary:
79320.00 - 110680.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-5 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka
  • Proficiency in Python programming
  • Expertise in data processing frameworks such as Apache Spark, Hadoop
  • Expertise in Data Lakehouse technologies (Apache Iceberg, Trino, Deltalake)
  • Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.)
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Datalink Test Engineer - SME

Astrion has an exciting opportunity for a SME Datalink Test Engineer located at ...
Location
Location
United States , Eglin Air Force Base
Salary
Salary:
Not provided
astrion.us Logo
Astrion
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Recognized as a leading datalink and testing authority in the community of interest. Typically seen for this level is a Master’s Degree in a technical field and a minimum of 10 years of technical experience
  • Must be a U.S. citizen and possess or be eligible to obtain a Secret clearance. Interim Secret clearance required prior to starting employment
  • Relevant engineering (electrical, mechanical, aerospace or systems) and/or technical experience in areas related to TDL, data link radios, radio frequency waves and propagation, and computer networking
  • Ability to participate on a test team to meet exercise, demonstration, or test requirements
  • Ability to execute test scripts, run test procedures, develop block diagrams, and collect data for post-test analysis and reporting
  • Strong work ethic
  • Comfortable working in a team environment with minimal supervision
  • Ability to communicate and present technical details both written and verbally
  • Experience developing and authoring documents such as briefings, plans, reports, executive summaries, white papers, and staff actions
  • Proficiency with the Microsoft Suite of Office applications
Job Responsibility
Job Responsibility
  • Design, coordinate, document, and brief test equipment architectures required to meet information exchange requirements (voice and data communications) specific to assigned program operations
  • Advise the government in decision making relevant to lead command responsibilities and to assigned capabilities and/or programs
  • Assist program offices in developing technical requirements associated with supported capabilities and/or programs and translating user operational requirements statements into the appropriate requirements format(s)
  • Author, review and edit program documentation, including test plans, concept of operations, test cards, data-analysis plans, and formal reports
  • Coordinate test resources with Major Range and Test Facility Base (MRTFB) program managers for use of and support to program testing activities
  • Maintain a comprehensive schedule of program activities, including support requirements and personnel utilization
  • Develop and maintain a comprehensive library and/or continuity database used to capture all lessons learned, planning, execution, and reporting documentation relative to program involvement
  • Develop and present briefings to test community, program office and senior-level personnel on program activities
  • Utilize software tools to conduct in-depth data reduction and analysis which will be used to inform leadership of program activities pursuant to established objectives and technical performance criteria
  • Travel to various sites to participate in planning, execution, data analysis, report generation, etc., of program-related activities
What we offer
What we offer
  • Competitive salaries
  • Continuing education assistance
  • Professional development
  • Multiple healthcare benefits package options
  • 401K with employer matching
  • Competitive time off policy along with a federally recognized holiday schedule
  • Fulltime
Read More
Arrow Right