CrawlJobs Logo

Software Developer / Data Engineer

United States, Huntsville Employment contract · Job Posted May 03, 2026
Apply Position
Job Link Share

Job Responsibility

  • Design and implement scalable data pipelines and data architectures
  • Develop and optimize data storage solutions (SQL, NoSQL, graph databases)
  • Support ETL processes and ensure efficient data throughput and performance
  • Work closely with stakeholders to translate data requirements into technical solutions
  • Maintain and enhance data infrastructure using tools like Apache Airflow and Docker

Requirements

  • 2+ years of experience in data engineering, software development, or machine learning
  • Strong Python development skills and experience with data pipelines
  • Experience with tools such as Apache Airflow, Linux, Docker, Git
  • Familiarity with SQL, NoSQL, ORMs, and distributed data systems
  • Experience working in Agile environments
  • Bachelor’s degree in a related field
  • Active or eligible for TS/SCI clearance (U.S. must be eligible to work in the U.S. required)

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Developer / Data Engineer

8 matching positions

Software Engineer / Senior Software Engineer - Data Engineering GitHub

As a Software Engineer at GitHub, you will enhance the collaboration experience ...
Location
Location
Czech Republic , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND experience in Data Engineering and coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust, or Python OR equivalent experience.
  • Master's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR Bachelor's Degree in Computer Science or related technical field AND engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Go, Ruby, Rust or Python OR equivalent experience.
Job Responsibility
Job Responsibility
  • Design, develop, test and ship high-quality technical solutions that scale across multiple GitHub services.
  • Collaborate with cross-functional teams to define and implement innovative solutions.
  • Provide technical leadership, mentorship, pairing opportunities, and code reviews to encourage the growth of others.
  • Own and advocate for the health and quality of the systems that the team builds, including participating in on-call and first responder rotations
  • Write architecture briefs and proposals, carry out code experiments, and build prototypes to learn how we can achieve planetary scale with our systems.
  • Design and implement APIs to facilitate seamless integration between software components.
  • Utilize CI/CD tools to set up automated pipelines for continuous integration and delivery.
  • Become intimately familiar with the systems you build and take pride in writing maintainable code.
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Software Developer / Data Engineer in Proteomics

The Chair of Proteomics and Bioanalytics at the Technical University of Munich l...
Location
Location
Germany , Freising
Salary
Salary:
Not provided
jobrxiv.org Logo
jobRxiv
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MSc or PhD in Computer Science, Bioinformatics, Computational Biology, or a related quantitative field
  • Solid experience in programming and system architecture design (e.g., Python), workflow management tools (e.g., Nextflow) and containerization (e.g., Docker)
  • Strong knowledge of relational database systems and schema design (e.g., MySQL), and web-development (e.g., Vue.js) including data visualization frameworks (e.g., D3.js)
  • Excellent collaborative skills
  • ability to work in multidisciplinary teams
Job Responsibility
Job Responsibility
  • Develop and maintain scalable data-processing pipelines for mass spectrometry-based phosphoproteomics and related omics data
  • Design, build, and document database systems and interfaces for managing, visualizing, and mining complex multi-omics datasets
  • Integrate quantification, annotation, and pathway information with genomic and transcriptomic data relevant to cancer signaling and drug response
  • Collaborate closely with proteomics experts, cancer biologists, and clinicians to transform experimental data into biologically and clinically meaningful insights
  • Implement data quality control, and reproducibility workflows in accordance with regulatory requirements
  • Contribute to the development of APIs, web tools, and dashboards for internal users and collaborators
What we offer
What we offer
  • Join an interdisciplinary team of biochemists, cell biologists, bioinformaticians, and clinicians that uses the latest proteomic approaches to fight cancer
  • The Technical University of Munich is one of the best academic institutions in the world, and offers a stimulating work environment and excellent future perspectives
  • The position is initially available for two years but may be extended
  • The salary follows the TVL scale
  • Fulltime
Read More
Arrow Right

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...
Location
Location
United States , Southlake, TX or Austin, TX
Salary
Salary:
55.92 - 62.13 USD / Hour
aquent.com Logo
Aquent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
  • 8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
  • Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
  • Proficiency in Python and SQL for data processing and automation
  • Extensive experience with ETL processes and data pipeline design
  • Excellent problem-solving skills and meticulous attention to detail
  • Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
  • Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
  • Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
  • Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
  • Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
  • Implement and uphold best practices for data quality, data governance, and data security
  • Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
  • Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
  • Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
  • Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
  • Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity
What we offer
What we offer
  • subsidized health, vision, and dental plans
  • paid sick leave
  • retirement plans with a match
Read More
Arrow Right

Software Engineer III (Data Engineer)

We are seeking a motivated and detail-oriented Data Engineer to join our data en...
Location
Location
United States , Irvine
Salary
Salary:
96500.00 - 138061.00 USD / Year
haeaus.com Logo
Hyundai AutoEver America
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, or related field
  • 10+ years of experience in data warehouse and MDM applications
  • Extensive knowledge of SQL and relational databases
  • Strong programming skills in Python and PL/SQL
  • 10+ years of experience working with Informatica
  • Knowledge of Informatica IDMC and PowerCenter is a must
  • Knowledge of big data technologies such as Apache Spark, Hadoop, or equivalent cloud-based services
  • Strong understanding of data governance, security, and quality practices in cloud environments
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines and ETL processes to transform and integrate data from multiple sources
  • Develop workflow automation using Apache Airflow and manage production batches with performance tuning
  • Create and optimize data models, schemas, and database structures for scalability and efficiency
  • Implement best practices in data warehouse and MDM applications, ensuring data governance, security, and quality
  • Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions
  • Develop scripts and automation tools to streamline data processing and pipeline operations
  • Implement automated monitoring, alerting systems, and maintain documentation for pipelines and data models
  • Create reports and visualizations to communicate pipeline performance and data insights
What we offer
What we offer
  • comprehensive medical/dental coverage
  • generous PTO
  • education assistance
  • annual merit increase eligibility
  • Fulltime
Read More
Arrow Right

Senior Software Engineer / Principal Software Engineer - Copilot CLI

Within GitHub and Microsoft CoreAI, the Copilot CLI team builds GitHub's coding ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Job Responsibility
Job Responsibility
  • Take ownership of critical product and platform areas of the Copilot CLI and shared agent runtime
  • Set a high technical and quality bar for agentic systems and developer-facing tooling
  • Design and ship performant, reliable terminal experiences that developers depend on for daily work
  • Use data, benchmarks, and direct user feedback to guide iteration and investment
  • Collaborate across org boundaries to enable other teams to build agentic products on top of a shared foundation
  • Influence architecture, technical direction, and engineering standards beyond your immediate team
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation
  • Fulltime
Read More
Arrow Right

Software Engineer / Lead Software Engineer – Border Protection (Firewall) Technologies

The Border Protection Product Team within the Information Security-Network Secur...
Location
Location
United States , Richardson
Salary
Salary:
97000.00 - 150000.00 USD / Year
State Farm
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Java / Spring: 2–4 years of experience developing enterprise web applications using Java and Spring Framework (with a heavy emphasis on Spring Tool Suite).
  • Database Technologies: 2–4 years of experience working with PostgreSQL or DB2.
  • Application Server: 2–4 years of experience with Apache Tomcat as a web server/application deployment environment.
  • Required Programming Languages: Java
  • JavaScript
  • C++
  • C#
  • Python
  • Required Technical Skills and primary tools used: Spring Tool Suite
  • Microsoft Visual Studio
Job Responsibility
Job Responsibility
  • Create and maintain DBMS (Postgres) and IBM DB2
  • Create and deploy Java Spring applications in AWS, on EC2 servers, using Terraform code and Scalr
  • Use Azure for Entra ID for user management and authentication
  • Work with AWS Cloud, IaaS Servers, and Mainframe
  • Work with applications NSCRA (proprietary), nslookup (proprietary), Hot Spot Enabler (proprietary)
What we offer
What we offer
  • Annual raise and bonus
  • Robust health and wellbeing programs
  • State Farm pays most of your healthcare premium
  • Multiple healthcare plan options including high deductible plan
  • 100% coverage for in-network preventative care
  • Vision, dental, telemedicine, 24/7 mental health professionals
  • Educational benefits including training programs
  • Tuition assistance programs
  • Employee resource groups
  • Mentoring
  • Fulltime
Read More
Arrow Right

Software Engineer II/Sr. Software Engineer

Join Microsoft’s Core AI team and help shape the future of intelligent software ...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements is required for this role
  • This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design and ship AI-assisted features in Visual Studio that help developers generate, explain, and refactor code—measured by adoption, reliability, and user satisfaction
  • Bring intelligence into IDE by integrating GitHub Copilot/MCP tools into core IDE workflows with strong attention to performance, privacy, and safety-by-default
  • Collaborate with partner teams across Microsoft and GitHub to deliver secure, performant solutions and iterate quickly based on real developer feedback
  • Contribute to designs (APIs, data flows, extensibility points) and participate in code/design reviews to maintain quality and scalability for a large codebase
  • Instrument and learn using telemetry, experimentation, and diagnostics to improve latency, reliability, and relevance over time
  • Fulltime
Read More
Arrow Right