CrawlJobs Logo

Senior Data Engineer, Information Technology

United States, Indianapolis Employment contract 97000.00 - 143000.00 USD / Year · Job Posted May 16, 2026
Apply Position
Job Link Share

Job Description

CREA, LLC is a full-service low-income housing tax credit (LIHTC) syndicator forming long-term relationships with investors and developers that cultivate success and improve lives. With 25 years in affordable housing, CREA has raised $13.5 billion, resulting in the formation of over 97,500 homes within 1059 communities across the country. Thanks to the contributions of over 135 employees, CREA continues to seek talented, passionate individuals eager to grow with us. We are seeking a Senior Data Engineer to lead the design, development, and modernization of enterprise data platforms supporting LIHTC and real estate finance operations. This role is ideal for a seasoned data professional who thrives in building scalable data solutions, driving cloud transformation, and enabling advanced analytics. You will play a key role in CREA's transition to a modern Azure Fabric data ecosystem, unlocking data-driven insights across the organization.

Job Responsibility

  • Lead the design, development, and modernization of enterprise data platforms supporting LIHTC and real estate finance operations
  • Design, build, test, deploy, and maintain scalable, secure, and reliable data pipelines and integrations
  • Develop and maintain ETL/ELT processes for structured and semi-structured data, including orchestration and documentation
  • Ingest, transform, and integrate structured and unstructured data into centralized data platforms (warehouse/lakehouse)
  • Build reusable code and automation to streamline data processing and management
  • Lead and support migration of on-prem SQL Server workloads to Azure/Microsoft Fabric
  • Participate in data architecture decisions, standards, and platform/tool selection
  • Maintain and optimize performance, reliability, and monitoring across cloud and hybrid environments
  • Develop and support data solutions that enable analytics, reporting, and business operations
  • Produce dashboards and reports
  • communicate insights to stakeholders
  • Serve as a subject matter expert, partnering with IT and business teams to solve key data challenges
  • Implement data quality, validation, and monitoring controls
  • perform root cause analysis
  • Establish and support data governance practices to ensure integrity and business value
  • Champion data security, compliance, and adherence to company guidelines
  • Drive Power BI/Fabric governance, including semantic models and workspace management

Requirements

  • Bachelor's degree in Engineering, Computer Science, or related field required
  • advanced degree preferred
  • 7+ years of experience in data engineering or development with increasing responsibility
  • Proven experience building and evolving data platforms and supporting business decision-making
  • Industry experience in Real Estate, Financial Services, Banking, or FinTech preferred
  • Strong experience designing, integrating, securing, monitoring, and optimizing data platforms
  • Experience with APIs for system integration and data exchange
  • Experience leveraging AI-enabled tools for analytics, automation, or solution development
  • Azure Data Platform: SQL Server Managed Instance, Azure SQL Database, Azure Synapse, Dataverse, Microsoft Fabric (OneLake, Fabric Warehouse, Data Factory)
  • Data Integration: Azure Data Factory, Microsoft Fabric
  • Analytics & Reporting: Power BI, Power Query, DAX
  • Business Applications: Microsoft 365 (O365, SharePoint, OneDrive), VSTO/C# .NET Add-ins
  • Development & DevOps: GitHub, CI/CD pipelines, Visual Studio, Power BI Deployment Pipelines, Monday.com
  • Ability to travel up to 5% as needed
  • No visa sponsorship available

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer, Information Technology

8 matching positions

Senior Information Technology Engineer

The IT Systems Engineer is responsible for architecting, securing, and scaling L...
Location
Location
India , Pune
Salary
Salary:
Not provided
logicmonitor.com Logo
LogicMonitor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of IT experience in a global high-tech environment
  • 5+ years of hands-on networking experience (enterprise/global scale)
  • Strong experience managing Cisco switches, Fortinet firewalls, VPNs, and wireless infrastructure
  • Demonstrated experience with Zero-Trust Network Architecture (ZTNA), Secure Web Gateways, and CASB (preferred: Cloudflare)
  • Proficiency with Terraform for Infrastructure-as-Code and familiarity with GitOps practices
  • Strong understanding of networking in cloud environments (AWS, GCP, Azure)
  • Familiarity with FedRAMP/GovCloud requirements preferred
  • Experience using AI tools to enhance productivity, innovation, or problem-solving
  • Solid Linux systems experience
  • macOS networking and certificate compatibility knowledge required
Job Responsibility
Job Responsibility
  • Own Cloudflare ZTNA and Secure Web Gateway end-to-end: design, policy enforcement, monitoring, troubleshooting, and Terraform-based configuration
  • Handle multiple instances of Cloudflare ZTNA, covering commercial and government infrastructure
  • Ensure compatibility and reliability of certificates and macOS networking with SWG/Zero-Trust controls
  • Architect and administer global networking across offices, data centers, and multi-cloud (AWS, GCP, Azure) environments
  • Manage Cisco switches, Fortinet firewalls, VPNs, Wi-Fi, and global remote access infrastructure
  • Implement Infrastructure-as-Code practices with Terraform and support GitOps workflows
  • Deliver and maintain network observability dashboards, SLAs, and uptime reporting using LogicMonitor
  • Partner with Security and Technical Operations to maintain compliance in both commercial and FedRAMP environments
  • Ability to work within an on-call rotation schedule and be available after hours for specialized support
  • Proactively identify opportunities for AI-driven automation within IT operations and quietly deliver solutions that reduce manual workloads
Read More
Arrow Right

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...
Location
Location
United States , Southlake, TX or Austin, TX
Salary
Salary:
55.92 - 62.13 USD / Hour
aquent.com Logo
Aquent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
  • 8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
  • Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
  • Proficiency in Python and SQL for data processing and automation
  • Extensive experience with ETL processes and data pipeline design
  • Excellent problem-solving skills and meticulous attention to detail
  • Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
  • Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
  • Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
  • Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
  • Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
  • Implement and uphold best practices for data quality, data governance, and data security
  • Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
  • Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
  • Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
  • Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
  • Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity
What we offer
What we offer
  • subsidized health, vision, and dental plans
  • paid sick leave
  • retirement plans with a match
Read More
Arrow Right

Data Engineer Big Data Technology

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-6 years of hands-on experience in Hadoop, Scala, Java, Spark, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks
  • 4+ years of experience with relational SQL and NoSQL databases: Oracle, MongoDB, HBase
  • Strong proficiency in Python and Spark Java with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc) and Scala and SQL
  • Data Integration, Migration & Large Scale ETL experience (Common ETL platforms such as PySpark/DataStage/)
  • 4-6 years of relevant experience in the Financial Service industry
  • Experienced in working with large and multiple datasets and data warehouses
  • Experience building and optimizing ‘big data’ data pipelines, architectures, and datasets
  • Strong analytic skills and experience working with unstructured datasets
  • Ability to effectively use complex analytical, interpretive, and problem-solving techniques
  • Experience with Confluent Kafka, Redhat JBPM, CI/CD build pipelines and toolchain – Git, BitBucket, Jira
Job Responsibility
Job Responsibility
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Senior Staff Engineer – Cybersecurity Data Protection Engineer

GEICO’s Cybersecurity organization has an exciting opportunity for an accomplish...
Location
Location
United States , Chevy Chase; Palo Alto; Seattle
Salary
Salary:
115000.00 - 260000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with data discovery, classification, handling, access, inventory, and retention
  • Proven experience with data protection technologies, such as encryption, tokenization and data loss prevention tools
  • Familiar with programming languages such as Python, Java, or .NET
  • Experience with designing and implementing data security solutions for enterprise environments
  • Experience in managing and supervising other Data Protection Engineers
  • Experience in developing and managing data protection programs focused on data discovery, data inventory, data risk assessments, and encryption for both structured and unstructured data
  • Strong knowledge of cybersecurity laws, regulations, and best practices
  • Knowledge of data security frameworks, standards, and protocols
  • Strong understanding of data privacy laws and regulations (i.e. NYDFS, PCI, etc.)
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Develop and Implement data protection strategies and initiatives, including classification and handling, data access controls, inventory, encryption, and retention
  • Work closely with other stakeholders to enforce data protection related policy and respond to regulatory requirements
  • Develop and maintain data security policies, procedures, standards, and ensure that they are followed by the entire organization
  • Create and maintain data inventories and data flows, and manage data sharing controls
  • Drive the design and implementation of data access controls, ensuring only authorized access to sensitive data
  • CO-develop and implement data retention policy and procedures, ensure compliance with internal policy and external regulations
  • Enforce data encryption standards and strategies to secure data at rest and in transit
  • Lead incident response efforts related to data breach and work with stakeholders to mitigate impact
  • Lead and conduct regular data risk assessments to identify potential vulnerabilities and threats to the organization's data and information systems
  • Stay abreast of new developments in the field of cybersecurity and ensure that the organization's risk assessment and data security processes are aligned with industry standards and best practices
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right
New

Technology Engineer – Senior (1043) - Systems Specialty - Citywide

Location
Location
United States , San Francisco
Salary
Salary:
156000.00 - 196300.00 USD / Year
sf.gov Logo
City and County of San Francisco
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • An associate degree in computer science, computer engineering, information systems, or a closely-related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field]
  • One (1) year of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of a system or platform
Job Responsibility
Job Responsibility
  • Leads the day-to-day operational support for software systems, services, and supporting infrastructure, including cloud-based and on-premises environments
  • Builds, patches, tests (check for compatibility issues, conducts QA) and deploys complex systems and platforms across cloud-based, on-premises, and hybrid environments meeting clients’ needs and specifications
  • Leads in planning and implementing changes to software systems and infrastructure with the goal of enhancing performance, including through infrastructure-as-code and automated delivery practices
  • Performs data backup, data migration and disaster recovery operations
  • Performs complex software and operating system upgrades and track system licensing
  • Configures security settings or access permissions for groups and individuals
  • Provides technical support (help desk) to users by troubleshooting problems related to software platform and application performance
  • Documents complex procedures and troubleshooting procedures related to software systems, platforms and services
  • Leads the configuration and maintenance of software
  • Works with vendors, consultants, contractors and personnel from other City Bureaus, Divisions and Departments
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer – Core Team (Onshore)

Location
Location
United States
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–10 years of hands-on data engineering experience
  • Strong understanding of Apache Spark and its core concepts
  • Proficiency in Scala and/or Java — code-first approach required
  • Advanced SQL skills
  • Experience with Azure Synapse
  • Working knowledge of GitHub for source control
  • Experience with data warehousing and large-scale data integration
  • Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent work experience
  • Must be a hands-on builder
  • Must be available to mobilize immediately
Job Responsibility
Job Responsibility
  • Migrate Spark Job Definitions from Synapse to Fabric (32) Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark
  • Monitor and support Phase 1 pipelines post go-live
  • Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks
  • Lead refactoring and cleanup of existing Phase 1 code
  • Optimize existing solutions for performance and scalability
  • Build and contribute to reusable patterns and automation frameworks
  • Work within TCCC’s metadata-driven architecture
  • Ensure pipelines are used strictly for scheduling — ETL logic must remain in code
  • Manage code using GitHub version control
  • Contribute to discovery sessions to derive requirements directly from data
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer - The Senior Data Engineer is responsible for executing the...
Location
Location
Canada , Toronto
Salary
Salary:
110000.00 - 130000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5-8 years experience Data Engineering
  • with experience in Azure using Databricks
  • Bachelor’s degree Required
  • Expert in Data Engineering in Microsoft Azure Environment + Toolsets (ADF, Synapse, Data Bricks, Cosmos DB, FunctionApps, Logic Apps etc)
  • Lakehouse experience using Databricks
  • Azure platform administration
  • Data Governance Software experience
  • Microsoft Power BI delivery and support
  • Strong SQL query skills
  • Strong history in Python, Pyspark, or Scala
Job Responsibility
Job Responsibility
  • Leading the delivery of finance domain data migration projects with clear milestones, quality controls, and operational readiness
  • Designing and maintaining reusable data ingestion and transformation frameworks aligned with enterprise engineering standards
  • Ensuring data consistency, lineage, and trustworthiness across finance and enterprise data domains
  • Collaborating with business and technical stakeholders to enable analytics, forecasting, and AI readiness for finance data
  • Driving operational excellence across engineering practices, optimizing for cost, performance, and maintainability
  • Design, develop, and maintain robust batch and streaming data pipelines across Azure Data Factory, Databricks, Informatica, and SQL environments
  • Closely work with vendors, contractors and other FS teams to operationalize the data migration process for the hotels
  • Implement and oversee CI/CD workflows, Infrastructure as Code (IaC), and automated testing frameworks
  • Operationalize data quality by integrating Informatica IDQ into finance workflows
  • Apply governance standards by embedding metadata, cataloging, and lineage practices
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer (ETL/Big Data/Python) - Assistant Vice President

CITI Bank Enterprise Analytical Services organization is seeking a highly skille...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • 8+ years of experience in data engineering, software development, or a similar role, with at least 2 years in a lead capacity
  • Proven experience with ETL pipeline design and development
  • Expert proficiency in Python and Spark
  • Strong experience with advanced scripting
  • Deep knowledge of relational databases (Oracle) and NoSQL databases (MongoDB), Snowflake
  • Solid understanding of data modeling, data warehousing, and performance tuning
  • Experience with CI/CD pipelines and tools (e.g., Jenkins, GitLab CI, GitHub Actions)
  • Experience with monitoring, logging, and alerting tools (e.g., Prometheus, Grafana, ELK Stack, Splunk, Datadog)
  • Excellent problem-solving and analytical skills, with a keen eye for detail
Job Responsibility
Job Responsibility
  • Design, develop, and implement ETL based reporting framework, focusing on data collection, transformation, and presentation
  • Utilize a robust technology stack including Databricks, Spark, Hive, Ozone, and Hadoop to process large volumes of data efficiently
  • Write and optimize complex ETL jobs using PySpark and advanced Python scripting
  • Design and manage data storage in various databases, including Oracle, MongoDB and Snowflake for flexible data models
  • Develop and maintain automated job schedules using Autosys, Apache Airflow for seamless data pipeline execution
  • Ability to develop visualization reporting dashboards
  • Able to leverage enterprise approved productivity tools like Copilot, etc., in daily analysis & development tasks
  • Act as the technical subject matter expert (SME) for the reporting framework, providing guidance and mentorship to the development team
  • Lead requirements gathering discussions with business stakeholders and product owners to understand reporting needs and translate them into technical solutions
  • Coordinate closely with the QA team to ensure thorough testing and data validation, maintaining high standards of data accuracy and integrity
  • Fulltime
Read More
Arrow Right