Senior Data Developer Job at TechTalent Software

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...

Location

United States , Southlake, TX or Austin, TX

Salary:

55.92 - 62.13 USD / Hour

Aquent

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
Proficiency in Python and SQL for data processing and automation
Extensive experience with ETL processes and data pipeline design
Excellent problem-solving skills and meticulous attention to detail
Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks

Job Responsibility

Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
Implement and uphold best practices for data quality, data governance, and data security
Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity

What we offer

subsidized health, vision, and dental plans
paid sick leave
retirement plans with a match

Pyspark Big Data Senior Developer - Vice President

We are building an A-team of highly skilled and autonomous engineers, and we are...

Location

Canada , Mississauga

Salary:

120800.00 - 170800.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

6+ years of extensive, hands-on experience as a Senior Big Data Developer, with a strong emphasis on PySpark and the Apache Spark ecosystem, operating as a player/coach
Expert proficiency in Python, with a proven track record of developing robust, scalable, and high-performance PySpark applications for large-scale data processing
Deep understanding and extensive hands-on experience with Apache Spark (Spark Core, Spark SQL, Spark Streaming) and its ecosystem
Experience with distributed computing frameworks such as Hadoop (HDFS, YARN)
Expert proficiency in SQL and extensive experience with data warehousing concepts and technologies (e.g., Hive, Snowflake, Redshift, Databricks SQL)
Proven experience with various data storage formats (e.g., Parquet, ORC, Avro) and data lake solutions (e.g., Delta Lake, Iceberg)
Experience with NoSQL databases (e.g., MongoDB, Cassandra, HBase) is a significant plus
Strong experience with Apache Kafka for building real-time data pipelines and event-driven architectures
Demonstrated experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift, Azure Databricks/Data Factory/Synapse, GCP Dataflow/Dataproc/BigQuery) is highly desirable
Proven effectiveness with AI coding tools (e.g., Claude Code, Codex, Antigravity) is a mandatory requirement

Job Responsibility

Operate end-to-end in the design, development, and implementation of robust big data solutions, ensuring optimal performance, scalability, data quality, and security
Collaborate closely within small, co-located squads (4-7 person teams), fostering high communication and low coordination overhead, to translate complex business requirements into technical specifications for big data processing and analytical solutions
Act as a player/coach within the team, mentoring junior members and leading by example in the development of efficient and innovative big data architectures
Design, develop, and optimize large-scale data pipelines using PySpark for data ingestion, transformation, and aggregation, always with an eye towards efficiency and domain relevance
Implement and manage real-time data streaming and event-driven architectures using technologies like Apache Kafka
Design and implement sophisticated data warehousing solutions and dimensional models for efficient data storage and retrieval, ensuring alignment with business needs
Work with various distributed data storage technologies, including distributed file systems (e.g., HDFS, S3) and NoSQL databases (e.g., MongoDB, Cassandra), selecting the right tool for the right problem
Implement efficient data processing and storage strategies to optimize the performance and scalability of big data applications, with a strong focus on the 'why' behind the technology choices
Champion best practices in software development, including rigorous code reviews, implementing comprehensive testing, and supporting continuous integration and continuous deployment (CI/CD) pipelines
Demonstrate high autonomy and agency in driving projects forward, making informed decisions, and proactively identifying areas for improvement

Fulltime

Senior Data Developer (Azure)

We are looking for a highly skilled and experienced Senior Azure Data Developer ...

Location

Egypt , Cairo

Salary:

Not provided

Coca-Cola HBC

Expiration Date

Until further notice

Requirements

Bachelor's or Master’s degree in computer science, information technology, data science, or a related field (or an equivalent of 7+ years of practical experience in a tech-domain)
Hands-on experience with MS Power BI, MS PowerApps, MS Azure Data Factory, MS Azure Data Lake Store, SQL Database (T-SQL), DAX & Power Query M (3+ years)
Proven track record of implementing proof-of-concept (POC) backend solutions
Expert knowledge with cloud platforms (Azure, Google Cloud Storage, Amazon), preferably Microsoft Azure – with a focus on data warehousing & backend development
Strong programming skills in languages such as C#, .NET, Python, Scala or Java
Experience with big data architectures and large data volumes technologies (partitioned tables with billions of records, files with hundreds of GBs)
Familiarity with big data technologies such as Hadoop, Spark, and Hive as well as strong knowledge with data manipulation frameworks such a PySpark
Strong analytical & problem-solving abilities, as well as good communication skills
Strong willingness to learn and adapt to new technologies and tools
Good proficiency in English as a day-to-day business language is a must.

Job Responsibility

Assist in the design, development, and maintenance of ETL (Extract, Transform, Load) processes using Azure Data Factory
Implement data ingestion processes from various data sources into Azure data storage solutions
Work with Azure SQL Database, Azure Data Lake Storage, and Hive & Databricks to store and manage large datasets (Terabytes of data)
Ensure data integrity and availability by implementing appropriate storage solutions
Integrate data from various sources, ensuring accuracy, completeness, and consistency
Collaborate with data scientists and analysts to understand data requirements and provide necessary support
Contribute to the strategy, design and development of our Enterprise and Operational Reporting, providing insights and supporting decision making for end users
Integrate & transform data from various data systems into structures that are suitable for building analytical solutions
Design, develop and implement Azure-based solutions connecting certified and validated data sources to Power BI front-end visualizations and creating a single source of truth for reporting

What we offer

Development opportunities
Equal opportunity employer
IT Equipment
Learning programs
Work with iconic brands
Supportive team
Volunteering Opportunities
Wellbeing program

Senior Developer, Data Security

We are excited to welcome a Senior Developer to join our new Data Security team ...

Location

United States; Canada

Salary:

156000.00 - 210000.00 USD; CAD / Year

1Password

Expiration Date

Until further notice

Requirements

5+ years of experience in software development with a security focus
Passion for and strong experience with security development best practices, coding standards, and design patterns
Strong foundational understanding of modern cryptographic algorithms, trade-offs and implementation considerations gained from real world experience
Work well in a team environment with positive communications amongst a variety of technical and non-technical stakeholders
Proven experience in implementing testing methodologies and debugging techniques to ensure high-quality code
Adaptable and resilient, thriving in fast-paced environments with shifting priorities

Job Responsibility

Partially responsible for the underlying cryptography across our products
Build cryptographic libraries and implement the latest algorithms directly into our client applications with security, performance and usability in mind
Develop proof-of-concepts and implement new industry specifications into code
Conduct code and design reviews to ensure good cryptographic hygiene and standards across our codebase
Work with a small team of security developers who are specialists in Rust and Golang Security
Develop cryptographic or other security libraries to share common security-critical code across our applications
Assist in security design efforts or scoping initiatives for new features, particularly with heavy cryptographic components
Assess and take appropriate steps to resolve new security vulnerabilities across our applications
Implement new security features for the next generation of 1Password
Demonstrate leadership in security development and act as a trusted point of contact for management and other developers

What we offer

Health benefits
Dental benefits
401k
RRSP
Generous paid time off
Equity grant
Participation in incentive programs
Maternity and parental leave top-up programs
RSU program for most employees
Retirement matching program

Fulltime

Senior Data Solution Developer

Job Description

Location

Canada , Administrative Centre

Salary:

Not provided

Bombardier

Expiration Date

Until further notice

Requirements

You hold a bachelor’s degree in computer science, Statistics, Informatics, Information Systems or another quantitative field
You have 8+ years of experience in a Data Engineer / Data Solution Developer role
You have knowledge of Agile / SCRUM project delivery, DevOps and CI/CD practices related to data solutions
You have advanced knowledge of SQL, query authoring/optimization and relational databases
You have experience optimizing ‘big data’ pipelines (storage, file formats, partitioning, Spark, Python, streaming)
You are efficient at performing root cause analysis to address data pipeline issues and applying long-term fixes
You have experience designing and building data transformation, data structures, metadata frameworks, semantic layer and automated workload management
You have experience implementing data protection measures, understanding data privacy and collaborating with Cybersecurity teams
You have good knowledge of Azure data services (Azure Data Factory, Azure Data Lake Storage, Event Hub, Databricks, Lakehouse Medallion Architecture) and PowerBI
You have good knowledge of object-oriented and functional programming languages: Python, Java, C++, Scala, etc

Job Responsibility

Administer the enterprise data platforms (DWH, Data Lake, BI)
Create and maintain performance- and cost-optimized data pipelines, with high reliability, to meet business needs
Define and operate the infrastructure required for optimal extraction, loading and transformation (ELT) of data from a wide variety of data sources using SQL, API and Spark technologies
Design and implement improvements to life-cycle management processes (DevOps) enabling continuous integration, testing and deployment (CI/CT/CD) of data systems
Integrate data from various sources (including external data sources and IoT) and manage the big data as a key enterprise asset
Create and maintain backend data solutions for data analysts and data scientists
Assist data analysts and data scientists in unlocking insights from enterprise data
Identify, design, and implement internal processes and frameworks to improve the data platform (e.g. eliminating manual processes, optimizing data delivery, evolving data infrastructure capabilities, etc.)
Work with stakeholders including product, data and architecture SMEs to assist with data-related technical issues and support their data infrastructure needs
Ensure compliance with data architecture, data governance principles and security requirements

What we offer

Insurance plans (Dental, medical, life insurance, disability, and more)
Competitive base salary
Retirement savings plan
Employee Assistance Program
Tele Health Program

Fulltime

Senior Data Solution Developer

At Bombardier, we design, build and maintain the world’s peak-performing aircraf...

Location

Canada , Dorval

Salary:

Not provided

Bombardier

Expiration Date

Until further notice

Requirements

You hold a bachelor’s degree in computer science, Statistics, Informatics, Information Systems or another quantitative field
You have 8+ years of experience in a Data Engineer / Data Solution Developer role
You have knowledge of Agile / SCRUM project delivery, DevOps and CI/CD practices related to data solutions
You have advanced knowledge of SQL, query authoring/optimization and relational databases
You have experience optimizing ‘big data’ pipelines (storage, file formats, partitioning, Spark, Python, streaming)
You are efficient at performing root cause analysis to address data pipeline issues and applying long-term fixes
You have experience designing and building data transformation, data structures, metadata frameworks, semantic layer and automated workload management
You have experience implementing data protection measures, understanding data privacy and collaborating with Cybersecurity teams
You have good knowledge of Azure data services (Azure Data Factory, Azure Data Lake Storage, Event Hub, Databricks, Lakehouse Medallion Architecture) and PowerBI
You have good knowledge of object-oriented and functional programming languages: Python, Java, C++, Scala, etc.

Job Responsibility

Administer the enterprise data platforms (DWH, Data Lake, BI)
Create and maintain performance- and cost-optimized data pipelines, with high reliability, to meet business needs
Define and operate the infrastructure required for optimal extraction, loading and transformation (ELT) of data from a wide variety of data sources using SQL, API and Spark technologies
Design and implement improvements to life-cycle management processes (DevOps) enabling continuous integration, testing and deployment (CI/CT/CD) of data systems
Integrate data from various sources (including external data sources and IoT) and manage the big data as a key enterprise asset
Create and maintain backend data solutions for data analysts and data scientists. Assist them in unlocking insights from enterprise data
Identify, design, and implement internal processes and frameworks to improve the data platform (e.g. eliminating manual processes, optimizing data delivery, evolving data infrastructure capabilities, etc.)
Work with stakeholders including product, data and architecture SMEs to assist with data-related technical issues and support their data infrastructure needs
Ensure compliance with data architecture, data governance principles and security requirements
Implement and maintain the data platform’s semantic layer

What we offer

Insurance plans (Dental, medical, life insurance, disability, and more)
Competitive base salary
Retirement savings plan
Employee Assistance Program
Tele Health Program

Fulltime

Senior Data Warehouse Developer

The Senior Data Warehouse Developer is responsible for architecting, designing, ...

Location

United States of America , Brighton

Salary:

86482.00 - 129723.00 USD / Year

University of Rochester

Expiration Date

Until further notice

Requirements

Bachelor's degree in a related discipline such as Computer Science, Business, Mathematics, Statistics, Science or Engineering required
5 years of related experience required
Multiple project experience with Data Warehousing ETL technologies and overall knowledge of Data Warehousing/Business Intelligence lifecycles required
Experience with dimensional data models required
Strong Analytical and Problem-solving abilities required
Ability to actively participate and collaborate on a team required
Excellent written communication skills. Ability to translate functional business requirements into documented system requirements and designs required
Analytical mindset with strong problem solving abilities required
Proficiency in developing data transformation packages/stored procedures required

Job Responsibility

Works with the user community and reporting team to understand business data and data transformation requirements. Converts those requirements to functional/technical specifications for database and integration design. Manages requests and/or components of larger projects with appropriate documentation and status reports
Architects data integration and transformation processes across on premise and cloud data sources. Provides leadership and is a subject matter expert depending on area of focus.
Develops data integration and transformation processes across on premise and cloud data sources using tools including Oracle Data Integrator, Boomi Atmosphere, Informatica as determined by the environment.
Develops data models and database designs that leverage their knowledge of data warehouse modeling best practices.
Collaborates with other team members using scrum processes or other project management disciplines depending on area of focus. Follows best practices for change and code management. Provides supporting technical documentation that is written, organized and maintained.
Participates in ongoing stabilization, support and maintenance. Provides on call support as needed for business continuity and operations. Attends webinars, reads case studies and white papers, and participates in opportunities to further refine skills and stay apprised on functional area topics. Maintains current knowledge of technology, equipment, and/or systems and advises on newer technologies.
Other duties as assigned

Fulltime

Senior Software Developer - Data Plane

We are looking for a skilled Senior Software Engineer with a deep understanding ...

Location

Canada , Markham; Oshawa

Salary:

115000.00 - 164600.00 USD / Year

General Motors

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field
Proficiency in programming languages such as C, C++, and other related languages (5+ years of hands on development experience)
Familiarity with Linux, QNX and Android
Solid understanding of logging and data processing principles
Solid understanding of embedded software development and optimization
Experience in data plane/ other data intensive pipelines in an embedded environment
Strong problem-solving skills and the ability to troubleshoot complex issues
Excellent communication skills and the ability to work effectively in a team environment

Job Responsibility

Design, implement, and maintain embedded data plane and processing pipelines using various technologies
Optimize and enhance the performance of our data plane for high throughput and low latency
Integrate Embedded data collection with various data sinks such as Azure, S3, GCP and other storage systems
Develop custom plugins for our data plane as needed to support unique data processing requirements
Collaborate with DevOps to ensure seamless deployment and operation of logging infrastructure
Monitor and troubleshoot data plane software to ensure reliability and stability
Contribute to the open-source community by reporting issues, contributing to documentation, and submitting patches
Assist with developing and integrating a control plane to manage the distributed architecture on a large scale

What we offer

Paid time off including vacation days, holidays, and supplemental benefits for pregnancy, parental and adoption leave
Healthcare, dental, and vision benefits
Life insurance plans to cover you and your family
Company and matching contributions to a Defined Contribution Pension plan to help you save for retirement
GM Vehicle Purchase Plan for you, your family and friends

Fulltime

Select Country

Senior Data Developer

Job Description

Job Responsibility

Requirements

What we offer

Looking for more opportunities?