CrawlJobs Logo
FinXL Logo FinXL · IT - Software Development

Associate Data Engineer - AWS & Python

Australia, Sydney CBD 75000.00 - 85000.00 AUD / Year · Job Posted April 12, 2026
Apply Position
Job Link Share

Job Description

Associate Data Engineer - AWS & Python Leading banking client (consulting through FinXL). FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise sectors. FinXL is seeking an Associate Data Engineer - AWS & Python to join our consulting team and be deployed with a leading banking client on a 6 months contract in Sydney.

Job Responsibility

  • Provide hands-on engineering support for complex data integration pipelines
  • Designed end to end data integration pipelines using SQL Server, dbt, and Python, enabling accurate, unified datasets for analytics and risk insights
  • Develop and maintain automation scripts to improve system efficiency
  • Support and enhance risk-related systems to ensure robust performance
  • Create data scripts to facilitate seamless information flow
  • Collaborate on the delivery of digital and AI transformation initiatives
  • Ensure all technical solutions align with the Software Development Life Cycle

Requirements

  • 3+ years of proven experience working on Data Integration projects
  • Strong experience working with core AWS services
  • Proficiency in Python for data manipulation and integration tasks
  • Hands-on experience with SQL databases
  • Solid understanding of Data Integration concepts and the SDLC
  • Previous experience within the Financial Services industry is highly regarded
  • Ability to provide technical support for data-heavy systems
  • Strong problem-solving skills and a collaborative mindset
FinXL - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Associate Data Engineer - AWS & Python

8 matching positions

Associate Data Engineer

Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-6 years of experience with Bachelor’s degree in Computer Science, Data Engineering, Information Systems, Engineering, Mathematics, or a related field, or equivalent practical experience
  • Hands-on experience with Python for data processing, scripting, and automation
  • Strong working knowledge of PySpark and distributed data processing concepts
  • Proven hands-on experience using Databricks for data engineering, including notebooks, clusters, jobs, workflows, Delta tables, and performance optimization
  • Ability to build, maintain, and troubleshoot scalable ETL/ELT pipelines in Databricks
  • Experience working with Delta Lake and lakehouse architecture concepts
  • Working knowledge of SQL for querying, transforming, and validating data
  • Ability to work with structured and semi-structured data formats such as CSV, JSON, Parquet, and Delta
  • Understanding of data engineering concepts such as ETL/ELT, data pipelines, data lakes, data warehouses, batch processing, and data quality
  • Basic understanding of AI and machine learning concepts, including features, training datasets, model inputs/outputs, and model evaluation basics
Job Responsibility
Job Responsibility
  • Develop, test, and maintain data pipelines using Databricks, PySpark, and Python
  • Ingest, transform, and process structured and semi-structured data from multiple sources
  • Support the development of scalable ETL/ELT workflows for analytics, reporting, and machine learning use cases
  • Work with data engineers, analysts, and data scientists to understand data requirements and deliver reliable datasets
  • Perform data cleansing, validation, and quality checks to ensure accuracy and consistency
  • Optimize Spark jobs and Databricks notebooks for performance, reliability, and cost efficiency
  • Create and maintain documentation for data pipelines, workflows, data definitions, and processes
  • Assist in troubleshooting pipeline failures, data issues, and performance bottlenecks
  • Follow best practices for version control, code quality, testing, and deployment
  • Support basic AI/ML data preparation activities, including feature engineering, dataset creation, and model input preparation
  • Fulltime
Read More
Arrow Right

Sr. Associate Data Engineer

As part of the cybersecurity organization, the Data Engineer is responsible for ...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree OR Bachelor’s degree and 5 to 9 years of Computer Science, IT or related field experience
  • Hands on experience with data practices, technologies, and platforms, such as Databricks, Python, Gitlab, LucidChart, etc.
  • Proficiency in data analysis tools (e.g. SQL) and experience with data sourcing tools
  • Excellent problem-solving skills and the ability to work with large, complex datasets
  • Understanding of data governance frameworks, tools, and best practices
  • Knowledge of and experience with data standards (FAIR) and protection regulations and compliance requirements (e.g., GDPR, CCPA)
  • Experience with ETL tools and various Python packages related to data processing, machine learning model development
  • Strong understanding of data modeling, data warehousing, and data integration concepts
  • Experience with data visualization and dashboarding tools—Tableau, Power BI, or similar is a plus
  • Knowledge of Python/R, Databricks, cloud data platforms
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Develop and maintain interactive dashboards and reports using tools like Tableau, ensuring data accuracy and usability
  • Schedule and manage workflows the ensure pipelines run on schedule and are monitored for failures
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate and communicate effectively with product teams
  • Fulltime
Read More
Arrow Right

Associate Data Engineer

Join Amgen’s Mission of Serving Patients At Amgen, if you feel like you’re part...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Any degree and 3 to 6 years of Computer Science, IT or related field experience
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration and performance tuning on big data processing
  • Strong understanding of AWS services
  • Ability to quickly learn, adapt, and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets
  • Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains
  • Design and implement solutions to enable unified data access, governance, and interoperability across hybrid cloud environments
  • Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms
  • Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring
  • Innovate, explore, and implement new tools and technologies to enhance efficient data processing
  • Stay updated with the latest design trends and techniques to ensure the best data engineering
  • Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
  • Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value
  • Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories
  • Fulltime
Read More
Arrow Right

Associate Data Engineer

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Irving
Salary
Salary:
61800.00 - 148320.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Understanding of programming languages like R, Python, Node.JS and SQL
  • Understanding of cloud technologies - Azure, GCP or AWS
  • Understanding of LLMs and AI Agents
  • Bachelor’s Degree in Computer Science, Engineering, Statistics, Physics, Math, or related field
Job Responsibility
Job Responsibility
  • Compiles data from different sources and systems, ensuring compatibility and consistency, and works with APIs, connectors, and cloud services to build software applications
  • Conducts data quality checks and validation processes to ensure data accuracy, completeness, and consistency
  • Compiles data engineering processes, workflows, and systems for reference and knowledge sharing purposes
  • Builds efficient and scalable data pipelines
  • Communicates effectively with technical and non-technical stakeholders, translating complex technical concepts into understandable terms
  • Actively contributes to team meetings, brainstorming sessions, and collaborative projects, by sharing ideas, providing feedback, and contributing to the overall goals and objectives of the team
  • Assists team members with tasks, timelines, and deliverables, including collaborating on projects, sharing information, and ensuring effective communication within the team
What we offer
What we offer
  • Affordable medical plan options
  • 401(k) plan (including matching company contributions)
  • Employee stock purchase plan
  • No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Dependent care resources
  • Colleague assistance programs
  • Tuition assistance
  • Fulltime
Read More
Arrow Right

Associate Data Engineer

At CVS Health, we’re building a world of health around every consumer and surrou...
Location
Location
United States , Irving, TX
Salary
Salary:
122949.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree (or foreign equivalent) in Computer Science, Data Science, Statistics, Mathematics, Analytics, or a related field
  • completion of a university-level course, research project, internship, or thesis in each of the following: GIT
  • Java, Python, or R
  • XML, JSON, HTML, CSS, or JavaScript
  • Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP)
  • SAS or SQL
  • Spark, PySpark, or Scala
  • Machine learning and NLP
  • Extract/Transform/Load (ETL)
  • Data warehousing
Job Responsibility
Job Responsibility
  • Develop and build large-scale data structures, pipelines and efficient Extract/Load/Transform (ETL) workflows to address complex problems and support business applications
  • develop large scale data structures and pipelines to organize, collect and standardize data to generate insights and addresses reporting needs
  • write ETL (Extract/Transform/Load) processes, design database systems, and develop tools for real-time and offline analytic processing that improve existing systems and expand capabilities
  • collaborate with Data Science team to transform data and integrate algorithms and models into automated processes
  • test and maintain systems and troubleshoot malfunctions
  • leverage knowledge of Hadoop architecture, HDFS commands, and designing and optimizing queries to build data pipelines
  • utilize programming skills in Python, Java, or similar languages to build robust data pipelines and dynamic systems
  • build data marts and data models to support Data Science and other internal customers
  • integrate data from a variety of sources and ensure adherence to data quality and accessibility standards
  • analyze current information technology environments to identify and assess critical capabilities and recommend solutions to complex business problems
What we offer
What we offer
  • Full range of medical, dental, and vision benefits
  • 401(k) retirement savings plan
  • Employee Stock Purchase Plan
  • fully-paid term life insurance plan
  • short-term and long term disability benefits
  • well-being programs
  • education assistance
  • free development courses
  • CVS store discount
  • discount programs with participating partners
  • Fulltime
Read More
Arrow Right

Associate Data Engineer

Adtalem is a data driven organization. The Data Engineering team builds data sol...
Location
Location
United States , Lisle
Salary
Salary:
64225.00 - 116083.75 USD / Year
adtalem.com Logo
Adtalem Global Education
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Computer Engineering, Software Engineering, or other related technical field
  • One (1) plus year Experience in data engineering solutions such as data platforms, ingestion, data management, or analytics
  • One (1) plus year Experience in any cloud platform (GCP, AWS, Azure)
  • Excellent knowledge on SQL and Python programming
  • Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed
  • Experience in tuning queries for performance and scalability
  • Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment
Job Responsibility
Job Responsibility
  • Work closely with various business, IT, Analyst and Data Science groups to collect business requirements
  • Work closely with Senior Data Engineers in the design & development phase and follow the CI/CD deployment pipeline
  • Collaborate with senior data engineers and develop optimal data solutions by applying the business logic and building objects in the semantic layer of the data warehouse
  • Follow the documentation standards and document the design and support strategy of all the data pipelines
  • Collaborate with senior data engineers to capture, store, and socialize data lineage and operational metadata
  • Play a crucial role in solving data pipeline issues and communicate the impact & status to stakeholders
  • Understand the pipeline flow, dependencies, origins and service levels of data systems to continuously improve the accuracy, timeliness, and availability of data
  • Performs other duties as assigned
  • Complies with all policies and standards
What we offer
What we offer
  • Health, dental, vision, life and disability insurance
  • 401k Retirement Program + 6% employer match
  • Participation in Adtalem’s Flexible Time Off (FTO) Policy
  • 12 Paid Holidays
  • Fulltime
Read More
Arrow Right

AWS Data Engineer

About the Role: Key Responsibilities: Architect and implement scalable, secure, ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
cigres.com Logo
Cigres
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, or related field
  • 5–8 years of experience in data engineering, including at least 3 years of hands-on expertise with AWS Big Data platforms
  • Proficiency in Python, SQL, Spark, and various AWS data services
  • Strong understanding of data architecture, data modeling, and data warehousing concepts
  • Experience in DevOps practices and tools, including CI/CD, monitoring, and infrastructure-as-code (IaC)
  • Hands-on experience with key AWS services: Glue, S3, Redshift, Lambda, CloudWatch, IAM
  • Experience with CI/CD tools and IaC technologies such as Terraform or CloudFormation
  • Proficiency with Git for version control and collaborative development
Job Responsibility
Job Responsibility
  • Architect and implement scalable, secure, and cost-effective data platforms on AWS
  • Lead the development of complex ETL/ELT pipelines and data workflows
  • Define, standardize, and enforce data engineering best practices and coding standards
  • Collaborate closely with data scientists, analysts, and business stakeholders to deliver data-driven solutions
  • Conduct code reviews to ensure high-quality, maintainable deliverables
  • Optimize data workflows for performance, scalability, and cost-efficiency
  • Ensure strong data quality, governance, and security across all data environments
  • Work with cross-functional teams to gather, analyze, and refine data requirements
  • Monitor, maintain, and troubleshoot data pipelines and associated infrastructure
  • Fulltime
Read More
Arrow Right

Sr. Associate Data Engineer

In this vital role you will be responsible for the development and implementatio...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, or a related field with 5+ years of experience
  • Mastery with at least one programming language (Python, Scala, or similar)
  • Experience with data engineering platforms like Databricks
  • Experience with vibe coding using large language models for production systems
  • Broad interest in various Amgen preferred platforms/tools
  • Eagerness to learn and grow in a data engineering environment
  • Ability to work well within a team and communicate effectively
  • Experienced with data modelling and structuring
  • Experienced working with ETL orchestration technologies
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and DevOps
Job Responsibility
Job Responsibility
  • Design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Deliver for data pipeline projects from development to deployment, managing, timelines, and risks
  • Ensure data quality and integrity through meticulous testing and monitoring
  • Leverage cloud platforms (AWS, Databricks) to build scalable and efficient data solutions
  • Work closely with product team, and key collaborators to understand data requirements
  • Enforce to data engineering industry standards and standards
  • Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies
  • Familiarity with code versioning using GIT and code migration tools
  • Familiarity with JIRA
  • Stay up to date with the latest data technologies and trends
Read More
Arrow Right