CrawlJobs Logo

Cloud Architect

https://www.randstad.com Logo

Randstad

Location Icon

Location:
Canada, North York

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We are seeking a Cloud Architect to design and deliver a new NPDUIS data collection system, focusing on AWS-based big data, microservices, ETL pipelines, and DevOps practices. This role involves architecting secure, scalable solutions, optimizing data processing workflows, and collaborating with cross-functional teams to modernize technology stacks.

Job Responsibility:

  • Develop a cohesive architectural framework for big data ingestion, ETL, and analytics using AWS (Lambda, Redshift, RDS/Aurora), microservices, and container services
  • Produce UML models, technical documentation, and design specifications addressing performance, security, and availability
  • Oversee Apache Airflow-based workflows, orchestrate advanced ETL processes, and streamline transformations for large datasets
  • Implement best practices around data encoding (XML, JSON) and design robust data flows with Hive/HQL
  • Configure AWS environment (VPC, IAM, CloudFormation, EC2 scaling), ensuring compliance with security and performance standards
  • Employ Bamboo, GitLab, and other CI/CD tools to automate builds, tests, and deployments, supporting continuous improvement
  • Provide hands-on guidance to cross-functional teams, ensuring agile solutions meet short/long-term business objectives
  • Conduct feasibility analyses, handle cost optimization, orchestrate parallel workflow enhancements, and manage risk in a dynamic environment
  • Record system specifications, solution designs, and best-practice guidelines to facilitate smooth onboarding of staff
  • Ensure knowledge transfer across the project lifecycle, supporting final handover and operational readiness

Requirements:

  • 5+ years of application development with Bamboo, GitLab, containerization (Docker on AWS ECS/ECR), microservices, and serverless architecture
  • 5+ years in ETL/BI tasks using Apache Airflow, plus advanced SQL/HQL
  • In-depth AWS experience (RedShift, IAM, CloudFormation, Lambda, RDS/Aurora, S3) with strong data engineering background (Spark, Python)
  • Ability to produce high-quality technical documentation, conceptual/detailed design, and lead DevOps/CI/CD pipelines

Nice to have:

  • Exposure to leadership in a big data environment with optimization of parallel data processing
  • Familiarity with architecture standards, problem-solving, process automation, and cost-efficiency in complex infrastructures
What we offer:
  • High-Impact Cloud Transformation: Lead end-to-end architecture for complex AWS initiatives, enhancing data ingestion and analytics at enterprise scale
  • Cutting-Edge Tech Stack: Work with advanced tools including Docker (ECS/ECR), Apache Spark, Airflow, Redshift, and serverless architectures
  • Comprehensive DevOps: Engage with Bamboo, GitLab, and CI/CD pipelines, leveraging Infrastructure as Code for robust continuous delivery
  • Collaboration & Leadership: Partner with data engineers, developers, and business stakeholders, honing communication and problem-solving skills
  • Professional Growth: Advance expertise in big data, containerization, data lakehouse paradigms, and next-generation data workflow automation

Additional Information:

Job Posted:
April 27, 2025

Expiration:
May 27, 2025

Work Type:
Hybrid work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.