CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

AWS Big Data Architect

United States, Philadelphia Employment contract · Job Posted March 13, 2026
Apply Position
Job Link Share

Job Description

We are seeking a highly skilled AWS Big Data Architect / Senior Data Engineer to design, develop, and deliver scalable Big Data Warehouse solutions. This is a hands-on role suited for someone who is passionate about technology, thrives in a collaborative environment, and can work effectively with both technical and non-technical stakeholders. The ideal candidate excels in fast-paced settings and is committed to producing high-quality, impactful results. This role offers the opportunity to collaborate with engineering teams across the enterprise and influence broader data and technology strategies.

Job Responsibility

  • Design and develop scalable Big Data Warehouse solutions across the full data supply chain
  • Build and implement metadata management solutions
  • Create and maintain technical documentation, user documentation, data models, data dictionaries, glossaries, process flows, and architecture diagrams
  • Enhance and expand the enterprise Data Lake environment
  • Solve complex data integration challenges across multiple systems
  • Design and execute strategies for real-time data analysis and decision-making
  • Collaborate with business partners, analysts, developers, architects, and engineers to support ongoing data quality initiatives
  • Work closely with Data Science teams to improve actionable insights
  • Continuously expand knowledge of new tools, platforms, and technologies

Requirements

  • Strong background in data management, data access, Big Data, Data Marts, and Data Warehousing
  • Proficiency in SQL, Spark SQL, and DataFrames
  • Experience with modern data warehousing concepts using technologies such as Redshift, Spark, Hadoop, and web services
  • Experience in data architecture and data assembly
  • Knowledge of Data Governance and Data Security practices
  • Hands-on experience with data integration tools (e.g., Talend preferred
  • Cascading a plus)
  • Experience with scripting languages for data manipulation
  • Experience with Business Intelligence tools, MDM, XML, SOA/Web Services
  • Exposure to Data Science technologies and toolsets
  • Bachelor’s or Master’s degree in Computer Science, Data Processing, or equivalent work experience
  • Strong background in Data Warehousing or related analytical environments
  • Proficiency in Java programming and building frameworks
  • Hands-on experience with Hadoop and Spark
  • Experience with Amazon EMR/EC2 or equivalent cloud technologies
  • Minimum 2 years of experience with Python
  • Experience with Bitbucket and solid understanding of Git fundamentals
  • Familiarity with Linux environments
  • Experience with Jenkins and CI/CD pipelines
  • Strong understanding of core computer science fundamentals
  • Experience with AWS services such as Aurora, Athena, EMR, Redshift, and S3
  • Experience with Postgres and MySQL databases
  • Excellent organizational, communication, and project management skills

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

AWS Big Data Architect

8 matching positions

AWS Big Data Architect

We are seeking a highly skilled AWS Big Data Architect / Senior Data Engineer to...
Location
Location
United States , Philadelphia
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong background in data management, data access, Big Data, Data Marts, and Data Warehousing
  • Proficiency in SQL, Spark SQL, and DataFrames
  • Experience with modern data warehousing concepts using technologies such as Redshift, Spark, Hadoop, and web services
  • Experience in data architecture and data assembly
  • Knowledge of Data Governance and Data Security practices
  • Hands-on experience with data integration tools (e.g., Talend preferred
  • Cascading a plus)
  • Experience with scripting languages for data manipulation
  • Experience with Business Intelligence tools, MDM, XML, SOA/Web Services
  • Exposure to Data Science technologies and toolsets
Job Responsibility
Job Responsibility
  • Design and develop scalable Big Data Warehouse solutions across the full data supply chain
  • Build and implement metadata management solutions
  • Create and maintain technical documentation, user documentation, data models, data dictionaries, glossaries, process flows, and architecture diagrams
  • Enhance and expand the enterprise Data Lake environment
  • Solve complex data integration challenges across multiple systems
  • Design and execute strategies for real-time data analysis and decision-making
  • Collaborate with business partners, analysts, developers, architects, and engineers to support ongoing data quality initiatives
  • Work closely with Data Science teams to improve actionable insights
  • Continuously expand knowledge of new tools, platforms, and technologies
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • eligible to enroll in our company 401(k) plan
  • Fulltime
Read More
Arrow Right

AWS Big Data Architect III

We are seeking a hands-on AWS Big Data Architect with strong Hadoop and Spark ex...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Data Processing, or equivalent practical experience
  • Strong experience in data management, data access, and enterprise data warehousing
  • Hands-on experience with Big Data technologies including Hadoop and Spark
  • Proficiency in SQL, including Spark SQL and DataFrames
  • Experience with modern data warehousing and analytics platforms (e.g., Redshift, Spark, Hadoop, web services)
  • Experience in data architecture, data assembly, and data integration
  • Working knowledge of data governance and data security principles
  • Experience with AWS services, including: EMR, EC2, S3
  • Redshift, Athena
  • Aurora
Job Responsibility
Job Responsibility
  • Design and develop scalable Big Data Warehouse solutions spanning the full data lifecycle
  • Extend, enhance, and optimize enterprise Data Lake platforms
  • Architect and implement solutions for metadata management and data governance
  • Design and execute strategies for real-time data analysis and decision support
  • Solve complex data integration challenges across multiple systems and data sources
  • Collaborate with data science teams to improve accessibility and usability of actionable data
  • Support and promote data quality, security, and governance initiatives
  • Create and maintain technical and user-facing documentation, including: Data models and schemas
  • Data dictionaries and business glossaries
  • Architecture diagrams and data flow documentation
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

AWS Big Data Architect III

We are seeking a hands-on AWS Big Data Architect with strong Hadoop and Spark ex...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Data Processing, or equivalent practical experience
  • Strong experience in data management, data access, and enterprise data warehousing
  • Hands-on experience with Big Data technologies including Hadoop and Spark
  • Proficiency in SQL, including Spark SQL and DataFrames
  • Experience with modern data warehousing and analytics platforms (e.g., Redshift, Spark, Hadoop, web services)
  • Experience in data architecture, data assembly, and data integration
  • Working knowledge of data governance and data security principles
  • Experience with AWS services, including: EMR, EC2, S3, Redshift, Athena, Aurora
  • Programming experience with Java and framework development
  • At least 2 years of Python development experience
Job Responsibility
Job Responsibility
  • Design and develop scalable Big Data Warehouse solutions spanning the full data lifecycle
  • Extend, enhance, and optimize enterprise Data Lake platforms
  • Architect and implement solutions for metadata management and data governance
  • Design and execute strategies for real-time data analysis and decision support
  • Solve complex data integration challenges across multiple systems and data sources
  • Collaborate with data science teams to improve accessibility and usability of actionable data
  • Support and promote data quality, security, and governance initiatives
  • Create and maintain technical and user-facing documentation, including data models and schemas, data dictionaries and business glossaries, architecture diagrams and data flow documentation
  • Partner with management, architects, analysts, and engineers across teams
  • Demonstrate curiosity and willingness to learn and adopt new tools and skills
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Architect - Enterprise Data & AI Solutions

We are looking for a visionary Data Architect who can translate enterprise data ...
Location
Location
India , Chennai; Madurai; Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong background in RDBMS design, data modeling, and schema optimization
  • Advanced SQL skills, including performance tuning and analytics functions
  • Proven expertise in data warehouses, data lakes, and lakehouse architectures
  • Proficiency in ETL/ELT tools (Informatica, Talend, dbt, Glue)
  • Hands-on with cloud platforms (AWS Redshift, Azure Synapse, GCP BigQuery, Snowflake)
  • Familiarity with GenAI frameworks (OpenAI, Vertex AI, Bedrock, Azure OpenAI)
  • Experience with real-time streaming (Kafka, Kinesis, Flink) and big data ecosystems (Hadoop, Spark)
  • Strong communication skills with the ability to present data insights to executives
  • 8+ years in data architecture, enterprise data strategy, or modernization programs
  • Hands-on with AI-driven analytics and GenAI adoption
Job Responsibility
Job Responsibility
  • Design scalable data models, warehouses, lakes, and lakehouse solutions
  • Build data pipelines to support advanced analytics, reporting, and predictive insights
  • Integrate GenAI frameworks to enhance data generation, automation, and summarization
  • Define and enforce enterprise-wide data governance, standards, and security practices
  • Drive data modernization initiatives, including cloud migrations
  • Collaborate with stakeholders, engineers, and AI/ML teams to align solutions with business goals
  • Enable real-time and batch insights through dashboards, AI-driven recommendations, and predictive reporting
  • Mentor teams on best practices in data and AI adoption
What we offer
What we offer
  • Opportunity to design next-generation enterprise data & AI architectures
  • Exposure to cutting-edge GenAI platforms to accelerate innovation
  • Collaborate with experts across cloud, data engineering, and AI practices
  • Access to learning, certifications, and leadership mentoring
  • Competitive pay with opportunities for career growth and leadership visibility
  • Fulltime
Read More
Arrow Right

Principal Data Architect

At Comcast advertising, we're building a data-driven future, and we need a Princ...
Location
Location
United States
Salary
Salary:
107020.26 - 250828.74 USD / Year
comcastadvertising.com Logo
Comcast Advertising
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Implementing cloud data architecture and data integration patterns (AWS Glue, Azure Data Factory, Event Hub, Databricks, etc.), storage and processing (Redshift, Azure Synapse,BigQuery, Snowflake)
  • Infrastructure as code (CloudFormation, Terraform)
  • 3rd Party Integration (Salesforce, D365)
  • Understanding and experience with modern cloud data architectures and engineering for one or more of the following cloud providers - AWS, Azure, GCP
  • Experience building data models and semantic layers
  • Design and Implementing enterprise reporting solutions using Tableau / Looker
  • Experience in integrating pipeline with REST API / GRAPHQL
  • Exposure to Mulesoft API and Clean Rooms will be desired
  • Experience in defining Master Data Management strategy and exposing data securely as a through data sharing architecture and APIs
  • Leading and supporting data architecture team and leads in creation of cloud data migration/integration/warehouse plans, roadmap, success metrics, and assessment of client’s enterprise (on-premise and on-cloud) data systems
Job Responsibility
Job Responsibility
  • Collaborate across application and data teams to orchestrate data solutions that meet needs from transactional, analytics and data science needs
  • Propose solutions focusing on tenants such as cost optimization, reducing data hops, ensuring high availability, performance and Effectv’s strategic needs and future growth goals as it relates to becoming a ‘data driven’ organization
  • Ensure solutions adhere to policies outlined at Comcast level such as data privacy and security
  • Design and manage robust, scalable data models and semantic layer
  • Build prototypes, publish design patterns for use by the organization
  • Provide guidance on getting started in cloud and cloud migration techniques
  • Work with the data governance team to ensure critical data elements are identified and monitored
  • Work with partners like AWS, Databricks, Snowflake to ensure services meet the growing needs of Effectv
  • Facilitate in-depth architectural discussions and design exercises to create world-class cloud solutions
  • Work with internal and external stakeholders to gather requirements
What we offer
What we offer
  • Paid Time off
  • Physical Wellbeing
  • Financial Wellbeing
  • Emotional Wellbeing
  • Life Events + Family Support
  • Base pay
  • Bonus/Commission eligibility
  • Fulltime
Read More
Arrow Right

Cloud Solution Architect (Data & Analytics)

With more than 45,000 employees and partners worldwide, the Customer Experience ...
Location
Location
Spain , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Information Technology, Engineering, Business or related field and experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or Business Applications consulting OR equivalent experience
  • Enterprise-scale experience with Azure Databricks, including Spark, Delta Lake, and Unity Catalog for scalable data engineering and transformation
  • Hands-on experience with Microsoft Fabric, including OneLake, Fabric Lakehouse, Fabric Data Warehouse, and Real-Time Intelligence (RTI) components
  • Proven ability to design and deliver Advanced Analytics and Big Data architectures within Microsoft Fabric and Azure ecosystems
  • Deep understanding of data modeling, data warehousing, and distributed data architectures
  • Proficiency in Python, SQL, PowerShell, and Infrastructure as Code for automation and integration
  • Strong understanding of data governance, security, and compliance best practices in cloud data environments
  • Awareness of competitive data platforms such as AWS (Redshift, Glue, EMR), GCP (BigQuery, DataProc), and Snowflake
Job Responsibility
Job Responsibility
  • Understand customers' overall data estate, business priorities, and IT success measures
  • Prioritize Customer Satisfaction: Foster positive relationships and become a trusted advisor
  • Ensure Solution Excellence: Deliver solutions with high performance, security, scalability, maintainability, repeatability, reusability, and reliability upon deployment
  • Drive Consumption Growth: Develop opportunities to enhance Customer Success and help customers extract value from their Microsoft investments
  • Unblock Customer Challenges: Leverage subject matter expertise to identify resolutions for customer blockers
  • Architect modern Data & Analytics Solutions: Apply technical knowledge to design solutions aligned with business and IT needs
  • Advocate for Customers: Share insights and best practices, collaborate with the Engineering team to address key blockers, and drive product improvements
  • Continuous Learning: Stay updated on market trends, collaborate with the Data, Analytics and AI technical community, and educate customers about the Azure platform
  • Accelerate Outcomes: Share expertise, contribute to IP creation, and promote reusability to accelerate customer success
  • Fulltime
Read More
Arrow Right

Data Architect

Experience : 8+ Years Full Time Location: Chennai, Madurai, Coimbatore- Hybrid ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong background in RDBMS design, data modeling, and schema optimization
  • Advanced SQL skills, including performance tuning and analytics functions
  • Proven expertise in data warehouses, data lakes, and lakehouse architectures
  • Proficiency in ETL/ELT tools (Informatica, Talend, dbt, Glue)
  • Hands-on with cloud platforms (AWS Redshift, Azure Synapse, GCP BigQuery, Snowflake)
  • Familiarity with GenAI frameworks (OpenAI, Vertex AI, Bedrock, Azure OpenAI)
  • Experience with real-time streaming (Kafka, Kinesis, Flink) and big data ecosystems (Hadoop, Spark)
  • Strong communication skills with the ability to present data insights to executives
Job Responsibility
Job Responsibility
  • Design scalable data models, warehouses, lakes, and lakehouse solutions
  • Build data pipelines to support advanced analytics, reporting, and predictive insights
  • Integrate GenAI frameworks to enhance data generation, automation, and summarization
  • Define and enforce enterprise-wide data governance, standards, and security practices
  • Drive data modernization initiatives, including cloud migrations
  • Collaborate with stakeholders, engineers, and AI/ML teams to align solutions with business goals
  • Enable real-time and batch insights through dashboards, AI-driven recommendations, and predictive reporting
  • Mentor teams on best practices in data and AI adoption
What we offer
What we offer
  • Opportunity to design next-generation enterprise data & AI architectures
  • Exposure to cutting-edge GenAI platforms to accelerate innovation
  • Collaborate with experts across cloud, data engineering, and AI practices
  • Access to learning, certifications, and leadership mentoring
  • Competitive pay with opportunities for career growth and leadership visibility
  • Fulltime
Read More
Arrow Right

Data Architect

Do you want to join a fast-growing global consultancy in the life science indust...
Location
Location
Denmark , København
Salary
Salary:
Not provided
life-science-talent-solutions.dk Logo
Life Science Talent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in implementing IT solutions
  • 3+ years in the pharmaceutical or life sciences industry
  • Experience building Data Architecture frameworks for a specific tech/data product
  • Experience designing and managing systems that integrate data from various sources (Mulesoft, Alteryx, Rest APIs)
  • Experience leading initiatives to establish robust data governance framework and lineage (GxP, 21 CFR Part 11)
  • Experience overseeing the continuous improvement of defined frameworks
  • Experience contributing to the identification of significant data assets & translation of business requirements into data products
  • Experience identifying & assessing potential impacts/opportunities of product choices from a data architecture standpoint
  • Experience coordinating with other Data/Tech Architects
  • Ability to provide data architecture best practices
Job Responsibility
Job Responsibility
  • Design and implement scalable data architectures to support the complex data needs of pharmaceutical clients
  • Lead the strategy for data integration, data governance, and cloud infrastructure across R&D and Commercial Excellence datasets
  • Ensure architecture aligns with industry standards and supports the team’s analytical objectives
  • Collaborate with senior stakeholders, business analysts, data engineers, and data scientists to create a unified, efficient data ecosystem
  • Translate pharma clients’ business needs into user stories and technology
  • Participate in implementation projects for high profile clients – from initiation to completion
What we offer
What we offer
  • Flexible schedule
  • An entrepreneurial and multi-cultural work environment
  • Ongoing learning and development opportunities
  • An inspiring work environment with many social events
  • A culture based on trust, diversity, and inclusion
  • Home office setup and a remote friendly mindset
  • Comprehensive benefit package
  • Opportunities for career advancement
  • Competitive salary
  • Fulltime
Read More
Arrow Right