Big Data & Scala Engineer Job at We Are Meta (Porto)

Data Engineer

An entry level, highly motivated, results oriented individual with strong data e...

Location

United States , Starkville; Dallas; San Francisco; Syracuse

Salary:

Not provided

PhasorSoft Group

Expiration Date

Until further notice

Requirements

Data engineering experience in the industry working in data architecture, data modeling, master data management, and metadata management
Working experience with relational as well as NoSQL data stores, methods and approaches (logging, columnar, star and snowflake, dimensional modeling)
Scaling and optimizing schemas, performance tuning SQL and ETL pipelines in OLAP and Data Warehouse environments
Moving fluidly between programming languages: Scala, Java, and Python
Familiarity with data governance frameworks, SDLC, and Agile methodology
BE/BTech, MS in CS, CE, SE, Data Science, BIS, and MIS - recent Graduate is required
Good written and verbal communication skills

Fulltime

Senior Big Data Engineer

The Big Data Engineer is a senior level position responsible for establishing an...

Location

Canada , Mississauga

Salary:

94300.00 - 141500.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

5+ Years of Experience in Big Data Engineering (PySpark)
Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources
Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka
Proficiency in programming languages like Python, or Scala
Strong expertise in data processing frameworks such as Apache Spark, Hadoop
Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)
Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery)
Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.)
Experience with data orchestration tools like Apache Airflow or Prefect
Familiarity with containerization (Docker, Kubernetes) is a plus

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets

Fulltime

Senior Big Data Engineer

The Big Data Engineer is a senior level position responsible for establishing an...

Location

Canada , Mississauga

Salary:

94300.00 - 141500.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

5+ Years of Experience in Big Data Engineering (PySpark)
Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources
Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka
Proficiency in programming languages like Python, or Scala
Strong expertise in data processing frameworks such as Apache Spark, Hadoop
Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)
Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure (Synapse), or GCP (BigQuery)
Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.)
Experience with data orchestration tools like Apache Airflow or Prefect
Familiarity with containerization (Docker, Kubernetes) is a plus

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

What we offer

Well-being support
Growth opportunities
Work-life balance support

Fulltime

Big Data Scala Engineering Developer

The Applications Development Senior Programmer/Lead Analyst is an senior level p...

Location

India , Pune; Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
9+ years of experience working with Hive, Impala and Hbase, Kudu Spark for data curation/conformance related work
Strong proficiency in Spark for development work related to curation/conformance
Strong Scala developer (with previous Java background) preferred
Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging
Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
Experience working in an agile environment with a fast paced changing requirements
Excellent planning and organizational skills
Strong Communication skills
Bachelor's degree/University degree or equivalent experience

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation
Provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Interface with product teams to understand their requirements to build the ingestion pipelines and conformance layer
Work closely with the data ingestion team to track the requirements and drive the build out of the canonical models

Fulltime

Big Data Engineering Lead

The Senior Big Data engineering lead will play a pivotal role in designing, impl...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's or Master’s degree in Computer Science, Information Technology, or related field
Atleast 10 -12 years overall software development experience on majorly working with handling application with large scale data volumes from ingestion, persistence and retrieval
Deep understanding of big data technologies, including Hadoop, Spark, Kafka, Flink, NoSQL databases, etc.
Experience with Bigdata technologies Developer Hadoop, Apache Spark, Python, PySpark
Strong programming skills in languages such as Java, Scala, or Python
Excellent problem-solving skills with a knack for innovative solutions
Strong communication and leadership abilities
Proven ability to manage multiple projects simultaneously and deliver results

Job Responsibility

Lead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and resilience
Design complex data transformation processes using Spark and other big data technologies using Java, Pyspark or Scala
Design and implement data pipelines that ensure data quality, integrity, and availability
Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
Evaluate and select technologies that improve data efficiency, scalability, and performance
Oversee the deployment and management of big data tools and frameworks such as Hadoop, Spark, Kafka, and others
Provide technical guidance and mentorship to the development team and junior architects
Continuously assess and integrate emerging technologies and methodologies to enhance data processing capabilities
Optimize big data frameworks, such as Hadoop, Spark, for performance improvements and reduced processing time across distributed systems
Implement data governance frameworks to ensure data accuracy, consistency, and privacy across the organization, leveraging metadata management and data lineage tracking

Fulltime

Big Data Engineering Developer

The Applications Development Senior Programmer/Lead Analyst is an senior level p...

Location

India , Pune; Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
9+ years of experience working with Hive, Impala and Hbase, Kudu Spark for data curation/conformance related work
Strong proficiency in Spark for development work related to curation/conformance. Strong Scala developer (with previous Java background) preferred.
Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging
Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
Experience working in an agile environment with a fast paced changing requirements.
Excellent planning and organizational skills
Strong Communication skills

Job Responsibility

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
Ensure essential procedures are followed and help define operating standards and processes
Serve as advisor or coach to new or lower level analysts
Has the ability to operate with a limited level of direct supervision
Can exercise independence of judgement and autonomy
Acts as SME to senior stakeholders and /or other team members

Fulltime

Big Data / Scala / Python Engineering Lead

The Applications Development Technology Lead Analyst is a senior level position ...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

At least two years (Over all 10+ hands on Data Engineering experience) of experience building and leading highly complex, technical data engineering teams
Lead data engineering team, from sourcing to closing
Drive strategic vision for the team and product
Experience managing an data focused product, ML platform
Hands on experience relevant experience in design, develop, and optimize scalable distributed data processing pipelines using Apache Spark and Scala
Experience managing, hiring and coaching software engineering teams
Experience with large-scale distributed web services and the processes around testing, monitoring, and SLAs to ensure high product quality
7 to 10+ years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems
Proficiency in Functional Programming: High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines
Proficiency in Big Data Technologies: Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN

Job Responsibility

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary

Fulltime

Software Engineer - Data Engineering

Akuna Capital is a leading proprietary trading firm specializing in options mark...

Location

United States , Chicago

Salary:

130000.00 USD / Year

AKUNA CAPITAL

Expiration Date

Until further notice

Requirements

BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field
5+ years of professional experience developing software applications
Java/Scala experience required
Highly motivated and willing to take ownership of high-impact projects upon arrival
Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino
Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements
Must possess excellent communication, analytical, and problem-solving skills
Recent hands-on experience with AWS Cloud development, deployment and monitoring necessary
Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects
The ability to react quickly and accurately to rapidly changing market conditions, including the ability to quickly and accurately respond and/or solve math and coding problems are essential functions of the role

Job Responsibility

Work within a growing Data Engineering division supporting the strategic role of data at Akuna
Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark
Mentor junior engineers in software and data engineering best practices
Produce clean, well-tested, and documented code with a clear design to support mission critical applications
Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness
Challenge the status quo and help push our organization forward, as we grow beyond the limits of our current tech stack

What we offer

Discretionary performance bonus
Comprehensive benefits package that may encompass employer-paid medical, dental, vision, retirement contributions, paid time off, and other benefits

Fulltime

Big Data & Scala Engineer

We Are Meta

Location:
Portugal , Porto

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Requirements:

Nice to have:

Additional Information:

Job Posted:
January 15, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Big Data & Scala Engineer

Data Engineer

Senior Big Data Engineer

Senior Big Data Engineer

Big Data Scala Engineering Developer

Big Data Engineering Lead

Big Data Engineering Developer

Big Data / Scala / Python Engineering Lead

Software Engineer - Data Engineering

Big Data & Scala Engineer

We Are Meta

Location:Portugal , Porto

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Requirements:

Nice to have:

Additional Information:

Job Posted:January 15, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Big Data & Scala Engineer

Data Engineer

Senior Big Data Engineer

Senior Big Data Engineer

Big Data Scala Engineering Developer

Big Data Engineering Lead

Big Data Engineering Developer

Big Data / Scala / Python Engineering Lead

Software Engineer - Data Engineering

Location:
Portugal , Porto

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
January 15, 2026