CrawlJobs Logo
Sygna Solutions Logo Sygna Solutions · IT - Software Development

Software Engineer – Bigdata

United States · Job Posted December 12, 2025
Apply Position
Job Link Share

Job Description

Software Engineer – Bigdata role involving development, analysis, and support of computer applications and software, with a focus on handling large datasets, data transformation, and system architecture.

Job Responsibility

  • Develop, create, and modify computer applications
  • Analyze user needs and software requirements to determine feasibility of design
  • Provide support and administration of computer applications and software programs
  • Implementation of business approved transformation/logics using Vector pipeline, Python connector creation for aforesaid transformations
  • Analyzed the source data and designed the solution to implement using Python/Vector flow
  • Experienced in handling large datasets using Partitions, Memory utilizations, replication, load balancing, Fault tolerance, Transformations and other during ingestion process itself
  • Visualization of transformed data sets from Splunk tool
  • Handling and managing structured and semi-structured data and writing python connectors
  • Development and deployment of code and subsequently deploy in PRODUCTION server for down-streams
  • Develop Elastic search index and exposing as rest-full web-services for client consumption
  • Evaluate new technologies, execute proof-of-concepts and develop specialized algorithms
  • Participate in planning, definition, high-level design and code review of the solution and explore solution alternatives with team members
  • Create end to end technical design for the define business requirements, data governance rules and data domain transformation to Bigdata analytical data model
  • Define the structure of the system, its interfaces, and the principles that guide its organization, software design and implementation
  • Define architecture for Data Lake, Reporting mart, Extract data mart, Elastic Search data marts, In-house reporting and various Vendor extracts
  • Review and approve the test strategy and test plan
  • Assist for User Acceptance Testing and helping them setting up complex data to validate the scenarios
  • Preparing Technical Specification Documents, System Integration Testing Documents and User Acceptance Testing Documents
  • Attending daily hurdle meeting, weekly and monthly meetings with senior management
  • Work closely with team to ensure successful project completion

Requirements

  • 10+ Yrs experience
  • Bachelor’s degree or equivalent in Computer Science, Computer Information Systems, Information Technology, or a related degree
Sygna Solutions - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer – Bigdata

8 matching positions

Senior Bigdata Engineer -Assistant Vice President

The Senior Data Analyst is a senior-level position responsible for liaising betw...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-12 years of relevant experience in data analysis, preferably within the Financial Services or Banking industry
  • Proven interpersonal, diplomatic, management, and prioritization skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Proven ability to manage multiple activities, build strong working relationships, and work effectively under pressure
  • Demonstrated strong problem-solving, analytical, and decision-making skills with a methodical attention to detail
  • Proven self-motivation to take initiative and master new tasks and technologies quickly
  • Bachelor's degree/University degree in a technical or business discipline (or equivalent experience)
  • Extensive experience in analyzing and interpreting complex data from disparate sources to provide actionable insights
  • Strong understanding of financial products, banking processes, and industry standards
  • Proven ability to analyze different data sources and datasets to create comprehensive data mapping documents and define data ingestion requirements
Job Responsibility
Job Responsibility
  • Formulate and define the scope and objectives for complex data analysis projects, fostering clear communication between business leaders and IT
  • Consult with users and clients to solve complex data-related issues through in-depth evaluation of business processes, data sources, and industry standards
  • Analyze large and diverse datasets from various sources to identify trends, patterns, and anomalies, providing critical input for business and technology initiatives
  • Develop and document data mapping specifications, transformation logic, and ingestion requirements for new data pipelines and systems
  • Consult with business clients to determine functional specifications for data-centric systems and provide ongoing operational support
  • Identify, communicate, and mitigate risks and impacts related to data quality, data governance, and the application of technology
  • Act as an advisor or coach to new or lower-level analysts and work as a team to achieve business objectives
  • Act as a Subject Matter Expert (SME) on data sources, data models, and analysis techniques for senior stakeholders and other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Senior Bigdata Engineer

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8 - 10 years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Programming Languages: Python, PySpark
  • Data Lake Table Format: Apache Iceberg
  • Data Orchestration: Apache Airflow
  • Data Visualization: Tableau
  • Big Data Processing: Apache Spark
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
What we offer
What we offer
  • Equal employment opportunity
  • Fulltime
Read More
Arrow Right

Senior Java -Spark-Bigdata Engineer-Assistant Vice President

The Applications Development Senior Programmer Analyst is a senior-level positio...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-10 years of relevant experience in Data Engineering or a similar role, preferably within the Financial Services industry
  • Senior-level experience in an Applications Development or Data Engineering role
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
  • Hands-on expertise in Java (8+), Spring Boot, Python, and PySpark for building high-performance data applications
  • Extensive experience with the BigData ecosystem, including Apache Spark for large-scale data processing
  • Solid understanding of Data Warehouse concepts, design principles, and best practices
  • Strong proficiency with both relational SQL databases and NoSQL databases (e.g., MongoDB, Couchbase)
Job Responsibility
Job Responsibility
  • Utilize expert knowledge of data engineering principles, big data technologies, and software development best practices to design and implement robust data solutions
  • Collaborate with business stakeholders, data scientists, and other technology teams to understand data requirements and deliver effective solutions
  • Apply deep expertise in programming languages like Python and Java for building high-performance data processing applications
  • Ensure data solutions are secure, scalable, and adhere to the firm's security and architectural standards
  • Mentor and guide junior engineers, fostering a culture of technical excellence and continuous learning
  • Lead the analysis of complex data-related issues, identify root causes, and implement sustainable solutions
  • Operate with a high degree of autonomy and independence, exercising sound judgment and decision-making
  • Act as a Subject Matter Expert (SME) in big data technologies for senior stakeholders and other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Bigdata Developer With Spark

Citi are recruiting a Full Stack Data Engineer, reporting to the Engineering Lea...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years development and system design experience
  • More than 2 years of experience in BigData technologies like spark, hive, python
  • Strong Python programming skill
  • Strong experience in building ETL/data engineering solutions
  • Demonstrated experience with LLM Model, prompt engineering & AI workflow
  • Proven proactive problem solving & trouble shooting skills
  • Strong Knowledge in Spark, Python
  • Strong experience in Hive/SQL, PL/SQL
  • Good Understanding of Big data Ecosystem
  • Good Understanding of ETL & DW Concepts, Unix Scripting
Job Responsibility
Job Responsibility
  • Design & develop Data engineering solutions using Big Data Technologies
  • Design & Develop and test software applications that leverages LLM Models & AI Capabilities
  • Provide technical walk-throughs to various stakeholders
  • Be able to work independently as well as within a team
  • Works directly with end-users or a projects team to translate business requirements into technical specifications to drive Semantic layer and report
  • Prioritize technical issue resolution
  • Works closely with management to prioritize business needs and stay up to date with the goals of the organization as they evolve
  • Also work with other departments to find new ways to improve opportunities
  • Requirement gathering & understanding, effort estimation, technical design, project planning and monitoring
  • Understand and analyze the data to find patterns and valuable business insights
  • Fulltime
Read More
Arrow Right

Engineering Director Data Engineering

Location
Location
India , Gurugram
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 26, 2026
Flip Icon
Requirements
Requirements
  • Proficiency in Data Engineering
  • Strong knowledge of data pipeline development and data integration techniques
  • 5+ years of overall IT experience, which includes building & deployment of Bigdata applications using PySpark and AWS cloud
  • Extensive experience in design, build and deployment of Python-based applications
  • Hands-on experience in relational databases preferably Oracle and PostgreSQL and writing complex SQL queries
  • Experience in various AWS services such as EMR, API Gateway, RDS instance, and Lambda
  • Understand complex data sets and ETL processes, and how they can be optimized using Spark
  • Experience with cloud-based data platforms and distributed computing frameworks
  • Ability to optimize data workflows for performance and scalability
  • Familiarity with database management systems and data warehousing concepts
Job Responsibility
Job Responsibility
  • Expected to be an SME, collaborate and manage the team to perform
  • Responsible for team decisions
  • Engage with multiple teams and contribute on key decisions
  • Provide solutions to problems for their immediate team and across multiple teams
  • Lead the coordination of project activities to ensure timely delivery of software components
  • Mentor junior team members to support their professional growth and skill development
  • Facilitate effective communication between stakeholders to align technical solutions with business objectives
  • Collaborate with other teams to integrate Spark jobs into the overall data pipeline
  • Monitoring and tuning data loads and queries
Read More
Arrow Right

Cmi Application Developer

We are seeking a talented Application Developer to join our dynamic Capital Mark...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
credit-agricole.com Logo
Crédit Agricole
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Good knowledge in UNIX platform and database management systems ( SQL, Oracle, Sybase, BigData…..)
  • Experience with automation frameworks and libraries
  • Proficiency in scripting languages (Python, Shell script, PowerShell, SQL…)
  • Valuable exposure to tools & technologies like Elastic Search, Grafana, Prometheus, Kibana, Control-M, KAFKA, Confluence, Jira, Gitlab, MQ Series
  • Knowledge of Cloud platforms and services
  • Experience in DevOps tooling (GIT, Maven/Graven/Nuget/Ansible, Jenkins… )
  • Experience with Docker/Kurbernetes
  • Experience in supporting capital market applications and trading systems, ideally within the dynamic landscape of Market Risk/Front Office operations with a commendable grasp of financial products (Treasury, FX, Credit, IRD, Bonds, RSF etc.)
  • Excellent communication and interpersonal skills to effectively collaborate with diverse teams
  • Excellent problem-solving and analytical skills
Job Responsibility
Job Responsibility
  • Research, design, and develop computer and network software or specialised utility programs
  • Analyse user needs and develop software solutions, applying principles and techniques of computer science, engineering, and mathematical analysis
  • Update software, enhances existing software capabilities, and develops and direct software testing and validation procedures
  • Work with computer hardware engineers to integrate hardware and software systems and develop specifications and performance requirements
  • Build quality, shippable, and reusable code according to design and coding standards
  • Write simple, purposeful, and lean code that aligns with CMI project guidelines and quality standards
  • Perform peer reviews when needed to ensure code quality and adherence to best practices
  • Implement Configuration Management on each of your work items to ensure version control and traceability
  • Perform unit tests to verify the functionality
  • Automate tests according to the test strategy, ensuring test coverage targets are met and adhering to software factory practices
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data/Information Mgt Analyst 2 is a developing professional role. Applies sp...
Location
Location
India , Haryana; Bengaluru
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s / Engineering Degree with more than 3 years of experience in BigData systems, Hive, Hadoop, Spark (Python/ scala) and cloud based data management technologies
  • Hands-on experience in Unix Scripting, Python and Scala programing along with strong experience in SQL
  • Comfortable working with completed unstructured, undocumented code and turning it around into best in class code redesigning costly compute and data processes and aligning to best development standards
  • Experienced in working with large and multiple datasets, data warehouses and ability to pull data using relevant programs and coding
  • Well versed with necessary data preprocessing and application engineering skills
  • At least 3 years of experience designing software systems with intense computational needs across real time and batch process
  • Experience and understanding of Supervised, unsupervised machine learning techniques
  • Ability to identify, clearly articulate and solve complex business problems and present them to the management in a structured and simpler form
  • Should have experience of working in onsite, offsite delivery model
  • Experience working with large and multiple datasets, data warehouses and ability to pull data using relevant programs and coding
Job Responsibility
Job Responsibility
  • Applies specialty area knowledge in monitoring, assessing, analyzing and/or evaluating processes and data
  • Identifies policy gaps and formulates policies
  • Interprets data and makes recommendations
  • Researches and interprets factual information
  • Identifies inconsistencies in data or results, defines business issues and formulates recommendations on policies, procedures or practices
  • Integrates established disciplinary knowledge within own specialty area with basic understanding of related industry practices
  • Good understanding of how the team interacts with others in accomplishing the objectives of the area
  • Develops working knowledge of industry practices and standards
  • Limited but direct impact on the business through the quality of the tasks/services provided
  • Impact of the job holder is restricted to own team
  • Fulltime
Read More
Arrow Right

Senior Lead Developer (Java, Spark, HDFS, Hive) - Vice President

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Highly experienced and skilled Java technical lead with 10+years of experience with software building and platform engineering
  • Extensive development expertise in building the high scaled and performant software platforms for data computation and processing
  • Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right