CrawlJobs Logo

Software Engineer – Bigdata

Sygna Solutions

Location Icon

Location:
United States

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Software Engineer – Bigdata role involving development, analysis, and support of computer applications and software, with a focus on handling large datasets, data transformation, and system architecture.

Job Responsibility:

  • Develop, create, and modify computer applications
  • Analyze user needs and software requirements to determine feasibility of design
  • Provide support and administration of computer applications and software programs
  • Implementation of business approved transformation/logics using Vector pipeline, Python connector creation for aforesaid transformations
  • Analyzed the source data and designed the solution to implement using Python/Vector flow
  • Experienced in handling large datasets using Partitions, Memory utilizations, replication, load balancing, Fault tolerance, Transformations and other during ingestion process itself
  • Visualization of transformed data sets from Splunk tool
  • Handling and managing structured and semi-structured data and writing python connectors
  • Development and deployment of code and subsequently deploy in PRODUCTION server for down-streams
  • Develop Elastic search index and exposing as rest-full web-services for client consumption
  • Evaluate new technologies, execute proof-of-concepts and develop specialized algorithms
  • Participate in planning, definition, high-level design and code review of the solution and explore solution alternatives with team members
  • Create end to end technical design for the define business requirements, data governance rules and data domain transformation to Bigdata analytical data model
  • Define the structure of the system, its interfaces, and the principles that guide its organization, software design and implementation
  • Define architecture for Data Lake, Reporting mart, Extract data mart, Elastic Search data marts, In-house reporting and various Vendor extracts
  • Review and approve the test strategy and test plan
  • Assist for User Acceptance Testing and helping them setting up complex data to validate the scenarios
  • Preparing Technical Specification Documents, System Integration Testing Documents and User Acceptance Testing Documents
  • Attending daily hurdle meeting, weekly and monthly meetings with senior management
  • Work closely with team to ensure successful project completion

Requirements:

  • 10+ Yrs experience
  • Bachelor’s degree or equivalent in Computer Science, Computer Information Systems, Information Technology, or a related degree

Additional Information:

Job Posted:
December 12, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.