This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
Software Engineer – Bigdata role involving development, analysis, and support of computer applications and software, with a focus on handling large datasets, data transformation, and system architecture.
Job Responsibility:
Develop, create, and modify computer applications
Analyze user needs and software requirements to determine feasibility of design
Provide support and administration of computer applications and software programs
Implementation of business approved transformation/logics using Vector pipeline, Python connector creation for aforesaid transformations
Analyzed the source data and designed the solution to implement using Python/Vector flow
Experienced in handling large datasets using Partitions, Memory utilizations, replication, load balancing, Fault tolerance, Transformations and other during ingestion process itself
Visualization of transformed data sets from Splunk tool
Handling and managing structured and semi-structured data and writing python connectors
Development and deployment of code and subsequently deploy in PRODUCTION server for down-streams
Develop Elastic search index and exposing as rest-full web-services for client consumption
Evaluate new technologies, execute proof-of-concepts and develop specialized algorithms
Participate in planning, definition, high-level design and code review of the solution and explore solution alternatives with team members
Create end to end technical design for the define business requirements, data governance rules and data domain transformation to Bigdata analytical data model
Define the structure of the system, its interfaces, and the principles that guide its organization, software design and implementation
Define architecture for Data Lake, Reporting mart, Extract data mart, Elastic Search data marts, In-house reporting and various Vendor extracts
Review and approve the test strategy and test plan
Assist for User Acceptance Testing and helping them setting up complex data to validate the scenarios
Preparing Technical Specification Documents, System Integration Testing Documents and User Acceptance Testing Documents
Attending daily hurdle meeting, weekly and monthly meetings with senior management
Work closely with team to ensure successful project completion
Requirements:
10+ Yrs experience
Bachelor’s degree or equivalent in Computer Science, Computer Information Systems, Information Technology, or a related degree
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.