CrawlJobs Logo

Software Engineer – Web Data Extraction & API Development

sybrant.com Logo

Sybrant Technologies

Location Icon

Location:

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

Sybrant Technologies has been in the forefront of transforming its customers into full digital businesses. Though we are small, we grow at a rapid pace due to our capabilities in the contemporary technologies. Sybrant can deep dive in areas such as Mobility, IoT and Analytics in addition to traditional technologies. We can rapidly implement these solutions because of the Products, Frameworks and Partnerships that we have. In addition, our technically sound people and proven processes help in accelerating our customers’ adoption curves. Advantage Sybrant has always been in its nimbleness and delivering high quality yet cost effective solutions. That’s why we are the “Digital Transformation Power” behind our customers. We are a PreludeSys Group Company.

Job Responsibility:

  • Develop and maintain web scraping scripts using Python (Requests, BeautifulSoup, Selenium, Scrapy)
  • Automate extraction workflows to ensure reliable and repeatable data collection
  • Handle anti-scraping mechanisms such as CAPTCHAs, rotating proxies, headers, and session management
  • Clean, transform, and load extracted data into internal databases
  • Design and build REST APIs to expose processed data from the database
  • Optimize scraping workflows for performance, reliability, and error handling
  • Monitor scraping jobs, troubleshoot failures, and ensure data freshness
  • Maintain documentation for scraping logic, API endpoints, and workflows
  • Collaborate with product and data teams to understand evolving data requirements

Requirements:

  • Strong proficiency in Python
  • Hands-on experience with web scraping tools (Requests, BeautifulSoup, Selenium, Scrapy)
  • Good understanding of HTML, DOM structure, XPath, and CSS selectors
  • Experience building REST APIs using FastAPI, Flask, or Django
  • Solid knowledge of SQL and relational databases (MySQL / PostgreSQL)
  • Experience handling proxies, cookies, headers, rate limits, and sessions
  • Familiarity with Git and basic CI/CD workflows

Nice to have:

  • Understanding of ETL concepts and data engineering workflows
  • Exposure to Airflow or other workflow orchestrators
  • Basic understanding of data pipelines or ML pipelines

Additional Information:

Job Posted:
February 20, 2026

Icon
Sybrant Technologies - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer – Web Data Extraction & API Development

Senior Software Engineer

We are looking for a Senior Software Engineer to join our team in Southern New H...
Location
Location
United States , Portsmouth
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 7 years of experience in software engineering, with significant exposure to backend development and business logic
  • Proficiency in Agile Scrum methodologies, API development, and technologies such as ASP.NET, Linq, and Blazor
  • Demonstrated ability to design and maintain enterprise-level software interfaces
  • Strong problem-solving skills and the ability to work independently while collaborating effectively with team members and stakeholders
  • Familiarity with financial systems and applications, with experience in the finance, banking, insurance, or healthcare industries being highly desirable
  • Bachelor’s degree in Computer Science, Software Engineering, or a related field
  • Commitment to growth and development through continuous learning, attending relevant courses, and staying updated on industry trends
  • Excellent communication skills and a proactive approach to managing tasks and responsibilities
Job Responsibility
Job Responsibility
  • Develop and maintain software solutions that align with business requirements and adhere to established technical standards
  • Design, refactor, and support data extraction and transformation tools, as well as web-based workflow management utilities
  • Collaborate with team members to establish software development standards, conduct code reviews, and manage version control
  • Serve as a technical resource for server-based third-party applications, ensuring smooth functionality and resolving issues
  • Monitor system performance, troubleshoot incidents, and implement improvements to maintain optimal operations
  • Ensure the confidentiality and security of sensitive information during software development and maintenance
  • Contribute to the creation of policies and procedures for software architecture and technical standards, supporting the development of the company’s software roadmap
  • Provide training, coaching, and support to team members on in-house and third-party tools
  • Recommend and implement design and product enhancements based on business needs and technological advancements
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
  • Fulltime
Read More
Arrow Right

Web Scraper Specialist

Join our Sales Operations team, and will also be working closely with the Sales ...
Location
Location
Spain , Barcelona
Salary
Salary:
1200.00 EUR / Month
pro.bsport.io Logo
Bsport
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Python (Beautiful Soup, data extraction, pandas, etc.)
  • Good understanding of HTML DOM, Web Applications architecture and API usage
  • Enrolled in software development or IT engineering studies
  • Basic SQL knowledge
Job Responsibility
Job Responsibility
  • Develop new python web scrapers to gather and collect data from specific sources (websites, APIs, csv files and spreadsheets), and convey this data through multiple steps and pipelines: cleaning the data, parsing and storage
  • Maintain current scrapers to assure the continuous flow of leads, fixing and adapting our code in case of changes of the scraped sources
  • Active monitoring of new technical solutions to optimise resource usage of current scraping stack
  • Production of insights (using SQL and data viz tools) to support sales supply & sourcing processes
What we offer
What we offer
  • Vibrant penthouse office in Eixample, Barcelona
  • Hybrid work, with 1 remote day per week
  • Work from anywhere – Travel & work remotely for up to 15 days per year
  • Fitness perks – Exclusive gym benefits tailored for you
  • Health insurance – Fully covered by us
  • Team culture & socials – Join after-work events and team outings
  • Team building & sports – Connect with your teammates through fun activities
  • Paid sick leave
  • Fulltime
Read More
Arrow Right
New

Engineer III - Software Engineering

Location
Location
India , Pune
Salary
Salary:
Not provided
cencora.com Logo
Cencora
Expiration Date
April 10, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's degree or related experience and 8+ years of development experience
  • 5+ years of professional experience in designing, developing, and maintaining Java applications, with a strong understanding of core Java concepts, data structures, and algorithms
  • 3+ years of React or Angular, Typescript, JavaScript, Node.js, HTML 5, CSS, and Bootstrap preferred
  • Proven experience in designing, developing, and deploying scalable and resilient microservices-based applications
  • In-depth knowledge and hands-on experience with either Spring Boot or Quarkus for building enterprise-level, cloud-native Java applications and RESTful APIs
  • Solid understanding of RESTful API design principles and experience in building and consuming RESTful web services
  • Experience working with SQL (e.g.,MySQL, Oracle) databases, including data modeling and query optimization
  • Proficiency with Git for version control and experience with CI/CD pipelines and tools (e.g., Jenkins, Azure Repos, Azure Pipelines)
  • Strong understanding of software testing principles and experience with unit testing (e.g., JUnit, Mockito), integration testing
  • Familiarity with cloud platforms (e.g., AWS, Azure) and containerization technologies like Docker and orchestration tools like Kubernetes is desirable
Job Responsibility
Job Responsibility
  • Designs, implements, unit tests, documents and deploys applications and APIs based on functional requirements
  • Designs and develops database applications using SQL Server Integration Services, TSQL and Stored Procedures
  • Consults with the business to determine logical design for new business solutions according to existing data architecture
  • Performs code reviews, analyze execution plans, and re-factor inefficient code
  • Provides technical support & guidance to Software Engineers I/II in development of desired software/applications
  • Follows data standards, resolves data issues, completes unit testing and completes system documentation for ETL processes
  • Assists Managers with project development, including documentation of features, recording of progress, and creation of the testing plan
  • Collaborates with business analysts, source system experts, and other team members to determine data extraction and transformation requirements
  • Collaborates with IT operations and testing organizations to ensure timely releases of projects and database environments are sustainable
  • Supports IT staff and business users in the development, usage and troubleshooting of database-driven applications
  • Fulltime
Read More
Arrow Right
New

OpenText Exstream Developer

This role is responsible for the development, installation, and maintenance of o...
Location
Location
India , Pune
Salary
Salary:
Not provided
cencora.com Logo
Cencora
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands‑on experience in OpenText Exstream 23.x / 24.x / 25.x (CloudNative)
  • Strong experience with XML, Print Miner, columnar and delimited data inputs
  • Expertise in batch and real‑time application design
  • Skilled in creating automated and complex table structures
  • Experience working with barcodes and inserter configurations
  • Proficient in generating outputs: PS, PDF, AFP, Empower, multi‑channel delivery
  • Deep knowledge of rules, formula variables, control files, document/pages setup, design layers, language layers
  • Hands‑on experience with two‑pass application design
  • Knowledge of orchestration workflows
  • Proficient in sorting, bundling, and post‑processing (AFP/PDF)
Job Responsibility
Job Responsibility
  • Develop OpenText Exstream applications
  • Design, implement, unit test, document, and deploy applications/APIs
  • Develop database solutions using SSIS, T‑SQL, and stored procedures
  • Collaborate with business teams to define logical designs aligned with data architecture
  • Perform code reviews, analyze execution plans, and optimize/re-factor code
  • Provide technical guidance to junior software engineers
  • Follow data standards, resolve data issues, perform unit testing, and document ETL processes
  • Assist managers with project documentation, progress tracking, and test plan creation
  • Work with business analysts and source system experts on data extraction & transformation requirements
  • Coordinate with IT operations and testing teams for timely, sustainable releases
  • Fulltime
Read More
Arrow Right
New

Application Engineer-Analyst

We are a technology and data driven team building scalable, reliable solutions t...
Location
Location
Mexico , Mexico City
Salary
Salary:
Not provided
blackrock.com Logo
BlackRock Investments
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • 2–5 years of hands-on experience building production-quality solutions using Python
  • Bachelor’s degree in engineering, Computer Science, Mathematics, or a related technical discipline
  • Strong Computer Science fundamentals (data structures, algorithms, logic, and software design principles)
  • Experience developing modern web applications using component‑based frameworks
  • Strong database fundamentals and experience with SQL
  • comfortable working with relational and non-relational data stores and designing efficient data models
  • Familiarity with cloud-oriented architectures, APIs, and distributed systems concepts
  • Experience or exposure to data visualization or reporting tools
  • Bilingual proficiency in English and Spanish (written and spoken)
Job Responsibility
Job Responsibility
  • Design, develop, test, and support reliable, scalable software applications and services using strong engineering practices
  • Build datacentric solutions (extraction, transformation, validation, orchestration) that power analytics and reporting
  • Develop and maintain APIs and service components, ensuring performance, resilience, and clear documentation
  • Develop and maintain web‑based applications, contributing across presentation, logic, and data layers
  • Support cloud enabled and service-based components, prioritizing reliability, scalability, and operational readiness
  • Implement automation, monitoring, and troubleshooting practices to improve stability and reduce operational friction
  • Partner with business and technology stakeholders to translate requirements into effective, scalable solutions
  • Operate in an Agile delivery model, contributing to sprint execution, continuous improvement, and ongoing optimization
  • Work with structured and semi‑structured data to enable data processing, analytics, and reporting needs
What we offer
What we offer
  • Strong retirement plan
  • tuition reimbursement
  • comprehensive healthcare
  • support for working parents
  • Flexible Time Off (FTO)
  • Fulltime
!
Read More
Arrow Right

Intern - Data Engineering

Airbus is looking for an intern to join in Bangalore, India and will be responsi...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
airbus.com Logo
Airbus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently pursuing or recently completed a Bachelor's/Master's Degree in Computer Science, Data Science, Engineering, or a related technical field
  • Solid understanding of programming fundamentals in any programming language
  • Familiarity with data manipulation using libraries like Pandas
  • Good grasp of data structures, especially DataFrames
  • Basic knowledge of SQL and interacting with databases
  • Strong analytical and problem-solving skills
  • Eagerness to learn and a collaborative mindset
  • Good communication & Advanced level of English, Active listening
  • Quick learner who can learn a new technology/skill/application
  • Knowledge of Sustainability IT will be an added advantage
Job Responsibility
Job Responsibility
  • Assist in building and maintaining data processing pipelines for the A220 DMU project
  • Help extract data from various sources and load it into target systems
  • Support the development of simple web APIs using Node.js and AWS Lambda to make data accessible to other applications
  • Collaborate with senior engineers and team members to understand requirements and troubleshoot issues
  • Document code and processes to ensure clarity and maintainability
  • Learn and apply best practices in software development and data engineering
  • Candidates shall be willing to work in European Shift Times when needed(up to 10.30 PM IST in Summer and 11.30 PM IST in winter.)
  • Fulltime
Read More
Arrow Right
New

Sr Python Data Engineer

Python Data Engineer (Sr DE)
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
techmahindra.com Logo
Tech Mahindra
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • 4+ Years of experience in creation of end-to-end data engineering pipelines for data extraction, transformation and storage using Python
  • Good at Python Core concepts (Datatypes, Data structure, Multiprocessing, Object oriented programming, programming concepts)
  • Proficiency in Integrating large-scale data from a variety of sources (ftp, api, databases, web scraping) using Python
  • Working experience with large datasets through python is a must
  • Experience in implementing, maintaining and developing the functionality of Python packages for ETL processes
  • Strong hands-on experience in SQL, Normalization, Performance Optimization techniques
  • Good working knowledge of Google services : BigQuery, Workflows, DataProc, Google cloud Storage
  • Good working knowledge of containerization, CI/CD pipelines and DevOps practices
  • Knowledge of version control systems, particularly Github
  • Troubleshooting applications and processes for data consistency and integrity
!
Read More
Arrow Right
New

Engineer III - HR Technology

Our team members are at the heart of everything we do. At Cencora, we are united...
Location
Location
India , Pune
Salary
Salary:
Not provided
cencora.com Logo
Cencora
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree is required, preferably in computer science related field or equivalent work experience
  • 6+ years software development experience utilizing such technologies as EDI, Web Services, API, XPATH, SOAP, REST, XML, XSLT, Java, .Net or other integration technologies
  • 5 - 6+ years Human Resource, Payroll or Financial software application experience
  • 3 - 5+ years of Workday integration experience
  • EDI, Web Services, API, XPATH, SOAP, REST, XML, XSLT, Java, .Net or other integration technologies
  • WebLogic, WebSphere, WebMethods, or other middleware experience
  • Expertise in the full range of Workday proprietary tools (Report Writer, Calculated Fields, Core Connectors, EIB, Workday Studio)
  • Conversion or data integration related project experience
  • Strong analytical, troubleshooting and problem resolution skills
  • Strong verbal and written communication skills
Job Responsibility
Job Responsibility
  • Collaborate to define requirements for integrations between HR systems (Workday, Taleo, Cornerstone, Kronos, etc.) and other systems (outside carriers, outside vendors, internal systems and data warehouses)
  • Leads all software engineering activities related to design, build and test with all software solutions necessary parties to ensure that solutions perform to the expectations of the business
  • Troubleshoot and resolve complex technology issues
  • Coordinate assigned deliverable schedules to ensure timelines are met
  • Provide guidance on integration strategies
  • Perform data loads (extract, transform, load, validate)
  • Design and develop custom reports
  • Define the object model of a complex business system by mapping its components Define the functional and technical requirements for software solutions and identify alternative solutions that best fit the needs of the business
  • Transform large data sets and format them to various outputs using Excel, XML, and XSLT tools
  • Use appropriate software to write queries, design workflows, and develop reports which support the business (BIRT, OBI)
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy