CrawlJobs Logo
10Pearls Logo 10Pearls · IT - Software Development

Staff/Senior Software Consultant - Data Engineer

Pakistan, Lahore · Job Posted May 29, 2026
Apply Position
Job Link Share

Job Description

We are hiring for a Senior Data Engineer at 10Pearls responsible for designing, building, and optimizing scalable data pipelines and cloud-based data platforms. The role involves working with modern ETL/ELT tools, data warehouses, real-time data systems, and cloud storage solutions to support analytics and business intelligence initiatives. The engineer collaborates with cross-functional teams to develop reliable, high-performance data solutions using technologies such as Airflow, Snowflake, SQL Server, Python, dbt, and Azure services, while ensuring data quality, automation, and efficient CI/CD practices across production environments.

Job Responsibility

  • Analyze large, complex datasets to extract key insights that inform strategic decision-making
  • Develop and maintain data models, dashboards, and reports to support business objectives
  • Apply statistical techniques and predictive modeling to drive business forecasts and performance analysis
  • Collaborate with data consultant teams to build scalable, reliable data pipelines and optimize data flows
  • Ensure data quality and integrity through best practices in data governance and validation processes
  • Partner with cross-functional teams (engineering, product, marketing) to understand data requirements and deliver customized insights
  • Present findings and actionable recommendations to senior leadership and non-technical stakeholders
  • Lead, mentor, and provide guidance to junior data analysts and team members
  • Manage multiple data projects, prioritize deliverables, and meet tight deadlines with high quality output
  • Implement CI/CD pipelines and version control for data workflows to ensure seamless deployment and collaboration
  • Stay up to date with the latest trends and technologies in data analytics and propose strategic improvements for ongoing data initiatives
  • Design, develop, and optimize interactive dashboards using visualization tools, ensuring clarity and usability for business users
  • Understand client needs and provide tailored, strategic solutions that align with business objectives
  • Build strong relationships by clearly communicating technical concepts and managing expectations
  • Actively participate in recruiting top technical talent for the team

Requirements

  • 5+ years of professional data engineering experience, including ownership of production pipelines that other teams depended on
  • ETL / ELT: deep experience with Airflow (DAG design, sensors, retries, backfills) and Airbyte (or equivalents like Fivetran, Meltano, or custom connectors)
  • Data warehousing: strong hands-on experience with Snowflake and/or BigQuery, including performance tuning, partitioning/clustering, and cost optimization
  • Transactional databases: solid SQL Server experience covering schema design, indexing, query tuning, and CDC patterns
  • Real-time data: production experience with Firebase / Firestore or comparable real-time stores, and at least one streaming or message-bus technology (Kafka, Azure Service Bus, Pub/Sub, Kinesis)
  • Programming: advanced SQL plus strong Python for data engineering
  • comfortable building reusable, tested, well-documented code
  • Modeling: fluency with dimensional and modern warehouse modeling, and with transformation frameworks such as dbt
  • Cloud storage: hands-on experience with Azure Storage (Blob/ADLS)
  • comfort with AWS S3 or GCS is a plus
  • Experience working with CI/CD for data pipelines (GitLab CI or equivalent), including environment promotion and automated testing
  • Strong written and verbal communication in English

Nice to have

  • Experience supporting ML use cases: feature stores, training/serving skew, point-in-time correctness, and dataset versioning
  • Familiarity with Kubernetes-based data platforms and running Airflow on AKS or equivalent
  • Experience with data quality frameworks such as Great Expectations, Soda, or dbt tests at scale
  • Domain experience in supply chain, logistics, e-commerce, or warehousing
  • Familiarity with Azure AI Foundry data integration patterns
10Pearls - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Staff/Senior Software Consultant - Data Engineer

8 matching positions

Staff/Senior Software Consultant - Observability Engineer

Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Around 8+ years of experience with IT infrastructure and applications
  • 3-5 years of hands-on experience in observability and continuous integration
  • 2+ years of programming background in Java or relevant technologies
  • Knowledge of cloud infrastructure (Azure) and cluster management tools such as Kubernetes
  • In-depth knowledge of application performance metrics, monitoring, and troubleshooting
  • Strong communication skills with the ability to align the organization on complex technical decisions
  • Bachelor's or Master's degree in Information Technology, Computer Science, or a related quantitative discipline
Job Responsibility
Job Responsibility
  • Collaborate with engineering, operations, and other stakeholders to understand enterprise architecture, monitoring requirements, and performance goals
  • Identify and define key performance indicators (KPIs) and metrics, diagnose issues, and proactively identify areas for optimization
  • Develop and implement observability frameworks, tools, and processes to enable comprehensive monitoring, logging, and tracing of systems and applications
  • Ensure the availability, scalability, and reliability of infrastructure and deployment environments
  • Implement and manage monitoring and observability tools (such as AppDynamics, DataDog, Splunk, ELK, or Sentry) to gain insights into system performance and health
  • Provide timely and accurate reports on application performance, highlighting key insights and trends
  • Collaborate with digital squads to implement performance improvements, including code optimizations and infrastructure adjustments
  • Offer guidance and training to end-users and internal teams on best practices for APM and optimizing application performance
  • Provide recommendations on monitoring systems, logging frameworks, and distributed tracing platforms
  • Manage and deliver key KPI metrics across enterprise architecture and perform trend analysis
Read More
Arrow Right

Staff/Senior Software Consultant - Elixir

10Pearls is seeking a Senior Elixir Developer to design, build, and scale highly...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional software engineering experience
  • 3+ years of hands-on experience building production systems with Elixir
  • Strong expertise in Elixir, Erlang/OTP, GenServer, Supervisors, and BEAM internals
  • Experience building applications with Phoenix Framework and Phoenix LiveView
  • Solid understanding of distributed systems, concurrency, fault tolerance, and message-driven architectures
  • Experience designing and consuming RESTful APIs, GraphQL APIs, and microservices
  • Proficiency with relational databases such as PostgreSQL and ORM tools like Ecto
  • Experience with event-driven systems, message queues, and streaming platforms
  • Strong understanding of software architecture patterns and system design principles
  • Experience deploying and operating applications in cloud environments (AWS, Azure, or GCP)
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable backend services using Elixir and Phoenix
  • Build fault-tolerant, highly concurrent distributed systems leveraging OTP principles and BEAM capabilities
  • Architect APIs, event-driven services, and real-time applications with a focus on reliability and performance
  • Collaborate with product managers, designers, and engineers to deliver high-quality software solutions
  • Design and implement messaging, streaming, and asynchronous processing workflows
  • Optimize application performance, scalability, and resource utilization across production environments
  • Develop and maintain integrations with third-party platforms, internal services, and data systems
  • Implement observability, monitoring, logging, and alerting strategies for production services
  • Contribute to infrastructure automation, CI/CD pipelines, and cloud-native deployment processes
  • Establish coding standards, best practices, and architectural guidelines across teams
Read More
Arrow Right

Staff/Senior Software Consultant - Angular + GraphQL

10Pearls is seeking a highly skilled Frontend Engineer with expertise in Angular...
Location
Location
Pakistan , Lahore, Islamabad, Karachi
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience in frontend development, with strong expertise in Angular (latest versions)
  • Strong hands-on experience with Angular, including advanced usage of RxJS for reactive programming
  • Experience working with Angular Signals for efficient state management
  • Proficiency in TypeScript, HTML5, and CSS3, with a focus on building responsive, accessible, and high-performing user interfaces
  • Experience with GraphQL for efficient data querying, integration, and state handling
  • Strong understanding of component-based architecture, lazy loading, and performance optimization in Angular applications
  • Experience in consuming RESTful APIs and integrating frontend applications with backend services
  • Familiarity with state management patterns and best practices in modern Angular applications
  • Experience with version control systems such as Git
  • Familiarity with CI/CD pipelines and frontend build tools
Job Responsibility
Job Responsibility
  • Own the architecture, design, and technical direction for large-scale projects, ensuring that solutions are scalable, secure, and aligned with business goals
  • Lead technical reviews and ensure that high-quality standards, including company engineering practices (CI/CD, testing, security), are met across projects
  • Collaborate with cross-functional teams and business stakeholders to align technology with business needs and influence technical decisions
  • Actively mentor and guide engineers at all levels, promoting a culture of technical excellence and knowledge sharing
  • Help in the recruitment process by identifying and interviewing technical talent, ensuring alignment with the company's standards and culture
  • Embrace a consulting mindset by identifying opportunities to improve business processes through innovative technical solutions, and act as a trusted advisor to clients and stakeholders
  • Communicate technical solutions effectively to both technical and non-technical stakeholders
  • Act as a point of contact for technical issues for specific work streams across multiple projects
  • Engage in continuous learning of industry trends, tools, and technologies to provide informed recommendations to clients
  • Fulltime
Read More
Arrow Right

Staff/Senior Software Consultant - Marketing Automation - Evening Shift

10Pearls is seeking a Senior Full Stack Engineer – Marketing Automation Platform...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of full-stack engineering experience with proven delivery of production SaaS applications
  • Hands-on experience building or contributing to marketing automation platforms, CRM systems, workflow engines, or audience builders
  • Strong understanding of customer data architecture, including event streams, behavioral segmentation, lifecycle management, and attribution models
  • Backend expertise in Node.js/TypeScript or Python, relational and document databases, message queues, job schedulers, and event-driven systems
  • Frontend proficiency in React/Next.js with strong understanding of state management and responsive UI architecture
  • Experience with cloud infrastructure (AWS, GCP, or Azure), containerization, CI/CD, monitoring, and alerting systems
  • Strong security mindset including OAuth, RBAC, encryption, PII handling, and compliance awareness
Job Responsibility
Job Responsibility
  • Architect and productionize AI-prototyped features with a focus on scalability, security, observability, and reliability
  • Build and maintain marketing automation backend services including campaign orchestration engines, segmentation pipelines, event-driven triggers, scheduling systems, and delivery tracking
  • Design and implement CRM data models, contact management APIs, and integrations with bank core systems and third-party providers
  • Develop multi-tenant architectures, role-based access control (RBAC), and audit logging suitable for financial services
  • Own API design, documentation, and partner-facing integrations
  • Establish and enforce code quality standards, testing strategies, and CI/CD pipelines
  • Collaborate closely with product managers and AI-augmented engineering teams in agile 2-week delivery cycles
Read More
Arrow Right

Staff/Senior Software Consultant - MERN

10Pearls is looking for a skilled Full Stack Engineer with strong experience in ...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science or a related field is preferred
  • Minimum 5 years of experience as a Full Stack Engineer with hands-on expertise in React and Node.js
  • Strong proficiency in JavaScript and TypeScript
  • Solid experience building and consuming REST APIs using Node.js
  • Good knowledge of SQL databases and data modeling concepts
  • Hands-on experience with Git for version control and collaborative development
  • Familiarity with Docker with basic deployment practices, environments, CI/CD exposure, and cloud platforms (e.g., AWS, Azure, GCP)
  • Experience with testing frameworks such as Jest and/or Cypress is a plus
  • Strong analytical and problem-solving skills
  • Ability to interact effectively with clients, stakeholders, and cross-functional teams
Job Responsibility
Job Responsibility
  • Analyze requirements, design solutions, and implement responsive full-stack web applications
  • Lead the design and development of complex end-to-end application features, ensuring scalability, maintainability, and performance
  • Coordinate with business and technical teams to ensure alignment of development goals
  • Mentor junior developers and assist in solving complex technical issues
  • Ensure code quality through best practices, testing, and code reviews
  • Provide guidance on architectural decisions, scalability, and performance optimization
  • Plan proactively, anticipate technical challenges, and propose effective technical solutions
  • Take ownership of assigned modules and support cross-project technical initiatives
  • Promote collaboration, knowledge sharing, and a strong engineering culture within the team
Read More
Arrow Right

Staff/Senior DevOps Consultant - Observability

We are seeking a highly skilled Staff/Senior Software Consultant with deep exper...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 3+ years of experience in software engineering, DevOps, or SRE roles
  • Strong expertise in observability concepts: logging, monitoring, tracing
  • Hands-on experience with tools like Datadog, Prometheus, Grafana, ELK stack and APM tools such as Datadog, NewRelic, AWS X-ray, Application Insights
  • Deep understanding of distributed systems architecture and debugging techniques
  • Experience working in cloud environments (AWS, Azure, or GCP)
  • Proficiency in at least one programming language (e.g., Python, Java, Go)
  • Experience with containerization and orchestration (Docker, Kubernetes)
  • Strong understanding of application performance tuning, transaction tracing, and service dependency mapping
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of observability solutions across complex distributed systems
  • Architect and optimize logging, monitoring, and tracing frameworks for cloud-native applications
  • Diagnose and resolve performance bottlenecks and system failures in large-scale distributed environments
  • Collaborate with engineering, DevOps, and SRE teams to improve system visibility and reliability
  • Implement best practices for metrics collection, alerting, and incident response
  • Work with tools such as Datadog, Prometheus, Grafana, OpenTelemetry, and APM platforms like New Relic, Dynatrace, AWS X-ray and Azure Application Insights
  • Provide consulting guidance on cloud architectures (AWS, Azure, GCP) and observability strategies
  • Implement and manage Application Performance Monitoring (APM) solutions to gain deep visibility into application behavior and performance
  • Correlate APM data with logs, metrics, and traces for faster root cause analysis (RCA)
  • Develop dashboards, alerts, and automated workflows to ensure proactive system monitoring
  • Fulltime
Read More
Arrow Right

Staff/Senior Platform Consultant – GenAI Specialist

As a Senior Platform Consultant, you will leverage your expertise in Python, pro...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 07 Years of relevant experience in platform consulting or software development
  • Strong proficiency in Python programming language
  • Experience with prompt engineering and working with large language models
  • Knowledge of RAG basics and their application in AI solutions
  • Hands-on experience with OpenAI API and other LLM APIs
  • Familiarity with LangChain framework
  • Experience using Hugging Face libraries and models
  • Working knowledge of vector databases such as Pinecone or FAISS
  • Excellent problem-solving and communication skills
  • Ability to work independently and as part of a team
Job Responsibility
Job Responsibility
  • Develop and implement platform solutions using Python and AI technologies
  • Apply prompt engineering techniques to optimize large language model interactions
  • Utilize RAG (Retrieval-Augmented Generation) basics to enhance data retrieval and generation processes
  • Integrate and work with LLM APIs, specifically OpenAI API, to build intelligent applications
  • Employ LangChain framework for building language model applications
  • Leverage Hugging Face tools and models for natural language processing tasks
  • Work with vector databases such as Pinecone or FAISS for efficient similarity search and retrieval
  • Collaborate with clients and internal teams to gather requirements and deliver tailored solutions
  • Provide technical guidance and mentorship to junior team members
  • Stay updated with the latest trends and advancements in AI and platform technologies
Read More
Arrow Right

Workshop Fitter

Are you a Workshop Fitter looking to further your skill set? We’re looking for a...
Location
Location
United Kingdom , Whitminster
Salary
Salary:
32000.00 - 40000.00 GBP / Year
https://www.wallacehind.com Logo
Wallace Hind
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Previous HGV fitting / mechanical experience is essential
  • Positive attitude and strong work ethic
  • Class 1 licence preferred, but not essential
Job Responsibility
Job Responsibility
  • Carrying out servicing, maintenance, and repairs on our HGV fleet
  • Diagnosing faults and ensuring vehicles are kept in excellent working order
  • Working as part of a professional workshop team to keep our operation running smoothly
  • Monday to Friday on a rotating shift pattern: 05:00 – 14:00 & 10:00 – 19:00
  • Fulltime
Read More
Arrow Right