CrawlJobs Logo
10Pearls Logo 10Pearls · IT - Software Development

Staff/Senior Software Consultant - Data Engineer

Pakistan, Lahore · Job Posted May 27, 2026
Apply Position
Job Link Share

Job Description

We are hiring for a Senior Data Engineer at 10Pearls responsible for designing, building, and optimizing scalable data pipelines and cloud-based data platforms. The role involves working with modern ETL/ELT tools, data warehouses, real-time data systems, and cloud storage solutions to support analytics and business intelligence initiatives. The engineer collaborates with cross-functional teams to develop reliable, high-performance data solutions using technologies such as Airflow, Snowflake, SQL Server, Python, dbt, and Azure services, while ensuring data quality, automation, and efficient CI/CD practices across production environments.

Job Responsibility

  • Analyze large, complex datasets to extract key insights that inform strategic decision-making
  • Develop and maintain data models, dashboards, and reports to support business objectives
  • Apply statistical techniques and predictive modeling to drive business forecasts and performance analysis
  • Collaborate with data consultant teams to build scalable, reliable data pipelines and optimize data flows
  • Ensure data quality and integrity through best practices in data governance and validation processes
  • Partner with cross-functional teams (engineering, product, marketing) to understand data requirements and deliver customized insights
  • Present findings and actionable recommendations to senior leadership and non-technical stakeholders
  • Lead, mentor, and provide guidance to junior data analysts and team members
  • Manage multiple data projects, prioritize deliverables, and meet tight deadlines with high quality output
  • Implement CI/CD pipelines and version control for data workflows to ensure seamless deployment and collaboration
  • Stay up to date with the latest trends and technologies in data analytics and propose strategic improvements for ongoing data initiatives
  • Design, develop, and optimize interactive dashboards using visualization tools, ensuring clarity and usability for business users
  • Understand client needs and provide tailored, strategic solutions that align with business objectives
  • Build strong relationships by clearly communicating technical concepts and managing expectations
  • Actively participate in recruiting top technical talent for the team

Requirements

  • 5+ years of professional data engineering experience, including ownership of production pipelines that other teams depended on
  • ETL / ELT: deep experience with Airflow (DAG design, sensors, retries, backfills) and Airbyte (or equivalents like Fivetran, Meltano, or custom connectors)
  • Data warehousing: strong hands-on experience with Snowflake and/or BigQuery, including performance tuning, partitioning/clustering, and cost optimization
  • Transactional databases: solid SQL Server experience covering schema design, indexing, query tuning, and CDC patterns
  • Real-time data: production experience with Firebase / Firestore or comparable real-time stores, and at least one streaming or message-bus technology (Kafka, Azure Service Bus, Pub/Sub, Kinesis)
  • Programming: advanced SQL plus strong Python for data engineering
  • comfortable building reusable, tested, well-documented code
  • Modeling: fluency with dimensional and modern warehouse modeling, and with transformation frameworks such as dbt
  • Cloud storage: hands-on experience with Azure Storage (Blob/ADLS)
  • comfort with AWS S3 or GCS is a plus
  • Experience working with CI/CD for data pipelines (GitLab CI or equivalent), including environment promotion and automated testing
  • Strong written and verbal communication in English

Nice to have

  • Experience supporting ML use cases: feature stores, training/serving skew, point-in-time correctness, and dataset versioning
  • Familiarity with Kubernetes-based data platforms and running Airflow on AKS or equivalent
  • Experience with data quality frameworks such as Great Expectations, Soda, or dbt tests at scale
  • Domain experience in supply chain, logistics, e-commerce, or warehousing
  • Familiarity with Azure AI Foundry data integration patterns
10Pearls - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Staff/Senior Software Consultant - Data Engineer

8 matching positions

Staff/Senior Software Consultant - Marketing Automation - Evening Shift

10Pearls is seeking a Senior Full Stack Engineer – Marketing Automation Platform...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of full-stack engineering experience with proven delivery of production SaaS applications
  • Hands-on experience building or contributing to marketing automation platforms, CRM systems, workflow engines, or audience builders
  • Strong understanding of customer data architecture, including event streams, behavioral segmentation, lifecycle management, and attribution models
  • Backend expertise in Node.js/TypeScript or Python, relational and document databases, message queues, job schedulers, and event-driven systems
  • Frontend proficiency in React/Next.js with strong understanding of state management and responsive UI architecture
  • Experience with cloud infrastructure (AWS, GCP, or Azure), containerization, CI/CD, monitoring, and alerting systems
  • Strong security mindset including OAuth, RBAC, encryption, PII handling, and compliance awareness
Job Responsibility
Job Responsibility
  • Architect and productionize AI-prototyped features with a focus on scalability, security, observability, and reliability
  • Build and maintain marketing automation backend services including campaign orchestration engines, segmentation pipelines, event-driven triggers, scheduling systems, and delivery tracking
  • Design and implement CRM data models, contact management APIs, and integrations with bank core systems and third-party providers
  • Develop multi-tenant architectures, role-based access control (RBAC), and audit logging suitable for financial services
  • Own API design, documentation, and partner-facing integrations
  • Establish and enforce code quality standards, testing strategies, and CI/CD pipelines
  • Collaborate closely with product managers and AI-augmented engineering teams in agile 2-week delivery cycles
Read More
Arrow Right

Staff/Senior Platform Consultant – GenAI Specialist

As a Senior Platform Consultant, you will leverage your expertise in Python, pro...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 07 Years of relevant experience in platform consulting or software development
  • Strong proficiency in Python programming language
  • Experience with prompt engineering and working with large language models
  • Knowledge of RAG basics and their application in AI solutions
  • Hands-on experience with OpenAI API and other LLM APIs
  • Familiarity with LangChain framework
  • Experience using Hugging Face libraries and models
  • Working knowledge of vector databases such as Pinecone or FAISS
  • Excellent problem-solving and communication skills
  • Ability to work independently and as part of a team
Job Responsibility
Job Responsibility
  • Develop and implement platform solutions using Python and AI technologies
  • Apply prompt engineering techniques to optimize large language model interactions
  • Utilize RAG (Retrieval-Augmented Generation) basics to enhance data retrieval and generation processes
  • Integrate and work with LLM APIs, specifically OpenAI API, to build intelligent applications
  • Employ LangChain framework for building language model applications
  • Leverage Hugging Face tools and models for natural language processing tasks
  • Work with vector databases such as Pinecone or FAISS for efficient similarity search and retrieval
  • Collaborate with clients and internal teams to gather requirements and deliver tailored solutions
  • Provide technical guidance and mentorship to junior team members
  • Stay updated with the latest trends and advancements in AI and platform technologies
Read More
Arrow Right

Staff/Senior Software Consultant - MERN

10Pearls is looking for a skilled Full Stack Engineer with strong experience in ...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science or a related field is preferred
  • Minimum 5 years of experience as a Full Stack Engineer with hands-on expertise in React and Node.js
  • Strong proficiency in JavaScript and TypeScript
  • Solid experience building and consuming REST APIs using Node.js
  • Good knowledge of SQL databases and data modeling concepts
  • Hands-on experience with Git for version control and collaborative development
  • Familiarity with Docker with basic deployment practices, environments, CI/CD exposure, and cloud platforms (e.g., AWS, Azure, GCP)
  • Experience with testing frameworks such as Jest and/or Cypress is a plus
  • Strong analytical and problem-solving skills
  • Ability to interact effectively with clients, stakeholders, and cross-functional teams
Job Responsibility
Job Responsibility
  • Analyze requirements, design solutions, and implement responsive full-stack web applications
  • Lead the design and development of complex end-to-end application features, ensuring scalability, maintainability, and performance
  • Coordinate with business and technical teams to ensure alignment of development goals
  • Mentor junior developers and assist in solving complex technical issues
  • Ensure code quality through best practices, testing, and code reviews
  • Provide guidance on architectural decisions, scalability, and performance optimization
  • Plan proactively, anticipate technical challenges, and propose effective technical solutions
  • Take ownership of assigned modules and support cross-project technical initiatives
  • Promote collaboration, knowledge sharing, and a strong engineering culture within the team
Read More
Arrow Right

Staff/Senior Software Consultant - Angular + GraphQL

10Pearls is seeking a highly skilled Frontend Engineer with expertise in Angular...
Location
Location
Pakistan , Lahore, Islamabad, Karachi
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience in frontend development, with strong expertise in Angular (latest versions)
  • Strong hands-on experience with Angular, including advanced usage of RxJS for reactive programming
  • Experience working with Angular Signals for efficient state management
  • Proficiency in TypeScript, HTML5, and CSS3, with a focus on building responsive, accessible, and high-performing user interfaces
  • Experience with GraphQL for efficient data querying, integration, and state handling
  • Strong understanding of component-based architecture, lazy loading, and performance optimization in Angular applications
  • Experience in consuming RESTful APIs and integrating frontend applications with backend services
  • Familiarity with state management patterns and best practices in modern Angular applications
  • Experience with version control systems such as Git
  • Familiarity with CI/CD pipelines and frontend build tools
Job Responsibility
Job Responsibility
  • Own the architecture, design, and technical direction for large-scale projects, ensuring that solutions are scalable, secure, and aligned with business goals
  • Lead technical reviews and ensure that high-quality standards, including company engineering practices (CI/CD, testing, security), are met across projects
  • Collaborate with cross-functional teams and business stakeholders to align technology with business needs and influence technical decisions
  • Actively mentor and guide engineers at all levels, promoting a culture of technical excellence and knowledge sharing
  • Help in the recruitment process by identifying and interviewing technical talent, ensuring alignment with the company's standards and culture
  • Embrace a consulting mindset by identifying opportunities to improve business processes through innovative technical solutions, and act as a trusted advisor to clients and stakeholders
  • Communicate technical solutions effectively to both technical and non-technical stakeholders
  • Act as a point of contact for technical issues for specific work streams across multiple projects
  • Engage in continuous learning of industry trends, tools, and technologies to provide informed recommendations to clients
  • Fulltime
Read More
Arrow Right

Staff/Senior DevOps Consultant - Observability

We are seeking a highly skilled Staff/Senior Software Consultant with deep exper...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 3+ years of experience in software engineering, DevOps, or SRE roles
  • Strong expertise in observability concepts: logging, monitoring, tracing
  • Hands-on experience with tools like Datadog, Prometheus, Grafana, ELK stack and APM tools such as Datadog, NewRelic, AWS X-ray, Application Insights
  • Deep understanding of distributed systems architecture and debugging techniques
  • Experience working in cloud environments (AWS, Azure, or GCP)
  • Proficiency in at least one programming language (e.g., Python, Java, Go)
  • Experience with containerization and orchestration (Docker, Kubernetes)
  • Strong understanding of application performance tuning, transaction tracing, and service dependency mapping
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of observability solutions across complex distributed systems
  • Architect and optimize logging, monitoring, and tracing frameworks for cloud-native applications
  • Diagnose and resolve performance bottlenecks and system failures in large-scale distributed environments
  • Collaborate with engineering, DevOps, and SRE teams to improve system visibility and reliability
  • Implement best practices for metrics collection, alerting, and incident response
  • Work with tools such as Datadog, Prometheus, Grafana, OpenTelemetry, and APM platforms like New Relic, Dynatrace, AWS X-ray and Azure Application Insights
  • Provide consulting guidance on cloud architectures (AWS, Azure, GCP) and observability strategies
  • Implement and manage Application Performance Monitoring (APM) solutions to gain deep visibility into application behavior and performance
  • Correlate APM data with logs, metrics, and traces for faster root cause analysis (RCA)
  • Develop dashboards, alerts, and automated workflows to ensure proactive system monitoring
  • Fulltime
Read More
Arrow Right
New

Store Associate

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Valdosta
Salary
Salary:
15.00 - 18.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 14, 2026
Flip Icon
Requirements
Requirements
  • At least 16 years of age
  • Remaining upright on the feet, particularly for sustained periods of time
  • Lifting and exerting up to 35 lbs of force occasionally, up to 10 lbs of force frequently, and a negligible amount of force regularly to move objects to and from, including overhead lifting
  • Visual Acuity - Having close visual acuity to perform activities such as: viewing a computer terminal, reading, visual inspection involving small parts/details
Job Responsibility
Job Responsibility
  • Providing differentiated customer service by anticipating customer needs, demonstrating compassion and care in all interactions, and actively identifying and resolving potential service issues
  • Focusing on the customer by giving a warm and friendly greeting, maintaining eye contact and offering help locating additional items, when needed
  • Accurately perform cashier duties - handling cash, checks and credit card transactions with precision while following company policies and procedures
  • Maintaining the sales floor by restocking shelves, checking in vendors, updating pricing information and completing inventory management tasks as directed by store manager
  • Supporting opening and closing store activities, when needed
  • Providing customer support to all departments, including photo and beauty, ensuring departments are fully stocked and operational while remaining current with all updated services and tools
  • Assisting pharmacy personnel when needed, including working regular shifts in the pharmacy as part of opportunities for growth and career development
  • Embracing and advocating for new CVS services and loyalty programs that support our purpose of helping people on their path to better health
What we offer
What we offer
  • dental
  • vision
  • wellness resources
  • employee discounts
  • access to certain voluntary benefits
  • other programs
  • Parttime
Read More
Arrow Right
New

Store Associate

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , San Jose
Salary
Salary:
18.95 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
June 03, 2026
Flip Icon
Requirements
Requirements
  • At least 16 years of age
  • Ability to remain upright on the feet for sustained periods
  • Ability to lift up to 35 lbs occasionally, 10 lbs frequently
  • Close visual acuity for computer terminal, reading, inspection
Job Responsibility
Job Responsibility
  • Providing differentiated customer service by anticipating customer needs, demonstrating compassion and care in all interactions, and actively identifying and resolving potential service issues
  • Focusing on the customer by giving a warm and friendly greeting, maintaining eye contact and offering help locating additional items
  • Accurately perform cashier duties - handling cash, checks and credit card transactions with precision
  • Maintaining the sales floor by restocking shelves, checking in vendors, updating pricing information and completing inventory management tasks
  • Supporting opening and closing store activities
  • Providing customer support to all departments, including photo and beauty
  • Assisting pharmacy personnel when needed
  • Embracing and advocating for new CVS services and loyalty programs
What we offer
What we offer
  • Affordable medical plan options
  • 401(k) plan with matching company contributions
  • Employee stock purchase plan
  • No-cost wellness screenings, tobacco cessation and weight management programs
  • Confidential counseling and financial coaching
  • Paid time off
  • Flexible work schedules
  • Family leave
  • Dependent care resources
  • Colleague assistance programs
  • Parttime
!
Read More
Arrow Right
New

Shift Supervisor

We're building a world of health around every individual — shaping a more connec...
Location
Location
United States , Sandwich
Salary
Salary:
17.00 - 26.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 04, 2026
Flip Icon
Requirements
Requirements
  • Deductive reasoning ability, analytical skills and computer skills
  • Advanced communication skills and supervision skills
  • Ability to work a flexible schedule, including some early morning, overnight and weekend shifts, to work overtime as needed, and to respond to urgent issues at the store when they arise
  • High School diploma or equivalent preferred but not required
Job Responsibility
Job Responsibility
  • Work effectively with store management and store crews
  • Supervise the store's crew through assigning, directing and following up of all activities
  • Effectively communicate information both to and from store management and crews
  • Assist customers with their questions, problems and complaints
  • Promote CVS customer service culture (Greet, offer help, and thank)
  • Handle all customer relations issues in accordance with company policy and promote a positive shopping experience for all CVS customers
  • Maintain customer/patient confidentiality
  • Price merchandise
  • Stock shelves
  • Execute the displays, sign and inventory of weekly, promotional, and seasonal merchandise
What we offer
What we offer
  • Medical, dental, and vision coverage
  • Paid time off
  • Retirement savings options
  • Wellness programs
  • Fulltime
Read More
Arrow Right