CrawlJobs Logo
10Pearls Logo 10Pearls · IT - Software Development

Staff/Senior Software Consultant - Data Engineer

Pakistan, Lahore · Job Posted May 27, 2026
Apply Position
Job Link Share

Job Description

We are hiring for a Senior Data Engineer at 10Pearls responsible for designing, building, and optimizing scalable data pipelines and cloud-based data platforms. The role involves working with modern ETL/ELT tools, data warehouses, real-time data systems, and cloud storage solutions to support analytics and business intelligence initiatives. The engineer collaborates with cross-functional teams to develop reliable, high-performance data solutions using technologies such as Airflow, Snowflake, SQL Server, Python, dbt, and Azure services, while ensuring data quality, automation, and efficient CI/CD practices across production environments.

Job Responsibility

  • Analyze large, complex datasets to extract key insights that inform strategic decision-making
  • Develop and maintain data models, dashboards, and reports to support business objectives
  • Apply statistical techniques and predictive modeling to drive business forecasts and performance analysis
  • Collaborate with data consultant teams to build scalable, reliable data pipelines and optimize data flows
  • Ensure data quality and integrity through best practices in data governance and validation processes
  • Partner with cross-functional teams (engineering, product, marketing) to understand data requirements and deliver customized insights
  • Present findings and actionable recommendations to senior leadership and non-technical stakeholders
  • Lead, mentor, and provide guidance to junior data analysts and team members
  • Manage multiple data projects, prioritize deliverables, and meet tight deadlines with high quality output
  • Implement CI/CD pipelines and version control for data workflows to ensure seamless deployment and collaboration
  • Stay up to date with the latest trends and technologies in data analytics and propose strategic improvements for ongoing data initiatives
  • Design, develop, and optimize interactive dashboards using visualization tools, ensuring clarity and usability for business users
  • Understand client needs and provide tailored, strategic solutions that align with business objectives
  • Build strong relationships by clearly communicating technical concepts and managing expectations
  • Actively participate in recruiting top technical talent for the team

Requirements

  • 5+ years of professional data engineering experience, including ownership of production pipelines that other teams depended on
  • ETL / ELT: deep experience with Airflow (DAG design, sensors, retries, backfills) and Airbyte (or equivalents like Fivetran, Meltano, or custom connectors)
  • Data warehousing: strong hands-on experience with Snowflake and/or BigQuery, including performance tuning, partitioning/clustering, and cost optimization
  • Transactional databases: solid SQL Server experience covering schema design, indexing, query tuning, and CDC patterns
  • Real-time data: production experience with Firebase / Firestore or comparable real-time stores, and at least one streaming or message-bus technology (Kafka, Azure Service Bus, Pub/Sub, Kinesis)
  • Programming: advanced SQL plus strong Python for data engineering
  • comfortable building reusable, tested, well-documented code
  • Modeling: fluency with dimensional and modern warehouse modeling, and with transformation frameworks such as dbt
  • Cloud storage: hands-on experience with Azure Storage (Blob/ADLS)
  • comfort with AWS S3 or GCS is a plus
  • Experience working with CI/CD for data pipelines (GitLab CI or equivalent), including environment promotion and automated testing
  • Strong written and verbal communication in English

Nice to have

  • Experience supporting ML use cases: feature stores, training/serving skew, point-in-time correctness, and dataset versioning
  • Familiarity with Kubernetes-based data platforms and running Airflow on AKS or equivalent
  • Experience with data quality frameworks such as Great Expectations, Soda, or dbt tests at scale
  • Domain experience in supply chain, logistics, e-commerce, or warehousing
  • Familiarity with Azure AI Foundry data integration patterns
10Pearls - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Staff/Senior Software Consultant - Data Engineer

8 matching positions

Staff/Senior Software Consultant - Marketing Automation - Evening Shift

10Pearls is seeking a Senior Full Stack Engineer – Marketing Automation Platform...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of full-stack engineering experience with proven delivery of production SaaS applications
  • Hands-on experience building or contributing to marketing automation platforms, CRM systems, workflow engines, or audience builders
  • Strong understanding of customer data architecture, including event streams, behavioral segmentation, lifecycle management, and attribution models
  • Backend expertise in Node.js/TypeScript or Python, relational and document databases, message queues, job schedulers, and event-driven systems
  • Frontend proficiency in React/Next.js with strong understanding of state management and responsive UI architecture
  • Experience with cloud infrastructure (AWS, GCP, or Azure), containerization, CI/CD, monitoring, and alerting systems
  • Strong security mindset including OAuth, RBAC, encryption, PII handling, and compliance awareness
Job Responsibility
Job Responsibility
  • Architect and productionize AI-prototyped features with a focus on scalability, security, observability, and reliability
  • Build and maintain marketing automation backend services including campaign orchestration engines, segmentation pipelines, event-driven triggers, scheduling systems, and delivery tracking
  • Design and implement CRM data models, contact management APIs, and integrations with bank core systems and third-party providers
  • Develop multi-tenant architectures, role-based access control (RBAC), and audit logging suitable for financial services
  • Own API design, documentation, and partner-facing integrations
  • Establish and enforce code quality standards, testing strategies, and CI/CD pipelines
  • Collaborate closely with product managers and AI-augmented engineering teams in agile 2-week delivery cycles
Read More
Arrow Right

Staff/Senior Platform Consultant – GenAI Specialist

As a Senior Platform Consultant, you will leverage your expertise in Python, pro...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 07 Years of relevant experience in platform consulting or software development
  • Strong proficiency in Python programming language
  • Experience with prompt engineering and working with large language models
  • Knowledge of RAG basics and their application in AI solutions
  • Hands-on experience with OpenAI API and other LLM APIs
  • Familiarity with LangChain framework
  • Experience using Hugging Face libraries and models
  • Working knowledge of vector databases such as Pinecone or FAISS
  • Excellent problem-solving and communication skills
  • Ability to work independently and as part of a team
Job Responsibility
Job Responsibility
  • Develop and implement platform solutions using Python and AI technologies
  • Apply prompt engineering techniques to optimize large language model interactions
  • Utilize RAG (Retrieval-Augmented Generation) basics to enhance data retrieval and generation processes
  • Integrate and work with LLM APIs, specifically OpenAI API, to build intelligent applications
  • Employ LangChain framework for building language model applications
  • Leverage Hugging Face tools and models for natural language processing tasks
  • Work with vector databases such as Pinecone or FAISS for efficient similarity search and retrieval
  • Collaborate with clients and internal teams to gather requirements and deliver tailored solutions
  • Provide technical guidance and mentorship to junior team members
  • Stay updated with the latest trends and advancements in AI and platform technologies
Read More
Arrow Right

Staff/Senior Software Consultant - MERN

10Pearls is looking for a skilled Full Stack Engineer with strong experience in ...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science or a related field is preferred
  • Minimum 5 years of experience as a Full Stack Engineer with hands-on expertise in React and Node.js
  • Strong proficiency in JavaScript and TypeScript
  • Solid experience building and consuming REST APIs using Node.js
  • Good knowledge of SQL databases and data modeling concepts
  • Hands-on experience with Git for version control and collaborative development
  • Familiarity with Docker with basic deployment practices, environments, CI/CD exposure, and cloud platforms (e.g., AWS, Azure, GCP)
  • Experience with testing frameworks such as Jest and/or Cypress is a plus
  • Strong analytical and problem-solving skills
  • Ability to interact effectively with clients, stakeholders, and cross-functional teams
Job Responsibility
Job Responsibility
  • Analyze requirements, design solutions, and implement responsive full-stack web applications
  • Lead the design and development of complex end-to-end application features, ensuring scalability, maintainability, and performance
  • Coordinate with business and technical teams to ensure alignment of development goals
  • Mentor junior developers and assist in solving complex technical issues
  • Ensure code quality through best practices, testing, and code reviews
  • Provide guidance on architectural decisions, scalability, and performance optimization
  • Plan proactively, anticipate technical challenges, and propose effective technical solutions
  • Take ownership of assigned modules and support cross-project technical initiatives
  • Promote collaboration, knowledge sharing, and a strong engineering culture within the team
Read More
Arrow Right

Staff/Senior Software Consultant - Angular + GraphQL

10Pearls is seeking a highly skilled Frontend Engineer with expertise in Angular...
Location
Location
Pakistan , Lahore, Islamabad, Karachi
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional experience in frontend development, with strong expertise in Angular (latest versions)
  • Strong hands-on experience with Angular, including advanced usage of RxJS for reactive programming
  • Experience working with Angular Signals for efficient state management
  • Proficiency in TypeScript, HTML5, and CSS3, with a focus on building responsive, accessible, and high-performing user interfaces
  • Experience with GraphQL for efficient data querying, integration, and state handling
  • Strong understanding of component-based architecture, lazy loading, and performance optimization in Angular applications
  • Experience in consuming RESTful APIs and integrating frontend applications with backend services
  • Familiarity with state management patterns and best practices in modern Angular applications
  • Experience with version control systems such as Git
  • Familiarity with CI/CD pipelines and frontend build tools
Job Responsibility
Job Responsibility
  • Own the architecture, design, and technical direction for large-scale projects, ensuring that solutions are scalable, secure, and aligned with business goals
  • Lead technical reviews and ensure that high-quality standards, including company engineering practices (CI/CD, testing, security), are met across projects
  • Collaborate with cross-functional teams and business stakeholders to align technology with business needs and influence technical decisions
  • Actively mentor and guide engineers at all levels, promoting a culture of technical excellence and knowledge sharing
  • Help in the recruitment process by identifying and interviewing technical talent, ensuring alignment with the company's standards and culture
  • Embrace a consulting mindset by identifying opportunities to improve business processes through innovative technical solutions, and act as a trusted advisor to clients and stakeholders
  • Communicate technical solutions effectively to both technical and non-technical stakeholders
  • Act as a point of contact for technical issues for specific work streams across multiple projects
  • Engage in continuous learning of industry trends, tools, and technologies to provide informed recommendations to clients
  • Fulltime
Read More
Arrow Right

Staff/Senior DevOps Consultant - Observability

We are seeking a highly skilled Staff/Senior Software Consultant with deep exper...
Location
Location
Pakistan , Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 3+ years of experience in software engineering, DevOps, or SRE roles
  • Strong expertise in observability concepts: logging, monitoring, tracing
  • Hands-on experience with tools like Datadog, Prometheus, Grafana, ELK stack and APM tools such as Datadog, NewRelic, AWS X-ray, Application Insights
  • Deep understanding of distributed systems architecture and debugging techniques
  • Experience working in cloud environments (AWS, Azure, or GCP)
  • Proficiency in at least one programming language (e.g., Python, Java, Go)
  • Experience with containerization and orchestration (Docker, Kubernetes)
  • Strong understanding of application performance tuning, transaction tracing, and service dependency mapping
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of observability solutions across complex distributed systems
  • Architect and optimize logging, monitoring, and tracing frameworks for cloud-native applications
  • Diagnose and resolve performance bottlenecks and system failures in large-scale distributed environments
  • Collaborate with engineering, DevOps, and SRE teams to improve system visibility and reliability
  • Implement best practices for metrics collection, alerting, and incident response
  • Work with tools such as Datadog, Prometheus, Grafana, OpenTelemetry, and APM platforms like New Relic, Dynatrace, AWS X-ray and Azure Application Insights
  • Provide consulting guidance on cloud architectures (AWS, Azure, GCP) and observability strategies
  • Implement and manage Application Performance Monitoring (APM) solutions to gain deep visibility into application behavior and performance
  • Correlate APM data with logs, metrics, and traces for faster root cause analysis (RCA)
  • Develop dashboards, alerts, and automated workflows to ensure proactive system monitoring
  • Fulltime
Read More
Arrow Right
New

Mid-Level BI Developer

We are seeking a Business Intelligence Developer to support a growing analytics ...
Location
Location
United States , Charlotte
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of BI Development or Data Analytics experience
  • Strong Power BI development experience
  • Strong SQL querying and reporting skills
  • Experience with DAX and data modeling
  • Experience working within Microsoft/Azure environments
  • Ability to work with complex operational and financial datasets
  • Strong communication and collaboration skills
Job Responsibility
Job Responsibility
  • Develop and maintain Power BI dashboards, reports, and visualizations
  • Support reporting initiatives related to job costing, operational metrics, margin analysis, and profitability
  • Work with large datasets across multiple business systems and platforms
  • Create and optimize SQL queries, data models, and reporting structures
  • Collaborate with the lead BI Developer on enterprise analytics initiatives
  • Support integration and reporting efforts across NetSuite, Oracle, and ERP/CRM systems
  • Assist with data validation, reporting accuracy, and ongoing reporting enhancements
  • Utilize DAX and Power Query to improve analytics usability and reporting performance
What we offer
What we offer
  • Medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Pharmacy Intern

You've invested a lot of time and energy in your education. Now you want the cha...
Location
Location
United States , Reynoldsburg
Salary
Salary:
18.00 - 19.75 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 01, 2026
Flip Icon
Requirements
Requirements
  • Accepted into, or actively enrolled in, an ACPE accredited college or school of pharmacy
  • Must possess, or be in the process of obtaining, valid intern and/or technician licensure as required
  • 1+ years of related work experience in pharmacy, retail, medical, or customer service setting
  • Ability to become immunization certified
  • Ability to work in home store, and across the market in other locations, to meet business needs
  • Proficiency in Microsoft Suite (Outlook, Excel, Word, PowerPoint, etc.)
Job Responsibility
Job Responsibility
  • Living our purpose by following all company SOPs at each workstation to help our Pharmacists and Technicians manage and improve patient health
  • Following pharmacy workflow procedures at each pharmacy workstation (i.e., production, pick-up, drive-thru, and drop-off) for safe and accurate prescription fulfillment
  • Contributing to positive patient experiences showing empathy and genuine care
  • creating heartfelt and personalized moments while serving patients at pick-up, drive-thru, and over the phone
  • keeping patients healthy by offering immunizations and other services at the register and over the phone
  • and demonstrating compassionate care by solving or escalating patient problems
  • Offering to counsel, fielding medical questions, and soliciting information on a patient's medical history to provide optimal care, when appropriate under the direct supervision of a licensed pharmacist
  • Taking telephonic prescriptions from the prescriber, and calling the prescriber to clarify prescriptions or facilitate medication changes, where allowed by state regulation
  • Maintaining the highest level of self-awareness and providing in-the-moment coaching, training, and mentoring to pharmacy team members while sharing best practices
  • Completing basic inventory activities, as permitted by law, and as directed by the pharmacy leadership team, such as accurately putting away medication deliveries and completing cycle counts, returns-to-stocks, waiting bin inventories, etc.
  • Fulltime
Read More
Arrow Right
New

Pharmacy Intern

You’ve invested a lot of time and energy in your education. Now you want the cha...
Location
Location
United States , Spring Valley
Salary
Salary:
18.00 - 19.75 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 01, 2026
Flip Icon
Requirements
Requirements
  • Accepted into or actively enrolled in an ACPE accredited college or school of pharmacy
  • 0-3 years relevant work experience
  • Must possess or be in process of obtaining valid intern and/or technician licensure as required
  • Strong communication and presentation skills
  • Complete all required training within state guidelines and required timeframe
  • Ability to: Have regular and predictable attendance, including nights and weekends
  • Be mobile and remain upright for extended periods of time
  • Lift, scan, and bag items
  • Finger Dexterity: Picking, pinching, typing or otherwise working primarily with fingers rather than whole hand or arm
  • Reach overhead
Job Responsibility
Job Responsibility
  • Patient Safety
  • Pharmacy Professional Practice
  • Regulatory Requirements
  • Quality Assurance
  • Customer Service
  • Inventory Management
  • Workflow Management excluding final prescription verification
  • Lead with Heart – display empathy and compassion for your patients, customers, caregivers, and colleagues on your team
  • Seek new ways to grow, collaborate with others, and deliver better outcomes
  • Align others around our purpose to bring your heart to every moment of your health and gain support and commitment
Read More
Arrow Right