Resume Score
CV/Résumé Score
  • Expertini Resume Scoring: See how well your CV/Résumé matches this job: Lumiq ETL Data Engineer Python/Numpy.
Expertini

Urgent! Lumiq - ETL Data Engineer - Python/Numpy Job | Confidential

Lumiq ETL Data Engineer Python/Numpy



Job description

Job Purpose

We are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB.

The engineer will ensure this migration has zero impact on data quality, system performance, or end-user experience.

Key Responsibilities

  • Analyze existing ETL pipelines and their dependencies on Microsoft SQL Server as source systems.
  • Design and implement modifications to repoint ETL extractions from PostgreSQL (CURA) while preserving the current transformations and load logic into Elasticsearch and MongoDB.
  • Ensure end-to-end data integrity, quality, and freshness remain unaffected after the source switch.
  • Write efficient and optimized SQL queries to extract data from the new source.
  • Conduct performance testing to confirm no degradation of pipeline throughput or latency in production.
  • Work closely with DevOps and platform teams to containerize, orchestrate, and deploy the updated ETLs using Docker and Kubernetes.
  • Monitor post-deployment performance and handle any production issues proactively.
  • Document design, code, data mappings, and operational runbooks.

Required Skills And Qualifications

  • Strong experience building and maintaining large-scale distributed data systems.
  • Expert-level proficiency in Python, especially data analysis/manipulation libraries like pandas, NumPy, and Polars.
  • Advanced SQL development skills with proven experience in performance optimization.
  • Working knowledge of Docker and Kubernetes.
  • Familiarity with Elasticsearch and MongoDB as data stores.
  • Experience working in production environments with mission-critical systems.

(ref:hirist.tech)
Skills Required
Postgresql, Microsoft Sql Server, Sql, Numpy, Pandas, Docker, Elasticsearch, Mongodb, Python, Kubernetes, Etl


Required Skill Profession

Computer Occupations



Your Complete Job Search Toolkit

✨ Smart • Intelligent • Private • Secure

Start Using Our Tools

Join thousands of professionals who've advanced their careers with our platform

Rate or Report This Job
If you feel this job is inaccurate or spam kindly report to us using below form.
Please Note: This is NOT a job application form.


    Unlock Your Lumiq ETL Potential: Insight & Career Growth Guide


Advance your career or build your team with Expertini's smart job platform. Connecting professionals and employers in Noida, India.