wiggeren

Senior Data Engineer

I’m a Data Engineer with 4+ years of production experience building batch and near-real-time pipelines, orchestration workflows, data warehouses, and analytics-ready datasets.

My main cloud experience is with GCP. At MGCom, I functionally led the migration of a commercial MarTech product from a DWH-centric platform to a data lake built with Google Cloud Storage, Cloud Composer/Airflow, Dataproc/PySpark, BigQuery, and Looker Studio.

My later enterprise work included Python services for Kafka/gRPC ingestion, PostgreSQL and Greenplum, event-driven Airflow, Data Vault, and monitoring with Prometheus and Grafana.

I’m currently preparing for the Google Cloud Professional Data Engineer exam through Google Skills courses and hands-on labs covering batch and streaming pipelines, BigQuery, Dataflow, Data Fusion, Dataform, Datastream, serverless Spark, and lakehouse patterns. Alongside this, I’m strengthening algorithms and data structures through Python practice.

Open to remote B2B via an Armenian sole proprietorship; permanent roles with relocation.


Experience: 4 years

Yearly salary: $54,000

Hourly rate: $25

Nationality: 🌏 Remote

Residency: 🇦🇲 Armenia


Experience

Senior Data Engineer
IBS, Sber Client Project
2024 - 2025
Built a near-real-time Python service for Kafka and gRPC ingestion into PostgreSQL, adding validation, a dead-letter queue, and Prometheus/Grafana monitoring for approximately 10 messages per second. Replaced scheduled Airflow runs with FileSensor-based execution, reducing manual restarts and processing delayed upstream data as soon as it became available. Standardized recurring Greenplum transfers to a neighboring data platform with a parameter-driven SQL interface used by the team. - - Developed Data Vault and SCD Type 4 transformations for historical storage and publication of integration data to downstream teams.
Data Engineer
Freight One
2023 - 2024
Migrated approximately 30 daily pipelines from an Airflow sandbox to Apache NiFi, the company-supported production platform. Brought migrated NiFi workflows under corporate standards for monitoring, logging, retries, access control, scheduling, and support documentation. Took over dataset preparation and ETL support, removing pipeline maintenance from the Data Scientist and Product Manager.
Data Engineer
MGCom
2021 - 2023
Promoted from Junior to Middle Data Engineer. Functionally led Brandformanceʼs migration from a DWH-centric platform to a GCP data lake supporting more than eight client implementations. Designed the platform with Google Cloud Storage, Cloud Composer/Airflow, Dataproc/PySpark, BigQuery data marts, Looker Studio, data-quality checks, and alerting. Reduced Yandex Metrica extraction time from 6 hours to 15 minutes by moving synchronous API loading to asynchronous Python processing on Compute Engine. Added file, schema, freshness, and volume checks with alerts, detecting SFTP source issues before they affected client reports. Introduced Git and Cloud Build CI/CD for Airflow code, replacing direct Google Cloud Storage uploads with a controlled deployment process. Built a configuration-driven Airflow DAG generator, removing approximately two hours of pipeline setup from each new-client onboarding.

Skills

big-data
gcp
data-science
english
russian