faisalmalikwp

Lead Data Engineer

Experienced Data Engineer with a track record of building end-to-end data pipelines from various sources, processing, and loading data to destinations while optimizing storage-compute decoupling. Skilled in modeling data destinations and implementing data governance for business users. Able to convert messy raw data into data-driven actionable insights. Additionally, developed soft skills including problem-solving, team leading, and consulting through experience at McKinsey.


Experience: 4 years

Yearly salary: $60,000

Hourly rate: $30

Nationality: 🇮🇩 Indonesia

Residency: 🇮🇩 Indonesia


Experience

Data Engineer
Quantumblack, AI by McKinsey
2021 - 2023
Advanced Analytics company under McKinsey Management Consulting Firm. Facing clients to gather business requirements and translate them into technical requirements. Working with internal and client teams. Perform learning and handover sessions with the client teams. Develop data engineering solutions using both Cloud (AWS, GCP, Alicloud, Azure) and On-Premise technologies. Develop internal assets (Mainly on Spark and Terraform) to be implemented on various clients and use cases.
Data Engineering Course Mentor
Springboard
2021 - 2022
Career Bootcamp Company providing courses for on-demand tech jobs. Giving weekly mentoring calls to 10 students at one cycle (17 students in total). Successfully graduates 7 students with exceptional capstone projects. Giving technical and career guidance to the students. Perform Technical Mock Interview on Coding Challenges and Technical Data Engineering Concepts.
Senior Data Engineer
Flip
2021 - 2021
Fund transfer product company that reduces the transaction fees. Maintain existing data technologies (MySQL) using scheduled jobs and materialized view to fulfill business needs while waiting for the new data ecosystem development and deployment. Migrate legacy data technologies (MySQL) into Cloud Data Warehouse (BigQuery) using Cloud Native data pipeline (DataStream to GCS to Pub/Sub to DataFlow to BigQuery). Improve analytics performance by 360 times faster than previous data technologies. Helping head of BI to manage data governance on the data warehouse.
Data Engineer
Pintu
2020 - 2021
Crypto Exchange Product company with beginner friendly UI. Initiate Data Ecosystem in both AWS as processing and GCP as Data Warehouse from scratch. Develops data pipeline from various sources (MySQL, PostgreSQL, MongoDB, External APIs and Web Pages) to BigQuery using Batch (Airflow on Kubernetes) and Stream Processing (Kinesis and Kafka). Educate business users to build their own analytics using Metabase. Build and Lead Data Analytics team which consist of 2 Data Engineers, 2 Data Scientist and 2 Data Analysts using Agile Methodologies (Manage analytics sprint plannings, standups and retrospective on JIRA). Optimize Analytics cost by implementing Partitioning, Clustering and Materialized View on BigQuery Data Warehouse which reduce analytics cost on BI tools up to 100 times previous implementation. Implement a fraud detection system that successfully captures fraudulent transactions which secure approx. a million dollars of assets.

Skills

big-data
dataops
devops
javascript
python
english
indonesian