0xfrankie

Senior Data Engineer

Experienced Data Engineer with 8+ years of expertise in building comprehensive big data platforms and developing business intelligent systems for retail and supply chain operations. Also a passionate individual developer who creates modern web applications using Next.js. Specialized in data warehouse architecture, business intelligence solutions, and full-stack development that drives both enterprise and personal projects.

Data Engineering & Architecture
- Data warehouse design and ETL pipeline development
- Big data platform construction using HDFS, Spark, and DolphinScheduler
- Data modeling and multi-layered data architecture implementation
- API development and microservices architecture

Business Intelligence & Analytics
- BI system construction and dashboard development
- Cross-functional data analysis for retail, supply chain, and operations
- Self-service analytics platform development

Full-Stack Development
- Modern web application development using Next.js
- Personal website creation and maintenance
- Frontend and backend integration
- Responsive design and user experience optimization

Technical Stack
- Big Data: HDFS, Spark, DolphinScheduler, Elasticsearch, Delta Lake
- Programming: Python, SQL, JavaScript, TypeScript
- Web Development: Next.js, React, Node.js
- Databases: Data warehouses, NoSQL, distributed storage systems
- Visualization: Tableau, PowerBI, custom dashboard solutions



Experience: 8 years

Yearly salary: $30,000

Hourly rate: $20

Nationality: 🇨🇳 China

Residency: 🇨🇳 China


Experience

Senior Data Engineer
Ting Hsin International Group
2020 - 2022
Led data planning and modeling for various business units (retail, F&B, supply chain), establishing comprehensive BI systems. Architected and built data mining platforms, including tag systems and related API frameworks. Served as a key technical lead for data mining business projects, focusing on data-driven solutions for business operations. Developed and implemented data storage layers with structured modeling (raw, feature, relational layers). Designed and executed data cleansing processes using distributed computing frameworks. Created internal data computation services (e.g., for data processing, optimization tasks) using Python frameworks. Managed the integration of processed data into search and analytics clusters for external data interfaces.
Data Analysis Engineer
FamilyMart Company, Ltd
2016 - 2020
Spearheaded the establishment of data warehouses and formulated ETL process evaluations. Built analytical metric systems and developed reporting solutions based on business requirements. Provided technical explanations and participated in reviews for data product projects, tracking progress and contributing to testing and bug resolution. Actively participated in all phases of reporting system development, from initial tool selection to the implementation of self-service data visualization platforms. Responsible for establishing new reporting frameworks from the ground up for emerging business segments.

Skills

data-science
nextjs
python
english
chinese-mandarin
german