jhonlucas

Owned the design and implementation of the entire data platform, improving scalability, cost efficiency, and delivery speed. Built ingestion pipelines from blockchain nodes, APIs, and third-party providers into a cloud data lakehouse using AWS and Iceberg. Developed a Data Pipeline Factory that automated pipeline scaffolding, Airflow DAG generation, YAML-based config management, and CI/CD deployment with Docker, ECS, and Terraform - reducing delivery time from 1 month to 1-2 weeks. Deployed a production-grade Data API with a caching layer, enabling clients to handle 3K+ requests per day. This API powered client applications and dashboards. Designed a consumer data layer using Athena for processing and PostgreSQL for low-latency API consumption. Developed a ClickHouse-based analytical database to support a Text-to-SQL product, allowing users to run natural language queries over blockchain datasets. Built a DBT-based transformation pipeline for cross-chain analytics (Ethereum, Arbitrum, Linea, Eigenlayer) integrating Athena, Snowflake, and BigQuery.

Built ETL pipelines for DeFi credit scoring using real-time blockchain data. Launched Ethereum nodes, eliminating third-party API dependencies. Reduced AWS costs by 30% with IaC and service optimization. Managed a lakehouse enabling direct data consumption by DS teams. Enhanced pipeline performance and resource usage by 50%. Tech stack: AWS Athena, ECS, DocumentDB, Docker, Terraform, DBT.

Led the Data Platform team, improving workflows and reducing delivery times. Mentored 12 engineers; advanced 3 from junior to mid-level within a year. Built and maintained data analytics platforms improving data deployment. Optimized pipelines reducing some processes from 15 hours to 30 minutes.

Built ML models for customer segmentation and reduced stockouts by 20%. Managed Oracle databases, Linux/Windows servers, and implemented backup routines. Developed ETL pipelines for sales, inventory, and business analytics.