tucker19
Senior Data Engineer
Experience: 11 years
Yearly salary: $156,000
Hourly rate: $75
Nationality: πΊπΈ United States
Residency: πΊπΈ United States
Experience
Sr Data Engineer
Brightcove 2023 - 2024
*Primary Language - Python, Google Cloud Platform, Jenkins, BigQuery SQL, Airflow, Yaml *Built new and maintained legacy DAGs by analyzing and enhancing. Was able to optimize multiple pipelines by 10-20% *Enhanced complex SQL in BigQuery to improve data for downstream users which stakeholders were able to create more efficient process *Biggest contribution by updating a sql process to allow more good data and see a 13% decrease bad data which was causing negative ad-duration *Built reporting via Slack, utilizes multiple channels for different levels of alerting by introducing a Slack Connection within Airflow. Now if a task fails there is a notification to speed up the response *Documented all of Internal Analytics workflows and systems via Confluence pages to help with future hires and allow me to learn the multiple complex processes Developed new Grafana graphs for metrics that allows executives to see data in a simpler format *Modified Google Cloud Platform Cloud Functions after being informed our systems would need to look at a new Google Cloud Storage bucket to ingest into BigQuery
Data Engineer II
Mythical Games 2022 - 2022
*Primary Language - Python, Google Cloud Platform, Github Workflow Yaml, dbt, Airflow *Built Airflow DAGs to gather Marketing Data for Finance Team using Astronomer Managed service *Researched Blockchain and Crypto technologies to help with game development *Built Github CI/CD via workflow actions and Docker to automate code checks to help team with code standards and create a cohesive team *Modified Slack reporting to work with multiple channels and ways to call Slack Alerts. This was done to help the team to determine if alerts were just info, warnings or true problems. *Partnered with Analytics Engineers to migrate from a dbt Cloud hosted instance of self hosted within Airflow Astronomer. Saw a lower set of COGS by doing this by 50%.
Sr Development Engineer
RiskRecon a MasterCard Company 2021 - 2022
Primary Language β Python, AWS, JavaScript Rebuilt the Whois Communication protocols from inefficient and outdated Swift protocol to HTTP Wrote multiple documents for new features to help future development and other teams with API endpoint values Rebuilt deployment process from a manual process to automated with Docker to remove possible human error Optimized to scale better and able to run on a single machine instead of a distributed system for testing purposes. Was able to take the largest client processing from 3 hours to 5 minutes. Before deployment to production local machine was able to run faster than production
Software Engineer II
RSA Security 2019 - 2021
Primary Languages: Python and AWS Built Django Rest Api endpoints for Content Parser, RCA and Data Science Portal Content Parser Project Built Dynamic Regex tool to find specific regulatory data dynamically for Archer and allow codebase to grow over time with new Regex patterns RCA (Regulatory Content Analysis) Worked with regular release testing and releasing the project onto an AWS environment Telemetry Project Assisted with setting up system to use telemetry data more effectively and investigated ways to use this data to better the Archer product Data Science Portal SSO Portal for all Data Science for current and future products
Software Engineer
eDataSource 2016 - 2019
Primary Languages: Java, JavaScript, SQL and Bash Created new features and bug fixes for Ecommerce project Maintained Prizm process of Nielson tracking Developed robust test suite for parsers and verified code changes via regression testing Executed SQL queries for finding errors and reprocessing receipts. Designed tools utilizing SPF and DKIM data
Skills
backend
big-data
computer-science
data-science
dataops
python
remote
research
sql
english