| Job Position and Company | Posted | Location | Salary | Tags |
|---|---|---|---|---|
| $120k - $150k | ||||
| $79k - $84k | ||||
| $175k - $206k | ||||
| $120k - $144k | ||||
ISO 9001 Certified | 400+ students | Learn more | by Metana | ||
| $147k - $195k | ||||
| $103k - $110k | ||||
| $127k - $149k | ||||
| $81k - $102k | ||||
| $147k - $195k | ||||
| $90k - $148k | ||||
| $87k - $145k | ||||
| $76k - $113k | ||||
| $76k - $108k | ||||
| $76k - $108k | ||||
| $76k - $108k |
Senior Data Engineer
Responsibilities
- Ensure all teams are drawing data from a single source of truth
- Work with our current systems in GCP, Clickhouse and dbt, and help evolve them
- Ensure data integrity, so that data from many sources are transformed into a useful format, and is correct
- Automate as much of the data pipeline as possible
- Quickly debug data discrepancies
- Scale our data capacity by 10x for the next 2-3 years
- Data instrumentation and Implement tooling in Go and Typescript so all engineers can meter products with client libraries
- Design data backup and recovery protocols
- Ensure the data can be easily digestible, and usable, using a BI tool like Looker or Superset within an acceptable period of time (realtime, daily, monthly, yearly)
- Help guide a small team of data engineers on roadmap, design, and implementation
Skills & Experience
- 3-5 years relevant industry experience
- Strong working knowledge of at least one data warehouse like Snowflake, Redshift, Clickhouse, etc.
- Ability to work cross-functionally well with other stakeholders and teams
- Strong programming skills, and not just a hacker
- Ability or high-willingness to quickly learn about blockchain technology, its data structures, schema, and ecosystem
- Excellent SQL skills and experience with ETL using tools such as dbt
- Experience with distributed log systems like Kafka, Spark, etc. a plus
- Expertise working with large software systems in one of the major cloud providers: AWS, Google Cloud, Azure
- Strong understanding of building fault-tolerant, scalable systems
- Experience with blockchain data operations
- Experience with at least one scripting language (Python, bash, Ruby, etc.)
- Big plus if you have experience working with Go, Typescript, or similar derivatives
- Interest in web3
What does a data scientist in web3 do?
A data scientist in web3 is a type of data scientist who focuses on working with data related to the development of web-based technologies and applications that are part of the larger web3 ecosystem
This can include working with data from decentralized applications (DApps), blockchain networks, and other types of distributed and decentralized systems
In general, a data scientist in web3 is responsible for using data analysis and machine learning techniques to help organizations and individuals understand, interpret, and make decisions based on the data generated by these systems
Some specific tasks that a data scientist in web3 might be involved in include developing predictive models, conducting research, and creating data visualizations.