Stop applying — get discovered by hiring agents.
| Job Position and Company | Posted | Location | Salary | Tags |
|---|---|---|---|---|
| $98k - $103k | ||||
| $180k - $212k | ||||
| $112k - $120k | ||||
Fireblocks📍 Remote | $86k - $150k | |||
 ISO 9001 Certified | 400+ students | Learn more | by Metana | ||
| $87k - $100k | ||||
| $90k - $104k | ||||
Bitso📍 European Economic Area | $106k - $106k | |||
| $76k - $81k | ||||
| $105k - $120k | ||||
Bitso📍 Latin America | $94k - $210k | |||
| $95k - $198k | ||||
| $90k - $140k | ||||
| $287k - $350k | ||||
| $129k - $147k | ||||
| $185k - $245k |
Data Engineer
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes to efficiently extract, transform, and load high volume of data from various sources into our data lake.
- Develop and implement data quality checks and monitoring processes to ensure data integrity and accuracy.
- Leverage AWS services (e.g., EKS, EMR, S3, Glue, Lambda) to build and maintain cloud-based data infrastructure.
- Implement CI/CD pipelines for data engineering processes.
- Utilize Infrastructure as Code (IaC) tools like CloudFormation and Terraform to manage AWS resources.
- Stay up-to-date with the latest data engineering technologies and trends.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Minimum of 3 years of experience as a Data Engineer.
- Strong proficiency in SQL, Python, and Spark.
- Familiarity with relational databases like PostgreSQL.
- Hands-on experience with AWS cloud services (EKS, EMR, S3, Athena, Lambda, etc).
- Experience with Kafka and real-time data processing.
- Experience with Tableau and knows about the setup and maintenance.
- Experience with data lake and lake house architecture.
- Experience with Databricks and Delta Lake.
- Proficiency in Apache Airflow for workflow orchestration.
- Proficiency in Kubernetes and Docker for containerization and orchestration.
- Experience with CI/CD pipelines and tools.
- Experience with Infrastructure as Code (IaC) tools like CloudFormation and Terraform.
- Excellent problem-solving and analytical skills.
- Strong attention to detail and ability to work independently.
- Excellent communication and collaboration skills
Is Kubernetes high demand?
Yes, Kubernetes is currently in high demand in the technology industry
Kubernetes is an open-source container orchestration platform that is widely used for deploying, scaling, and managing containerized applications
It provides a standardized way to manage and automate the deployment of containerized applications across multiple hosts and provides benefits such as reliability, scalability, and flexibility
As more and more organizations move towards containerized architectures, Kubernetes has become a critical component of their infrastructure
Kubernetes is used by companies of all sizes, from startups to large enterprises, and across various industries, including finance, healthcare, and e-commerce
According to various job market and salary surveys, Kubernetes-related skills are in high demand, and job positions related to Kubernetes are growing at a rapid pace
In fact, Kubernetes is often listed as one of the top skills that are in high demand by technology companies
Overall, Kubernetes is a highly sought-after skill in the technology industry, and it's likely to remain in high demand in the foreseeable future as more and more organizations adopt containerization and cloud-native architectures.