12/12/2024 14:12:52

Open

[Remote] Data Infrastructure Engineer (Python/Streaming)

Salary

Negotiable

Level

5 YOE +

Location

Remote

Employment type

Fulltime

Working time

Mon - Fri (8 hours/day)

English level

Fluently

Info

Headcount: 1
Address: Remote with teams based in San Francisco, California

Responsibilities

  • Transform the data infrastructure to an event drivent architecture utilize Kafka and related technologies.
  • Develop a producer to generate and stream synthetic sensor data to Kafka topics.
  • Create a consumer that reads events, performs data enrichment using cache or databases, and reinjects enriched data into another Kafka topic.
  • Build an end-of-pipeline consumer to process and analyze streamed events.
  • Collaborate with cross-functional teams to integrate the event streaming solutions into existing infrastructure.
  • Contribute to the setup and maintenance of infrastructure as code (IaC) and CI/CD pipelines using ArgoCD and Kubernetes.
  • Optimize and ensure the reliability and efficiency of data workflows.

Requirement

  • Minimum of 5 years of experience in a Software Engineer role, with a focus on the technologies mentioned.
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent work experience.
  • Proven experience as a senior Python engineer with a strong focus on event streaming.
  • Proficient in using Kafka for building event streaming applications.
  • Familiar with Jupyter notebook
  • Experience with CI/CD tools and infrastructure management, particularly with ArgoCD and Kubernetes.
  • Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment.
  • Excellent communication skills to effectively work with cross-functional teams.
  • Full professional proficiency in English.
  • Experience with Apache Flink is a plus.
  • Experience with Elasticsearch is a plus.
  • Experience with Databricks or Snowflake is a plus.

Benefit

  • A remote working environment that allows you to work from anywhere in the world
  • Full-time insurance follow VN Labor laws
  • Work equipment support.
  • Annual bonus, performance-based bonus.
  • Monthly compensation package to help you work and live better, remotely!
  • Fully support for exams to get Certification and skills improvement training.
  • Receive 22 paid leaves on your 5th years. We encourage you to take one month off work.
  • A competitive salary and benefits package
  • Opportunities for professional development and career advancement with monthly coaching.
  • A dynamic and innovative team that values creativity and collaboration.

About client

Mibi Source Client