Responsibilities

• Design, implement, maintain and document highly scalable data pipelines for real-time and batch processing.
• Build and optimize data systems to support accurate, low-latency analytics and reporting use cases.
• Develop and maintain solutions for streaming and serverless data processing.
• Collaborate with cross-functional teams to implement and support end-to-end analytics workflows.

Qualifications

• 5+ years of experience in data engineering or related fields.
• Strong expertise in ClickHouse: experience in designing schemas and jobs, optimizing data ingestion as well as queries, managing clusters, etc.
• Proven experience in real-time data processing and enrichment using tools like Apache Kafka, Apache Flink, Apache Spark Streaming, Serverless technologies like AWS Lambda, GCP Functions, etc.
• Proficiency in programming languages like Python, or Java

Skills

• Strong problem-solving skills and ability to work in a fast-paced environment.
• Excellent communication and collaboration skills, with a demonstrated ability to work effectively as part of a team.

Desired requirements

• Experience in the e-commerce industry or similar high-traffic, data-intensive environments would be a big plus
• Knowledge of ETL/ELT tools like Airflow, dbt, or equivalent
  

• التقديم الان