Job summary
We are seeking a highly skilled and motivated AI Data Engineer to design, build, and maintain data pipelines that power our AI and machine learning solutions. You will work closely with data scientists, machine learning engineers, and software developers to ensure the seamless flow, transformation, and integrity of data for AI applications.
Qualifications
- Bachelor's or Masters degree in Computer Science, Data Engineering, or a related field.
- 5 years of experience in data engineering, preferably with exposure to AI/ML workflows.
Responsibilities
- Design, build, and manage scalable and efficient data pipelines for AI/ML systems.
- Collaborate with AI/ML teams to understand data requirements and deliver high-quality datasets.
- Optimize data storage and retrieval to support low-latency AI workloads.
- Implement ETL/ELT processes using modern data engineering tools and cloud platforms.
- Ensure data quality, consistency, governance, and security across platforms.
- Integrate structured and unstructured data from various sources (APIs, databases, streaming platforms, etc.).
- Work with large-scale distributed systems and big data technologies such as Spark, Hadoop, Kafka, etc.
- Monitor data pipelines for performance and reliability; automate error handling and recovery.
- Contribute to the development and deployment of AI/ML models in production environments.
- Document data processes, schemas, and infrastructure for cross-functional use.
Skills
- Proficiency in programming languages like Python, Scala, or Java.
- Experience with cloud platforms such as AWS, Azure, or GCP (e.g., S3, Redshift, BigQuery, Databricks).
- Hands-on experience with data orchestration tools (e.g., Apache Airflow, Prefect).
- Proficiency in SQL and NoSQL databases.
- Familiarity with machine learning workflows and tools (TensorFlow, PyTorch, MLflow, etc.) is a plus.
- Knowledge of data lakehouse architectures and MLOps pipelines is desirable.
- Experience with containerization (Docker) and CI/CD pipelines is an advantage.
Benefits
- Competitive Compensation: Enjoy a salary package tailored to your skills and experience, along with performance-based bonuses.
- Comprehensive Benefits: We support your well-being with accommodation, meal allowances, and assistance with work visa processing.
- Work-Life Balance: Unwind with generous holiday and New Year bonuses.
- Top-Tier Equipment: Stay productive with the latest tools, including a MacBook and iPhone.
- Thriving Culture: Immerse yourself in a dynamic, inclusive work environment that fosters growth.
- Employee Support: Enjoy twice-yearly expense reimbursements for home visits.
