Experience

Role & Responsibility (R&R)

• Data Pipeline Development

1. Develop and maintain scalable ETL/ELT pipelines for structured, semi-structured, and unstructured data

• Data Management & Transformation

1. Implement data cleansing, transformation, and normalization processes.
2. Ensure data consistency, accuracy, and integrity.
3. Build curated datasets and feature stores for AI/ML models.

• Operations & Monitoring

1. Monitor pipeline performance, latency, and costs.
2. Troubleshoot data ingestion or quality issues.
3. Automate workflows using orchestration tools (Airflow, dbt, Azure Data Factory, etc.).

• Document & Best Practices

1. Maintain documentation of pipelines, schemas, and data dictionaries.
2. Follow coding standards, version control (Git), and CI/CD practices.
3. Ensure compliance with Responsible AI and data security guidelines.

Education

• Bachelor’s degree in Computer Science, Data Engineering, IT, or related.