About the Role
Job Overview
The Data Engineer is responsible for designing, building, and maintaining data infrastructure and pipelines for data storage, processing, and retrieval. They ensure data quality, integration, and security to support data-driven applications and analytics.
Responsibilities and Duties
▪ Develop data pipelines for data ingestion and transformation.
▪ Create and optimize data models for efficient storage and retrieval.
▪ Integrate data from various sources into unified datasets.
▪ Implement data quality checks and governance processes.
▪ Manage and optimize data infrastructure and databases.
▪ Design and manage ETL processes for data movement.
▪ Ensure data security and compliance with regulations.
▪ Collaborate with data scientists and analysts.
▪ Document data engineering processes and architectures.
Requirement
▪ Bachelor's degree in Computer Science or related field.
▪ Proven experience in data engineering and ETL processes.
▪ Proficiency in Python, SQL, or Scala.
▪ Strong understanding of data modeling and warehousing.
▪ Familiarity with cloud-based data platforms (AWS, Azure, GCP).
▪ Analytical mindset and problem-solving skills.
▪ Excellent communication and teamwork abilities.