Data Engineer

16-11-2024

Assist in the design, development, and maintenance of data pipelines to ingest, process, and store large-scale data from various sources (internal and external).
Collaborate with Data Engineers and Data Scientists to optimize data processes and improve the overall infrastructure.
Ensure data quality and consistency by conducting regular data validation and integrity checks.
Participate in the development and maintenance of data warehouses and data lakes.
Work closely with business and technical teams to understand data requirements and ensure accurate delivery of data.
Develop and maintain documentation for data flows, pipelines, and systems architecture.
Assist with ETL development, including monitoring and debugging processes.
Perform data extraction, manipulation, and analysis using SQL and other database tools.
Support ongoing data migration projects, ensuring a smooth transition and integration of data systems.
Troubleshoot and resolve issues related to data processes, pipelines, and storage.

Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field.
Minimum 2 year experience in the related field.
Experience with ETL development, including monitoring and debugging processes.
Basic understanding of database systems (SQL, NoSQL) and data management concepts.
Proficiency in SQL for querying and manipulating data.
Familiarity with one or more programming languages such as Python, Java, or Scala.
Strong problem-solving skills and attention to detail.
Willingness to learn new technologies and improve existing skill sets.
Excellent communication and collaboration skills.