Data Engineer

We are looking for a motivated and detail-oriented Data Engineer with 2-3 years of experience in managing and optimizing ETL/ELT processes using industry-standard tools. The ideal candidate should have a solid background in database management systems, expertise in SQL, and a passion for designing efficient, scalable data pipelines.

Sri Lanka

Responsibilities

Design, implement, and optimize ETL/ELT pipelines to support data transformation and integration using tools such as AirByte, DBT, and other data orchestration technologies.
Manage and monitor data visualization tools like Metabase to create meaningful insights for stakeholders.
Work with diverse DBMS technologies, including PostgreSQL, MSSQL, and Oracle, to ensure efficient database integration and data processing.
Write, debug, and optimize complex SQL queries to manage data flows and transformations across different platforms.
Collaborate with cross-functional teams, including data analysts, data scientists, and developers, to understand data needs and deliver actionable insights.
Ensure data integrity, accuracy, and security throughout the data pipeline.
Maintain and document data engineering processes, ensuring best practices are followed in version control and CI/CD pipelines for data workflows.
Stay updated with the latest trends and tools in the data engineering ecosystem to propose and implement innovative solutions.

Requirements

Bachelors degree in Computer Science, Information Technology, or related field.
2-3 years of hands-on experience in data engineering, with a strong emphasis on ETL/ELT processes.
Proficiency with AirByte, DBT, Metabase, or similar tools.
In-depth knowledge of PostgreSQL, MSSQL, MySQL etc. and advanced SQL techniques.
Strong understanding of data modeling, data warehousing, and data architecture principles.
Experience working with cloud platforms (AWS, GCP, or Azure) and cloud-based data storage solutions is a plus.
Familiarity with CI/CD practices and tools for data pipeline management.
Strong problem-solving skills and ability to work in an agile environment.
Excellent communication skills and a collaborative mindset.

Preferred Qualifications

Experience with Python or another scripting language for data pipeline automation.
Familiarity with orchestration tools such as Dagster, or similar.
Exposure to data governance and data quality frameworks.
Experience with dashboarding or reporting tools other than Metabase, such as Tableau or Power BI.