Senior Data Engineer

Location: Singapore (Priority will be given to candidates who currently possess the right to work in Singapore) About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service providers and partners around the globe, making access to business-critical applications simple, predictable and ultra-secure. Console Connect by PCCW Global is the world’s first global software-defined interconnection platform, born out of the belief that business connectivity should be simpler and more accessible for all. Console Connect enables users to efficiently manage their private connections via a user-friendly interface, regardless of their level of technical expertise. Backed by PCCW Global, one of the world’s leading telecommunications groups with a tier 1 global IP network, Console Connect is completely scalable and offers maximum resilience and reliability, leaving you confident and secure in your cloud connections. Role Overview We are passionate about harnessing the power of data to drive innovation and empower businesses. We are seeking a highly technical and experienced Senior Data Engineer to join our dynamic team. The successful candidate will be a key player in designing, building, and optimizing our data infrastructure, ensuring seamless integration and efficient data processing. Key Responsibilities Implement and manage data workflows using tools to ensure timely and reliable execution of data pipelines Integrate data from various sources, ensuring consistency, accuracy, and reliability in the data warehouse or data lake Demonstrate strong expertise in data warehousing concepts, ETL processes, and data integration techniques Optimize existing data processes and improve efficiency and scalability. Deploy and optimize open-source solutions for data engineering tasks, leveraging their flexibility and scalability Integrate diverse data sources, both structured and unstructured, into our data warehouse and data lake Establish coding standards and conduct thorough peer code reviews to ensure a high-quality, maintainable codebase Minimum Qualifications Bachelor or Master Degree in relevant fields (E.g. Statistics, Computer Science, Data Science etc) 8 years of experience in Data Engineering Experience working in a linux based environment Familiarity with data pipeline orchestration tools such as Apache Airflow Proficiency in programming languages such as SQL, Python, Java, or Scala Familiarity with containerization technologies, especially Docker. Proficient in Big Data technology, skilled in ingesting vast amounts of data and ensuring scalability. Excellent communication skills to effectively collaborate with business stakeholders and present findings and recommendations Independent problem-solver and team player 10 years and above of experience in Data Engineering preferably but candidates with lesser years of experience would be considered too.