senior data engineer

توضیحات آگهی

About SnappPay SnappPay is the first and leading BNPL provider in Iran started in 2020 We are leveraging Financial Technologies to reshape Iranians experience of consumer credit Supporting Snapp Group s mission of enhancing Iranian people s quality of life through Internet services SnappPay s mission is to bring financial freedom to all Iranians by providing them with better smarter and more efficient solutions for payment and shopping About the Role We are looking for an experienced and passionate Senior Data Engineer who can architect design and implement a data engineering platform using cutting edge technologies You will be part of a dynamic and cross functional team that works on various data projects such as data ingestion data processing data analysis and data visualization Responsibilities Architect design and implement a data engineering platform using Apache Airflow Apache Spark Apache Kafka ClickHouse S3 object storage and data lakehouse Deploy monitor and maintain the platform on Kubernetes using Helm charts and GitLab CI CD Design and develop ETL pipelines to load data from RDBMS databases and Google Analytics into an analytical database system like ClickHouse or a data lakehouse with high performance and quality Collaborate with data scientists data analysts and other stakeholders to understand the data requirements and deliver data solutions Ensure data quality reliability and security by applying best practices and standards Design and develop automation applications and RESTful APIs based on the team s processes and business needs Research and evaluate new technologies and tools to improve the data engineering platform and processes Requirements 3 years of experience as a data engineer or in a similar role Bachelor s or Master s degree in Computer Science Engineering or a related field Proficient in at least one programming language preferably Python or Java Expertise in Apache Airflow Apache Spark Apache Kafka and ClickHouse Experience with S3 object storage and data lakehouse Experience with Kubernetes Helm charts and GitLab CI CD Experience with Docker and containerization Experience with ETL pipelines data modeling and data warehousing Knowledge of SQL and NoSQL databases تهران تهران جردن تمام وقت اسنپ پی کارشناس ارشد جنسیت تفاوتی ندارد اینترنت تجارت الکترونیک خدمات آنلاین