استخدام senior data engineer

توضیحات آگهی

We are looking for an experienced and passionate Senior Data Engineer to architect build and evolve our data engineering platform
You will work across data ingestion processing storage analytics data quality and data governance while collaborating closely with data team members software engineers and other cross functional teams
The ideal candidate combines strong hands on engineering skills with architectural thinking and is comfortable taking ownership of projects from design and implementation through deployment monitoring optimization and continuous improvement
Responsibilities
Architect design and implement scalable data engineering platforms and pipelines
Design and implement robust batch and streaming data pipelines for high volume and near real time data processing
Design and develop ETL ELT pipelines to ingest data from databases APIs analytics platforms event streams and other data sources
Build and maintain analytical data platforms and data lakehouse solutions
Design efficient data models schemas transformations and storage strategies for analytical workloads
Develop test document and maintain scalable data transformation and modeling workflows
Work closely with data team members and cross functional teams to design and implement scalable reliable and maintainable data pipelines
Build and maintain analytical dashboards and data visualizations to support business and operational decision making
Establish practices for data quality validation observability monitoring lineage and alerting
Deploy monitor maintain and troubleshoot data services and pipelines in production environments
Troubleshoot and optimize production data pipelines improving performance reliability and scalability
Collaborate with software engineers and business stakeholders to translate requirements into production ready data solutions
Establish best practices for data engineering security testing documentation and version control
Research and evaluate new technologies and approaches to continuously improve the data platform
Provide technical guidance and mentorship to other engineers
Requirements
3 years of professional experience in data engineering or a related engineering role
Strong programming skills in Python
Good knowledge of SQL ETL ELT data modeling and data warehousing
Expertise in Apache Airflow Apache Spark or dbt and Apache Kafka
Hands on experience building and maintaining data pipelines and data processing systems
Experience working with relational and NoSQL databases such as PostgreSQL and MongoDB
Experience with containerization Linux and CI CD
Understanding of batch and streaming data processing and distributed systems
Familiarity with data quality observability monitoring and data governance
Experience with data lake or data lakehouse architectures is a plus
Strong problem solving skills and ability to take end to end ownership of data engineering projects
Strong communication and collaboration skills
شرکت زیبال Zibal
دسته بندی وب برنامه نویسی و نرم افزار
نحوه همکاری تمام وقت
نوع همکاری حضوری
مدرک تحصیلی کارشناسی
سابقه کار سه تا شش سال
حقوق توافقی
جنسیت مهم نیست
مهارت ها Python SQL ETL kafka
شهر تهران تهران