استخدام data engineer

توضیحات آگهی

We are a technology driven travel and accommodation marketplace connecting travelers with accommodation providers Our platform processes large volumes of data from accommodation listings user interactions searches reservations and transactions to support business operations and data driven decision making
About the Role
We are looking for a Mid Level Data Engineer to help develop maintain and improve our data platform
Our Data Engineering team owns the entire data platform lifecycle from building data pipelines to deploying operating and maintaining distributed infrastructure
In this role you will primarily focus on developing reliable and scalable data pipelines while gradually gaining hands on experience with distributed systems and DataOps practices
Key Responsibilities
Design develop and maintain reliable batch and streaming data pipelines using Python SQL and Apache Spark
Build and maintain data orchestration workflows using Apache Airflow
Develop and support data ingestion pipelines using Apache Kafka and Schema Registry
Design and optimize analytical datasets data models and SQL queries in ClickHouse
Work with distributed storage systems such as HDFS
Implement data quality checks monitoring error handling and recovery mechanisms
Troubleshoot pipeline failures data inconsistencies and performance bottlenecks
Participate in deploying monitoring and maintaining distributed data infrastructure including containerized services using Docker and Kubernetes
Collaborate with engineers and analysts participate in code reviews and follow software engineering best practices
Required Qualificatio
1 3 years of professional experience as a Data Engineer
Strong hands on experience with Python including writing clean modular testable and maintainable code
Strong hands on experience with SQL including complex queries joins aggregations and query optimization
Hands on experience with Apache Airflow including developing scheduling and troubleshooting DAGs
Practical experience with at least one OLTP database such as PostgreSQL MySQL or SQL Server
Hands on experience with Linux including command line tools shell scripting process management and troubleshooting
Proven experience designing developing and maintaining production ETL ELT pipelines
Good understanding of batch and streaming data processing concepts
Solid understanding of distributed systems fundamentals including partitioning replication scalability and fault tolerance
Understanding of Docker Kubernetes and containerization concepts
Experience with Git and software engineering best practices
Strong troubleshooting and problem solving skills with an interest in DataOps and infrastructure operations
Nice to Have
Hands on experience developing pipelines using Apache Spark or Kafka
Experience with ClickHouse or other column oriented analytical databases
Experience with HDFS Kafka Schema Registry Avro or Protobuf
Practical experience with Docker Kubernetes or distributed data services
Exposure to cluster configuration monitoring troubleshooting or performance optimization
Experience with CI CD automated testing and observability practices
Experience working with large scale transactional or event driven datasets
شرکت جاباما Jabama
دسته بندی وب برنامه نویسی و نرم افزار
نحوه همکاری تمام وقت
نوع همکاری حضوری
مدرک تحصیلی مهم نیست
سابقه کار کمتر از سه سال
حقوق توافقی
جنسیت مهم نیست
مهارت ها Python SQL Data engineer
شهر تهران تهران