Airflow Expert
- Львов
- Постоянная работа
- Полная занятость
We’re at the forefront of travel, media and fintech innovation, healthcare efficiency enhancements, and others. Our goal? To connect interesting customer projects and skilled talent alike. Become a part of our team and take the next step on your personal career journey.About our clientOur client is a global mining company with a world-class portfolio of products that are used by a billion consumers every day. Our client relies on data and cutting-edge data science to enhance their operations. They also use advanced machine learning and artificial intelligence to optimize their processes.About the projectOur client is a giant corporation with 90000 employees globally. They have their own innovative IT department handling the whole cycle of development of the products used by the organization. You will work in an international expert team to develop sophisticated software solutions that have a direct impact on almost every aspect of modern life. You will use the innovative practices and the latest technologies to deliver safe and sustainable products to their customers around the world. Data Analytics is a new discipline in the Technical and Sustainability function of our client. The company is going to generate more data than ever before, and it needs to build the systems to support this and for making better decisions.ResponsibilitiesOptimize and fine-tune Apache Airflow environment for performance, reliability, and scalabilityDesign and implement modular, reusable DAGs to orchestrate complex data workflowsIntegrate Airflow with Azure Data Factory, Databricks, Synapse, and other Azure servicesDevelop and maintain CI/CD pipelines for DAG deployment via Azure DevOpsEstablish robust monitoring, alerting, and logging for Airflow operationsProvide architectural guidance and hands-on support for new data pipeline initiativesMentor team members and document operational standards and best practicesQualificationsProven expertise with Apache Airflow in production, including scheduler, executors (Celery, Kubernetes), and pluginsStrong experience with Azure services: Data Factory, Databricks, Storage, SynapseSkilled in Python programming with focus on modular, testable codeProficient in Azure DevOps (YAML pipelines, release management)Knowledge of KEDA and Celery for orchestration and autoscalingExperience with Docker, Kubernetes, and Airflow deployment strategiesFamiliarity with monitoring/logging tools: Prometheus, Grafana, ELK, Azure MonitorStrong problem-solving, communication, and collaboration skillsPwrteams offers:
- Family-like environment and personal attention to each specialist
- Direct cooperation with European and USA clients and their innovative products
- Competitive salary and regular reviews
- The work-life balance you deserve: 24 working days of paid vacations
- Educational reimbursement, funded language classes, certifications
- "Benefit Cafe with various categories like sport, leisure, books, fuel, etc.
- Health care: 10 paid sick leaves, on-demand medical insurance, vaccinations
- Cozy workplace and WFH opportunities
- Exciting events and lovely gifts for your family