ГоловнаВакансіїMiddle/Senior Data Engineer

Middle/Senior Data Engineer

 
HYS Enterprise, Договорная   Закрыта

Requirements

— Knowledge and experience with Python (or other languages if experienced in other topics);
— Experience with distributed data processing with Apache Flink / Beam pipelines / MapReduce principles;
— Experience with Kubernetes (including knowledge about Kubernetes operator pattern, Helmfile, Helm, Docker);
— Experience or knowledge of Kubeflow;
— Experience with SQL, Data structures, Data design;
— Practical experience with CI/CD (GitOps, Jenkins X, ArgoCD);
— Upper-intermediate English level.

About project

The client’s data platform’s solution stack is on Kubernetes and consists of:
— Apache Kafka (collecting order and deal events, data from metering points, etc. with Kafka);
— Apache NiFi (for integration with external systems);
— Apache Flink (Flink jobs for tagging, calculating positions, weighted average prices, etc. out of allocation data, load forecasts, order and deal event streams; using Apache Beam pipelines using Python, designed for parallel, distributed data processing);
— Apache Druid (OLAP, supporting real-time dashboards, optimized for time series aggregations);
— Apache Superset (for real-time dashboards as it integrates nicely with Druid);
— Kubeflow for forecasting pipelines, machine learning, Jupyter notebooks.

Main programming language: Python.

Three main pillars:
— (Near) real-time hedge book/sales book dashboards for portfolio managers;
— Forecasting (short, mid, and long term; for initial pricing, before delivery, etc.);
— Asset monitoring & control (wind turbines, etc., grid balancing).

IT-service provider is active in the Dutch/European Energy Sector. The client`s goal is to help energy companies maximize control over their energy portfolio and increase value across the entire energy supply chain.
To achieve this, the client delivers an energy management platform. Flexible and scalable process automation and big data processing software application that covers the entire energy supply chain and can be fully integrated with the company’s digital infrastructure for optimal business-IT alignment.

HR Contacts

Email

We’re proud of our team and are always on the lookout for people who share our vision and values so we can deliver amazing results together.

Benefits

Location

You have a great chance to do your favorite thing in a cozy office with the sea view in the heart of sunny Odesa

Lunches

There is no need to waste your energy on cooking or searching for catering, because we have free tasty lunches, yummy snacks and fruits

Team

You will have all-round growth which is unavoidable in a team of cool specialists in large-scale projects

Parties

We know how to work hard, but also we know how to enjoy life, that’s why we have a lot of fun corporate parties and team buildings

Medical Insurance

We take care of our guys, which is why every team member has medical insurance that also covers COVID-19 cases.

 
Database
Похожие вакансии
Нет похожих вакансий