ГоловнаВакансіїMiddle/Senior Data Engineer

Middle/Senior Data Engineer

 
HYS Enterprise, Договорная   Закрыта

Talented co-workers who are always happy to share knowledge, fun and inspiring atmosphere combined with nice benefits and culture make people excited to come to work every day. Want to become a part of this? Check out our current job opening. Maybe you’re the next member of our big HYS family!

Requirements:

— Knowledge and experience with Python (or other languages if experienced in other topics);
— Experience with distributed data processing with Apache Flink / Beam pipelines / MapReduce principles;
— Experience with Kubernetes (including knowledge about Kubernetes operator pattern, Helmfile, Helm, Docker);
— Experience or knowledge of Kubeflow;
— Experience with SQL, Data structures, Data design;
— Practical experience with CI/CD (GitOps, Jenkins X, ArgoCD);
— Upper-intermediate English level.

About project:

The client’s data platform’s solution stack is on Kubernetes and consists of:
— Apache Kafka (collecting order and deal events, data from metering points, etc. with Kafka);
— Apache NiFi (for integration with external systems);
— Apache Flink (Flink jobs for tagging, calculating positions, weighted average prices, etc. out of allocation data, load forecasts, order and deal event streams; using Apache Beam pipelines using Python, designed for parallel, distributed data processing);
— Apache Druid (OLAP, supporting real-time dashboards, optimized for time series aggregations);
— Apache Superset (for real-time dashboards as it integrates nicely with Druid);
— Kubeflow for forecasting pipelines, machine learning, Jupyter notebooks.

Main programming language: Python.

Three main pillars:

— (Near) real-time hedge book/sales book dashboards for portfolio managers;
— Forecasting (short, mid, and long term; for initial pricing, before delivery, etc.);
— Asset monitoring & control (wind turbines, etc., grid balancing).

IT-service provider is active in the Dutch/European Energy Sector. The client`s goal is to  help energy companies maximize control over their energy portfolio and increase value across the entire energy supply chain.
To achieve this, the client delivers an energy management platform. Flexible and scalable process automation and big data processing software application that covers the entire energy supply chain and can be fully integrated with the company’s digital infrastructure for optimal business-IT alignment.

HR Contacts

We’re proud of our team and are always on the lookout for people who share our vision and values so we can deliver amazing results together.

Embedded
Похожие вакансии
HYS Enterprise, Договорная
11 Серпня
Epicflow, Договорная
9 Серпня