Hi colleagues,

thanks a lot everyone, it seems the puzzle is assembling in my head. Will look into the VictoriaMetrics since it's a drop-in replacement for Prometheus while being more effective and faster.

Push model required not just for generic pods/k8s metrics but for gathering internal pod's metrics as well, so native support for push messages in Victoria is a big plus.

Appreciate your help :-) Have a nice day!

On 6/11/24 16:54, Vadim Kurland wrote:
if this is for kubernetes, you could look into node-exporter. It deploys as daemonset and should automatically start on new nodes. Prometheus scrapes from node-exporter and gives you good visibility into node resources and follows them as they come up and go down

https://prometheus.io/docs/guides/node-exporter/
https://github.com/prometheus/node_exporter

as for monitoring of containers and pods, look into cadvisor, it is embedded in the kubelet

https://prometheus.io/docs/guides/cadvisor/

All of this works with standard Prometheus pull. Prometheus guys do not recommend using push at any scale because it is expensive and complex. 

Good overview:

https://se7entyse7en.dev/posts/how-to-set-up-kubernetes-service-discovery-in-prometheus/

Visualisation and alerts can be done with Grafana. There is also Prometheus alert manager.

All of this is very mature and well maintained. Do not reinvent the wheel

--vk



On Tue, Jun 11, 2024 at 7:38 AM Maksym Tulyuk <maksym@tulyuk.com> wrote:
StatsD + Graphite ?

Best wishes,
Maksym (via mobile)

Le 11 juin 2024 à 12:36, Volodymyr Litovka via UANOG <uanog@uanog.one> a écrit :

Привіт, а скажіть мені таку штуку, панове.

Я тут дивлюсь на Прометей та здається мені, що він не альо для dynamic scale in/out, бо заточений під data pulling, а коли поди в кубері автоскейляться, то стає різко незрозуміло, звідки пулити дату :)

Push типу є, але його зроблено збоку, через PushGateway, який  самим розробниками радиться to use in certain limited cases через низку причин - https://prometheus.io/docs/practices/pushing/

Тож питання наступне - а що ви знаєте на риночку таке, що вміє push natively та може бути зінтегрованим з притомною візуалізацією / алярмовкою?

Дякую

--
Volodymyr Litovka
 "Vision without Execution is Hallucination." -- Thomas Edison

_______________________________________________
UANOG mailing list -- uanog@uanog.one
To unsubscribe send an email to uanog-leave@uanog.one
_______________________________________________
UANOG mailing list -- uanog@uanog.one
To unsubscribe send an email to uanog-leave@uanog.one

-- 
Volodymyr Litovka
  "Vision without Execution is Hallucination." -- Thomas Edison