[Question] Self hosted setup for monitoring Self-hosted services?
[Question] Self hosted setup for monitoring Self-hosted services?
Hi all. I just set-up my first self-hosting server with NextCloud, Immich and a VPN server. I was wondering if there is a tool or layer of tools which would help me monitor my server and the services including running stats, resource usage stats, system logs, access logs, etc?
I read that Grafana Loki along with Prometheus could possibly help me with this. I just wanted to ask that - should I explore these two tools or do we have some other and better(suiting to my needs) tools? Please recommend Open Source tools only. Preferably Docker, or Linux based otherwise. Thank you :))
+1 for Netdata
-1 for Netdata. I used it for a bit, but the configuration is not very intuitive and the docs for alerts were basically “rest of the fucking owl”, at least for the non-cloud version. I ended up just switching to Glances which is pretty boneless but it’s easy.
Though for OP I’d probably recommend Prometheus.
I'm a big fan of netdata; it's part of my standard deployment. I put in some custom configs depending on what services are running on what servers. If there's an issue it sends me an email and posts into a slack channel.
Next step is an influxdb backend to keep more history.
I also use monit to restart certain services in certain situations.
I like Uptime Kuma, but it only monitors if a service is online or not. I'm up to 21 services now so I'm not interested in all their details, just if I need to fix something urgently.
Grafana + Prometheus + data gathering will at least give you the resource and usage stats.
I’m using Zabbix to monitor the most important bits.
There Russian affiliation makes me a bit nervous. It seems fine though
I'd swap Prometheus for VoctoriaMetrics. It's a drop-in replacement with a much better resource consumption story and a few extra goodies.
Grafana + Prometheus dashboards can be quite addicting or useful. Noted.lol put together a nice tutorial for getting started.
For most of my services though, I simply use Uptime Kuma which then sends an alert to Gotify when my services go down or whatnot, Gotify then instantly notifies my phone so I can be aware. It helps keep the spouse happy when their go to service for some reason crashed. :)
How much do you point and click your setup?
As I use nagios
I'm a web-app developer myself. So I don't mind configuring things if needed. I can opt to configure if it meets my goals better. I'd check out nagios. :))
If you're willing to go that route, check out Zabbix and Icinga2 as well. They're compatible with Nagios checks but the user interface is better.
I've not found a good solution for actual constant monitoring and I'll be following this thread, but I have a similar/related item: I use healthcheck.io (specifically a self-hosted instance) to verify all my cron jobs (backups, syncs, ...) are working correctly. Often even more involved monitoring solutions do not cover that area (and it can be quite terrible if it goes wrong), so I think it'll be a good addition to most of these.
A similar solution but I use https://ntfy.sh/ I have the app on my phone and have it set to alert when jobs ping the service. Mine ping on success but it is possible to ping when the job fails as well.