Commit Graph

254 Commits

Author SHA1 Message Date
oysteikt
34a16149f8 ildkule: add config for prometheus_mysqld_exporter
There's a PR waiting to add this module to nixpkgs,
so we should enable this once it gets merged.
2023-07-10 00:06:27 +02:00
oysteikt
998e66db65 bicep: enable mysql 2023-07-10 00:06:09 +02:00
Daniel Olsen
699569249a ildkule: adjust matrix version annotations for nixos matrix module 2023-06-20 14:01:44 +02:00
Daniel Olsen
e73b7d2cd1 ildule: fix upstream dashboard variables 2023-06-20 13:46:00 +02:00
Daniel Olsen
ff30477e86 ildule: Update matrix dashboard from upstream 2023-06-20 13:20:42 +02:00
8f55ef3193 Bekkalokk: Configure Gitea, clean web services
Update bekkalokk secrets format

Update gitea keys and firewall rules

Create gitea-user-import script

Fix SSH host key verification

Gitea-import-users bug squashification

Fix Gitea-import SSH problems
2023-06-05 19:41:25 +02:00
Daniel Olsen
d694724f5c bicep/synapse: Set event cache to 20K
This is double the cache from default
changed because we're seeing periodic cpu spikes
with this cache beeing the main one missing
2023-05-26 02:22:18 +02:00
Daniel Olsen
68ce7acebb Revert "bicep: Emergency fix for matrix postgres auth"
This reverts commit fdbcd8c884.

This was not it
2023-05-23 05:12:46 +02:00
Daniel Olsen
fdbcd8c884 bicep: Emergency fix for matrix postgres auth
I think
2023-05-23 04:59:34 +02:00
Daniel Olsen
815063744b bicep/postgres: Remove jit setting
The nixos build of postgres doesn't support it anyways
2023-05-23 04:57:18 +02:00
Daniel Olsen
dfd827ee74 Clean up jokum removal 2023-05-23 04:29:45 +02:00
Felix Albrigtsen
9ccfb6cbed Merge branch 'bekkalokk-metrics' 2023-05-21 04:04:29 +02:00
Felix Albrigtsen
1335ab1d4b Add metrics exporters to bekkalokk 2023-05-21 04:03:14 +02:00
felixalb
69be23712f Merge branch 'bicep-metrics' of Drift/pvv-nixos-config into main 2023-05-21 03:47:53 +02:00
Felix Albrigtsen
ce58f91e16 Add metrics exporters to bicep 2023-05-21 03:47:02 +02:00
Felix Albrigtsen
8ccf9e9298 Update keys and re-enable web services 2023-05-21 02:29:14 +02:00
8b70d84f41 bekkalokk: hardware-config for baremetal 2023-05-21 00:06:25 +02:00
h7x4
cd0c8c8198
bekkalokk: continue work on mediawiki service 2023-05-19 03:03:47 +02:00
h7x4
c11a804097
bicep: set up mysql/mariadb 2023-05-18 15:40:13 +02:00
Daniel Olsen
4ff5da28c4 bicep: nginx listen on bicep ip 2023-05-08 03:38:59 +02:00
Daniel Olsen
ee73a964be move matrix to bicep 2023-05-08 03:38:59 +02:00
h7x4
dcbe6871da
bekkalokk: setup keycloak 2023-05-07 00:34:42 +02:00
h7x4
0e75e0a5b9
bicep: add backup service 2023-05-06 19:07:10 +02:00
Daniel Olsen
f77a5e946f bicep: mount /data 2023-04-08 05:23:01 +02:00
Daniel Olsen
bac67ee123 bicep: don't wait for all interfaces and especially not jokums 2023-04-07 04:53:36 +02:00
Daniel Olsen
38e3202c9e Move more of jokum
slightly less stupid this time
2023-03-26 14:44:58 +02:00
Daniel Olsen
7620fb3dee move jokum to nixos bicep 2023-03-26 06:36:04 +02:00
h7x4
dfe8b8b44c
bicep: added postgres settings 2023-03-26 01:50:00 +01:00
h7x4
169f774e81
bicep dead, but maybe soon bicep alive 2023-03-26 01:09:44 +01:00
Felix Albrigtsen
2568800794 Add andresbu to node-exporter targets 2023-03-12 00:41:36 +01:00
Daniel Olsen
d9c19385fa synapse: cache more event_auth 2023-03-08 03:18:57 +01:00
Daniel Olsen
70f4777696 fix synapse dashboard 2023-03-04 05:11:40 +01:00
Daniel Olsen
db69d28b42 Revert "metrics: Fix Synapse dashboard"
This reverts commit beb8df8fc7.
2023-03-04 03:14:54 +01:00
Daniel Olsen
8f23d7ba06 jokum: don't use host resolv.conf 2023-03-04 03:04:32 +01:00
Daniel Olsen
3252a3b5d1 turn on jokum 2023-03-04 02:03:37 +01:00
Daniel Olsen
8e819b5546 fix ip for bekkalokk 2023-03-04 00:57:28 +01:00
Daniel Olsen
6cf831a347 switch to networkd 2023-03-04 00:44:30 +01:00
Daniel Olsen
af955c88f8 jokum: move to systemd-nspawn container on bicep 2023-02-26 19:23:00 +01:00
Daniel Olsen
eed3c9b05f matrix: Point mjolnir directly at synapse so it can use the admin api 2023-02-13 03:42:52 +01:00
Daniel Olsen
7a9759ef71 matrix: Add mjolnir as a moderation bot 2023-02-13 02:34:11 +01:00
Daniel Olsen
4684cd239a matrix: enable shared secret registration 2023-02-13 00:58:15 +01:00
Daniel Olsen
c0c0dea069 tune worker distribution post fosdem and turning off prescence 2023-02-06 02:11:07 +01:00
Daniel Olsen
9c18a87866 element: disable presence if disabled in synapse 2023-02-02 18:51:47 +01:00
Daniel Olsen
73aa42a5f5 synapse: Disable presence
For now at least until we move to a stronger
machine.

Most large servers don't have this enabled.
2023-02-02 18:39:08 +01:00
Daniel Olsen
eade192132 synapse: bump federation receiver count to 3 2023-02-02 00:35:26 +01:00
Daniel Olsen
beb8df8fc7 metrics: Fix Synapse dashboard
Some of the panels were set to the wrong
datasource

Additionally since we don't do MAU limits,
I moved the relevant MAU panel to Overview
2023-02-01 22:54:54 +01:00
Daniel Olsen
1a424c79fe synapse: track monthly active users 2023-02-01 19:42:49 +01:00
h7x4
796155481f
Add host bekkalokk
`bekkalokk` is a new machine, meant to host web services and eventually
miscellaneous services.
2023-01-29 01:51:35 +01:00
h7x4
efc8eb7ffc
ildkule: add postgres exporter for knakelibrak 2023-01-26 02:16:52 +01:00
Felix Albrigtsen
84b57bb4db Provision go dashboard for gogs 2023-01-23 14:48:26 +01:00
Felix Albrigtsen
b4e74a3959 Add node and gogs metrics collection to prometheus 2023-01-23 13:12:46 +01:00
h7x4
a78f120a65
explicitly state nginx listen addresses 2023-01-22 17:46:48 +01:00
h7x4
3880190577
ildkule: add postgres dashboard to grafana 2023-01-22 02:28:19 +01:00
h7x4
171fea39bc
ildkule: switch grafana db from sqlite to postgres 2023-01-22 02:18:21 +01:00
h7x4
2bc5d7d91e
ildkule: set up postgres metrics exporter 2023-01-22 00:47:22 +01:00
h7x4
a7408b8800
ildkule: restructure prometheus config 2023-01-21 20:08:36 +01:00
h7x4
ad75cb0c88
Restructure values file to separate hosts from services 2023-01-21 19:54:20 +01:00
Daniel Olsen
94fc936251 ildkule: use ip addressess from values.nix 2023-01-21 11:45:05 +01:00
Felix Albrigtsen
ecfde9f56a Update ildkule IPv6-address 2023-01-20 11:40:42 +01:00
Daniel Olsen
1a0880086a metrics: use matrix-lib to simplify generation of prometheus scrape config 2023-01-20 08:24:02 +01:00
Daniel Olsen
efed13c810 Revert "metrics: stop parsing prometheus labels from url"
This reverts commit 1524b6b10c.

Prometheus doesn't allow scraping from uris only socketAddresses
The relabeling is to change the internal labels to trick it to read
from a url
2023-01-20 05:04:16 +01:00
h7x4
1524b6b10c
metrics: stop parsing prometheus labels from url 2023-01-20 01:15:45 +01:00
Daniel Olsen
90e924c083 synapse: also generate metric config for the master node 2023-01-18 04:04:42 +01:00
h7x4
c8d26e3c81
synapse: generate metric endpoints automatically 2023-01-18 02:55:05 +01:00
Daniel Olsen
1330c9575f metrics/dashboards/synapse: update default timeframe 2023-01-17 18:57:32 +01:00
4a82d22a56 Merge branch 'jokum_logs' of Drift/pvv-nixos-config into main 2023-01-17 18:50:41 +01:00
Daniel Olsen
64d0253aa0 I dont think the nginx config verifier has caught a single configuration error ever 2023-01-17 18:47:08 +01:00
Daniel Olsen
1ea40456a5 add ipv6 to allowed ip addresses for metrics exporters 2023-01-17 18:23:42 +01:00
Daniel Olsen
524bbdb78b ildkule/dashboard/synapse: Make zooming out on the cpu graph aggregate max cpu instead of avg 2023-01-17 17:37:44 +01:00
Daniel Olsen
5b798b2f1d jokum: enable metric exporters 2023-01-17 17:28:47 +01:00
Daniel Olsen
96b6dee404 Add firewalling to metric exporters 2023-01-17 17:28:11 +01:00
Daniel Olsen
e4cb215d39 Simplify networking configs
Introduces values.nix, a place to store information relevant across systems
2023-01-17 17:28:11 +01:00
Felix Albrigtsen
e679c7d27a Add bicep and hildring to monitoring 2023-01-17 13:47:48 +01:00
Felix Albrigtsen
084313e01d Add ildkule to prometheus targets 2023-01-14 22:45:01 +01:00
Felix Albrigtsen
40c67c6153 Removed motd extras 2022-12-20 23:15:52 +01:00
Felix Albrigtsen
f6cc25cdaf Add synapse monitoring with prometheus 2022-12-20 23:11:46 +01:00
Felix Albrigtsen
a45a08db57 Cleanup ildkule configs 2022-12-20 23:11:46 +01:00
Felix Albrigtsen
fcdce57a3d SSL and loki network config 2022-12-20 18:11:32 +01:00
Felix Albrigtsen
c0b5932432 Improve grafana config, enable boltdb-shipper 2022-12-20 18:11:32 +01:00
Felix Albrigtsen
ed46e9af61 Add a default dashboard 2022-12-20 18:11:32 +01:00
Felix Albrigtsen
a2f71ba120 ildkule-grafana upgrades 2022-12-20 18:11:32 +01:00
Felix Albrigtsen
2236863f09 Add a new metrics stack 2022-12-20 18:11:32 +01:00
Felix Albrigtsen
1de68ee0e2 ildkule: hardware-configuration.nix 2022-12-20 18:11:28 +01:00
Felix Albrigtsen
1429a1b51b Simplify nginx on ildkule 2022-12-20 18:06:49 +01:00
6b1f0eb090 Add host ildkule 2022-12-17 21:51:43 +01:00
Daniel Olsen
44f2b6d8d8 fed-sender2 metrics 2022-12-14 10:26:28 +01:00
Daniel Olsen
154e12e609 add another federation sender as one is being maxed out 2022-12-14 10:25:29 +01:00
Daniel Olsen
8a3219e8d1 user directory worker 2022-12-14 10:15:37 +01:00
Daniel Olsen
911ce4057a event-persist metrics 2022-12-14 09:19:13 +01:00
Daniel Olsen
72eab1d2aa add an event persister worker 2022-12-14 09:16:43 +01:00
Daniel Olsen
ea4fe98055 point discord bridge at the public url again
It was fetching avatars from 127.0.0.1
2022-12-12 16:05:50 +01:00
Daniel Olsen
8c6b73129b move services to be host specific 2022-12-12 15:54:47 +01:00
Daniel Løvbrøtte Olsen
121dcd8ab2 Initialize flake 2022-12-07 22:13:28 +01:00
System administrator
cfed55f61a Merge remote-tracking branch 'origin/main' 2022-12-07 10:31:41 +01:00
Daniel Olsen
4a9efb0d5c Finally comitting matrix-configuration now that we have secret-management 2022-12-07 10:16:15 +01:00
Daniel Olsen
3ed65c6cfa Add sops for secret management 2022-12-07 10:16:07 +01:00
System administrator
fec14535a1 Rename dir to 2022-09-08 17:34:00 +02:00
fa8420a337 move real minecraft server to greddost from innovation 2021-12-29 04:09:09 +01:00
254e9934ad greddost: static ip 2021-12-20 03:06:55 +01:00
7c8e9e0b93 FAST MINECRAFT SØRVER 2021-12-19 03:21:30 +01:00
8910e4b8a2 Make jokum use base.nix 2021-12-18 22:24:22 +01:00
cae766b85f Split common options into base 2021-12-18 22:09:16 +01:00
System administrator
b7bf6f3727 move configuration file for greddost 2021-12-17 09:25:15 +01:00
System administrator
ae1a91bc2d modularize configuration 2021-12-15 18:14:48 +01:00