Create log monitoring for better SRE experience

[weslayer]

cool project idea from weslayer!!

Grabbing some inspo from Grafana Loki, SCE should create a lightweight, microservice-based log aggregation system. We tried to run the Loki image with Docker Logging Drivers but the server couldn't handle it 🥀

Here is the current Grafana Loki architecture: https://grafana.com/docs/loki/latest/get-started/architecture/#loki-architecture

Here is the SCE Log Aggregator that I am proposing (super simple for now):

Steps to create:

1. create Go project
2. watch MinIO tutorial to setup bucket
3. create POST /ingest endpoint
4. store logs in MinIO in nice format (ex: `/logs/{time and date }.log)

Deploying to server:

1. setup a docker compose for these services
2. manually POST example logs to see if it works
3. configure grafana MinIO datasource, scroll down to see log datatype
4. boom dashboard (not cool yet)

Future additions:

1. create service to scrape logs from containers running on the local machine (may have to use Docker Log Driver, regular docker logs should be fine)
2. adding tags for logs coming from which container that it is from
3. querying logs with SQL using PostgreSQL metadata store (maybe too much for just display)?

sre time