Centralised logging for cryptnono?

[manics]

Currently the Cryptnono pod logs are lost when there's an update.

There is a lot of interesting information in the logs, including, which cryptnominers were detected, processes that were incorrectly killed, which repos were involved, etc.

Could we forward the logs to a persistent location? BinderHub already sends some event logs to Google Cloud Logs

mybinder.org-deploy/mybinder/values.yaml

Lines 202 to 226 in 69cb5df

	01-eventlog: |
	import os
	import google.cloud.logging
	import google.cloud.logging.handlers
	from traitlets.log import get_logger
	# importing google cloud configures a root log handler,
	# which prevents tornado's pretty-logging
	import logging
	logging.getLogger().handlers = []
	class JSONCloudLoggingHandler(google.cloud.logging.handlers.CloudLoggingHandler):
	def emit(self, record):
	record.name = None
	super().emit(record)
	def _make_eventsink_handler(el):
	client = google.cloud.logging.Client()
	# These events are not parsed as JSON in stackdriver, so give it a different name
	# for now. Should be fixed in https://github.com/googleapis/google-cloud-python/pull/6293
	name = os.environ.get("EVENT_LOG_NAME") or "binderhub-events-text"
	get_logger().info("Sending event logs to %s/logs/%s", client.project, name)
	return [JSONCloudLoggingHandler(client, name=name)]
	c.EventLog.handlers_maker = _make_eventsink_handler

so we could do something similar, though there'll be a cost for storing the logs.

Alternatively we could store them somewhere else?