consider using spark.metrics.namespace

[erikerlandson]

This is an issue to brainstorm about possible uses of spark.metrics.namespace, as described here

A possible example. Set spark.metrics.namespace to the spark cluster name assigned by the user or oshinko. So for a cluster named "wilma" the metrics from driver and executors would be:

wilma.metric.name instead of spark_app_uid.metric.name

[elmiko]

i feel like this is something that app developers should be doing in their code. it might be nice to have a default back to the cluster name, but i'm not sure how we would avoid stomping on the value provided by an app in that case.

[tbradellis]

So, would this be:
spark.metrics.namespace.${spark.app.name}

or
spark.metrics.${spark.app.name}