With multi-topics ingestion from Pinot now, it would be helpful the delay metrics emit the topic name as well. At the moment, if we want to find which topic has the issue, we have to do partition % 1000 and get the kafka topic name from the config. This is especially an issue with the new kafka offset reset feature since in this case Pinot automatically adds topics to the config. If we want to just get the backfill topics ingestion or only exclude them, there's no way to do it.
With multi-topics ingestion from Pinot now, it would be helpful the delay metrics emit the topic name as well. At the moment, if we want to find which topic has the issue, we have to do partition % 1000 and get the kafka topic name from the config. This is especially an issue with the new kafka offset reset feature since in this case Pinot automatically adds topics to the config. If we want to just get the backfill topics ingestion or only exclude them, there's no way to do it.