Improve ExternalSorter ResourcesExhausted Error Message #20225
Description
Is your feature request related to a problem or challenge?
When there is no enough memory to continue external sort, either increasing the memory limit or decreasing sort_spill_reservation_bytes need to be applied. It can be useful to guide the user with clearer error message by also highlighting required configs because expected structure is as follows:
SET datafusion.runtime.memory_limit = '10G'
SET datafusion.execution.sort_spill_reservation_bytes = 10485760
Current:
Not enough memory to continue external sort. Consider increasing the memory limit, or decreasing sort_spill_reservation_bytes
New:
Not enough memory to continue external sort. Consider increasing the memory limit config: 'datafusion.runtime.memory_limit', or decreasing the config: 'datafusion.execution.sort_spill_reservation_bytes'.
Also, a new UT case is being added to cover this use-case and being updated snapshot files.
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response