macOS PR builds failing with OOM / fail to create threads

[andygrove]

Describe the bug

Example:

Seems to be related to shuffle.

  java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached
  at java.base/java.lang.Thread.start0(Native Method)
  at java.base/java.lang.Thread.start(Thread.java:809)
  at java.base/java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:945)
  at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1353)
  at scala.concurrent.impl.ExecutionContextImpl.execute(ExecutionContextImpl.scala:21)
  at java.base/java.util.concurrent.CompletableFuture.asyncSupplyStage(CompletableFuture.java:1782)
  at java.base/java.util.concurrent.CompletableFuture.supplyAsync(CompletableFuture.java:2005)
  at org.apache.spark.sql.execution.SQLExecution$.withThreadLocalCaptured(SQLExecution.scala:333)
  at org.apache.spark.sql.execution.exchange.ShuffleExchangeLike.org$apache$spark$sql$execution$exchange$ShuffleExchangeLike$$triggerFuture(ShuffleExchangeExec.scala:87)
  at org.apache.spark.sql.execution.exchange.ShuffleExchangeLike.org$apache$spark$sql$execution$exchange$ShuffleExchangeLike$$triggerFuture$(ShuffleExchangeExec.scala:85)

Steps to reproduce

No response

Expected behavior

No response

Additional context

No response

[comphead]

Thats interesting, is it local or Github CI issue?

[comphead]

The example of CI fail https://github.com/apache/datafusion-comet/actions/runs/20474185612/job/58836799566?pr=2817

[wForget]

It looks like this issue isn’t limited to fuzz tests—exec tests are affected as well. https://github.com/apache/datafusion-comet/actions/runs/20514752194/job/58940558293?pr=2916

Warning: [305.818s][warning][os,thread] Failed to start thread "Unknown thread" - pthread_create failed (EAGAIN) for attributes: stacksize: 4096k, guardsize: 16k, detached.
Warning: [305.818s][warning][os,thread] Failed to start the native thread for java.lang.Thread "Thread-1762"
Warning: [305.853s][warning][os,thread] Failed to start thread "Unknown thread" - pthread_create failed (EAGAIN) for attributes: stacksize: 4096k, guardsize: 16k, detached.
Warning: [305.853s][warning][os,thread] Failed to start the native thread for java.lang.Thread "shutdown-hook-0"
Error: Exception in thread "Thread-1" java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached
	at java.base/java.lang.Thread.start0(Native Method)
	at java.base/java.lang.Thread.start(Thread.java:809)
	at java.base/java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:945)
	at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1353)
	at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
	at java.base/java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:748)
	at org.apache.hadoop.util.ShutdownHookManager.executeShutdown(ShutdownHookManager.java:122)
	at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:95)

[wForget]

A possibly related issue: https://issues.apache.org/jira/browse/SPARK-51365