RuntimeError: File descriptor 2877 is used by transport <TCPTransport closed=False reading=True 0x55b8dc9baa90>

[AntonArsentiev]

In our service we had aiohttp==3.8.5 and upgraded aiohttp to 3.10.5 version. That is all. In production now we have issues like issue below.
Maybe i should to write issue to another libs, tell me about it if so, or maybe you have your own fix then tell me uvloop version i need to upgrade in my service.

traceback:

RuntimeError: File descriptor 2877 is used by transport <TCPTransport closed=False reading=True 0x55b8dc9baa90>
  File "our_service/app/client.py", line 204, in get_recommendations
    async with self._session.get(
  File "aiohttp/client.py", line 1353, in __aenter__
    self._resp = await self._coro
  File "aiohttp/client.py", line 657, in _request
    conn = await self._connector.connect(
  File "aiohttp/connector.py", line 564, in connect
    proto = await self._create_connection(req, traces, timeout)
  File "aiohttp/connector.py", line 975, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
  File "aiohttp/connector.py", line 1319, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
  File "aiohttp/connector.py", line 1073, in _wrap_create_connection
    sock = await aiohappyeyeballs.start_connection(
  File "aiohappyeyeballs/impl.py", line 104, in start_connection
    raise first_exception
  File "aiohappyeyeballs/impl.py", line 82, in start_connection
    sock = await _connect_sock(
  File "aiohappyeyeballs/impl.py", line 174, in _connect_sock
    await loop.sock_connect(sock, address)
  File "uvloop/loop.pyx", line 2631, in sock_connect
    fut = self._sock_connect(sock, address)
  File "uvloop/loop.pyx", line 1089, in uvloop.loop.Loop._sock_connect
    self._add_writer(sock, handle)
  File "uvloop/loop.pyx", line 837, in uvloop.loop.Loop._add_writer
    self._ensure_fd_no_transport(fd)
  File "uvloop/loop.pyx", line 764, in uvloop.loop.Loop._ensure_fd_no_transport
    raise RuntimeError(

python version:
Python 3.10.15

os info:
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm
ID=debian

other installed libs:
aiohttp==3.10.5
aiohttp_traversal==0.11.0
aiojobs==1.2.0
asyncpg==0.29.0
orjson==3.9.10
uvloop==0.19.0
yarl==1.12.1

[top-oai]

I have also encountered this issue when upgrading from aiohttp 3.9.5 -> 3.11.11.

I was able to reproduce with this test script (gist) on Ubuntu 24 x86.

After some experimentation I found that aio-libs/aiohttp#10464 resolved the issue for my test script... however it does feel like there's something funny on uvloop's side here, in that when an exception is thrown on this line:

uvloop/uvloop/loop.pyx

Line 2066 in 7bb12a1

await waiter

then it is possible for the transport to linger on in

uvloop/uvloop/loop.pyx

Line 150 in 7bb12a1

self._transports = weakref_WeakValueDictionary()

despite the file descriptor being relinquished to the OS.

[top-oai]

Also, it looks like #646 would be a uvloop-side fix for this issue.