Esp32 ESP-IDF websocket echo client server pair

I have implemented a simple websocket echo server and a corresponding client that runs on separate esp32s3’s and communicate via wifi and it works. However the performance is very poor (~ 500ms for a roundtrip) so what I need is a optimization giving ~50ms roundtrip times. I have also implemented a python client and tested it against the esp32 server with good results (1000 roundtrips):

Number of echos over 50 millies: 999
Number of echos over 75 millies: 40
Number of echos over 100 millies: 29
Number of echos over 150 millies: 13
Number of echos over 200 millies: 8
Number of echos over 250 millies: 8
Number of echos over 300 millies: 5

And I need the same performance with a client implemented in C/ESP-IDF. I’m using ESP-IDF 5.0.1 and the sources are attached.