Bad client connection

I'm trying to play "Don't Starve Together" with my friend however we are dealing with poor client performance.
When he tries to connect to me he has a bad connection and same goes for me. We tried to play both with mods and without and nothing changed.We both have a stable and good internet we are not far from each other and we both have a good computers.