server fast at night, slow during the day To Many Connections ?

I have been having trouble with a server that gets REAL slow during the day but is rocket fast at night. The thing that has been throwing me is that according to the forum, the numbers we get online at night are about the same as the day.

When looking at mrtg though I noticed this. This image is from a couple days ago,

http://www.wickedvision.com/tcp-day.png


and this one is from right now

http://www.wickedvision.com/tcp-day2.png

When the server gets fast they are low and when the server gets slow they are high. The problem is I can't see why there are so many connections, the forum numbers are the same. netstat -an is not showing me anything, maybe 12 entries, two of which are mine.

Is there some way someone could be opening a ton of tcp connections on this box without me knowing it ?

 

 

 

 

Top