I have been told that there are performance issues when using a lot of vhosts w/ individual error logs/access logs due to a large number of open file descriptors. I understand that one approach is to periodically parse a single universal access log into individual transfer logs. What about using "tail -f" (or something similar) on the central log, and then parse each line, and have it write the transfer data to an sql database. This way, you could have real-time transfer data, and no problem w/ open file descriptors.
Does this make any sense? Anyone see any huge glaring problems before i start on this?
