mysql optimise
ive got a mysql database thats got about 37million lines in. every 15 minutes it gets a file with 40k lines, and it has to compare those 40k lines to the 37million lines to check if it exists already, and if not it adds it... the db files are about 1.3gigs in size now toonow as you might've guessed this is v.v.v. slow, and in its current unoptimised state the sql server cant handle it. I've got some changes in mind to make to the table structures that were overlooked on original design/implementation, but im wondering if anyone can suggest any optimisations for the actual server itself.
the machine is a p4 2.8 with half a gig of ram. (im think upgrading that would be a good start..)
Thanks in advance