Home » Performance » MySQL » Queries are slowing down as table grows
Queries are slowing down as table grows [message #89] Mon, 21 August 2006 18:39 Go to previous message
sergey  is currently offline sergey
Messages: 3
Registered: August 2006
Location: California
Junior Member
I am running MySQL 4.1 on RedHat Linux. The box has 2GB of RAM, it has dual 2.8GHz Xeon processors, and /etc/my.cnf file looks like this.

[mysqld]
...
key_buffer = 512M
max_allowed_packet = 8M
table_cache = 512
sort_buffer_size = 32M
read_buffer_size = 32M
read_rnd_buffer_size = 128M
myisam_sort_buffer_size = 256M
thread_cache = 32
query_cache_size = 256M

I am running data mining process that updates/inserts rows to the table (i.e. I do multifield select on indexed fields, and if row is found, I update the data, if not I insert new row). Up to about 15,000,000 rows (1.4GB of data) the procedure was quite fast (500-1000 rows per second), and then it started to slow down. Now I have about 75,000,000 rows (7GB of data) and I am getting about 30-40 rows per second.

Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic:1 union Vs. 14 separate queries
Next Topic:slow_launch_threads
Goto Forum:

  


Current Time: Fri Jul 10 05:53:38 EDT 2009

Total time taken to generate the page: 0.02165 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 2.7.7.
Copyright ©2001-2007 FUD Forum Bulletin Board Software

MySQL is a trademark of Sun Microsystems.
InnoDB is a trademark of Oracle Corp.

Percona Performance Forums are a service of Percona, Inc.
Not affiliated with Sun Microsystems or Oracle Corp.