TBDev Forum
Programming board
Main Page Forum Rules Privacy Policy Members Contact Us
Welcome Guest (Login | Register)
TBDev Forum TBDev.net - Help *nix based Installations server load is too high! HELP!
Page 1 2 3 4 5 6 7 8 9 10 11

server load is too high! HELP!

2006-05-13 17:34:00
Group: Member
Posts: 510
Topics participated: 277
Topics started: 5
First post: 2006-03-13 22:18:00
Last post: 2006-10-25 20:54:00
Try to make use of INSERT DELAYED / UPDATE LOW_PRIORITY queries..might help for some parts. Statistics like numer of comments for example aren't important to be saved right away so could be a low prio query. The insert delayed could be used in announce.php for isnerting peers. Peers won't show up that fast anymore since they are being inserted in 'blocks' instead of 1 by one, but it should be better for the load ;) (also you could try converting the peers table to a heap table, but i'm not sure how those perform under high loads)
 
2006-05-13 23:38:00
Group: Member
Posts: 41
Topics participated: 1
Topics started: 1
First post: 2006-05-08 00:35:00
Last post: 2006-05-17 16:14:00
The insert delayed could be used in announce.php for isnerting peers. Peers won't show up that fast anymore since they are being inserted in 'blocks' instead of 1 by one, but it should be better for the load ;)


it sounds good, but I don't know how to do it. can you tell me the exact solution, please
 
2006-05-14 12:49:00
Group: Member
Posts: 510
Topics participated: 277
Topics started: 5
First post: 2006-03-13 22:18:00
Last post: 2006-10-25 20:54:00
Not really that hard ;)

INSERT INTO.... would be INSERT DELAYED INTO
 
2006-05-14 01:26:00
Group: Member
Posts: 16
Topics participated: 13
Topics started: 0
First post: 2006-03-09 16:18:00
Last post: 2006-10-08 22:45:00
What I am missing in your my.cnf is the thread_concurrency variable.
This enables you to use the hyperthreading options of your single HTT or dual (HTT or not) CPU setup.

For a single CPU set the value = 2
For a single CPU (HTT) set value = 4
For a dual CPU set the value = 4
For a dual CPU (HTT) set value = 8

Measure is amount of CPU's * 2
Since a HTT CPU is virtually 2 CPU's it counts as 2.

so add this to your [mysqld] part of my.cnf

thread_concurrency = * (where * is the value I just explained)


Restart your MySQL and see if that will help any to lower the load or divide the load over several processes.
 
2006-05-14 11:55:00
Group: Member
Posts: 41
Topics participated: 1
Topics started: 1
First post: 2006-05-08 00:35:00
Last post: 2006-05-17 16:14:00
What I am missing in your my.cnf is the thread_concurrency variable


thx a lot. I've added the right row to my my.cnf

Try to make use of INSERT DELAYED / UPDATE LOW_PRIORITY queries


ok. I'm so stupid.
I've modified announce.php and the comments.php using delayed insert and low priority update. (when insert new peers and update the number of comments)
thx for you too.

unfortunately the SERVER LOAD IS TOO HIGH!
but the load is decreased a bit.

ANY IDEA?! PLEASE HELP!
 
2006-05-14 00:44:00
Group: Member
Posts: 510
Topics participated: 277
Topics started: 5
First post: 2006-03-13 22:18:00
Last post: 2006-10-25 20:54:00
Well is the cpu usage mainly coming from apache or mysql now? ;)

Did some load testing myself today and the only thing that was slowing things down was apache, mysql was doing around 150-200 queries a sec without any problem. However response times were around 900ms before the request was totally done on the webpage.

You could read this in case you didn't do so already:



 
2006-05-14 13:28:00
Group: Member
Posts: 10
Topics participated: 4
Topics started: 1
First post: 2006-03-13 00:59:00
Last post: 2006-05-16 19:09:00
Hello

I have something important for you guys...!
Do you have the passkey mod...? The Passkey mod is very bad for the load... (if you installed it as it is)
You should look to your database and set some indices...

I add an indice in the users table for "passkey" and my load is 0.8 now.
And I had a load of 20 before I added the indices.

Test it and let us know how it works for you...




greetz


PS: sorry for my bad english... But I hope you understand what I mean in my post.
 
2006-05-14 15:08:00
Group: Member
Posts: 41
Topics participated: 1
Topics started: 1
First post: 2006-05-08 00:35:00
Last post: 2006-05-17 16:14:00
I add an indice in the users table for "passkey" and my load is 0.8 now.
Test it and let us know how it works for you...


thx, but I have an index of passkey.

here is the structure of my users table:

CREATE TABLE `users` (
 
2006-05-14 16:19:00
Group: Member
Posts: 2312
Topics participated: 1240
Topics started: 124
First post: 2006-02-25 21:12:00
Last post: 2009-01-03 14:56:00
That's one big users table! Are all those entries absolutely needed? You've got nearly as many KEYS as you have fields! Do you need the combined length of ALL fields, or just part there of to decide if an entry is unique?
 
2006-05-14 16:30:00
Group: Member
Posts: 510
Topics participated: 277
Topics started: 5
First post: 2006-03-13 22:18:00
Last post: 2006-10-25 20:54:00
About the same usertable as i have, well i even have a few fields more (messages, posts, comments). Well i shouldn't answer for him, but yes most of those indexes are being used ;)
 

Similar threads

Topic Posts Last post
High server load! 11 2008-05-14 20:39:00
"Server load very high" 1 2006-09-24 09:20:00
The server load is very high... 9 2006-04-24 14:27:00
Server load too high 9 2006-12-25 15:26:00
server load to high, what to do? 17 2007-03-12 11:44:00