Koozali.org: home of the SME Server
Obsolete Releases => SME Server 7.x => Topic started by: linuxhelp on August 11, 2010, 08:48:51 AM
-
Can anyone reports about the RAM Usage of SME on big Servers? (8GB-RAM)
Are the options to fine tune? hold Databases inside RAM?
(by default SME take up to 500MB RAM..for my some Domains)
(http://files.myopera.com/linuxonlinehelp/files/ram-usage-sme-server.png)
-
Are the options to fine tune? hold Databases inside RAM?
Do you need to? Are you suffering performance issues related to the databases? If not, I would not bother as optimizing databases is no easy job.
Can anyone reports about the RAM Usage of SME on big Servers? (8GB-RAM)
...
(http://files.myopera.com/linuxonlinehelp/files/ram-usage-sme-server.png)
Are you sure there is 8GB of RAM in this server? It seems to only see half of it.
-
Notes / Report:
- (only smp) SME kernel can handle that much memory ! (32bit boundary)
- There are (still) boards around which will ignore "above 4Gb RAM" unless you set correct bios options
- Linux always uses all available ram (for buffers) and by default only goes to disk when needed
so unless your DATABASE does have a special "buffers" option or like it's all provided for already.
Hope (32bit-) htop gives you incorrect/misleading numbers here ...
free -m should (must!) show something like
total used free shared buffers cached
Mem: 8105 1292 6812 0 38 483
Most important: What database are we talking?
There are beasts such as IMDB databases (In Memory...) but I doubt SME is the right basis (being 32bit & all)
Regards
Reinhold
-
- (only smp) SME kernel can handle that much memory ! (32bit boundary)
That is not true IMHO, why would SME Server otherwise provide the hugemen kernel (http://"http://mirror.contribs.org/releases/7/smeos/i386/repoview/kernel-hugemem.html") for instance?
- Linux always uses all available ram (for buffers) and by default only goes to disk when needed
so unless your DATABASE does have a special "buffers" option or like it's all provided for already.
Wrong. That totally depends on how the database is configured. By default the buffers in MySQL (the database engine that SME Server provides) are small, meaning once buffers are full writing reading is done to the harddisk and for lookups the same analogy holds, when data is not in the memory cache it is retrieved from the hard disk. You can tweak very much for a MySQL database making it resemble a so-called In Memory DataBase (IMDB), but by default it is not.
The closest MySQL comes to it is with it's MySQL Cluster server, but that is a whole different beast than the community server edition that comes with SME Server.
Here are some of the MySQL parameters related to these issues from a stock SME Server:
mysql> show variables like '%buffer%';
+-------------------------------+---------+
| Variable_name | Value |
+-------------------------------+---------+
| bdb_log_buffer_size | 262144 |
| bulk_insert_buffer_size | 8388608 |
| innodb_buffer_pool_awe_mem_mb | 0 |
| innodb_buffer_pool_size | 8388608 |
| innodb_log_buffer_size | 1048576 |
| join_buffer_size | 131072 |
| key_buffer_size | 8384512 |
| myisam_sort_buffer_size | 8388608 |
| net_buffer_length | 16384 |
| preload_buffer_size | 32768 |
| read_buffer_size | 131072 |
| read_rnd_buffer_size | 262144 |
| sort_buffer_size | 2097144 |
+-------------------------------+---------+
13 rows in set (0.00 sec)
mysql> show variables like '%mem%';
+---------------------------------+---------+
| Variable_name | Value |
+---------------------------------+---------+
| innodb_additional_mem_pool_size | 1048576 |
| innodb_buffer_pool_awe_mem_mb | 0 |
| locked_in_memory | OFF |
+---------------------------------+---------+
3 rows in set (0.00 sec)
mysql> show variables like '%heap%';
+---------------------+----------+
| Variable_name | Value |
+---------------------+----------+
| max_heap_table_size | 16777216 |
+---------------------+----------+
1 row in set (0.00 sec)
mysql>
Apart from that there still is the HEAP or MEMORY type tables (http://"http://dev.mysql.com/doc/refman/4.1/en/memory-storage-engine.html"), but these by default are not used much as one of the drawbacks is that the tables are never stored on disk, not even when MySQL is shut down.
-
A quick check on the memory usage of the MySQL server on that same server results in the following excerpt:
[root@homer ~]# pmap -x `cat /var/run/mysqld/mysqld.pid`
8700: /usr/libexec/mysqld --defaults-file=/etc/my.cnf --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid
Address Kbytes RSS Dirty Mode Mapping
0000000000400000 6724 1840 0 r-x-- mysqld
0000000000c91000 432 276 144 rwx-- mysqld
...
00002b358aee3000 40 40 40 rwx-- [ anon ]
00007fff0025c000 84 36 36 rw--- [ stack ]
ffffffffff600000 8192 0 0 ----- [ anon ]
---------------- ------ ------ ------
total kB 105016 10684 7532
[root@homer ~]# free -k
total used free shared buffers cached
Mem: 524288 515072 9216 0 3288 31212
-/+ buffers/cache: 480572 43716
Swap: 1081336 499572 581764
[root@homer ~]#So MySQL seems to use only 105 kB of 524 kB (about 20% of the total available amount of memory)
-
So MySQL seems to use only 105 kB of 524 kB (about 20% of the total available amount of memory)
kB? :-)
-
kB? :-)
Oops, you are right... that should have read 105000 Kb or 105 Mb, etc. I was so concerned about getting the order of magnitudes correct in the commands I forgot them in the post. :blush:
-
That is not true IMHO, why would SME Server otherwise provide the hugemen kernel (http://"http://mirror.contribs.org/releases/7/smeos/i386/repoview/kernel-hugemem.html") for instance?
Man ... at least sometimes YOU should READ before you reply - READ AGAIN ! :-(((
Again... he doesn't even state which database he's using...
And what did I say? "so unless your database does ..."
You cactus killed off the german section ... please continue shooting of the hip ...
Bye Bye SME
-
Man ... at least sometimes YOU should READ before you reply - READ AGAIN ! :-(((
Again... he doesn't even state which database he's using...
And what did I say? "so unless your database does ..."
You cactus killed off the german section ... please continue shooting of the hip ...
Bye Bye SME
Reinhold, although cactus' answer may not be accurate (http://www.centos.org/product.html#four), I think your tone is inappropriate; please respect other forum members and their opinion
furthermore, cactus was expressing his own opinion (re-read, he wrote IMHO)
-
Man ... at least sometimes YOU should READ before you reply - READ AGAIN ! :-(((
I did and if you would as well you would have seen that I replied to your remarks and to the topic of this thread (RAM usage of SME Server).
Again... he doesn't even state which database he's using...
Once again, my reply was to your reply, so that seems irrelevant to me.
Excuse me for wandering off topic now:
You cactus killed off the german section ... please continue shooting of the hip ...
I think you should state the facts instead of trying to make someone look bad. This seems to be a bit like 'the pot calling the kettle black' as you now seem to be shooting from the hip. You know, as well as I, that I tried to convince the German community to cooperate with the development team and share solutions and knowledge to a wider public in the proper channels and have them solve problems in the proper way instead of, for instance modifying core files which might problems on updates/upgrades.
If the German section is lacking the will to report issues in the bug tracker as the common policy is, they can not expect the developers to improve and fix their problem. Since, in general, the German section has proven to be unwilling to do so they are to blame, not me.
-
Reinhold,
You have received a warning for insulting other users and/or staff members. Please cease these activities and abide by the forum rules otherwise we will take further action.
Regards,
The Contribs.org Team.
Since I do not find a way to delete my account personally
I would kindly ask the person that sent this warning to do so himself on my authority.
As I said before "Bye Bye" ... and let me add a thank you for the team (exceptions apply)
-
Since I do not find a way to delete my account personally
I would kindly ask the person that sent this warning to do so himself on my authority.
It was me..
and no, I have no possibility to cancel your membership
as the "delete account" is a (actually disabled) feature of smf, I will open a bug for it in bugzilla
I think that every user should be able to do it.
As I said before "Bye Bye" ... and let me add a thank you for the team (exceptions apply)
sincrerely, I don't understand your point of view.. if something happened in the german forum, if what cactus said is true (and I have no way to verify, as I'm not able to read/write in german), I think you are wrong.
everyboy here should work to improve SME and to help; going away will not help you and us.
about cactus' sentence:
I tried to convince the German community to cooperate with the development team and share solutions and knowledge to a wider public in the proper channels and have them solve problems in the proper way instead of, for instance modifying core files which might problems on updates/upgrades.
If the German section is lacking the will to report issues in the bug tracker as the common policy is, they can not expect the developers to improve and fix their problem.
I can only say that I agree 110%.. I'm working with italian users and everytime a new issue raise, I ask users to go to bugzilla.. the only way to make SME live and better is to cooperate
feel free to contact me off-line, if you want
Stefano (hope my english is good enough)