Changes between Version 8 and Version 9 of MultiHost


Ignore:
Timestamp:
Jul 12, 2007, 4:35:24 PM (17 years ago)
Author:
Nicolas
Comment:

Added SIMAP as another project using multiple hosts. Plus the usual stuff (typos, formatting, links...)

Legend:

Unmodified
Added
Removed
Modified

  • MultiHost

    v8 v9  
    77 * slow web site access
    88 * daemons fall behind
    9  * database queries take minutes or hours to complete.
     9 * database queries take minutes or hours to complete
    1010
    1111If you experience these problems, try the following (in order).
    … …  
    1616This eliminates the overhead of creating processes and connecting to the database.
    1717To use Fast CGI, build an Apache server with mod_fastcgi,
    18 compile the Fast CGI version of the scheduler (fcgi) and file upload handler
    19 (fcgi_file_upload_handler), modify your httpd.conf, and restart Apache.
     18compile the Fast CGI version of the scheduler (`fcgi`) and file upload handler
     19(`fcgi_file_upload_handler`), modify your `httpd.conf`, and restart Apache.
    2020
    2121== Upgrade your hardware ==
    22 Use a host with good CPU capacity (dual Xeon or Opteron), at least 2 GB of RAM, and at least 40 GB of free disk space. Do whatever you can to make it highly reliable (UPS power supply, RAID disk configuration, hot-swappable spares, tempurature-controlled machine room, etc.). For a high-traffic project, use a machine whose RAM capacity is 8 GB or more and that uses 64-bit processors.
     22Use a host with good CPU capacity (dual Xeon or Opteron), at least 2 GB of RAM, and at least 40 GB of free disk space. Do whatever you can to make it highly reliable (UPS power supply, RAID disk configuration, hot-swappable spares, temperature-controlled machine room, etc.). For a high-traffic project, use a machine with 8 GB of RAM or more, and 64-bit processors.
    2323
    2424== Run MySQL on a separate host ==
    … …  
    3232
    3333 * The [GroupPermissions project admin account] must exist on all hosts, and a user must be able to use 'ssh' to run commands on any other host without typing a password.
    34  * The hosts must share a common network file system, and path to the project directory relative to the project admin's home directory (typically ~/projects/PROJECT_NAME) must be the same on all hosts.
     34 * The hosts must share a common network file system, and path to the project directory relative to the project admin's home directory (typically `~/projects/PROJECT_NAME`) must be the same on all hosts.
    3535 * One host is designated as the project's '''main host''' in config.xml. '''The 'start', 'stop', and 'status' scripts should normally be run on the main host''' (if you run them on a different host X, they'll affect only daemons and tasks on host X).
    3636 * The project admin account on all hosts must be able to access the project's MySQL database. (Exception: data servers and file upload handlers don't need DB access).
    3737
    3838Host locations are specified as follows:
    39  * Scheduling servers are listed in the project's [ServerComponents master page].
     39 * Scheduling servers are listed in the project's [ServerComponents#ThemasterURL master page].
    4040 * The hosts on which tasks and daemons are run are specified in the [ProjectConfigFile config.xml] file.
    4141 * Data servers are listed in [WorkGeneration template files].
    … …  
    6262You can run scheduling servers on multiple hosts by running an instance of the feeder on each host, and including the URLs in your master file.
    6363
    64 An example of a dual-host server (Leiden Classical) is [http://boinc.gorlaeus.net/ServerHardware.php here].
     64Example of projects using multiple hosts are [http://boinc.gorlaeus.net/ServerHardware.php Leiden Classical] and [http://boinc.bio.wzw.tum.de/boincsimap/server_hardware.php SIMAP].
    6565
    6666== Increasing network performance ==
    … …  
    9696
    9797
    98 The short story is that you can greatly improve your data transfer rate
    99 over long internet links by increasing the system TCP tx and rx
     98You can greatly improve your data transfer rate
     99over long Internet links by increasing the system TCP tx and rx
    100100window/buffer values. Note also the comments in
    101101http://www.onlamp.com/pub/a/onlamp/2005/11/17/tcp_tuning.html?page=1
    … …  
    107107before trying to go any larger.)
    108108
    109 Other comments are in this example /etc/sysctl.conf (for Linux 2.6.xx):
     109Other comments are in this example `/etc/sysctl.conf` (for Linux 2.6.xx):
    110110
    111111{{{
    … …  
    179179# If you see stuff like "swapper: page allocation failure. order:0,
    180180mode:0x20"
    181 # you definately need to increase min_free_kbytes for the virtual memory.
     181# you definitely need to increase min_free_kbytes for the virtual memory.
    182182#
    183183#