HPC
HPC

| HPC and Data for Lattice QCD

network

HPC and Data for Lattice QCD

network

APEmille network

[noe/010827]
                     Ifh network (141.34.40.*/24)
                               +----------------------------+
                               |                            |           
                    +----------|----------+                 |  
                    |     apemaster*      |                 |  
                    |                     |                 |  
                    |     APEMASTER*      |                 |  
                    |                     |                 |  
                    | master      umaster |                 |  
                    +---|------------|----+                 |  
                        |            |                      |   to router and rest              
                  Boot Network     Unit Network             |   of IfH network       
                192.168.38.*/24    192.168.40.*/23 (!)      |        ^
                        |            |                      |        |    
                        +------+-----+                      |        |        
                               |                            |        |        
                   +-----------|----------------------------|--------|-+
	           |                  switch                           |
                   +-----------|-------------------------|-------------+
                               |                         |
                        +------+-----+             +-----+------+
           Boot network |            |             |            | Unit network
                    +---|------------|----+    +---|------------|----+
                    | host02      unit01  |    | host01      unit03  |
                    |                     |    |                     |  ... etc.
                    |      HOST02         |    |      HOST01         | 
                    |                     |    |                     |
                    +---------------------+    +---------------------+

Notes:

     o  The names at the ports indicate the network name associated with the IP address
        of that port. The name given in capital letters is the hostname.
     o  The Boot- and Unit-networks actually share the same physical cable. The 
        Unit network is implemented as interface aliases with a different IP 
        address (and network mask). The switch can handle such cases gracefully.
        This means that the interface eth0 of each unit is listed twice in 
        'ifconfig', once as 'eth0' (Boot network) and once as 'eth0:1' 
        (Unit network). (On apemaster this is eth1 and eth1:1)
     o  The configuration of the Boot network interfaces is done at boot
        time. The Ziatechs actually need this network for booting.
        The Unit network is configured at a later stage of booting, since here
        the information about the host<->unit assignments is needed and is
        taken from /zroot/HostConfig (which is only available after the 
        automounter has started).
        Startup scripts: /etc/rc.d/init.d/APEunitname, /etc/rc.d/APEunitserver
     o  The 23-bit netmask of the unit-network is just a trick to allow
        the unit-number (including 00) to appear as the last part of the 
        IP number.
     o  The network names of the Boot- and Unit-networks are not registered
        in the name server. Instead they are listed in the /etc/hosts files
        of all participating machines.
        The name resolution process of linux must be configured to check 
        files only (units) or dns,nis AND files (apemaster).
     o  The switch ports are configured to be in either the intranet (Boot- and
        Unit-networks) or the Ifh network.
        As of 2001/08/20 , only the ports 33,35,37 and 39 are configured for 
        the IfH network.