XFdtd's calculation engine, XFsolver, supports Open MPI for the 64-bit Red Hat Enterprise Linux 6 (RHEL6) and later versions, as well as operating systems that are comparable with one of these platforms.
Users can install and run XF when the MPI cluster configuration meets all of the following requirements:
- A shared file system is available to all nodes (e.g., /opt/).
- The XF simulation directory is located in the shared network directory and each node has write permissions.
- The openmpi installation directory is installed in the same location on each node. Alternatively, it can be placed in a single shared directory, e.g., /opt/openmpi/
Similar to the MPI distribution, XF needs to be installed in the same location on each node or in a shared directory:
- Log on to the node(s) and follow the installation instructions for the operating system.
LicenseThe distributed machines in a compute cluster need to have access to a floating license server:
- Follow the instructions to set up a floating license configuration.
- Define the environment variable REMCOMINC_LICENSE_FILE on each node, e.g., REMCOMINC_LICENSE_FILE=1711@node0
Once XF is installed and licensed, XFsolver can be run in a simulation directory, e.g. *.xf/Simulations/00001, using a command similar to the examples below:
[remcom@head 000001]$ /opt/hpmpi/bin/mpirun -np 4 -hostlist node1,node2 /opt/remcom/bin/xfsolver -hpmpi -v
[remcom@head 000001]$ /opt/openmpi/bin/mpirun -np 4 --host node1,node2 /opt/remcom/bin/xfsolver -openmpi -v
Specify the -hpmpi or -openmpi command line option appropriate for the cluster in order to choose the correct XFsolver executable. Users should note that system administrators of clusters usually provide documentation on how to launch MPI programs on their clusters, and that the mpirun command for any particular cluster may differ from the commands above.