Chelsio Communications Chelsio T4 Guía de usuario descargar pdf (Pagina 68)

Chapter IV. iWARP (RDMA)

v. Start the License Manager and run the test as:

mpirun -prot -e DAPL_MAX_INLINE=64 -UDAPL -hostlist <name of hosts

separated by comma> -np 4 /opt/platform_mpi/tests/IMB-3.2/IMB-MPI1

4.2.3.3. Open MPI (Installation and Setup)

The latest release of Open-MPI-1.4.3 comes with OFED package only. Select Open MPI

package while installing OFED package.

Open MPI iWARP support is only available in Open MPI version 1.3 or greater.

Open MPI will work without any specific configuration via the openib btl. Users wishing to

performance tune the configurable options may wish to inspect the receive queue values. Those

can be found in the "Chelsio T4" section of mca-btl-openib-device-params.ini.

To run Open MPI applications:

mpirun --host node1,node2 -mca btl openib,sm,self /usr/mpi/gcc/openmpi-

1.4.3/tests/IMB-3.2/IMB-MPI1

For OpenMPI/RDMA clusters with node counts greater than or equal to 8 nodes, and process

counts greater than or equal to 64, you may experience the following RDMA address resolution

error when running MPI jobs with the default OpenMPI settings:

The RDMA CM returned an event error while attempting to make a connection.

This type of error usually indicates a network configuration error.

Local host: core96n3.asicdesigners.com

Local device: Unknown

Error name: RDMA_CM_EVENT_ADDR_ERROR

Peer: core96n8

Workaround: Increase the OpenMPI rdma route resolution timeout. The default is 1000, or

1000ms. Increase it to 30000 with this parameter:

--mca btl_openib_connect_rdmacm_resolve_timeout 30000

4.2.3.4. MVAPICH2-1.7 setup

The latest release of MVAPICH2-1.7 comes with OFED package only. Select MVAPICH2

package while installing OFED package.

Note

1 2 ... 63 64 65 66 67 68 69 70 71 72 73 ... 373 374

Sin comentarios

Chelsio Communications Chelsio T4 Guía de usuario Pagina 68