gunthorp@cgy1-donard:~$ ib_write_bw -R

************************************
* Waiting for client to connect... *
************************************
 Couldn't create rdma QP - Invalid argument
Unable to create QP.
Failed to create QP.
 Unable to create the resources needed by comm struct
 Unable to perform rdma_server function
 Unable to init the socket connection
gunthorp@cgy1-donard:~$ ib_write_bw -R flash-cxgb
 Couldn't create rdma QP - Invalid argument
Unable to create QP.
Failed to create QP.
 Unable to create the resources needed by comm struct
 Unable to perform rdma_client function
 Unable to init the socket connection
gunthorp@cgy1-donard:~$ rping -s
rdma_create_qp: Invalid argument
setup_qp failed: -1
gunthorp@cgy1-donard:~$ rping -c -a flash-cxgb -v -C5
rdma_create_qp: Invalid argument
setup_qp failed: -1
gunthorp@cgy1-donard:~$ ucmatose 
cmatose: starting server
cmatose: unable to create QP: Invalid argument
cmatose: failing connection request
test complete
return status -1
gunthorp@cgy1-donard:~$ ucmatose -s flash-cxgb
cmatose: starting client
cmatose: connecting
cmatose: unable to create QP: Invalid argument
test complete
return status -1
gunthorp@cgy1-donard:~$ ibv_rc_pingpong 
  local address:  LID 0x0000, QPN 0x000430, PSN 0xef9f8e, GID ::
Failed to modify QP to RTR
Couldn't connect to remote QP
gunthorp@cgy1-donard:~$ ibv_rc_pingpong flash-cxgb
  local address:  LID 0x0000, QPN 0x000438, PSN 0x9e00c8, GID ::
client read: Success
Couldn't read remote address