Skip to content

[RFE]: Need more detailed log when creating QPs #42

Open

Description

@gangxie112

Please provide the below details to ensure we understand your needs

Hello,

Recently, we hit some issue of modifying the QP to RTR. But from the log, we couldn't find any useful info to dig further. So, do consider to log the parameters when QP opertaions?

error log:
main_nvshmem/src/modules/transport/ibrc/ibrc.cpp:420: non-zero status: 22 ibv_modify_qp failed.

The variables in the attr should be logged:
` attr.qp_state = IBV_QPS_RTR;
attr.path_mtu = port_attr->active_mtu;
attr.dest_qp_num = ep_handle->qpn;
attr.rq_psn = 0;
if (port_attr->lid == 0) {
ib_get_gid_index(&ftable, device->context, portid, port_attr->gid_tbl_len,
&device->gid_info[portid - 1].local_gid_index, ibrc_state->log_level,
ibrc_state->options);
ftable.query_gid(device->context, portid, device->gid_info[portid - 1].local_gid_index,
&device->gid_info[portid - 1].local_gid);
attr.ah_attr.is_global = 1;
attr.ah_attr.grh.dgid.global.subnet_prefix = ep_handle->spn;
attr.ah_attr.grh.dgid.global.interface_id = ep_handle->iid;
attr.ah_attr.grh.flow_label = 0;
attr.ah_attr.grh.sgid_index = device->gid_info[portid - 1].local_gid_index;
attr.ah_attr.grh.hop_limit = 255;
attr.ah_attr.grh.traffic_class = ibrc_state->options->IB_TRAFFIC_CLASS;
} else {
attr.ah_attr.dlid = ep_handle->lid;
attr.ah_attr.is_global = 0;
}
attr.max_dest_rd_atomic = NVSHMEMT_IBRC_MAX_RD_ATOMIC;
attr.min_rnr_timer = 12;
attr.ah_attr.sl = ibrc_state->options->IB_SL;
attr.ah_attr.src_path_bits = 0;
attr.ah_attr.port_num = portid;
flags = IBV_QP_STATE | IBV_QP_AV | IBV_QP_PATH_MTU | IBV_QP_DEST_QPN | IBV_QP_RQ_PSN |
IBV_QP_MIN_RNR_TIMER | IBV_QP_MAX_DEST_RD_ATOMIC;

status = ftable.modify_qp(ep->qp, &attr, flags);
NVSHMEMI_NZ_ERROR_JMP(status, NVSHMEMX_ERROR_INTERNAL, out, "ibv_modify_qp failed \n");

`

Activity

  1. abrooks98 commented on Jun 11, 2026

    @abrooks98
    Collaborator

    Improved in 3.7.0. Please let us know if there is any additional logging we missed that you would like to see.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions