Re: [RFI] ucmatose: No effect to set service type for QoS
From: Jinpu Wang <hidden>
Date: 2016-08-11 12:29:13
On Wed, Aug 10, 2016 at 8:52 PM, Hal Rosenstock [off-list ref] wrote:
On 8/9/2016 12:26 PM, Jinpu Wang wrote:quoted
Hi Sean, I'm testing QoS support for IB. I notice ucmatose has equally performance when set different service type, but set SL in ib_send_bw works well (different SL show different performance base on opensm settings) I capature packats using ibdump, it shows in in LRH the service level fields are all 0 when running traffic with ucmatose. When running ib_send_bw, it carries the right service level I set. Seems in rdma_set_service_type, it sets to tos to id_priv->tos, and lter set to path_rec->qos_class or traffic_class but not to sl directly, what's the consideration here? code snip: switch (cma_family(id_priv)) { case AF_INET: path_rec->qos_class = cpu_to_be16((u16) id_priv->tos); comp_mask |= IB_SA_PATH_REC_QOS_CLASS; break; case AF_INET6: sin6 = (struct sockaddr_in6 *) cma_src_addr(id_priv); path_rec->traffic_class = (u8) (be32_to_cpu(sin6->sin6_flowinfo) >> 20); comp_mask |= IB_SA_PATH_REC_TRAFFIC_CLASS; break; case AF_IB: sib = (struct sockaddr_ib *) cma_src_addr(id_priv); path_rec->traffic_class = (u8) (be32_to_cpu(sib->sib_flowinfo) >> 20); Does it make sense we also set sl here, or service type for ucmatose is totally different with SL for ib_send_bw?I think this is an OpenSM configuration issue. QoS policy needs to be setup to return the proper SL to use for QoS class or TClass in the PathRecord response. -- Hal
Thanks Hal, Configure extra QoS policy seems quite complex. Do you think patch attached make sense? -- Mit freundlichen Grüßen, Best Regards, Jack Wang Linux Kernel Developer Storage ProfitBricks GmbH The IaaS-Company. ProfitBricks GmbH Greifswalder Str. 207 D - 10405 Berlin Tel: +49 30 5770083-42 Fax: +49 30 5770085-98 Email: jinpu.wang-EIkl63zCoXaH+58JC4qpiA@public.gmane.org URL: http://www.profitbricks.de Sitz der Gesellschaft: Berlin. Registergericht: Amtsgericht Charlottenburg, HRB 125506 B. Geschäftsführer: Andreas Gauger, Achim Weiss.
Attachments
- 0001-cma-export-function-to-set-service-level.patch [text/x-patch] 2912 bytes · preview