0 Replies Latest reply on Mar 15, 2018 6:59 AM by joaomsoares

    Innova IPsec - problems setting up SR-IOV

    joaomsoares

      Hi,

      I have a Innova IPsec and I am trying to set up some SR-IOV interfaces to test the docker-passthrough-plugin (https://github.com/Mellanox/docker-passthrough-plugin).

      The setup of the card seems (apparently) correct. I have reached out to the docker-passthrough-plugin developers and its seems the problem is more fundamental (i.e. not on the plugin). After some debugging (https://github.com/Mellanox/docker-passthrough-plugin/issues/4), it dmesg throughs up a couple of problems when I am trying to ask docker for an SR-IOV network - please see below.

      Any hints on what is the problem and how can I overcome this?

      Thanks!

       

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.310139] (0000:04:00.0): E-Switch: E-Switch enable SRIOV: nvfs(4) mode (1)

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.458403] (0000:04:00.0): E-Switch: SRIOV enabled: active vports(5)

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.562856] pci 0000:04:00.1: [15b3:1016] type 00 class 0x020000

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.563383] pci 0000:04:00.1: Max Payload Size set to 256 (was 128, max 512)

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.563963] iommu: Adding device 0000:04:00.1 to group 48

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564165] mlx5_core 0000:04:00.1: enabling device (0000 -> 0002)

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564634] mlx5_core 0000:04:00.1: firmware version: 14.98.3410

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564674] mlx5_core 0000:04:00.1: mlx5_pcie_print_link_status:411:(pid 143482): PCIe width is lower than device's capability

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564678] mlx5_core 0000:04:00.1: PCIe link speed is 8.0GT/s, device supports 8.0GT/s

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564681] mlx5_core 0000:04:00.1: PCIe link width is x0, device supports x8

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73144.564751] DMAR: 64bit 0000:04:00.1 uses identity mapping

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73145.237041] mlx5_core 0000:04:00.1: mlx5_cmd_check:731:(pid 143482): ACCESS_REG(0x805) op_mod(0x1) failed, status bad parameter(0x3), syndrome (0x5a98c0)

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73145.237048] mlx5_core 0000:04:00.1: FPGA: mlx5_fpga_device_load_check:152:(pid 143482): Failed to query status: -22

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73145.237051] mlx5_core 0000:04:00.1: fpga device start failed -22

      Mar 15 14:21:58 ct-analytcis-2 kernel: [73145.259140] mlx5_core 0000:04:00.1: tools char device 243:2 destroyed

      Mar 15 14:21:59 ct-analytcis-2 kernel: [73145.637372] mlx5_core 0000:04:00.1: mlx5_load_one failed with error code -22

      Mar 15 14:21:59 ct-analytcis-2 kernel: [73145.637538] mlx5_core: probe of 0000:04:00.1 failed with error -22