DS8000 Service Documentation Version 7.5

MAP7060 Replacing the Ethernet switch

MAP7060 Section-1

About this task

Notes:
  • The replacement of the Ethernet switch is a manual process. There is no HMC GUI code driven process to manage the resource and help guide you through the repair.
  • There are two private networks, one is known as "Gray" and the other as "Black." One of the two networks must always be functional to all connected nodes.
  • The private networks are automatically checked every few minutes by a microcode driven "heartbeat" communication process that checks HMC-to-LPAR as well as HMC-to-HMC communications. A serviceable event is opened if a problem is found.
  • There is an HMC GUI network topology tool that will display the nodes and their "health" status. Running it will not cause a serviceable event to be created.

Procedure

  1. Were you directed to this MAP from a serviceable event FRU list that had MAP7060 as the first FRU?
    • - Yes, use the serviceable event FRU location information to determine which Ethernet switch will be replaced. See Figure 1. Then go to step 6.
    • - No, go to step 2.
    Figure 1. "SW1 (left) black" and "SW2 (right) gray"
    8-port Ethernet switch port designations (SW1, SW2-Tx)
  2. Display open serviceable events. Look for those that could be related to private network problems.
  3. Observe the SRC definition and also look for the following FRUs:
    • For Models 941, 951:
      • CEC enclosure I/O planar assembly
      • CEC enclosure VPD pass-through card
      • CEC enclosure service processor card
    • For Model 961:
      • CEC enclosure system backplane
      • CEC enclosure Ethernet four-port 1 Gb copper card
  4. Are there any open serviceable events related to the private networks?
    • Yes, exit this MAP and repair the related serviceable event.
    • No, go to the next step.
  5. Run the private network topology utility to view the state of the network. Refer to MAP7001 Using the network topology tool.

    Did you find any network problems?

  6. Select the following option that applies:

MAP7060 Section-2 (16-port switch Model 941)

Procedure

  1. At the rear of the rack:
    1. Disconnect the rack power cord Callout label 2 from the Ethernet switch assembly. See Figure 2.
    2. Disconnect the Ethernet cables Callout label 1.
      Figure 2. Ethernet switch with cables
      Ethernet switch with cables
  2. Unscrew the two captive thumbscrews Callout label 1, as shown in Figure 3, and remove the Ethernet switch from the rack.
    Figure 3. Ethernet switch (removed)
    Ethernet Switch (removed)
  3. Unplug the power cable Callout label 3 from the Ethernet switch.
  4. Remove the four screws Callout label 2 that attach the left and right sheet metal brackets.
  5. Install the left and right sheet metal brackets with two screws Callout label 2 each.
  6. Connect the power cable Callout label 3 to the Ethernet switch.
  7. At the rear of the rack install the Ethernet switch assembly in the rack and secure it with the two captive thumbscrews Callout label 1, as shown in Figure 3.
  8. Connect the rack power cord.
  9. Connect the Ethernet cables.
  10. Go to MAP7060 Section-5 (Checking the switch).

MAP7060 Section-3 (8-port switch Model 941)

Procedure

  1. At the rear of the rack:
    1. Disconnect the rack power cord Callout label 2 from the Ethernet switch assembly. See Figure 4.
    2. Disconnect the Ethernet cables Callout label 1.
    3. Remove screw Callout label 3.
      Figure 4. 8-port Ethernet switches
      8-port Ethernet switch with cables
  2. Remove the Ethernet switch assembly.
    • The Ethernet switch FRU is the assembly that includes the switch, the sheet metal enclosure it is mounted on, and the power adapter inside the enclosure.
    • The switch enclosure slides to the rear of the rack to enable you to see the port LED indicators on the top surface of the switch.
    • There is one tab Callout label 1 at each rear corner of the enclosure that engages the slots Callout label 2 in the sheet metal tray that supports both switch enclosures. See Figure 5.
    • If you do not lift the rear of the switch enclosure, the tabs stay engaged, and the enclosure slides forward to the service position and then stops.
    • Instead, if you slide it to the rear a little and then lift the rear of the enclosure, the tabs will disengage from the slot, and you can fully remove the enclosure.
    Figure 5. Rear enclosure tab and sheet metal tray slot
    Rear enclosure tab and sheetmetal tray slot
  3. Set the new Ethernet switch assembly on the sheet metal tray. Slide it in far enough so that the enclosure rear tabs drop down through the sheet metal tray slot cutout. Then, slide the tray fully in.
  4. Install the retaining screw in the front of the enclosure.
  5. Connect the rack power cable.
  6. Connect the Ethernet cables.
  7. Reinstall the air baffle.
  8. Go to MAP7060 Section-5 (Checking the switch).

MAP7060 Section-4 (8-port Model 951)

Procedure

  1. At the rear of the rack, remove the air baffle Callout label 2 above the Ethernet switch tray, as shown in Figure 6.
    1. Remove the two mounting screws Callout label 1.
    2. Pivot the two mounting tabs Callout label 1 inward so they do not interfere with the cables upon removal.
    3. Carefully remove the air baffle plate to not damage any cables.
    Figure 6. Ethernet switch tray air baffle (Model 951)
    Ethernet switch tray air control baffle
  2. At the rear of the rack (see Figure 6):
    1. Disconnect the rack power cord Callout label 6 from the Ethernet switch assembly.
    2. Disconnect the Ethernet cables Callout label 4.
    3. Remove screw Callout label 5.
  3. Remove the Ethernet switch assembly.
  4. Install the new Ethernet switch assembly.
  5. Install the front retaining screw.
  6. Connect the power cable.
  7. Connect the Ethernet cables.
  8. Reinstall the air baffle.
  9. Go to MAP7060 Section-5 (Checking the switch).

MAP7060 Section-5 (Checking the switch)

Procedure

  1. Ensure that at least one Ethernet switch LED indicator is lit, indicating it is powered on.
  2. Display open serviceable events.

    The replacement of the switch may have caused at least one serviceable event to be opened for the loss of the private network connectivity.

  3. Display the serviceable event details and ensure that it is related to the private network you just affected with the switch replacement and then close it.
  4. Run the network topology tool to check the status of the private network nodes. See MAP7001 Section-4 (Analyzing the results and repairing the network).
  5. Exit this procedure.

MAP7060 Section-6 (8-port Model 961)

Procedure

  1. At the rear of the rack, remove the Ethernet switch (see Figure 7):
    1. Disconnect the rack power cable Callout label 2 and Ethernet cables Callout label 1 from the Ethernet switch.
    2. Do not remove the Ethernet tray sheet metal air baffle Callout label 3.
    3. The Ethernet switch is held to the sheet metal tray by four hook-and-loop fasteners. See Figure 8.
    4. Beginning at one corner, lift the Ethernet switch off the tray.
    Figure 7. Ethernet switches SW1 and SW2 (Model 961), rack version 1 shown, rack version 2 similar
    Ethernet switches SW1 and SW2 (Model 961)
    Figure 8. Four hook-and-loop fasteners for each Ethernet switch
    Four hook-and-loop fasteners for each Ethernet switch
  2. There are three possible Ethernet switch FRUs, depending on which FRU P/N is ordered.
    • Version 1 Ethernet switch fastened to a sheet metal bracket. Go to step 3.
    • Version 2 Ethernet switch with power cable(s). Go to step 4.
    • Version 2 Ethernet switch with no power cable(s). Go to step 4.
  3. For Version 1, do the following:
    1. Remove the two black plastic latches that fasten the new Ethernet switch to the sheet metal bracket. See Figure 9.
    2. Discard the latches and sheet metal bracket.
    3. Locate the four hook-and-loop fasteners in the FRU kit and place one squarely on each Ethernet tray hook-and-loop fastener.
    4. Peel the backing off each hook-and-loop fastener to expose the adhesive surface.
    5. Align the Ethernet switch with the partner Ethernet switch and push down firmly. Gently lift up to ensure it is properly fastened.
    6. Properly connect the power and Ethernet cables; refer to the cable location labels.
    7. Go to MAP7060 Section-5 (Checking the switch).
    Figure 9. Release Ethernet switch from the sheet metal bracket
    Release Ethernet switch from the sheet metal bracket
  4. For Version 2, do the following:
    1. Set the new Ethernet switch on top of the tray so it aligns evenly with the partner Ethernet switch. See Figure 7. Push down firmly and then gently lift up to ensure it is fastened to the Ethernet switch tray.
    2. Connect the Ethernet cables.
    3. Connect the power cable.

      If the existing power cable does not properly plug into the new Version 2 Ethernet switch, use the power-cable installation instructions in the FRU kit to install the proper cable.

    4. Go to MAP7060 Section-5 (Checking the switch).