DS8000 Service Documentation Version 7.5

MAP43D0 CEC enclosure hard drive file system corruption detected (J2_XTREE_CORRUPT error)

The CEC hard drive file system has detected J2_XTREE_CORRUPT errors.

About this task

Note: A CEC enclosure boot drive file system corruption error was detected. It can be repaired without replacing the CEC disk drive.

MAP43D0 Section-1

Procedure

This failure will require next level of support to resolve.
- Contact your next level of support. They should contact PFE.
- Next level of support will need remote access to connect and do some command line procedures.
Quiesce the LPAR to be repaired.
1. From the navigation area, click Storage Facility Management > storage facility > SF image.
2. From the right work area, select a storage facility image.
3. From the bottom Task area, select Service Utilities > Change/Show LPAR State. The Change/Show LPAR State window opens.
4. Click Quiesce LPAR and follow the directions.
5. After the quiesce is complete, continue to the next step.

It is necessary to place the LPAR in maintenance mode to perform the subsequent steps. Perform the following procedure to place the applicable LPAR into maintenance mode:

Open a Terminal Window (Vterm) for the failing partition. To open a Terminal Window:
- From the navigation area, click Storage Facility Management > storage facility > Server View > server.
- From the right work area, select the failing LPAR.
- From the bottom Task area, click Console Window > Open Terminal Window.
- Return to the message box and click OK to continue.
- With the 2107 Operating System CD/DVD in the DVD drive, reboot the LPAR (shutdown -Fr) and wait to get into the SMS.
- When the keyboard network scsi .. message is shown, type 1 to get to SMS.

Wait for the SMS menu to appear on the Virtual Terminal as shown below. At this point it is required to set the boot device to the DVD/CD-ROM. Select option 5 and press Enter.

PowerPC Firmware
Version SF220_001
SMS 1.5 (c) Copyright IBM Corp. 2000,2003 All rights reserved.
-------------------------------------------------------------------------------
Main Menu
 1.  Select Language
 2.  Setup Remote IPL (Initial Program Load)
 3.  Change SCSI Settings
 4.  Select Console
 5.  Select Boot Options



--------------------------------------------------------------------------------
Navigation Keys:

                                            X = eXit System Management Services
--------------------------------------------------------------------------------

The following menu will now be displayed. Type 1 (Select Install or Boot a Device) and press Enter.

Version SF220_001
SMS 1.5 (c) Copyright IBM Corp. 2000,2003 All rights reserved.
-------------------------------------------------------------------------------
 1.  Select Install or Boot a Device
 2.  Select Boot Devices
 3.  Multiboot Startup <OFF>


-------------------------------------------------------------------------------
Navigation keys:
M = return to Main Menu
ESC key = return to previous screen         X = eXit System Management Services
-------------------------------------------------------------------------------

The following menu will now be displayed. Type 4 (IDE) and press Enter.

Version SF220_001
SMS 1.5 (c) Copyright IBM Corp. 2000,2003 All rights reserved.
-------------------------------------------------------------------------------
Select Device Type
 1.  Diskette
 2.  Tape
 3.  CD/DVD
 4.  IDE
 5.  Hard Drive
 6.  Network
 7.  List all Devices



--------------------------------------------------------------------------------
Navigation keys:
M = return to Main Menu
ESC key = return to previous screen         X = eXit System Management Services
--------------------------------------------------------------------------------

The following menu will now be displayed. The DVD/CD-ROM device should be shown. Type 1 and press Enter.

Version SF220_001
SMS 1.5 (c) Copyright IBM Corp. 2000,2003 All rights reserved.
-------------------------------------------------------------------------------
Select Device
Device  Current  Device
Number  Position  Name
 1.        1      IDE CD-ROM 
                  ( loc=U789D.001 .10002CA-P3-D2 )




-------------------------------------------------------------------------------
Navigation keys:
M = return to Main Menu
ESC key = return to previous screen         X = eXit System Management Services
-------------------------------------------------------------------------------

The following menu will now be displayed. Type 2 and press Enter.

Version SF220_001 SMS 1.5 (c) Copyright IBM Corp. 2000,2003 All rights reserved.
-------------------------------------------------------------------------------
Select Task

IDE CD-ROM 
    ( loc=U789D.001 .10002CA-P3-D2 )

 1.  Information
 2.  Normal Mode Boot
 3.  Service Mode Boot



-------------------------------------------------------------------------------
Navigation keys:
M = return to Main Menu
ESC key = return to previous screen         X = eXit System Management Services
-------------------------------------------------------------------------------

A confirmation screen will appear asking you to verify that you want to exit the SMS. Type 1 and press Enter.

Version SF220_001
SMS 1.5 (c) Copyright IBM Corp. 2000,2003 All rights reserved.
-------------------------------------------------------------------------------
Are you sure you want to exit System Management Services?
 1.  Yes
 2.  No



-------------------------------------------------------------------------------
Navigation Keys:

                                            X = eXit System Management Services
-------------------------------------------------------------------------------

The system will now boot from the CD. The "Welcome To AIX" screen is displayed. Other messages will scroll for several minutes. Go to the next step.

IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM                                 IBM IBM IBM IBM IBM IBM
IBM IBM IBM IBM IBM IBM       STARTING SOFTWARE         IBM IBM IBM IBM IBM IBM
IBM IBM IBM IBM IBM IBM          PLEASE WAIT...         IBM IBM IBM IBM IBM IBM
IBM IBM IBM IBM IBM IBM                                 IBM IBM IBM IBM IBM IBM
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 
IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM 

-------------------------------------------------------------------------------
                                Welcome to AIX.
                       boot image timestamp: 14:52 04/19

The following menu will now be displayed. Type 1 and press Enter.

Note: The '1' is not displayed when typed.

******* Please define the System Console. *******
Type a 1 and press Enter to use this terminal as the
 system console.
Pour definir ce terminal comme console systeme, appuyez
 sur 1 puis sur Entree.
Taste 1 und anschliessend die Eingabetaste druecken, um
 diese Datenstation als Systemkonsole zu verwenden.
Premere il tasto 1 ed Invio per usare questo terminal
 come console.
Escriba 1 y pulse Intro para utilizar esta terminal como
 consola del sistema.
Escriviu 1 1 i premeu Intro per utilitzar aquest
 terminal com a consola del sistema.
Digite um 1 e pressione Enter para utilizar este
 terminal como console do sistema.

The following menu will now be displayed. Type 1 and press Enter.

  HARDWARE SYSTEM MICROCODE
 Licensed Internal Code - Property of IBM 
 (C) Copyright IBM Corp. 1990, 1994.
 All rights reserved.

 US Government Users Restricted Rights -
 Use, duplication or disclosure restricted
 by GSA ADP Schedule Contract with IBM Corp.



>>>  1 Type 1 and press Enter to have English during install.
     2 Entreu 2 i premeu Intro per veure la installacion en catalan.
     3 Entrez 3 pour effectuer l'installation en français.
     4 Fur Installation in deutscher Sprache 4 eingeben
       und die Eingabetaste druecken.
     5 Immettere 5 e premere Invio per l'installazione in Italiano.
     6 Digite 6 e pressione Enter para usar Portugues na instalacio.
     7 Escriba 7 y pulse Intro para la instalacion en español.


    88  Help ?


>>> Choice [1]: 1

The following menu will now be displayed. Type 3 and press Enter.

Welcome to Base Operating System
            Installation and Maintenance

Type the number of your choice and press Choice is indicated by >>>.
        1 Start Install Now with Default Settings

        2 Change/Show Installation Settings and Install

    >>> 3 Start Maintenance Mode for System Recovery


      88 Help ?
      99 Previous Menu
>>> Choice (1): 3

The next screen will be called Maintenance. Type option 1 (Access a Root Volume Group). At the next screen, type 0 to continue, and select the appropriate volume group by typing the number next to it. A screen like the following will display:

             Access a Root Volume Group

        Type the number for a volume group to display the logical volume information and press Enter.

        1) Volume Group 0073656f2608e46a contains these disks:
          hdisk0 2063 04-C0-00-4,0.

After a volume group has been selected, information will be displayed about that volume group. For example:

              Volume Group Information
- - - - - - - - - - - - - – - - - - - - - - - - - - - - - - - -
Volume Group ID 0073656f2608e46a includes the following logical volumes:
  hd6     hd5     hd8     hd4      hd2    hd9var
  hd3     hd1
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Type the number of your choice and press Enter.

  1) Access this Volume Group and start a shell
  2) Access this Volume Group and start a shell before mounting filesystems
  99) Previous Menu

Note: If the logical volumes do not include logical volumes like hd4, hd2, hd3, and so on, you may have selected the wrong volume group. Press 99 to back up one screen and select again.

Type option 2 (Access this volume group and start a shell before mounting filesystems). Option 2 allows you to perform file system maintenance on /, /usr, /tmp, and /var before mounting them.
Note: You may need to set terminal type in preparation for editing the file. In the following example, xxx stands for a terminal type such as lft, ibm3151, or vt100.
```
TERM=<xxx>
export TERM
```
Errors from these steps may indicate failed or corrupt disks in rootvg. These problems should be corrected. For additional assistance, contact your vendor, your local branch office, or your AIX support center.

At shell command line from previous steps, run fsck -y. Look for any errors displayed in the output after the command completes. If any errors are displayed, retry running fsck -y one additional time. If errors persist, go to step 9.
Reboot the LPAR by running shutdown -Fr from the command line.
After the LPAR has rebooted, log back on the same LPAR and run /usr/lpp/searas/bin/rsMirrorVgChk. Look for GOOD state in the output, for example, GOOD hdisk0 mirroredvgstate. If state is something other than GOOD, go to step 9.
Run errpt and check for new J2_XTREE_CORRUPT errors in the AIX error log that have been logged since the last reboot. When you run rsMirrorVgChk in the previous step, new errors will be logged if there is still a problem with the drive.
Did new J2_XTREE_CORRUPT errors log during the LPAR IML?
- Yes, the LPAR hard drives need to be rebuilt. Go to step 9.
- No, the problem has been fixed successfully by the fsck command that you previously ran. Continue to next step.
Resume the LPAR.
1. From the navigation area, click Storage Facility Management > storage facility > SF image.
2. From the right work area, select a storage facility image.
3. From the bottom Task area, select Service Utilities > Change/Show LPAR State. The Change/Show LPAR State window opens.
4. Click Resume LPAR and follow the directions.
5. After the resume is complete, exit this MAP.
It will be necessary to run the hard drive rebuild process on the LPAR hard drives to correct this failure. Exit this MAP and go to MAP4020 Hard disk drive build process for both boot drives in a storage facility image LPAR.