Previous Topic

Next Topic

Troubleshoot Startup, Shutdown, or Configuration Problems

Use the following flow chart to isolate a problem with startup, shutdown or configuration of your Ingres installation:

Previous Topic

Next Topic

Check Ingres Installation on Windows

To check if the Ingres installation is working fine, follow these steps:

  1. Check that you are logged in as the installation owner. If not, log off and log in again as this user.
  2. Check that all users have II_SYSTEM set by issuing the following command at the operating system prompt:

    echo %II_SYSTEM%

    All users must have Ingres executables in their path variables. Check that everyone has the full search path to %II_SYSTEM%\ingres\bin.

    The installation owner must also include %II_SYSTEM%\ingres\utility.

  3. Check that each of the Ingres variables has a valid value.

    Ingres environment variables are only used and "seen" by Ingres and can be displayed with the following command entered at the operating system prompt:

    ingprenv

    If you are in doubt about the function or legal value of a particular environment variable, see the chapter "Setting Environment Variables and Logicals" and the appendix "Environment Variables and Logicals."

    Ingres environment variables denoting installation locations (II_DATABASE, II_CHECKPOINT, II_DUMP, II_JOURNAL, II_LOG_FILE, II_SYSTEM) cannot be reset. To change these, you must unload the databases, rerun the installation program, and reload the databases, as described in Installation Location.

  4. Check the Ingres environment variables that have been set locally, overriding the Ingres installation-level definitions.

    Only a small category of Ingres environment variables must be defined in the local user environment: those that permit you to access Ingres, and those that define values that are different for your local environment. They include TERM_INGRES and ING_EDIT.

    If you trace the problem to an Ingres environment variable setting, correct the value. For procedures and scenarios for setting these environment variables, see the chapter "Setting Environment Variables and Logicals." If the installation does not start up, continue with this procedure.

  5. Check that all Ingres processes are shut down. If there are processes that continue to run, see the section Check Shutdown Problems on Windows.
  6. Restart Ingres. Attempt once again to start up the installation by issuing the following command at the operating system prompt:

    ingstart

    If startup problems persist, continue diagnostics in the ingstart section below.

Previous Topic

Next Topic

Detect Ingres Startup Problems on Windows

To troubleshoot startup problems on Windows, follow these steps:

  1. Determine which Ingres processes are running.
  2. Verify that all required Ingres system processes are running. The following processes are the minimum required for a complete installation:
  3. If ingstart does not complete successfully, do the following:
    1. Check the output from ingstart. This is saved in the file:

      %II_SYSTEM%\ingres\files\ingstart.log

      Error log files and individual component log files are listed in Logging and Locking Systems.

    2. Try to determine the reason for startup failure.
    3. A process failed to start. If a process failed to start, continue on to the detailed sections on startup problems for that specific process.

Previous Topic

Next Topic

Check Ingres Installation on UNIX

To check if the Ingres installation is working fine, follow these steps:

  1. Check that you are logged in as the installation owner by issuing the following command at the operating system prompt:

    whoami

    If the user ID of the installation owner is not shown, log off and log in again as this user.

  2. Check that all users have II_SYSTEM set by issuing the following command at the operating system prompt:

    echo $II_SYSTEM

    / usr/r6 (this varies by system)

    All users must have Ingres executables in their path variables. Check that everyone has the full search path to $II_SYSTEM/ingres/bin.

    The installation owner must also include $II_SYSTEM/ingres/utility.

  3. Check that each of the Ingres installation variables has a valid value.

    Ingres environment variables are only used and "seen" by Ingres and can be displayed with the following command entered at the operating system prompt:

    ingprenv

    If you are in doubt about the function or legal value of a particular environment variable, see the chapter "Setting Environment Variables and Logicals" and the appendix "Environment Variables and Logicals."

    Ingres environment variables denoting installation locations (II_DATABASE, II_CHECKPOINT, II_DUMP, II_JOURNAL, II_LOG_FILE, II_SYSTEM) cannot be reset. To change these, you must rerun the installation program, ingbuild, and on UNIX possibly unload and reload your database with unloaddb. More information is provided in Installation Locations.

  4. Check the Ingres environment variables that have been set locally, overriding the Ingres installation-level definitions. Issue the following commands at the operating system prompt:

    BSD:

    printenv | grep II

    printenv | grep ING

    System V:

    env | grep II

    env | grep ING

    Only a small category of Ingres environment variables must be defined in the local user environment: those that permit you to access Ingres, and those that define values that are different for your local environment. They include TERM_INGRES and ING_EDIT.

    If you trace the problem to an Ingres environment variable setting, correct the value. For procedures and scenarios for setting these environment variables, see "Setting Environment Variables and Logicals." If the installation does not start up, continue with this procedure.

  5. Identify your installation code. If there is more than one Ingres installation on this machine, type the following command at the operating system prompt. The installation code is used to distinguish which processes belong to which installation at sites with more than one Ingres installation on the same machine:

    ingprenv | grep II_INSTALLATION

    The two-letter installation code is displayed (for example, the following code R6):

    II_INSTALLATION=R6

    Take note of your installation code: ______.

  6. Check that all Ingres processes are shut down. If there are processes that continue to run, see Check Shutdown Problems on UNIX.
  7. Restart Ingres: Attempt once again to start up the installation by issuing the following command at the operating system prompt:

    ingstart

  8. If startup problems persist, continue the diagnostics described in Ingbuild on UNIX or Detect Ingres Startup Problems on UNIX.

Previous Topic

Next Topic

Ingbuild on UNIX

The executable script ingbuild performs all the steps necessary to set up an installation. It checks system resources, installs shared memory and semaphores, configures DBMS server parameters, configures the logging and locking system, and starts all the required processes.

The ingbuild program is located in $II_SYSTEM/ingres/utility. It makes use of numerous shell commands as well as the following Ingres binary and shell executables:

One of the last things ingbuild does is call the ingstart script to actually start installation processes. When ingstart is called, it displays the message "Starting the Name Server process (iigcn)." If there are startup problems after this message has displayed, see Ingstart on UNIX.

Before you can diagnose a problem with ingbuild, you must identify which subroutine is failing. If you know which routine is failing and it is ingstart or one of the main installation processes (iigcn, iigcc, II_IUSV_nnn, dmfacp or iidbms), see the section below that addresses that executable.

Details on tracing are described in Bourne Shell -x Option.

Previous Topic

Next Topic

Detect Ingres Startup Problems on UNIX

To diagnose Ingres problems, use the following procedure.

  1. Display which processes are running by using the csreport and operating system ps commands.

    The csreport utility is described in Operating System Utilities and the ps command is described in UNIX Operating System Utilities.

  2. Verify that all required Ingres system processes are running. The following processes (in the order they are started) are the minimum required for a complete installation:
  3. If ingstart does not complete successfully, try to identify the reason for startup failure. For example:

    The problem is with ingstart. The ingstart script fails due to results of the checks it makes for sufficient resources and installation settings. If this is the reason for startup failure, correct the deficiency.

    A process failed to start. If a process failed to start, continue on to the details sections on startup problems for that specific process.

Previous Topic

Next Topic

Check Ingres Installation on VMS

It is recommended that you first make the following basic installation checks:

  1. Check that you are logged in as the ingres system administrator (ISA) user by issuing the following command at the operating system prompt:

    show process

    If the ISA is not shown, log off and log in again as the ISA. The ISA is typically ingres if there is only a single installation per machine. For multiple installations, there is a different ISA for each installation.

  2. Check that all users have II_SYSTEM set by issuing the following command at the operating system prompt:

    show logical II_SYSTEM

  3. Check that each of the Ingres installation logicals has a valid value.

    Ingres symbols are defined in the following files:

  4. Check the Ingres logicals that have been set locally, overriding the Ingres installation-level definitions. Issue the following command at the operating system prompt:

    show logical *II*, *ING*

    This shows which ones have been set at process, job, or group level, overriding the system-level definitions.

    Only a small category of Ingres logicals are defined in the local user environment: those that permit you to access Ingres, and those that define values that are different for your local environment. They can include TERM_INGRES and ING_EDIT.

    If you trace the problem to an Ingres logical setting, correct the value. For procedures and scenarios for setting these logicals, see the chapter "Setting Environment Variables and Logicals." If the installation does not start up, continue with this procedure.

  5. Identify your installation code if there is more than one Ingres installation on this machine. To do so, type the following command at the operating system prompt:

    show logical II_INSTALLATION

    The two-letter installation code is displayed. For example:

    II_INSTALLATION=R6

    If this is a system-wide Ingres installation, there is no definition for II_INSTALLATION. The installation code is used to distinguish which processes belong to which installation at sites with more than one Ingres installation on the same machine:

  6. Check that all Ingres processes are shut down. If processes continue to run, see Check Shutdown Problems on VMS.
  7. Restart Ingres. Attempt once again to start up the installation by issuing the following command at the operating system prompt:

    ingstart

  8. If startup problems persist, continue diagnostics contained in the next section—vmsinstal or ingstart.

Previous Topic

Next Topic

VMSINSTAL on VMS

The executable script vmsinstal performs all the steps necessary to set up an installation. It checks system resources, installs shared images, configures DBMS server parameters, configures the logging and locking system, and starts all the required processes.

During the execution of the vmsinstal script, if a problem occurs, do the following:

  1. Execute the vmsinstal program with the L option to log the contents of the VMSINSTAL session:

    @sys$update:vmsinstal * device_name options L

  2. Examine the DCL by issuing the following command at the operating system prompt:

    set verify

  3. Examine the vmsinstal log for error notifications and attempt to resolve the problem.
  4. If the Installation Verification Procedure (IVP) for the DBMS Server fails with the message "ii.node_name.syscheck.gblpages not found in config.dat" after you enter the number of concurrent users that the installation supports, check the value of the account parameter PRCLM (process limit) to ensure that it is not zero. The PRCLM must be a minimum of 15.
  5. If the problem persists, contact technical support, as described in What You Need Before Contacting Technical Support.

Previous Topic

Next Topic

Detect Ingres Startup Problems on VMS

If you are having ingstart problems, use the following procedure:

  1. Display the processes that are running by issuing the following command at the operating system prompt:

    show system /out = filename

    search filename "II_", "DMF"

    The search command searches the user-specified filename for the process names.

  2. Verify that all required Ingres system processes are running. The following processes (in the order they are started) are the minimum required for a complete installation:
  3. If ingstart does not complete successfully, do the following:
    1. Check for error messages in the errlog.log:

      II_SYSTEM:[INGRES.FILES] II_CONFIG:errlog.log

      For a complete list of error log files and individual component log files, see Logging and Locking Systems.

    2. Try to identify the reason for startup failure.
      • The problem is with ingstart. If the ingstart executable fails due to results of the checks it makes for sufficient resources and installation settings, correct the deficiency.
      • A process failed to start. If a process failed to start, continue on to the detail sections on startup problems for that specific process.

Previous Topic

Next Topic

Detect Ingres Startup Problems on System Reboot (Windows)

To detect Ingres startup problems on system reboot on Windows, follow these steps:

  1. Check that the "Startup Type" for the "Ingres Intelligent Database" service has been set to "automatic" in the services dialog.
  2. Check that the password specified for the "Ingres Intelligent Database" service matches the installation owner user password.
  3. Start the service manually.
  4. If the service fails to start, run ingstart from the command prompt.
  5. If the installation still does not start, contact technical support, as described in What You Need Before Contacting Technical Support.

Previous Topic

Next Topic

Detect Ingres Startup Problems on System Reboot (UNIX)

To detect Ingres startup problems on system reboot on UNIX, follow these steps:

  1. The most common cause of startup failure following a reboot is failure to include the startup command ingstart in the boot script for your machine. (The boot file is vendor-specific but can be named "/etc/rc" or "etc/rc.local".) This file contains the commands that are to be executed immediately after a reboot.

    Make sure that the following line appears in the boot script:

    su userid -c "ii_system/ingres/utility/ingstart ii_system" /dev/console

    where:

    userid refers to the user that owns the installation

    ii_system refers to the value of II_SYSTEM for your installation.

  2. Make sure that /dev/kmem is readable to the user that owns the installation. If this is a security problem for your machine, you can add this user as a member of /dev/kmem's group and make the /dev/kmem group readable.

    Issue the following command at the operating system prompt:

    chmod g+w /dev/kmem

    The user that owns the installation must be able to read /dev/kmem or the kernel resource checks in ingstart fails.

  3. Run ingstart. If the installation still does not start, contact technical support, as described in What You Need Before Contacting Technical Support.

Previous Topic

Next Topic

Detect Ingres Startup Problems on System Reboot (VMS)

To detect Ingres startup problems on system reboot on VMS, follow these steps:

  1. Make sure that a real error has occurred. If Ingres is performing startup recovery, see Automatic Recovery.
  2. Check to see that the Ingres initialization code is called from the VMS startup files. There are two main startup files:
  3. Be sure that you have examined all of the log files. Look in these files for possible error messages:
  4. Determine if any system logicals have been changed interactively since the last startup of Ingres but the command files have not been updated (use commands such as define/system/exec). Logical names become undefined when VMS is shut down and must be redefined (using the command files) at each boot.
  5. Make sure that DECnet and/or TCP/IP is started before either Ingres Cluster Option or Ingres Net is started.
  6. Execute the ingstart utility to start up Ingres.

    If the installation still does not start, contact technical support, as described in What You Need Before Contacting Technical Support.

Previous Topic

Next Topic

Check Shutdown Problems on Windows

If Ingres has problems during shutdown on Windows, follow these steps:

  1. Check environment variables in the local user environment by entering the following commands at the operating system prompt:
    1. Verify that II_SYSTEM is set correctly.

      echo %II_SYSTEM%

    2. Check that you have the full search path to %II_SYSTEM%\ingres\bin, and %II_SYSTEM%\ingres\utility

      echo %PATH%

      If you are having problems shutting down a client installation because Ingres believes a Communications Server is running locally when there is none, remove this file:

      %II_SYSTEM%\ingres\files\name\clientname\IICOMSVR_clientname

  2. Identify whether Ingres is recovering aborted transactions. Details of recovery delays are described in Recovery Process Monitoring. Issue the following command at the operating system prompt and examine the output for the word "RECOVER."

    logstat | findstr RECOVER

    If Ingres is recovering aborted transactions, wait for this process to finish. Continue reissuing the logstat command and examining the STATUS field. When it reads "ONLINE, ECP DONE," proceed with normal shutdown.

  3. Shut down the installation by typing the following command:

    ingstop

    You can also click the Stop toolbar button in Ingres Visual Manager to shut down the installation.

    Note: All users must be logged out of Ingres (that is, no sessions running in the server) for ingstop to succeed.

  4. Check that all processes are shut down. If shutdown succeeds, none of the following processes are running on your machine:
  5. Use one of your operating system utilities to kill any of these processes that are still running.
  6. Remove any shared memory segments that remain allocated to this installation. Execute the following command at the operating system prompt:

    ipclean

    Your installation is now shut down.

Note: For information about shutting down an Ingres installation that includes an ICE Server, see the chapter "Managing and Monitoring Web Deployment Option" in the Web Deployment Option User Guide.

Previous Topic

Next Topic

Check Shutdown Problems on UNIX

If Ingres has problems during shutdown on UNIX, follow these steps:

  1. Check environment variables in the local user environment by entering the following commands at the operating system prompt.
    1. Verify that II_SYSTEM is set correctly:

      echo $II_SYSTEM

      /usr/r6 (this varies system by system)

    2. Check that you have the full search path to $II_SYSTEM/ingres/bin and $II_SYSTEM/ingres/utility

      echo $PATH

  2. If there is more than one Ingres installation on this machine, identify your installation code by typing the following command at the operating system prompt:

    ingprenv | grep II_INSTALLATION

    The two-letter installation code is displayed (for example, the code here is JB):

    II_INSTALLATION=JB

    Take note of your installation code: ______.

  3. Identify if you are shutting down a client installation or a full installation by issuing the following command at the operating system prompt:

    ingprenv | grep II_CLIENT

    If this displays "II_CLIENT=true", this is a client installation, and only two processes (iigcn, iigcc) are running on this node.

  4. If you are having trouble shutting down a client installation because Ingres believes a Communications server is running locally when there is none, remove this file:

    $II_SYSTEM/ingres/files/name/clientname/IICOMSVR_clientname

    For troubleshooting details see the Connectivity Guide.

  5. Identify whether Ingres is recovering aborted transactions. Details on recovery delays are described in Recovery Process Monitoring. Issue the following command at the operating system prompt and examine the output for the word "RECOVER":

    logstat | grep RECOVER

    If Ingres is recovering aborted transactions, wait for this process to finish. Continue reissuing the logstat command and examining the STATUS field. When it says: "ONLINE, ECP DONE," proceed with normal shutdown.

  6. Now shut down the installation:

    ingstop

    Note: All users must be logged out of Ingres (that is, no sessions running in the server) for the ingstop script to succeed.

  7. Check that all processes are shut down:
    1. Display running processes by issuing the following command at the operating system prompt:

      BSD:

      ps -aux | grep ingres

      System V:

      ps -ef | grep ingres

    2. If shutdown succeeds, none of the following processes are running:
      • iigcn
      • iigcc
      • II_IUSV_nnn
      • dmfacp
      • iidbms
      • iijdbc
      • iigcd
      • iistar
      • icesvr
      • rmcmd
      • iigcb
  8. If any of these installation processes are not shut down, note the process ID of the running processes and do the following:
    1. Shut them down manually with the operating system command:

      kill- QUIT process_id

      where:

      process_id refers to the process ID of the process to stop.

    2. If processes are still not shut down, issue the operating system command:

      kill -9 process_id

      Important! If your site has more than one Ingres installation, examine the installation code associated with the iidbms process to make sure you are stopping only the processes associated with the installation you need to shut down.

  9. Check that no shared memory segments remain allocated to this installation. Execute the operating system command:

    csreport

    The following message indicates that shared segments have been properly removed:

    !Can't map system segment

  10. If shared memory segments remain for this installation, interactively remove them:
    1. To deallocate shared memory resources, issue the operating system command:

      ipcclean

    2. Use the UNIX command ipcs to verify that the actual segments have been removed:

      ipcs

    3. If they have not been properly removed, you must delete them manually.

      Important! If your site has more than one Ingres installation, you must take care to only remove shared memory or semaphores for the installation to be shut down. If your machine contains more than one installation, enter the following command from the environment of the installation you need to target:

      csreport

      The csreport utility displays the shared memory and semaphore segment identifiers for this installation.

      To remove the targeted segment(s), use the UNIX command:

      ipcrm -mmid

      or

      ipcrm -ssid

      where mid is the shared memory segment identifier and sid is the semaphore identifier.

  11. Verify that the following files are not present. If they are still present, you must remove them:

    $II_SYSTEM/ingres/files/memory/lockseg.mem
    $II_SYSTEM/ingres/files/memory/sysseg.mem

    Your installation is now shut down. Instructions on how to check and restart Ingres are described in Check Ingres Installation on UNIX.

Note: For information about shutting down an Ingres installation that includes an ICE Server, see the chapter "Managing and Monitoring Web Deployment Option" in the Web Deployment Option User Guide.

Previous Topic

Next Topic

Check Shutdown Problems on VMS

If Ingres has problems during shutdown on VMS, follow these steps:

  1. Check that you are logged in as the system administrator or another privileged account by issuing the following command at the operating system prompt:

    show process

    Make sure you have the WORLD and CMKRNL privileges required for stopping Ingres processes by issuing the following command at the operating system prompt:

    show process/privilege

    A privileged account must not only have the aforementioned VMS privileges but also must have the SERVER_CONTROL privilege authorized in II_CONFIG:CONFIG.DAT.

  2. Check that the logical II_SYSTEM is defined by issuing the following command at the operating system prompt:

    show logical II_SYSTEM

  3. Check to see that users are logged out of Ingres. You can use the utility logstat to determine which databases are open and active and find out whom to notify of the impending shutdown. For additional information, see the Logstat section in the Command Reference Guide.

    To obtain a list of running processes, use the DCL command:

    show system

  4. This command gives you a complete list of all processes that are running on your machine. It displays the process ID ('Pid'), Process Name, and other information. The main processes have the names as shown in Detect Ingres Startup Problems on VMS.

    If you use the form show system/full, you can also see the owner of the process. This is helpful if you have group level installations.

  5. Identify your installation code if there is more than one Ingres installation on this machine.

    For a group level installation the two-lettered code is displayed after the process name. In this example, the code is BE:

    Pid Process Name State Pri I/O CPU Page flts Ph.Mem

    236012AD II_DBMS_BE_1E3F HIB 6 86463 0 00:13:53.24 14401 8192

    Important! If your site has more than one Ingres installation, examine the installation code associated with the II_DBMS_nnn process to make sure you are only shutting down processes associated with the installation you need to shut down.

  6. Use the iinamu utility to find the names of the servers for this installation; iinamu shows you only the servers for the installation in which you currently reside. For example:

    IINAMU> show ingres

    INGRES * II_DBMS_BE_1E3F

    found.

    IINAMU> show comsvr

    COMSVR * II_GCC_BE_2B77

  7. Shut down servers. See the individual descriptions below.

    Note: Ingres can be shut down in several ways. Following are some tips on how each shutdown procedure works to enable you to make a choice as to how to shut down the installation.

    1. Shutting down the Name Server

      When you issue the stop command from iinamu, the Name Server process is stopped. Once this command is issued, no new servers are allowed to register with the Name Server. Therefore, it makes sense to take the Name Server down first for a clean shutdown. Current, active sessions are not affected by this command.

    2. Shutting down the DBMS Server

      Use iimonitor to stop the DBMS Server. The two commands you can use are:

      set server shut

      This causes the server to refuse further connections and shuts the server down gracefully, completing all current transactions first, including the iimonitor session.

      stop server

      This stops the server immediately without waiting for current connected sessions to complete. Use this command instead of the VMS command stop/id.

    3. Shutting down the recovery and archiver processes

      Take down the recovery and the archiver processes, either quickly or slowly, depending on the method you used to take down the DBMS Server in step b. Use either of the following commands at the operating system prompt:

      rcpconfig/shutdown

      This causes the processes to refuse all further connections and transaction processing, but allows current transactions to finish. This allows the archiver and recovery processes to shut down cleanly.

      rcpconfig/imm_shutdown

      This stops all pending transactions and immediately shuts down the recovery and archiver processes. This leaves open transactions in the log file, which requires rollback (and slow startup) when the system is restarted.

    4. Writing a DCL command file to take Ingres down

      Alternatively, you can write a DCL script that puts the above steps in a command procedure to shut down each of the Ingres processes.

  8. After shutting down Ingres, check that all processes are stopped:
    1. Issue the following command at the operating system prompt:

      show system

      Check to be sure that none of the processes listed in the Ingstart on VMS section is shown.

    2. If any of these installation processes are not shut down, note the process ID (PID#) of the running process and issue either of the following commands at the operating system prompt:

      stop process_name

      or

      stop/id = pid#

      Note: For serious system problems that require immediate attention, the VMS stop command can be used to stop an Ingres process. This is not recommended because it does not permit the recovery process to back out open transactions or the archiver process to flush the log file to disk.

      If this is a cluster installation, remember that these Ingres processes run on each node.

      Your Ingres installation is now shut down. Information about checking and restarting Ingres is described in Check Ingres Installation on VMS.

Note: For information about shutting down an Ingres installation that includes an ICE Server, see the chapter "Managing and Monitoring Web Deployment Option" in the Web Deployment Option User Guide.


© 2007 Ingres Corporation. All rights reserved.