Dec
10
2009

File-based persistent store state mismatch

Sometimes things change within a corporate network. And sometimes these changes also impact a GlassFish domain.
How much does relocating a server impact the GlassFish Domain?
That depends; When the glassfish installation was performed using proper DNS / hostnames then there should not be very much impact. When the GlassFish configuration itself (like JDBC resources or resource adapters) are also spared of IP-address usages then the impact should be diminished even further.

Unfortunately GlassFish uses some internal components which store the more physical information of the network location of the various GlassFish instances in a domain. This becomes apparent when the GlassFish domain is relocated to another IP-address range or VLAN.

Starting the domain after changing its underlying networkstructure could result in not being able to start domain or server instances within the domain. The logfiles might indicate that a connection to the IMQBroker has not been possible within the last 6000 milliseconds.

java.lang.RuntimeException: MQJMSRA_LB4001: start:Aborted:
Unable to ping Broker within 60000 millis (startTimeOut)

An exception like this will also be shown in the logfiles of the failing instance:
[C4003]: Error occurred on connection creation [localhost:37676].
- cause: java.net.ConnectException: Connection refused

The most common cause for this is network problems. Checking the correct DNS lookup and reverse lookup of the DAS and the various nodes containing in stances in the domain will provide more information whether there is a network problem.
If DNS lookup succeeds and the hosts-file of the operating system does not contain any incorrect references then other things might go wrong.

The problem could also lie within a corrupted persistent store of the IMQbroker(s). Looking at the imq log.txt files which are located in the server instance folders (and more specifically in the imq/instances/[full unique instancename]/log folder within the nodeagents folder) one might see message like:
ERROR [B3095]: Cannot join the cluster because of persistent store state mismatch. Please clear the existing persistent store with “-reset store” and try again. Broker exiting.

Clearing the persistent store can actually be done by executing the imqbroker daemon using the -reset store parameters.  Issue the following command from within the [GLASSFISH-HOME]/imq/bin directory:
./imqbrokerd -varhome [GLASSFISH_HOME]/nodeagents/[NODEAGENT_NAME]/[AFFECTED_INSTANCENAME]/imq -name [CLUSTERNAME][INSTANCENAME] -reset store

Replace the variables between brackets as appropriate! Mind the -name argument which contains a concatenated cluster and instancename!

For example:
/opt/glassfish-v2.1/imq/bin/imqbrokerd -varhome /opt/glassfish-v2.1/nodeagents/domain1-nodeagent1/serverinstance1/imq -name myclusterserverinstance1 -reset store

After this has been started, stop it and start the server instance which would previously not start. The persistent store for this instance has been cleared so a rendez-vous with the DAS should now work once again.

posted in No category by Thijs Volders

Follow comments via the RSS Feed | Leave a comment | Trackback URL

2 Comments to "File-based persistent store state mismatch"

  1. Tin Maung wrote:

    Jan 27, 2010 1:04:53 PM com.sun.enterprise.admin.servermgmt.launch.ASLauncher buildCommand
    INFO:
    C:/Program Files (x86)/Java/jdk1.6.0_12/jre/..\bin\java
    -Dcom.sun.aas.instanceRoot=C:/glassfish/nodeagents/node1/instance1
    -DHTTP_LISTENER_PORT=38080
    -DHTTP_SSL_LISTENER_PORT=38181
    -DIIOP_LISTENER_PORT=33700
    -DIIOP_SSL_LISTENER_PORT=33820
    -DIIOP_SSL_MUTUALAUTH_PORT=33920
    -DJMS_PROVIDER_PORT=37676
    -DJMX_SYSTEM_CONNECTOR_PORT=38686
    -Dcom.sun.aas.ClassPathPrefix=
    -Dcom.sun.aas.ClassPathSuffix=
    -Dcom.sun.aas.ServerClassPath=
    -Dcom.sun.aas.classloader.appserverChainJars.ee=
    -Dcom.sun.aas.classloader.appserverChainJars=admin-cli.jar,admin-cli-ee.jar,j2ee-svc.jar
    -Dcom.sun.aas.classloader.excludesList=admin-cli.jar,appserv-upgrade.jar,sun-appserv-ant.jar
    -Dcom.sun.aas.classloader.optionalOverrideableChain.ee=
    -Dcom.sun.aas.classloader.optionalOverrideableChain=webservices-rt.jar,webservices-tools.jar
    -Dcom.sun.aas.classloader.serverClassPath.ee=/lib/hadbjdbc4.jar,C:/glassfish/lib/SUNWjdmk/5.1/lib/jdmkrt.jar,/lib/dbstate.jar,/lib/hadbm.jar,/lib/hadbmgt.jar,C:/glassfish/lib/SUNWmfwk/lib/mfwk_instrum_tk.jar
    -Dcom.sun.aas.classloader.serverClassPath=C:/glassfish/lib/install/applications/jmsra/imqjmsra.jar,C:/glassfish/imq/lib/jaxm-api.jar,C:/glassfish/imq/lib/fscontext.jar,C:/glassfish/imq/lib/imqbroker.jar,C:/glassfish/imq/lib/imqjmx.jar,C:/glassfish/lib/ant/lib/ant.jar,C:/glassfish/lib/SUNWjdmk/5.1/lib/jdmkrt.jar
    -Dcom.sun.aas.classloader.sharedChainJars.ee=appserv-se.jar,appserv-ee.jar,jesmf-plugin.jar,/lib/dbstate.jar,/lib/hadbjdbc4.jar,jgroups-all.jar,C:/glassfish/lib/SUNWmfwk/lib/mfwk_instrum_tk.jar
    -Dcom.sun.aas.classloader.sharedChainJars=javaee.jar,C:/Program Files (x86)/Java/jdk1.6.0_12/jre/../lib/tools.jar,install/applications/jmsra/imqjmsra.jar,com-sun-commons-launcher.jar,com-sun-commons-logging.jar,C:/glassfish/imq/lib/jaxm-api.jar,C:/glassfish/imq/lib/fscontext.jar,C:/glassfish/imq/lib/imqbroker.jar,C:/glassfish/imq/lib/imqjmx.jar,C:/glassfish/imq/lib/imqxm.jar,webservices-rt.jar,webservices-tools.jar,mail.jar,appserv-jstl.jar,jmxremote_optional.jar,C:/glassfish/lib/SUNWjdmk/5.1/lib/jdmkrt.jar,activation.jar,appserv-rt.jar,appserv-admin.jar,appserv-cmp.jar,C:/glassfish/updatecenter/lib/updatecenter.jar,C:/glassfish/jbi/lib/jbi.jar,C:/glassfish/imq/lib/imqjmx.jar,C:/glassfish/lib/ant/lib/ant.jar,dbschema.jar
    -Dcom.sun.aas.configName=cluster1-config
    -Dcom.sun.aas.configRoot=C:/glassfish/config
    -Dcom.sun.aas.defaultLogFile=C:/glassfish/nodeagents/node1/instance1/logs/server.log
    -Dcom.sun.aas.domainName=domain1
    -Dcom.sun.aas.installRoot=C:/glassfish
    -Dcom.sun.aas.instanceName=instance1
    -Dcom.sun.aas.processLauncher=SE
    -Dcom.sun.aas.promptForIdentity=true
    -Dcom.sun.appserv.pluggable.features=com.sun.enterprise.ee.server.pluggable.EEPluggableFeatureImpl
    -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory
    -Dcom.sun.enterprise.overrideablejavaxpackages=javax.help,javax.portlet
    -Dcom.sun.enterprise.taglibs=appserv-jstl.jar,jsf-impl.jar
    -Dcom.sun.enterprise.taglisteners=jsf-impl.jar
    -Dcom.sun.updatecenter.home=C:/glassfish/updatecenter
    -Ddomain.name=domain1
    -Djava.endorsed.dirs=C:/glassfish/lib/endorsed
    -Djava.ext.dirs=C:/Program Files (x86)/Java/jdk1.6.0_12/jre/../lib/ext;C:/Program Files (x86)/Java/jdk1.6.0_12/jre/../jre/lib/ext;C:/glassfish/nodeagents/node1/instance1/lib/ext;C:/glassfish/javadb/lib;C:/glassfish/lib/jdbcdrivers
    -Djava.library.path=C:\glassfish\lib;C:\glassfish\lib;C:\glassfish\lib;C:\glassfish\lib;C:\glassfish\bin;C:\glassfish\lib;C:\glassfish\lib
    -Djava.security.auth.login.config=C:/glassfish/nodeagents/node1/instance1/config/login.conf
    -Djava.security.policy=C:/glassfish/nodeagents/node1/instance1/config/server.policy
    -Djava.util.logging.manager=com.sun.enterprise.server.logging.ServerLogManager
    -Djavax.management.builder.initial=com.sun.enterprise.ee.admin.AppServerMBeanServerBuilder
    -Djavax.net.ssl.keyStore=C:/glassfish/nodeagents/node1/instance1/config/keystore.jks
    -Djavax.net.ssl.trustStore=C:/glassfish/nodeagents/node1/instance1/config/cacerts.jks
    -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver
    -Djmx.invoke.getters=true
    -Dsun.rmi.dgc.client.gcInterval=3600000
    -Dsun.rmi.dgc.server.gcInterval=3600000
    -client
    -XX:+UnlockDiagnosticVMOptions
    -XX:MaxPermSize=192m
    -Xmx512m
    -XX:NewRatio=2
    -XX:+LogVMOutput
    -XX:LogFile=C:/glassfish/nodeagents/node1/instance1/logs/jvm.log
    -cp
    C:/glassfish/lib/jhall.jar;C:\glassfish\lib\appserv-launch.jar
    com.sun.enterprise.server.PELaunch
    start
    [#|2010-01-27T13:04:53.753+0800|INFO|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|Starting Sun GlassFish Enterprise Server v2.1.1 ((v2.1 Patch06)(9.1_02 Patch12)) (build b31g-fcs) ...|#]

    [#|2010-01-27T13:04:54.335+0800|INFO|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;Java HotSpot(TM) Client VM;1.6.0_12;Sun Microsystems Inc.;|CORE5076: Using [Java HotSpot(TM) Client VM, Version 1.6.0_12] from [Sun Microsystems Inc.]|#]

    [#|2010-01-27T13:04:54.401+0800|INFO|sun-appserver2.1|javax.enterprise.system.core.security|_ThreadID=11;_ThreadName=pool-1-thread-4;|SEC1002: Security Manager is OFF.|#]

    [#|2010-01-27T13:04:54.425+0800|INFO|sun-appserver2.1|javax.enterprise.resource.jms|_ThreadID=12;_ThreadName=pool-1-thread-7;|Using MQ RA for Broker lifecycle control|#]

    [#|2010-01-27T13:04:54.829+0800|INFO|sun-appserver2.1|javax.ee.enterprise.system.gms|_ThreadID=10;_ThreadName=main;|Initializing and Starting GroupManagementService|#]

    [#|2010-01-27T13:04:55.778+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;|GMS View Change Received for group cluster1 : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
    1: MemberId: instance1, MemberType: CORE, Address: urn:jxta:uuid-59616261646162614A787461503250337987FC1134E54090AB24B0C9E01AD7DF03
    |#]

    [#|2010-01-27T13:04:55.779+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;MASTER_CHANGE_EVENT;instance1;cluster1;|Analyzing new membership snapshot received as part of event : MASTER_CHANGE_EVENT for Member: instance1 of Group: cluster1|#]

    [#|2010-01-27T13:04:55.779+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;|adding GroupLeadershipNotification signal leaderMember: instance1 of group: cluster1|#]

    [#|2010-01-27T13:04:55.844+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;|GMS View Change Received for group cluster1 : Members in view for MASTER_CHANGE_EVENT(before change analysis) are :
    1: MemberId: server, MemberType: SPECTATOR, Address: urn:jxta:uuid-59616261646162614A787461503250332DE658F932AB436995B78E0CB3E080DA03
    2: MemberId: instance1, MemberType: CORE, Address: urn:jxta:uuid-59616261646162614A787461503250337987FC1134E54090AB24B0C9E01AD7DF03
    |#]

    [#|2010-01-27T13:04:55.846+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;MASTER_CHANGE_EVENT;server;cluster1;|Analyzing new membership snapshot received as part of event : MASTER_CHANGE_EVENT for Member: server of Group: cluster1|#]

    [#|2010-01-27T13:04:55.846+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;|adding GroupLeadershipNotification signal leaderMember: server of group: cluster1|#]

    [#|2010-01-27T13:04:55.846+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;|viewQueue size before take 1 for group: cluster1|#]

    [#|2010-01-27T13:04:55.847+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;|GMS View Change Received for group cluster1 : Members in view for ADD_EVENT(before change analysis) are :
    1: MemberId: server, MemberType: SPECTATOR, Address: urn:jxta:uuid-59616261646162614A787461503250332DE658F932AB436995B78E0CB3E080DA03
    2: MemberId: instance1, MemberType: CORE, Address: urn:jxta:uuid-59616261646162614A787461503250337987FC1134E54090AB24B0C9E01AD7DF03
    |#]

    [#|2010-01-27T13:04:55.847+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;ADD_EVENT;instance1;cluster1;|Analyzing new membership snapshot received as part of event : ADD_EVENT for Member: instance1 of Group: cluster1|#]

    [#|2010-01-27T13:04:55.847+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread:cluster1;|Adding Join member: instance1 group: cluster1 StartupState:INSTANCE_STARTUP|#]

    [#|2010-01-27T13:04:55.883+0800|SEVERE|sun-appserver2.1|javax.enterprise.system.core.security|_ThreadID=10;_ThreadName=main;[
    [
    Version: V1
    Subject: OU=Secure Server Certification Authority, O="RSA Data Security, Inc.", C=US
    Signature Algorithm: MD2withRSA, OID = 1.2.840.113549.1.1.2

    Key: Sun RSA public key, 1000 bits
    modulus: 6144706769222379850430183405655235862870193813433361902309516534729547168229223442088128897090426025874990958624426272027915771330043379079076269082776443120496525109458437435793974957144923190172655546279112796066635455545786300647745888353781002359412766112775410851780140804282673804950495744761467
    public exponent: 65537
    Validity: [From: Wed Nov 09 08:00:00 SGT 1994,
    To: Fri Jan 08 07:59:59 SGT 2010]
    Issuer: OU=Secure Server Certification Authority, O=”RSA Data Security, Inc.”, C=US
    SerialNumber: [ 02ad667e 4e45fe5e 576f3c98 195eddc0]

    ]
    Algorithm: [MD2withRSA]
    Signature:
    0000: 65 DD 7E E1 B2 EC B0 E2 3A E0 EC 71 46 9A 19 11 e…….:..qF…
    0010: B8 D3 C7 A0 B4 03 40 26 02 3E 09 9C E1 12 B3 D1 ……@&.>……
    0020: 5A F6 37 A5 B7 61 03 B6 5B 16 69 3B C6 44 08 0C Z.7..a..[.i;.D..
    0030: 88 53 0C 6B 97 49 C7 3E 35 DC 6C B9 BB AA DF 5C .S.k.I.>5.l....\
    0040: BB 3A 2F 93 60 B6 A9 4B 4D F2 20 F7 CD 5F 7F 64 .:/.`..KM. .._.d
    0050: 7B 8E DC 00 5C D7 FA 77 CA 39 16 59 6F 0E EA D3 ....\..w.9.Yo...
    0060: B5 83 7F 4D 4D 42 56 76 B4 C9 5F 04 F8 38 F8 EB ...MMBVv.._..8..
    0070: D2 5F 75 5F CD 7B FC E5 8E 80 7C FC 50 ._u_........P

    ];_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|SEC5054: Certificate has expired: [
    [
    Version: V1
    Subject: OU=Secure Server Certification Authority, O="RSA Data Security, Inc.", C=US
    Signature Algorithm: MD2withRSA, OID = 1.2.840.113549.1.1.2

    Key: Sun RSA public key, 1000 bits
    modulus: 6144706769222379850430183405655235862870193813433361902309516534729547168229223442088128897090426025874990958624426272027915771330043379079076269082776443120496525109458437435793974957144923190172655546279112796066635455545786300647745888353781002359412766112775410851780140804282673804950495744761467
    public exponent: 65537
    Validity: [From: Wed Nov 09 08:00:00 SGT 1994,
    To: Fri Jan 08 07:59:59 SGT 2010]
    Issuer: OU=Secure Server Certification Authority, O=”RSA Data Security, Inc.”, C=US
    SerialNumber: [ 02ad667e 4e45fe5e 576f3c98 195eddc0]

    ]
    Algorithm: [MD2withRSA]
    Signature:
    0000: 65 DD 7E E1 B2 EC B0 E2 3A E0 EC 71 46 9A 19 11 e…….:..qF…
    0010: B8 D3 C7 A0 B4 03 40 26 02 3E 09 9C E1 12 B3 D1 ……@&.>……
    0020: 5A F6 37 A5 B7 61 03 B6 5B 16 69 3B C6 44 08 0C Z.7..a..[.i;.D..
    0030: 88 53 0C 6B 97 49 C7 3E 35 DC 6C B9 BB AA DF 5C .S.k.I.>5.l....\
    0040: BB 3A 2F 93 60 B6 A9 4B 4D F2 20 F7 CD 5F 7F 64 .:/.`..KM. .._.d
    0050: 7B 8E DC 00 5C D7 FA 77 CA 39 16 59 6F 0E EA D3 ....\..w.9.Yo...
    0060: B5 83 7F 4D 4D 42 56 76 B4 C9 5F 04 F8 38 F8 EB ...MMBVv.._..8..
    0070: D2 5F 75 5F CD 7B FC E5 8E 80 7C FC 50 ._u_........P

    ]|#]

    [#|2010-01-27T13:04:55.910+0800|INFO|sun-appserver2.1|javax.enterprise.system.core.security|_ThreadID=10;_ThreadName=main;com.sun.enterprise.security.provider.PolicyWrapper;|SEC1143: Loading policy provider com.sun.enterprise.security.provider.PolicyWrapper.|#]

    [#|2010-01-27T13:04:56.175+0800|INFO|sun-appserver2.1|javax.enterprise.system.container.web|_ThreadID=10;_ThreadName=main;server;|WEB0114: SSO is disabled in virtual server [server]|#]

    [#|2010-01-27T13:04:57.397+0800|INFO|sun-appserver2.1|javax.enterprise.system.core.transaction|_ThreadID=10;_ThreadName=main;33700;|JTS5014: Recoverable JTS instance, serverId = [33700]|#]

    [#|2010-01-27T13:04:57.473+0800|INFO|sun-appserver2.1|javax.enterprise.system.tools.admin|_ThreadID=10;_ThreadName=main;|ADM1079: Initialization of AMX MBeans started|#]

    [#|2010-01-27T13:04:57.651+0800|INFO|sun-appserver2.1|javax.enterprise.system.tools.admin|_ThreadID=14;_ThreadName=Thread-19;service:jmx:rmi:///jndi/rmi://KTPWEBQMS-01.healthgrp.com.sg:38686/jmxrmi;|ADM1504: Here is the JMXServiceURL for the Standard JMXConnectorServer: [service:jmx:rmi:///jndi/rmi://KTPWEBQMS-01.healthgrp.com.sg:38686/jmxrmi]. This is where the remote administrative clients should connect using the standard JMX connectors|#]

    [#|2010-01-27T13:04:57.651+0800|INFO|sun-appserver2.1|javax.enterprise.system.tools.admin|_ThreadID=14;_ThreadName=Thread-19;true;|ADM1506: Status of Standard JMX Connector: Active = [true]|#]

    [#|2010-01-27T13:04:58.071+0800|INFO|sun-appserver2.1|javax.enterprise.resource.resourceadapter|_ThreadID=10;_ThreadName=main;|JMS Service Connection URL is :mq://KTPWEBQMS-01.healthgrp.com.sg:37676/,mq://KTPWEBQMS-03.healthgrp.com.sg:37676/,mq://KTPWEBQMS-02.healthgrp.com.sg:37676/|#]

    [#|2010-01-27T13:04:58.083+0800|INFO|sun-appserver2.1|javax.resourceadapter.mqjmsra.lifecycle|_ThreadID=10;_ThreadName=main;|MQJMSRA_RA1101: SJSMQ JMS Resource Adapter starting...|#]

    [#|2010-01-27T13:04:58.124+0800|INFO|sun-appserver2.1|javax.resourceadapter.mqjmsra.lifecycle|_ThreadID=10;_ThreadName=main;|MQJMSRA_LB1101: Looking for Broker Running at:localhost:37676|#]

    [#|2010-01-27T13:04:59.171+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:07.375+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=15;_ThreadName=iMQReadChannel-7;_RequestID=f16bdf8e-4336-445c-b3bc-88370eb90845;|[I500]: Caught JVM Exception: java.io.EOFException: Trying to read 72 bytes. Already read 0 bytes.|#]

    [#|2010-01-27T13:05:09.380+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=16;_ThreadName=iMQReadChannel-8;_RequestID=532740a2-3250-475f-9df8-94139ca68392;|[I500]: Caught JVM Exception: java.io.EOFException: Trying to read 72 bytes. Already read 0 bytes.|#]

    [#|2010-01-27T13:05:11.385+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=17;_ThreadName=iMQReadChannel-9;_RequestID=4837dc97-6828-4198-9e06-07b38845dd61;|[I500]: Caught JVM Exception: java.io.EOFException: Trying to read 72 bytes. Already read 0 bytes.|#]

    [#|2010-01-27T13:05:13.383+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:15.374+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:17.374+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:19.393+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:21.404+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:23.404+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:25.396+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:27.394+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:29.385+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:31.384+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:33.375+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:35.365+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:37.356+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:39.346+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:41.345+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:43.337+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:45.336+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:47.327+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:49.327+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:51.327+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:53.327+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:55.318+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:57.319+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:59.317+0800|WARNING|sun-appserver2.1|javax.jms|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|[C4003]: Error occurred on connection creation [localhost:37676]. – cause: java.net.ConnectException: Connection refused: connect|#]

    [#|2010-01-27T13:05:59.317+0800|SEVERE|sun-appserver2.1|javax.resourceadapter.mqjmsra.lifecycle|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|MQJMSRA_LB4001: start:Ping broker failed 60140 millis after broker start performed. Failing ra.start()|#]

    [#|2010-01-27T13:05:59.318+0800|WARNING|sun-appserver2.1|javax.resourceadapter.mqjmsra.lifecycle|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|MQJMSRA_LB4001: start:Aborting:Check Broker Log File at:C:\glassfish\nodeagents\node1\instance1\imq\instances\cluster1instance1\log\log.txt|#]

    [#|2010-01-27T13:05:59.318+0800|WARNING|sun-appserver2.1|javax.resourceadapter.mqjmsra.lifecycle|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|MQJMSRA_LB4001: start:Aborting:Check Broker Password File at:C:\Users\Administrator\AppData\Local\Temp\2\asmq1785150932709945470.tmp|#]

    [#|2010-01-27T13:05:59.318+0800|SEVERE|sun-appserver2.1|javax.resourceadapter.mqjmsra.lifecycle|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|MQJMSRA_RA4001: start:Aborting:Exception starting LOCAL broker=MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)|#]

    [#|2010-01-27T13:05:59.318+0800|INFO|sun-appserver2.1|javax.resourceadapter.mqjmsra.lifecycle|_ThreadID=10;_ThreadName=main;|SJSMQ LifecycleManagedBroker configuration=
    brokerInstanceName =cluster1instance1
    brokerBindAddress =null
    brokerPort =37676
    brokerHomeDir =C:\glassfish\imq
    brokerLibDir =C:\glassfish\imq\lib
    brokerVarDir =C:\glassfish\nodeagents\node1\instance1\imq
    brokerJavaDir =C:\Program Files (x86)\Java\jdk1.6.0_12
    brokerArgs =null
    MasterBroker =mq://KTPWEBQMS-01.healthgrp.com.sg:37676/
    brokerId =null
    adminUsername =admin
    adminPassword =
    adminPassFile =C:\Users\Administrator\AppData\Local\Temp\2\asmq1785150932709945470.tmp
    ConnectionURL =mq://KTPWEBQMS-01.healthgrp.com.sg:37676/,mq://KTPWEBQMS-03.healthgrp.com.sg:37676/,mq://KTPWEBQMS-02.healthgrp.com.sg:37676/
    dbType =null
    dbProps ={}
    dsProps ={}
    useJNDIRmiServiceURL =true
    useSSLJMXConnector =true
    brokerEnableHA =false
    clusterId =null
    rmiRegistryPort =37776
    startRmiRegistry =true
    brokerStartTimeout =60000
    |#]

    [#|2010-01-27T13:05:59.320+0800|WARNING|sun-appserver2.1|javax.enterprise.system.stream.err|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|java.lang.RuntimeException: MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.messaging.jms.ra.LocalBrokerRunner.start(LocalBrokerRunner.java:365)
    at com.sun.messaging.jms.ra.LifecycleManagedBroker.start(LifecycleManagedBroker.java:308)
    at com.sun.messaging.jms.ra.ResourceAdapter.start(ResourceAdapter.java:308)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter$1.run(ActiveInboundResourceAdapter.java:180)
    at java.security.AccessController.doPrivileged(Native Method)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.startResourceAdapter(ActiveInboundResourceAdapter.java:174)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.(ActiveInboundResourceAdapter.java:132)
    at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.(ActiveJmsResourceAdapter.java:234)
    at com.sun.enterprise.connectors.ActiveRAFactory.createActiveResourceAdapter(ActiveRAFactory.java:107)
    at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:300)
    at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:445)
    at com.sun.enterprise.connectors.ConnectorRuntime.createActiveResourceAdapter(ConnectorRuntime.java:230)
    at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:451)
    at com.sun.enterprise.server.ApplicationServer.onStartup(ApplicationServer.java:449)
    at com.sun.enterprise.server.ondemand.OnDemandServer.onStartup(OnDemandServer.java:134)
    at com.sun.enterprise.server.PEMain.run(PEMain.java:409)
    at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.sun.enterprise.server.PELaunch.main(PELaunch.java:415)
    |#]

    [#|2010-01-27T13:05:59.322+0800|SEVERE|sun-appserver2.1|javax.enterprise.resource.resourceadapter|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|RAR6035 : Resource adapter start failed : {0}
    javax.resource.spi.ResourceAdapterInternalException: MQJMSRA_RA4001: start:Aborting:Exception starting LOCAL broker=MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.messaging.jms.ra.LifecycleManagedBroker.start(LifecycleManagedBroker.java:311)
    at com.sun.messaging.jms.ra.ResourceAdapter.start(ResourceAdapter.java:308)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter$1.run(ActiveInboundResourceAdapter.java:180)
    at java.security.AccessController.doPrivileged(Native Method)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.startResourceAdapter(ActiveInboundResourceAdapter.java:174)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.(ActiveInboundResourceAdapter.java:132)
    at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.(ActiveJmsResourceAdapter.java:234)
    at com.sun.enterprise.connectors.ActiveRAFactory.createActiveResourceAdapter(ActiveRAFactory.java:107)
    at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:300)
    at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:445)
    at com.sun.enterprise.connectors.ConnectorRuntime.createActiveResourceAdapter(ConnectorRuntime.java:230)
    at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:451)
    at com.sun.enterprise.server.ApplicationServer.onStartup(ApplicationServer.java:449)
    at com.sun.enterprise.server.ondemand.OnDemandServer.onStartup(OnDemandServer.java:134)
    at com.sun.enterprise.server.PEMain.run(PEMain.java:409)
    at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.sun.enterprise.server.PELaunch.main(PELaunch.java:415)
    Caused by: java.lang.RuntimeException: MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.messaging.jms.ra.LocalBrokerRunner.start(LocalBrokerRunner.java:365)
    at com.sun.messaging.jms.ra.LifecycleManagedBroker.start(LifecycleManagedBroker.java:308)
    ... 20 more
    |#]

    [#|2010-01-27T13:05:59.323+0800|WARNING|sun-appserver2.1|javax.enterprise.system.stream.err|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|
    com.sun.enterprise.connectors.ConnectorRuntimeException: Failed to start resource adapter : MQJMSRA_RA4001: start:Aborting:Exception starting LOCAL broker=MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.(ActiveInboundResourceAdapter.java:148)
    at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.(ActiveJmsResourceAdapter.java:234)
    at com.sun.enterprise.connectors.ActiveRAFactory.createActiveResourceAdapter(ActiveRAFactory.java:107)
    at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:300)
    at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:445)
    at com.sun.enterprise.connectors.ConnectorRuntime.createActiveResourceAdapter(ConnectorRuntime.java:230)
    at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:451)
    at com.sun.enterprise.server.ApplicationServer.onStartup(ApplicationServer.java:449)
    at com.sun.enterprise.server.ondemand.OnDemandServer.onStartup(OnDemandServer.java:134)
    at com.sun.enterprise.server.PEMain.run(PEMain.java:409)
    at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.sun.enterprise.server.PELaunch.main(PELaunch.java:415)
    Caused by: javax.resource.spi.ResourceAdapterInternalException: MQJMSRA_RA4001: start:Aborting:Exception starting LOCAL broker=MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.messaging.jms.ra.LifecycleManagedBroker.start(LifecycleManagedBroker.java:311)
    at com.sun.messaging.jms.ra.ResourceAdapter.start(ResourceAdapter.java:308)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter$1.run(ActiveInboundResourceAdapter.java:180)
    at java.security.AccessController.doPrivileged(Native Method)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.startResourceAdapter(ActiveInboundResourceAdapter.java:174)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.(ActiveInboundResourceAdapter.java:132)
    ... 15 more
    Caused by: java.lang.RuntimeException: MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.messaging.jms.ra.LocalBrokerRunner.start(LocalBrokerRunner.java:365)
    at com.sun.messaging.jms.ra.LifecycleManagedBroker.start(LifecycleManagedBroker.java:308)
    ... 20 more
    |#]

    [#|2010-01-27T13:05:59.323+0800|INFO|sun-appserver2.1|javax.enterprise.resource.jms|_ThreadID=10;_ThreadName=main;|Failed to start or connect JMS RA|#]

    [#|2010-01-27T13:05:59.323+0800|INFO|sun-appserver2.1|javax.enterprise.resource.jms|_ThreadID=10;_ThreadName=main;|If MQ is configured as REMOTE and don't want to start MQ broker then set jvm-option com.sun.enterprise.jms.DONT_CONNECT_MQ_IN_REMOTE_MODE to true|#]

    [#|2010-01-27T13:05:59.324+0800|SEVERE|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;com.sun.enterprise.jms.JmsProviderLifecycle@1ece626;com.sun.appserv.server.ServerLifecycleException: Failed to start JMS RA;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|Service com.sun.enterprise.jms.JmsProviderLifecycle@1ece626 cannot be started! : com.sun.appserv.server.ServerLifecycleException: Failed to start JMS RA|#]

    [#|2010-01-27T13:05:59.324+0800|SEVERE|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|CORE5071: An error occured during initialization
    com.sun.appserv.server.ServerLifecycleException: Failed to start JMS RA
    at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:459)
    at com.sun.enterprise.server.ApplicationServer.onStartup(ApplicationServer.java:449)
    at com.sun.enterprise.server.ondemand.OnDemandServer.onStartup(OnDemandServer.java:134)
    at com.sun.enterprise.server.PEMain.run(PEMain.java:409)
    at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.sun.enterprise.server.PELaunch.main(PELaunch.java:415)
    Caused by: com.sun.enterprise.connectors.ConnectorRuntimeException: Failed to start resource adapter : MQJMSRA_RA4001: start:Aborting:Exception starting LOCAL broker=MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.(ActiveInboundResourceAdapter.java:148)
    at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.(ActiveJmsResourceAdapter.java:234)
    at com.sun.enterprise.connectors.ActiveRAFactory.createActiveResourceAdapter(ActiveRAFactory.java:107)
    at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:300)
    at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:445)
    at com.sun.enterprise.connectors.ConnectorRuntime.createActiveResourceAdapter(ConnectorRuntime.java:230)
    at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:451)
    ... 9 more
    Caused by: javax.resource.spi.ResourceAdapterInternalException: MQJMSRA_RA4001: start:Aborting:Exception starting LOCAL broker=MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.messaging.jms.ra.LifecycleManagedBroker.start(LifecycleManagedBroker.java:311)
    at com.sun.messaging.jms.ra.ResourceAdapter.start(ResourceAdapter.java:308)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter$1.run(ActiveInboundResourceAdapter.java:180)
    at java.security.AccessController.doPrivileged(Native Method)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.startResourceAdapter(ActiveInboundResourceAdapter.java:174)
    at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.(ActiveInboundResourceAdapter.java:132)
    ... 15 more
    Caused by: java.lang.RuntimeException: MQJMSRA_LB4001: start:Aborted:Unable to ping Broker within 60000 millis (startTimeOut)
    at com.sun.messaging.jms.ra.LocalBrokerRunner.start(LocalBrokerRunner.java:365)
    at com.sun.messaging.jms.ra.LifecycleManagedBroker.start(LifecycleManagedBroker.java:308)
    ... 20 more
    |#]

    [#|2010-01-27T13:05:59.325+0800|SEVERE|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|Server Startup failed. Exiting...|#]

    [#|2010-01-27T13:05:59.325+0800|INFO|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|Server shutdown in progress...|#]

    [#|2010-01-27T13:05:59.340+0800|INFO|sun-appserver2.1|javax.enterprise.system.container.web|_ThreadID=10;_ThreadName=main;Sun GlassFish Enterprise Server v2.1.1;|WEB0303: Stopping Sun GlassFish Enterprise Server v2.1.1|#]

    [#|2010-01-27T13:05:59.340+0800|WARNING|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|CORE5061: Exception :
    com.sun.appserv.server.ServerLifecycleException: WEB0106: An error occurred while stopping the web container
    at com.sun.enterprise.web.PEWebContainer.stopInstance(PEWebContainer.java:826)
    at com.sun.enterprise.web.PEWebContainerLifecycle.onShutdown(PEWebContainerLifecycle.java:100)
    at com.sun.enterprise.server.ApplicationServer.onShutdown(ApplicationServer.java:560)
    at com.sun.enterprise.server.ondemand.OnDemandServer.onShutdown(OnDemandServer.java:145)
    at com.sun.enterprise.server.PEMain.run(PEMain.java:427)
    at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.sun.enterprise.server.PELaunch.main(PELaunch.java:415)
    Caused by: LifecycleException: WEB0103: This web container has not yet been started
    at com.sun.enterprise.web.WebContainer.stop(WebContainer.java:913)
    at com.sun.enterprise.web.PEWebContainer.stopInstance(PEWebContainer.java:818)
    ... 10 more
    |#]

    [#|2010-01-27T13:05:59.341+0800|INFO|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|CORE5051: Shutting down all J2EE applications ...|#]

    [#|2010-01-27T13:05:59.341+0800|INFO|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|CORE5068 : Stopping all J2EE Connector 1.5 Compliant resource adapters ...|#]

    [#|2010-01-27T13:05:59.341+0800|INFO|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|CORE 5061 : Resource adapters Stop() Complete|#]

    [#|2010-01-27T13:05:59.342+0800|INFO|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|CORE5052: Application shutdown complete.|#]

    [#|2010-01-27T13:05:59.342+0800|WARNING|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|CORE5061: Exception :
    java.lang.NullPointerException
    at com.sun.enterprise.util.InvocationManagerImpl.preInvoke(InvocationManagerImpl.java:136)
    at com.sun.appserv.server.ServerLifecycleModule.preInvoke(ServerLifecycleModule.java:178)
    at com.sun.appserv.server.ServerLifecycleModule.postEvent(ServerLifecycleModule.java:219)
    at com.sun.appserv.server.ServerLifecycleModule.onShutdown(ServerLifecycleModule.java:273)
    at com.sun.appserv.server.LifecycleModuleService.onShutdown(LifecycleModuleService.java:487)
    at com.sun.enterprise.server.ApplicationServer.onShutdown(ApplicationServer.java:560)
    at com.sun.enterprise.server.ondemand.OnDemandServer.onShutdown(OnDemandServer.java:145)
    at com.sun.enterprise.server.PEMain.run(PEMain.java:427)
    at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.sun.enterprise.server.PELaunch.main(PELaunch.java:415)
    |#]

    [#|2010-01-27T13:05:59.351+0800|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=10;_ThreadName=main;cluster1;|Leaving GMS group cluster1 with shutdown type set to InstanceShutdown|#]

    [#|2010-01-27T13:05:59.672+0800|WARNING|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|CORE5061: Exception :
    java.lang.NullPointerException
    at com.sun.enterprise.util.InvocationManagerImpl.preInvoke(InvocationManagerImpl.java:136)
    at com.sun.appserv.server.ServerLifecycleModule.preInvoke(ServerLifecycleModule.java:178)
    at com.sun.appserv.server.ServerLifecycleModule.postEvent(ServerLifecycleModule.java:219)
    at com.sun.appserv.server.ServerLifecycleModule.onTermination(ServerLifecycleModule.java:277)
    at com.sun.appserv.server.LifecycleModuleService.onTermination(LifecycleModuleService.java:496)
    at com.sun.enterprise.server.ApplicationServer.onTermination(ApplicationServer.java:598)
    at com.sun.enterprise.server.PEMain.run(PEMain.java:432)
    at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.sun.enterprise.server.PELaunch.main(PELaunch.java:415)
    |#]

    [#|2010-01-27T13:05:59.673+0800|SEVERE|sun-appserver2.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=79123551-f0b2-48cc-8780-da6e3927209d;|Server stopped due to Server startup failure.|#]

    this is my log , i am having problem , i already tried possible ways (hosts file checking, restart everything, network ip checking).

  2. Gurram wrote:

    In addition you may want to delete the persistance directory as well….

    [GLASSFISH_HOME]/nodeagents/[NODEAGENT_NAME]/[AFFECTED_INSTANCENAME]/imq/instances/[CLUSTERNAME_INSTANCENAME]
    E.g. /opt/glassfish-v2.1/nodeagents/domain1-nodeagent1/serverinstance1/imq/instances/asclusterinst1/fs270

    You may wnat to search the directory “fs270″ to find the eact path.

Leave Your Comment

 


Copyright


Yenlo is de ICT dienstverlener in Nederland die volop Sun Glassfish technologie inzet om SOA en ESB projecten te doen slagen.
Voor meer informatie kijk ook op www.yenlo.nl

Glassfish is an official trademark of Sun's solution for Application Servers and SOA/BPEL/ESB middleware.
For more information, please see Sun's official website, http://www.sun.com/software/products/appsrvr