Groups > Weblogic > WebLogic Performance > Admin Server won't start




Admin Server won't start

Admin Server won't start
Tue, 8 Jan 2008 23:14:33 -0800
Hi, 
I got this problem where the administration server won't restart after i killed
the process. I got this as the startup script output:

.
.
JAVA Memory arguments: -Xms1024m -Xmx1024m  -XX:MaxPermSize=256m
.
WLS Start Mode=Production
.
CLASSPATH=:/apps/bea/patch_weblogic922/profiles/default/sys_manifest_classpath/w
eblogic_patch.jar:
/apps/bea/jdk150_10/lib/tools.jar:/apps/bea/weblogic92/server/lib/weblogic_sp.ja
r:/apps/bea/weblogic92/server/lib/weblogic.jar:
/apps/bea/weblogic92/server/lib/webservices.jar::/apps/bea/weblogic92/common/eva
l/pointbase/lib/pbclient51.jar:
/apps/bea/weblogic92/server/lib/xqrl.jar::/apps/PRISMA/bin/lib/spiparser.jar:/ap
ps/PRISMA/bin/lib/q3clientSR12.jar
.
PATH=/apps/bea/weblogic92/server/bin:/apps/bea/jdk150_10/jre/bin:/apps/bea/jdk15
0_10/bin:/apps/bea/weblogic92/server/bin:/apps/bea/jdk150_10/jre/bin:
/apps/bea/jdk150_10/bin:/opt/csw/bin:/opt/csw/sbin:/opt/SUNWppro/bin:/usr/sadm/b
in:/usr/sfw/bin:/usr/sfw/sbin:/opt/sfw/bin:/opt/sfw/sbin:/usr/local/bin:/usr/ccs
/bin:
/sbin:/usr/bin:/usr/sbin:/usr/openwin/bin:/usr/dt/bin:/etc:/usr/ucb:/export/home
/prisma/bin:.
.
***************************************************
*  To start WebLogic Server, use a username and   *
*  password assigned to an admin-level user.  For *
*  server administration, use the WebLogic Server *
*  console at http://hostname:port/console        *
***************************************************
starting weblogic with Java version:
java version "1.5.0_10"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_10-b03)
Java HotSpot(TM) Server VM (build 1.5.0_10-b03, mixed mode)
Starting WLS with line:
/apps/bea/jdk150_10/bin/java -server   -Xms1024m -Xmx1024m  -XX:MaxPermSize=256m
 -Dcom.sun.xml.namespace.QName.useCompatibleSerialVersionUID=1.0  -da
-Dplatform.home=/apps/bea/weblogic92 
-Dwls.home=/apps/bea/weblogic92/server
-Dwli.home=/apps/bea/weblogic92/integration  -Dweblogic.management.discover=true
 -Dwlw.iterativeDev=false -Dwlw.testConsole=false 
-Dwlw.logErrorsToConsole=
-Dweblogic.ext.dirs=/apps/bea/patch_weblogic922/profiles/default/sysext_manifest
_classpath -Dweblogic.security.SSL.ignoreHostnameVerification=true
-Dweblogic.Name=prismaAdminServer 
-Djava.security.policy=/apps/bea/weblogic92/server/lib/weblogic.policy  
weblogic.Server
<Jan 9, 2008 12:59:25 PM WIT> <Notice> <WebLogicServer>
<BEA-000395> <Following extensions directory contents added to the end
of the classpath:
/apps/bea/weblogic92/platform/lib/p13n/p13n-schemas.jar:/apps/bea/weblogic92/pla
tform/lib/p13n/p13n_common.jar:
/apps/bea/weblogic92/platform/lib/p13n/p13n_system.jar:/apps/bea/weblogic92/plat
form/lib/wlp/commerce_system.jar:
/apps/bea/weblogic92/platform/lib/wlp/content_system.jar:/apps/bea/weblogic92/pl
atform/lib/wlp/groupspace_system.jar:
/apps/bea/weblogic92/platform/lib/wlp/netuix_common.jar:/apps/bea/weblogic92/pla
tform/lib/wlp/netuix_schemas.jar:/apps/bea/weblogic92/platform/lib/wlp/netuix_sy
stem-full.jar:
/apps/bea/weblogic92/platform/lib/wlp/netuix_system.jar:/apps/bea/weblogic92/pla
tform/lib/wlp/nf-jspcmods.jar:/apps/bea/weblogic92/platform/lib/wlp/nf-system.ja
r:
/apps/bea/weblogic92/platform/lib/wlp/wlp-schemas.jar:/apps/bea/weblogic92/platf
orm/lib/wlp/wps_system.jar:/apps/bea/weblogic92/platform/lib/wlp/wsrp-client.jar
:
/apps/bea/weblogic92/platform/lib/wlp/wsrp-common.jar> 
<Jan 9, 2008 12:59:27 PM WIT> <Info> <WebLogicServer>
<BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) Server VM
Version 1.5.0_10-b03 from Sun Microsystems Inc.> 
<Jan 9, 2008 12:59:33 PM WIT> <Info> <Management>
<BEA-141107> <Version: WebLogic Server 9.2 MP2  Mon Jun 25 01:32:01 EDT
2007 952826 > 
<Jan 9, 2008 1:00:03 PM WIT> <Info> <WebLogicServer>
<BEA-000215> <Loaded License : /apps/bea/license.bea> 
<Jan 9, 2008 1:00:03 PM WIT> <Notice> <WebLogicServer>
<BEA-000365> <Server state changed to STARTING> 
<Jan 9, 2008 1:00:03 PM WIT> <Info> <WorkManager>
<BEA-002900> <Initializing self-tuning thread pool> 
<Jan 9, 2008 1:00:04 PM WIT> <Notice> <Log Management>
<BEA-170019> <The server log file
/apps/bea/user_projects/domains/prismaDomain/servers/prismaAdminServer/logs/pris
maAdminServer.log is opened. All server side log events will be written to this
file.> 




There is no error message so i'm confused as to where to look for the reasn why
is it stuck after printing the last line, keeping the server at 'STARTING'
state.

in the domain log there's this:

####<Jan 9, 2008 11:10:26 AM WIT> <Notice> <Security>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199851826849> <BEA-090082> <Security
initializing using security realm myrealm.> 
####<Jan 9, 2008 11:10:40 AM WIT> <Notice> <WebLogicServer>
<arspapp2> <prismaAdminServer> <main> <<WLS
Kernel>> <> <> <1199851840721> <BEA-000365>
<Server state changed to STANDBY> 
####<Jan 9, 2008 11:10:40 AM WIT> <Notice> <WebLogicServer>
<arspapp2> <prismaAdminServer> <main> <<WLS
Kernel>> <> <> <1199851840725> <BEA-000365>
<Server state changed to STARTING> 
####<Jan 9, 2008 11:10:44 AM WIT> <Error> <EmbeddedLDAP>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199851844407> <000000> <Error writing
'cn=urn@Lbea@Lxacml@L2.0@Lentitlement@Lresource@Ltype@AE@AFurl@AG@AM@AOapplicati
on
@AEconsoleapp@AM@AOcontextPath@AE@AUconsole@AM@AOuri@AE@AU+xacmlVersion=1.0,
ou=Policies,ou=XACMLAuthorization,ou=myrealm,dc=prismaDomain' MODIFY to
Transaction Log: No space left on device> 
####<Jan 9, 2008 11:10:44 AM WIT> <Error> <Security>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199851844413> <BEA-090064> <The
DeployableAuthorizer
"myrealm_weblogic.security.providers.xacml.authorization.XACMLAuthorization
ProviderImpl" returned an error:
weblogic.security.spi.ResourceCreationException: [Security:090310]Failed to
create resource.> 
####<Jan 9, 2008 11:10:44 AM WIT> <Error> <HTTP>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199851844418> <BEA-101199> <Could not deploy
policy for resource: type=<url>, application=consoleapp,
contextPath=/console, uri=/.
weblogic.security.service.ResourceCreationException:
weblogic.security.spi.ResourceCreationException: [Security:090310]Failed to
create resource
	at
weblogic.security.service.internal.PolicyDeploymentServiceImpl$DeploymentHandler
Impl.deployPolicy(PolicyDeploymentServiceImpl.java:178)
	at
weblogic.security.service.AuthorizationManager.deployPolicy(AuthorizationManager
.java:656)
	at
weblogic.servlet.security.internal.ResourceConstraint.deploy(ResourceConstraint.
java:108)
	at
weblogic.servlet.security.internal.WebAppSecurityWLS.deployPolicies(WebAppSecuri
tyWLS.java:252)
	at
weblogic.servlet.security.internal.WebAppSecurity.registerSecurityConstraints(We
bAppSecurity.java:132)
	at
weblogic.servlet.internal.WebAppServletContext.prepareFromDescriptors(WebAppServ
letContext.java:1098)
	at
weblogic.servlet.internal.WebAppServletContext.prepare(WebAppServletContext.java
:1030)
	at weblogic.servlet.internal.HttpServer.doPostContextInit(HttpServer.java:437)
	at weblogic.servlet.internal.HttpServer.loadWebApp(HttpServer.java:412)
	at
weblogic.servlet.internal.WebAppModule.registerWebApp(WebAppModule.java:549)
	at weblogic.servlet.internal.WebAppModule.prepare(WebAppModule.java:284)
	at
weblogic.application.internal.flow.ScopedModuleDriver.prepare(ScopedModuleDriver
.java:176)
	at
weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerI
nvoker.java:93)
	at
weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallb
ackFlow.java:360)
	at
weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:
26)
	at
weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCall
backFlow.java:56)
	at
weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCall
backFlow.java:46)
	at
weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:615)
	at
weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:
26)
	at
weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:191)
	at
weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChec
ker.java:147)
	at
weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerIn
voker.java:61)
	at
weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:1
37)
	at
weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdap
ter.java:38)
	at
weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.
java:177)
	at weblogic.managem

as can be seen the last input was on 11am, which was the first failed attempt on
restarting the server. Why does the next attempts result on a write to this log,
does anyone know? Also, it stated that there's No space left on device, but when
i checked the disk was not full.

last, this was in the server log

####<Jan 9, 2008 12:59:25 PM WIT> <Notice> <WebLogicServer>
<> <> <main> <> <> <> <1199858365940>
<BEA-000395> <Following extensions directory contents added to the end
of the classpath:
/apps/bea/weblogic92/platform/lib/p13n/p13n-schemas.jar:/apps/bea/weblogic92/pla
tform/lib/p13n/p13n_common.jar:
/apps/bea/weblogic92/platform/lib/p13n/p13n_system.jar:/apps/bea/weblogic92/plat
form/lib/wlp/commerce_system.jar:
/apps/bea/weblogic92/platform/lib/wlp/content_system.jar:/apps/bea/weblogic92/pl
atform/lib/wlp/groupspace_system.jar:
/apps/bea/weblogic92/platform/lib/wlp/netuix_common.jar:/apps/bea/weblogic92/pla
tform/lib/wlp/netuix_schemas.jar:
/apps/bea/weblogic92/platform/lib/wlp/netuix_system-full.jar:/apps/bea/weblogic9
2/platform/lib/wlp/netuix_system.jar:
/apps/bea/weblogic92/platform/lib/wlp/nf-jspcmods.jar:/apps/bea/weblogic92/platf
orm/lib/wlp/nf-system.jar:/apps/bea/weblogic92/platform/lib/wlp/wlp-schemas.jar:

/apps/bea/weblogic92/platform/lib/wlp/wps_system.jar:/apps/bea/weblogic92/platfo
rm/lib/wlp/wsrp-client.jar:/apps/bea/weblogic92/platform/lib/wlp/wsrp-common.jar
> 
####<Jan 9, 2008 12:59:27 PM WIT> <Info> <WebLogicServer>
<> <> <main> <> <> <> <1199858367505>
<BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) Server VM
Version 1.5.0_10-b03 from Sun Microsystems Inc.> 
####<Jan 9, 2008 12:59:33 PM WIT> <Info> <Management> <>
<> <main> <> <> <> <1199858373300>
<BEA-141107> <Version: WebLogic Server 9.2 MP2  Mon Jun 25 01:32:01 EDT
2007 952826 > 
####<Jan 9, 2008 1:00:03 PM WIT> <Info> <WebLogicServer>
<> <> <main> <> <> <> <1199858403179>
<BEA-000215> <Loaded License : /apps/bea/license.bea> 
####<Jan 9, 2008 1:00:03 PM WIT> <Notice> <WebLogicServer>
<> <> <main> <> <> <> <1199858403233>
<BEA-000365> <Server state changed to STARTING> 
####<Jan 9, 2008 1:00:03 PM WIT> <Info> <WorkManager> <>
<> <main> <> <> <> <1199858403282>
<BEA-002900> <Initializing self-tuning thread pool> 
####<Jan 9, 2008 1:00:03 PM WIT> <Info> <WebLogicServer>
<> <> <main> <> <> <> <1199858403613>
<BEA-000214> <WebLogic Server "prismaAdminServer" version:
WebLogic Server 9.2 MP2  Mon Jun 25 01:32:01 EDT 2007 952826  (c) 1995, 1996,
1997, 1998 WebLogic, Inc.
 (c) 1999, 2000, 2001 BEA Systems, Inc.> 
####<Jan 9, 2008 1:00:04 PM WIT> <Info> <Diagnostics>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858404532> <BEA-320001> <The ServerDebug
service initialized successfully.> 
####<Jan 9, 2008 1:00:04 PM WIT> <Info> <Store>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858404856> <BEA-280050> <Persistent store
"WLS_DIAGNOSTICS" opened:
directory="/apps/bea/user_projects/domains/prismaDomain/servers/prismaAdmin
Server/data/store/diagnostics" writePolicy="Disabled"
blockSize=512 directIO=false driver="wlfileio2"> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406368> <BEA-002622> <The protocol
"t3" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406378> <BEA-002622> <The protocol
"t3s" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406379> <BEA-002622> <The protocol
"http" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406380> <BEA-002622> <The protocol
"https" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406384> <BEA-002622> <The protocol
"iiop" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406389> <BEA-002622> <The protocol
"iiops" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406393> <BEA-002622> <The protocol
"ldap" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406396> <BEA-002622> <The protocol
"ldaps" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406402> <BEA-002622> <The protocol
"admin" is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406403> <BEA-002624> <The
administration protocol is "t3s" and is now configured.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <RJVM>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406470> <BEA-000570> <Network
Configuration for Channel "prismaAdminServer"
 Listen Address		 10.2.248.19:7009
 Public Address		 N/A
 Http Enabled		 true
 Tunneling Enabled	 false
 Outbound Enabled	 false
 Admin Traffic Enabled	 true> 
####<Jan 9, 2008 1:00:06 PM WIT> <Debug> <RJVM>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406479> <BEA-000571> <Network
Configuration Detail for Channel "prismaAdminServer"
 Channel Weight		 50
 Accept Backlog		 50
 Login Timeout		 5000ms
 Max Message Size	 10000000
 Message Timeout	 60s
 Idle Timeout		 65s
 Tunneling Timeout	 40s
 Tunneling Ping		 45s> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Server>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406618> <BEA-002609> <Channel Service
initialized.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Socket>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406682> <BEA-000416> <Using effective
file descriptor limit of: 65,536 open sockets/files.> 
####<Jan 9, 2008 1:00:06 PM WIT> <Info> <Socket>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858406692> <BEA-000406>
<DevPollSocketMuxer was built on Feb  9 2007 10:44:35> 
####<Jan 9, 2008 1:00:07 PM WIT> <Info> <Socket>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858407047> <BEA-000436> <Allocating 33
reader threads.> 
####<Jan 9, 2008 1:00:07 PM WIT> <Info> <Socket>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858407055> <BEA-000446> <Native IO
Enabled.> 
####<Jan 9, 2008 1:00:07 PM WIT> <Info> <IIOP>
<arspapp2> <prismaAdminServer> <[ACTIVE] ExecuteThread: '0' for
queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>>
<> <> <1199858407704> <BEA-002014> <IIOP subsystem
enabled.> 

Was there something corrupted when i killed the admin server process? If so, how
can i repair it, do i have to, say, reinstall the domain? The reason why i
wanted to restart the admin server in the first place was because the console is
not responding / loading.

Post Reply
about | contact