데이터/ν•˜λ‘‘

[CM] Yarn Node Manager μΆ”κ°€ μ‹œ ava.lang.IllegalArgumentException: java.net.UnknownHostException: HOSTNAME

•8• 2022. 5. 13. 15:02

yarn 에 λ“€μ–΄κ°€μžˆλŠ” μ–΄ν”Œλ¦¬μΌ€μ΄μ…˜μ΄ ν•˜λ‚˜λ„ μ•ˆλŒκ³  λŒ€κΈ°μ€‘μ΄μ–΄μ„œ Resorce Manager μ—­ν•  둜그λ₯Ό λ΄€λ”λ‹ˆ μ•„λž˜μ™€ 같은 μ—λŸ¬λ©”μ‹œμ§€ 확인..

Error trying to assign container token and NM token to an updated container CONTAINER_NAME
java.lang.IllegalArgumentException: java.net.UnknownHostException: HOST_NAME
at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:445)
at org.apache.hadoop.yarn.server.utils.BuilderUtils.newContainerToken(BuilderUtils.java:310)
at org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager.createContainerToken(RMContainerTokenSecretManager.java:256)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt.updateContainerAndNMToken(SchedulerApplicationAttempt.java:651)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt.pullNewlyAllocatedContainers(SchedulerApplicationAttempt.java:729)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:942)
at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:1141)
at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:1133)
at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46)
at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487)
at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:908)
at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:116)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:969)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:950)
at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197)
at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126)
at java.lang.Thread.run(Thread.java:748)

μ„œλ²„λ₯Ό μΆ”κ°€ν–ˆλŠ”λ° μ € HOST_NAME 을 λͺ»μ°Ύκ² λ‹€λŠ” κ±°μ˜€λ‹€.

Resource manager 역할을 ν•˜λŠ” μ„œλ²„μ˜ ν˜ΈμŠ€νŠΈνŒŒμΌμ— μΆ”κ°€ν•œ NM μ„œλ²„ 정보 등둝 ν›„ ν•΄κ²°ν–ˆμŒ