๐Ÿฅ

[CM] Yarn Node Manager ์ถ”๊ฐ€ ์‹œ ava.lang.IllegalArgumentException: java.net.UnknownHostException: HOSTNAME ๋ณธ๋ฌธ

๋ฐ์ดํ„ฐ/ํ•˜๋‘ก

[CM] Yarn Node Manager ์ถ”๊ฐ€ ์‹œ ava.lang.IllegalArgumentException: java.net.UnknownHostException: HOSTNAME

•8• 2022. 5. 13. 15:02

yarn ์— ๋“ค์–ด๊ฐ€์žˆ๋Š” ์–ดํ”Œ๋ฆฌ์ผ€์ด์…˜์ด ํ•˜๋‚˜๋„ ์•ˆ๋Œ๊ณ  ๋Œ€๊ธฐ์ค‘์ด์–ด์„œ Resorce Manager ์—ญํ•  ๋กœ๊ทธ๋ฅผ ๋ดค๋”๋‹ˆ ์•„๋ž˜์™€ ๊ฐ™์€ ์—๋Ÿฌ๋ฉ”์‹œ์ง€ ํ™•์ธ..

Error trying to assign container token and NM token to an updated container CONTAINER_NAME
java.lang.IllegalArgumentException: java.net.UnknownHostException: HOST_NAME
at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:445)
at org.apache.hadoop.yarn.server.utils.BuilderUtils.newContainerToken(BuilderUtils.java:310)
at org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager.createContainerToken(RMContainerTokenSecretManager.java:256)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt.updateContainerAndNMToken(SchedulerApplicationAttempt.java:651)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt.pullNewlyAllocatedContainers(SchedulerApplicationAttempt.java:729)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:942)
at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:1141)
at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AMContainerAllocatedTransition.transition(RMAppAttemptImpl.java:1133)
at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46)
at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487)
at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:908)
at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.handle(RMAppAttemptImpl.java:116)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:969)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher.handle(ResourceManager.java:950)
at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197)
at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126)
at java.lang.Thread.run(Thread.java:748)

์„œ๋ฒ„๋ฅผ ์ถ”๊ฐ€ํ–ˆ๋Š”๋ฐ ์ € HOST_NAME ์„ ๋ชป์ฐพ๊ฒ ๋‹ค๋Š” ๊ฑฐ์˜€๋‹ค.

Resource manager ์—ญํ• ์„ ํ•˜๋Š” ์„œ๋ฒ„์˜ ํ˜ธ์ŠคํŠธํŒŒ์ผ์— ์ถ”๊ฐ€ํ•œ NM ์„œ๋ฒ„ ์ •๋ณด ๋“ฑ๋ก ํ›„ ํ•ด๊ฒฐํ–ˆ์Œ