我正在学习Hadoop,现在我遇到了一个问题,当单节点设置。我想在网页上看到JobHistory,但是在我点击日志之后,我只能看到000001“,我不知道如何解决它。
以下是我的配置:
mapred-size.xml
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapreduce.jobhistory.address</name>
<value>hadoop000:10020</value>
<description>MapReduce JobHistory Server IPC host:port</description>
</property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>hadoop000:19888</value>
<description>MapReduce JobHistory Server Web UI host:port</description>
</property>
<property>
<name>mapreduce.jobhistory.done-dir</name>
<value>/history/done</value>
</property>
<property>
<name>mapreduce.jobhistory.intermediate-done-dir</name>
<value>/history/done_intermediate</value>
</property>
yarn-site.xml
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.log-aggregation-enable</name>
<value>true</value>
</property>
<property>
<name>yarn.log.server.url</name>
<value>hadoop000:19888/jobhistory/logs/</value>
</property>
原谅我糟糕的英语,谢谢!
发布于 2018-11-06 10:12:11
为了在WebApp中看到来自Hadoop作业的日志,除了启用聚合日志之外,还需要启动JobHistory守护进程。
尝试:
$ ./sbin/mr-jobhistory-daemon.sh # OR mr-job-history-daemon.sh $ stop-yarn.sh && start-yarn.sh
https://stackoverflow.com/questions/53143152
复制相似问题