CDH集群目录汇总

最近需要改CDH中组件的一些配置文件,在Cloudera可视化界面就可以改。

但是Java通过Phoenix访问Hbase的时候,需要把Hbase的配置文件拿出来放到项目中。

所以这里把CDH中的一些目录记录一下,不然太多了根本记不住。

1 日志目录

路径 说明
/var/log/cloudera-scm-agent CDH客户端日志
/var/log/cloudera-scm-server CDH服务端日志
/var/log/hadoop-hdfs hadoop日志目录
/var/log/hadoop-mapreduce mapreduce任务目录
/var/log/hadoop-yarn yarn目录
/var/log/zookeeper zookeeper目录
/var/log/kafka kafka目录
/var/log/hbase hbase日志目录
/var/log/hive hive日志目录

1.1 solr日志位置

1
tail -f /var/log/solr/solr-cmf-solr-SOLR_SERVER-...(hostname).log.out

2 配置文件目录

路径 说明
/etc/cloudera-scm-agent/config.ini cm agent的配置目录
/etc/cloudera-scm-server/ cm server的配置目录
/etc/hadoop/conf Hadoop各个组件的配置
/etc/hive/conf hive配置文件目录
/etc/hbase/conf hbase配置文件目录
/opt/cloudera/parcels/CDH/etc hadoop集群以及组件的配置文件文件夹

3 安装各个组件位置

路径 说明
/opt/cloudera/parcels/CDH 各组件安装目录

4 jar包目录

路径 说明
/opt/cloudera/parcels/CDH/jars 所有jar包所在目录
/opt/cloudera/parcels/CDH/lib/ 各个服务组件对应的jar包

5 Parcels包目录

路径 说明
/opt/cloudera/parcel-repo/ 服务软件包数据(parcels)
/opt/cloudera/parcel-cache/ 服务软件包缓存数据

6 服务运行时所有组件的配置文件目录

路径 说明
/var/run/cloudera-scm-agent/process/ 运行时组件配置文件目录

包含文件内容

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
107-cluster-host-inspector
117-cluster-host-inspector
124-cluster-host-inspector
12-host-perf-inspector
131-cluster-host-inspector
138-cluster-host-inspector
145-cluster-host-inspector
152-cluster-host-inspector
159-cluster-host-inspector
166-cluster-host-inspector
173-cluster-host-inspector
180-cluster-host-inspector
187-cluster-host-inspector
194-cluster-host-inspector
19-cluster-host-inspector
201-cluster-host-inspector
208-cluster-host-inspector
215-cluster-host-inspector
222-cluster-host-inspector
229-cluster-host-inspector
236-cluster-host-inspector
243-cluster-host-inspector
250-cluster-host-inspector
257-cluster-host-inspector
264-cluster-host-inspector
26-cluster-host-inspector
271-cluster-host-inspector
278-cluster-host-inspector
285-cluster-host-inspector
292-cluster-host-inspector
299-cluster-host-inspector
306-cluster-host-inspector
313-cluster-host-inspector
320-cluster-host-inspector
327-cluster-host-inspector
334-cluster-host-inspector
33-host-perf-inspector
341-cluster-host-inspector
348-cluster-host-inspector
355-cluster-host-inspector
362-cluster-host-inspector
369-cluster-host-inspector
376-cluster-host-inspector
383-cluster-host-inspector
390-cluster-host-inspector
397-cluster-host-inspector
404-cluster-host-inspector
40-host-perf-inspector
411-cluster-host-inspector
418-cluster-host-inspector
425-cluster-host-inspector
432-cluster-host-inspector
439-cluster-host-inspector
446-cluster-host-inspector
453-cluster-host-inspector
460-cluster-host-inspector
476-cluster-host-inspector
479-cluster-host-inspector
47-host-perf-inspector
484-cluster-host-inspector
491-cluster-host-inspector
499-cluster-host-inspector
500-cluster-host-inspector
520-cluster-host-inspector
521-cluster-host-inspector
523-cluster-host-inspector
526-cluster-host-inspector
537-cluster-host-inspector
540-hdfs-NAMENODE-format
541-cloudera-mgmt-SERVICEMONITOR
542-cloudera-mgmt-EVENTSERVER
543-cloudera-mgmt-ALERTPUBLISHER
544-cloudera-mgmt-HOSTMONITOR
545-hdfs-NAMENODE-format
54-cluster-host-inspector
553-hdfs-NAMENODE
554-hdfs-NAMENODE-nnRpcWait
555-hdfs-NAMENODE-createtmp
556-dfs-create-dir
557-dfs-create-dir
558-dfs-create-dir
559-yarn-RESOURCE-MANAGER-upload-mr-framework-jars
562-yarn-RESOURCEMANAGER
568-cloudera-mgmt-SERVICEMONITOR
569-cloudera-mgmt-EVENTSERVER
570-cloudera-mgmt-ALERTPUBLISHER
571-cloudera-mgmt-HOSTMONITOR
579-hdfs-NAMENODE
580-hdfs-NAMENODE-nnRpcWait
584-yarn-RESOURCEMANAGER
596-hdfs-NAMENODE
597-hdfs-NAMENODE-nnRpcWait
601-yarn-RESOURCEMANAGER
613-hdfs-NAMENODE
614-hdfs-NAMENODE-nnRpcWait
618-yarn-RESOURCEMANAGER
61-cluster-host-inspector
623-cloudera-mgmt-SERVICEMONITOR
624-cloudera-mgmt-EVENTSERVER
625-cloudera-mgmt-ALERTPUBLISHER
626-cloudera-mgmt-HOSTMONITOR
627-cloudera-mgmt-SERVICEMONITOR
628-cloudera-mgmt-EVENTSERVER
629-cloudera-mgmt-ALERTPUBLISHER
630-cloudera-mgmt-HOSTMONITOR
666-cloudera-mgmt-SERVICEMONITOR
667-cloudera-mgmt-EVENTSERVER
668-cloudera-mgmt-ALERTPUBLISHER
669-cloudera-mgmt-HOSTMONITOR
673-collect-host-statistics
682-host-inspector
6-host-inspector
85-cluster-host-inspector
ccdeploy_hadoop-conf_etchadoopconf.cloudera.hdfs_5818835745948542271
ccdeploy_hadoop-conf_etchadoopconf.cloudera.hdfs_6752681924895224861
ccdeploy_hadoop-conf_etchadoopconf.cloudera.yarn_6904562266639177485
ccdeploy_hadoop-conf_etchadoopconf.cloudera.yarn_8922238058878386299

7 CDH集群相常用命令

7.1 操作CM

命令 说明
systemctl start cloudera-scm-server 启动cm
systemctl restart cloudera-scm-server 重启cm
systemctl stop cloudera-scm-server 停止CM

7.2 查看日志

1
2
tail -f /var/log/kafka/kafka-broker-cdh1.log
tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

7.3 开启应用目录

1
/opt/cloudera/parcels/CDH/bin

7.4 查看组件版本号

8 躺板板

红伞伞白杆杆,吃完一起躺板板

躺板板埋山山,亲朋都来吃饭饭

饭饭里有红伞伞,吃完全村埋山山,来年长满红伞伞

联系博主,加入【羊山丨交流社区】

联系博主


本博客所有文章除特别声明外,均为原创。版权归博主小马所有。任何团体、机构、媒体、网站、公众号及个人不得转载。如需转载,请联系博主(关于页面)。如其他团体、机构、媒体、网站、博客或个人未经博主允许擅自转载使用,请自负版权等法律责任!