最近需要改CDH中组件的一些配置文件，在Cloudera可视化界面就可以改。
但是Java通过Phoenix访问Hbase的时候，需要把Hbase的配置文件拿出来放到项目中。
所以这里把CDH中的一些目录记录一下，不然太多了根本记不住。
关注博主不迷路，获取更多干货资源
1 日志目录
| 路径 |
说明 |
| /var/log/cloudera-scm-agent |
CDH客户端日志 |
| /var/log/cloudera-scm-server |
CDH服务端日志 |
| /var/log/hadoop-hdfs |
hadoop日志目录 |
| /var/log/hadoop-mapreduce |
mapreduce任务目录 |
| /var/log/hadoop-yarn |
yarn目录 |
| /var/log/zookeeper |
zookeeper目录 |
| /var/log/kafka |
kafka目录 |
| /var/log/hbase |
hbase日志目录 |
| /var/log/hive |
hive日志目录 |
1.1 solr日志位置
| tail -f /var/log/solr/solr-cmf-solr-SOLR_SERVER-...(hostname).log.out
|
2 配置文件目录
| 路径 |
说明 |
| /etc/cloudera-scm-agent/config.ini |
cm agent的配置目录 |
| /etc/cloudera-scm-server/ |
cm server的配置目录 |
| /etc/hadoop/conf |
Hadoop各个组件的配置 |
| /etc/hive/conf |
hive配置文件目录 |
| /etc/hbase/conf |
hbase配置文件目录 |
| /opt/cloudera/parcels/CDH/etc |
hadoop集群以及组件的配置文件文件夹 |
3 安装各个组件位置
| 路径 |
说明 |
| /opt/cloudera/parcels/CDH |
各组件安装目录 |
4 jar包目录
| 路径 |
说明 |
| /opt/cloudera/parcels/CDH/jars |
所有jar包所在目录 |
| /opt/cloudera/parcels/CDH/lib/ |
各个服务组件对应的jar包 |
5 Parcels包目录
| 路径 |
说明 |
| /opt/cloudera/parcel-repo/ |
服务软件包数据(parcels) |
| /opt/cloudera/parcel-cache/ |
服务软件包缓存数据 |
6 服务运行时所有组件的配置文件目录
| 路径 |
说明 |
| /var/run/cloudera-scm-agent/process/ |
运行时组件配置文件目录 |
包含文件内容
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
| 107-cluster-host-inspector
117-cluster-host-inspector
124-cluster-host-inspector
12-host-perf-inspector
131-cluster-host-inspector
138-cluster-host-inspector
145-cluster-host-inspector
152-cluster-host-inspector
159-cluster-host-inspector
166-cluster-host-inspector
173-cluster-host-inspector
180-cluster-host-inspector
187-cluster-host-inspector
194-cluster-host-inspector
19-cluster-host-inspector
201-cluster-host-inspector
208-cluster-host-inspector
215-cluster-host-inspector
222-cluster-host-inspector
229-cluster-host-inspector
236-cluster-host-inspector
243-cluster-host-inspector
250-cluster-host-inspector
257-cluster-host-inspector
264-cluster-host-inspector
26-cluster-host-inspector
271-cluster-host-inspector
278-cluster-host-inspector
285-cluster-host-inspector
292-cluster-host-inspector
299-cluster-host-inspector
306-cluster-host-inspector
313-cluster-host-inspector
320-cluster-host-inspector
327-cluster-host-inspector
334-cluster-host-inspector
33-host-perf-inspector
341-cluster-host-inspector
348-cluster-host-inspector
355-cluster-host-inspector
362-cluster-host-inspector
369-cluster-host-inspector
376-cluster-host-inspector
383-cluster-host-inspector
390-cluster-host-inspector
397-cluster-host-inspector
404-cluster-host-inspector
40-host-perf-inspector
411-cluster-host-inspector
418-cluster-host-inspector
425-cluster-host-inspector
432-cluster-host-inspector
439-cluster-host-inspector
446-cluster-host-inspector
453-cluster-host-inspector
460-cluster-host-inspector
476-cluster-host-inspector
479-cluster-host-inspector
47-host-perf-inspector
484-cluster-host-inspector
491-cluster-host-inspector
499-cluster-host-inspector
500-cluster-host-inspector
520-cluster-host-inspector
521-cluster-host-inspector
523-cluster-host-inspector
526-cluster-host-inspector
537-cluster-host-inspector
540-hdfs-NAMENODE-format
541-cloudera-mgmt-SERVICEMONITOR
542-cloudera-mgmt-EVENTSERVER
543-cloudera-mgmt-ALERTPUBLISHER
544-cloudera-mgmt-HOSTMONITOR
545-hdfs-NAMENODE-format
54-cluster-host-inspector
553-hdfs-NAMENODE
554-hdfs-NAMENODE-nnRpcWait
555-hdfs-NAMENODE-createtmp
556-dfs-create-dir
557-dfs-create-dir
558-dfs-create-dir
559-yarn-RESOURCE-MANAGER-upload-mr-framework-jars
562-yarn-RESOURCEMANAGER
568-cloudera-mgmt-SERVICEMONITOR
569-cloudera-mgmt-EVENTSERVER
570-cloudera-mgmt-ALERTPUBLISHER
571-cloudera-mgmt-HOSTMONITOR
579-hdfs-NAMENODE
580-hdfs-NAMENODE-nnRpcWait
584-yarn-RESOURCEMANAGER
596-hdfs-NAMENODE
597-hdfs-NAMENODE-nnRpcWait
601-yarn-RESOURCEMANAGER
613-hdfs-NAMENODE
614-hdfs-NAMENODE-nnRpcWait
618-yarn-RESOURCEMANAGER
61-cluster-host-inspector
623-cloudera-mgmt-SERVICEMONITOR
624-cloudera-mgmt-EVENTSERVER
625-cloudera-mgmt-ALERTPUBLISHER
626-cloudera-mgmt-HOSTMONITOR
627-cloudera-mgmt-SERVICEMONITOR
628-cloudera-mgmt-EVENTSERVER
629-cloudera-mgmt-ALERTPUBLISHER
630-cloudera-mgmt-HOSTMONITOR
666-cloudera-mgmt-SERVICEMONITOR
667-cloudera-mgmt-EVENTSERVER
668-cloudera-mgmt-ALERTPUBLISHER
669-cloudera-mgmt-HOSTMONITOR
673-collect-host-statistics
682-host-inspector
6-host-inspector
85-cluster-host-inspector
ccdeploy_hadoop-conf_etchadoopconf.cloudera.hdfs_5818835745948542271
ccdeploy_hadoop-conf_etchadoopconf.cloudera.hdfs_6752681924895224861
ccdeploy_hadoop-conf_etchadoopconf.cloudera.yarn_6904562266639177485
ccdeploy_hadoop-conf_etchadoopconf.cloudera.yarn_8922238058878386299
|
7 CDH集群相常用命令
7.1 操作CM
| 命令 |
说明 |
| systemctl start cloudera-scm-server |
启动cm |
| systemctl restart cloudera-scm-server |
重启cm |
| systemctl stop cloudera-scm-server |
停止CM |
7.2 查看日志
| tail -f /var/log/kafka/kafka-broker-cdh1.log
tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log
|
7.3 开启应用目录
| /opt/cloudera/parcels/CDH/bin
|
7.4 查看组件版本号
8 躺板板
红伞伞白杆杆，吃完一起躺板板
躺板板埋山山，亲朋都来吃饭饭
饭饭里有红伞伞，吃完全村埋山山，来年长满红伞伞
关注博主不迷路