分享知识,分享快乐

0%

clickhouse之HDFS云存储

clickhouse之HDFS云存储

参考: https://blog.csdn.net/weixin_40104766/article/details/120029525

按照官方文档说明,在config.xml文件中添加如下配置:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
<storage_configuration>
<disks>
<diskname>
<type>hdfs</type>
<endpoint>hdfs://10.0.19.241:8020/ckdata/</endpoint>
</diskname>
</disks>
<policies>
<hdfs>
<volumes>
<volumename>
<disk>diskname</disk>
</volumename>
</volumes>
</hdfs>
</policies>
</storage_configuration>

配置完成后,重启clickhouse-server服务,验证是否生效:

1.通过system.storage_policies表查看存储策略是否OK

select * from system.storage_policies;

2.通过settings参数指定storage_policy为我们配置好的hdfs,建表语句如下:

1
create table test_data engine=MergeTree order by id settings storage_policy='hdfs' as with (select ['A','a','A','A','B','B','B','B','B','A','59','90','80','85','90','929','80','72','90','123']) AS dict select dict[number%10 + 1] as id,dict[number + 11] as val from system.numbers limit 10;