第3章HBase环境搭建 Ver1.7-20230514

Imagemap
第3章HBase环境搭建 Ver1.7-20230514学习视频概述环境与版本配套关系Zookeeper安装安装&配置&测试Zookeeper视频HBase安装HBase下载与安装HBase配置与运行解决initializing视频http://master:16030持续出现initializing时才需要处 ...概述HBase的运行依赖于Hadoop HDFS文件系统提供数据的持久化，依赖Zoo ...HBase使用Zookeeper服务来进行节点管理以及表数据的定位HBase的基本组成结构HBase集群主要角色HBase Master(对应HMaster)Master是HBase集群的主控服务器； Master可有多个，但只要一个活跃 ...HBase Region ServerRegion Server是HBase具体对外提供服务的进程软件配套参考JavaHBase 2.0-2.2 -》JDK 8HBase 2.3+ -》 JDK 8 ，JDK 11ulimit sudo vi /etc/security/limits.confhadoop - nofile 32768 hadoop - ...sudo vi /etc/pam.d/common-sessionsession required pam_limits.soHadoopHadoop-3.3.x => HBase-2.3.x? & HBase-2.4.x=> Hadoop-2.10.x=> Hadoop-3.1.1+ Hadoop-3.2.x=>HBase2.3.xHadoop-3.1.1+=>HBase-2.1.x & HBase-2.2.x & HBase-2.3. ...Hadoop-2.8.5+=>HBase-2.0.x & HBase-2.1.x & HBase-2.2 ...ZooKeeper下载最新的稳定版本Apache ZooKeeper 3.7.1 (latest stable re ...其它ssh & DNS & NTP & ulimit测试环境环境一192.168.31.21 master192.168.31.22 c22192.168.31.23 c23192.168.31.24 c24环境二192.168.137.100 master192.168.137.101 slave1192.168.137.102 slave2安装参考HBase安装参考URLZookeeper安装参考URLZookeeper安装软件安装Zookeeper下载https://zookeeper.apache.org/https://zookeeper.apache.org/releases.ht ...wget -c https://dlcdn.apache.org/zookeep ...wget -c https://mirrors.aliyun.com/apac ...Zookeeper安装包解压tar -xzvf ./apache-zookeeper-3.7.1-bin.t ...Zookeeper目录转移sudo mv ./apache-zookeeper-3.7.1-bin /us ...Zookeeper配置配置zoo.cfgmkdir -p /home/hadoop/zookeeper/datacd /usr/local/zookeeper/conf cp ./zoo_sa ...修改/etc/profilesudo vi /etc/profileexport ZOOKEEPER_HOME=/usr/local/zookeep ...source /etc/profile复制hbase到从机在所有从机上创建目录： useradd hadoop -G users pass ...sudo scp -r /usr/local/zookeeper/ hado ...复制/etc/profile到从机 scp /etc/profile c22:/etc/ scp /etc/ ...然后到各从机使用生效配置: source /etc/profile写入文件myidmkdir -p /home/hadoop/zookeeper/data/ ch ...master机mkdir -p /home/hadoop/zookeeper/data/ ch ...c22机mkdir -p /home/hadoop/zookeeper/data/ ch ...c23机zookeeper运行在每台主机和从机都启动cd /usr/local/zookeeper/bin ./zkServer.s ...或在master主机批量启停从机.批量启动ZooKeeper节点cd /usr/local/zookeeper/bin vi ./zkstart ...#!/bin/bash echo “starting ZooKeeper clu ...chmod 755 ./zkstart-all.sh批量停止ZooKeeper节点cd /usr/local/zookeeper/bin vi ./zkstop- ...#!/bin/bash echo “starting ZooKeeper clu ...chmod 755 ./zkstop-all.sh 主从机上都可运行停止停止zk节点： cd /usr/local/zookeeper/bin ./zk ...主从机上都可以查询查看zk节点状态，#集群中只有一个leader其余节点为follower cd ...检查进程ps查询主从机进程会多出Dzookeeper的进程 ps aux |grep D ...jps查询master主机多出QuorumPeerMain进程 [root@ma ...截图jps查询从机有多出QuorumPeerMain进程 2386 QuorumPe ...截图一截图二zookeeper客户端参考cd /usr/local/zookeeper/bin ./zkCli.sh - ...结果截图命令使用help如图ls /create /zk_test my_dataget /zk_testset /zk_test junkdelete /zk_testquit退出HBase安装软件安装HBase下载解压 目录转移地址参考https://hbase.apache.org/https://www.apache.org/dyn/closer.lua/hb ...选择一种wget -c https://dlcdn.apache.org/hbase/2 ...wget -c wget -c https://mirrors.aliyun.c ...HBase配置完全分布式 HBase/etc/profilevi /etc/profileexport HBASE_HOME=/usr/local/hbase expor ...source /etc/profileconf/hbase-env.sh cd /usr/local/hbase/conf vi ./hbase-env ...export HBASE_DISABLE_HADOOP_CLASSPATH_LO ...conf/hbase-site.xml缺省配置参考参考路径创建mkdir -p /home/hadoop/hbase/zookeeper hd ...进入confcd /usr/local/hbase/conf vi ./hbase-sit ...推荐配置<configuration> <property> ...conf/regionserversvi conf/regionservers,修改内容如下,根据本集群主从机名修改master c22 c23conf/backup-mastersc22链接hadoop配置ln -s $HADOOP_HOME/etc/hadoop/core-site. ...ulimit 在所有主从机上修改以下两个文件sudo vi /etc/security/limits.conf在# End of file 行之前插入： hadoop - no ...sudo vi /etc/pam.d/common-sessionsession required pam_limits.so分发到从机scp /etc/security/limits.conf c22:/etc ...复制hbase到从机在所有从机上创建目录，设置目录权限： sudo mkdir -p /usr/lo ...以下指令在master上执行： scp -r /usr/local/hbase ...复制/etc/profile到从机 scp /etc/profile c22:/etc/ scp /etc/ ...然后到各从机使用生效配置： source /etc/profile从机上创建目录mkdir -p /home/hadoop/hbase/zookeeper启动hadoop&Zookeeper(已经启动zookeeper和hadoop的请忽略) 启动顺序 1，启动zkSe ...启动hbase集群在主master上执行bin/start-hbase.sh正常运行截图检查hbase进程jps查看进程master和c22节点上增加了 HMaster、HRegionServer如图如图c23节点上只增加了 HRegionServer如图查看HBase信息master主机http://master:16010/截图截图二http://master:16030/截图一slave从机(备master)http://slave1:16010截图一http://slave1:16030/截图一slave从机http://c22:16010/ 截图http://slave2:16030/截图一停止hbase集群在master执行cd /usr/local/hbase/bin ./hbase-daemon.s ...在slave1(备master) 执行cd /usr/local/hbase/bin ./hbase-daemon.s ...HBase使用HBase的Shell启动Shell hbase shell 截图[hadoop@master bin]$ hbase shell HBase ...查看HBase运行状态status运行截图hbase:001:0> status 1 active master, 1 b ...查看版本version运行截图hbase:004:0> version 2.4.13, r90fb1ddc1d ...获得帮助help截图退出ShellexitDDL操作命令DDL（Data Definition Languages）创建表create 't', 'f'hbase:007:0> create 't', 'f' Created tab ...截图disable 't'hbase:010:0> disable 't' Took 2.0308 sec ...截图DML操作命令数据操纵语言（Data Manipulation Language, DML）添加数据t.put 'r', 'f', 'v'hbase:012:0> t = create 't', 'f' Created ...截图获取表get_tablehbase:016:0> tab = get_table 't' Took 0. ...截图listhbase:019:0> tables = list('t.*') TABLE ...截图运行HBase Shell脚本参考Zookeeper安装参考参考一ZooKeeper、Hadoop、HBase的关闭顺序第1、2点只需要在主节点执行，而第3、4点需要每台机执行。1.先停止HBasestop-hbase.sh2.再停止Hadoopstop-all.sh3.最后停止ZooKeeperzkServer.sh stop log4j2.xmlSince version 3.0.0, HBase has upgraded ...log4j2参考Log4j 2.13.0 and greater require Java 8. ...其它配置hadoop配置Hadoop’s conf/hdfs-site.xml<property> <name>dfs.datanode.max.tran ...常见问题hbase 输入stop-hbase.sh停止不了，一直出现......如图解决先 bin/hbase-daemons.sh stop regionserver后 bin/hbase-daemon.sh stop masterhbase shell中运行异常status 状态查看报异常1ServerNotRunningYetException: Server is ...截图原因一，可能是hadoop异常原因： 这种情况是由于不正常的关闭hadoop，从而导致hadoop进入了安全模 ...原因二，目录权限修改所有的主从机： sudo chown hadoop:users -R /us ...原因三，真正原因是 少了配置文件链接hadoop配置ln -s $HADOOP_HOME/etc/hadoop/core-site. ...status状态查看报异常2错误提示：ERROR: KeeperErrorCode = Connection ...错误截图原因分析集群hbase服务是否有启集群zookeeper是否有启创建表报异常在create创建表的时候报错Hbase报错： Master is initia ...截图解决方法：进入zk客户端，把hbase目录删除，重启hbase即可。cd /usr/local/zookeeper/bin/ ./zkCli.sh ...重启hbase,再次测试创建表 create 'test','info' lis ...截图报日志异常SLF4J: Failed to load class "org.slf4j.i ...截图http://master:16030/报initializinghttp://master:16030/rs-status显示的内容为:The ...如图原因一查看hdfs safe mode hadoop dfsadmin -safemo ...原因二，少了hdfs配置文件链接hadoop配置ln -s $HADOOP_HOME/etc/hadoop/core-site. ...原因三， 需开启hadoop路径lookup解决方式cd /usr/local/hbase/conf vi ./hbase-env. ...原因四, zookeeper需关闭sasl认证解决方法cd /usr/local/zookeeper/conf vi ./zoo.cf ...logs/日志报异常2022-08-27 00:50:56,433 WARN [RS-EventL ...错误截图hbase2.3.x不兼容hadoop 3.3.x？如https://blog.csdn.net/jinluming19/artic ...当前选择hbase2.4.13出现： Server is not running yet问题当前选择Hadoop 3.3.1启动伪分布式hbase时报错Will not attempt to authenticate using ...版本历史Ver1.5.2-20220914Ver1.6-20221017添加hbase shell上创建表时报master初始化问题Ver1.7-20230514更新hbase版本为2.4.17
hide
第3章HBase环境搭建
Ver1.7-20230514
hide
学习视频
hide
概述
leaf
环境与版本配套关系 User Link
hide
Zookeeper安装
leaf
安装&配置&测试Zookeeper视频 User Link
hide
HBase安装
leaf
HBase下载与安装 User Link
leaf
HBase配置与运行 User Link
hide
解决initializing视频 User Link
leaf
http://master:16030持续出现initializing时才需要处理
hide
概述
leaf
HBase的运行依赖于Hadoop HDFS文件系统提供数据的持久化，依赖Zookeeper提供集群的同步和协调
leaf
HBase使用Zookeeper服务来进行节点管理以及表数据的定位
hide
HBase的基本组成结构
hide
HBase集群主要角色
hide
HBase Master(对应HMaster)
leaf
Master是HBase集群的主控服务器；
Master可有多个，但只要一个活跃的
hide
HBase Region Server
leaf
Region Server是HBase具体对外提供服务的进程
hide
软件配套
leaf
参考 User Link
hide
Java
leaf
HBase 2.0-2.2 -》JDK 8
leaf
HBase 2.3+ -》 JDK 8 ，JDK 11
hide
ulimit
hide
sudo vi /etc/security/limits.conf
leaf
hadoop - nofile 32768
hadoop - nproc 32000
hide
sudo vi /etc/pam.d/common-session
leaf
session required pam_limits.so
hide
Hadoop
hide
Hadoop-3.3.x
hide
=> HBase-2.3.x? &
HBase-2.4.x
leaf
=> Hadoop-2.10.x
leaf
=> Hadoop-3.1.1+
hide
Hadoop-3.2.x
leaf
=>HBase2.3.x
hide
Hadoop-3.1.1+
leaf
=>HBase-2.1.x &
HBase-2.2.x &
HBase-2.3.x &
HBase-2.4.x
hide
Hadoop-2.8.5+
leaf
=>HBase-2.0.x &
HBase-2.1.x &
HBase-2.2.x &
HBase-1.5.x &
HBase-1.6.x &
HBase-1.7.x
hide
ZooKeeper
leaf
下载最新的稳定版本
leaf
Apache ZooKeeper 3.7.1 (latest stable release)
hide
其它
leaf
ssh & DNS & NTP & ulimit
hide
测试环境
hide
环境一
leaf
192.168.31.21 master
leaf
192.168.31.22 c22
leaf
192.168.31.23 c23
leaf
192.168.31.24 c24
hide
环境二
leaf
192.168.137.100 master
leaf
192.168.137.101 slave1
leaf
192.168.137.102 slave2
hide
安装参考
leaf
HBase安装参考URL User Link
leaf
Zookeeper安装参考URL User Link
hide
Zookeeper安装
hide
软件安装
hide
Zookeeper下载
leaf
https://zookeeper.apache.org/
leaf
https://zookeeper.apache.org/releases.html
leaf
wget -c https://dlcdn.apache.org/zookeeper/zookeeper-3.7.1/apache-zookeeper-3.7.1-bin.tar.gz --no-check-certificate
leaf
wget -c https://mirrors.aliyun.com/apache/zookeeper/zookeeper-3.7.1/apache-zookeeper-3.7.1-bin.tar.gz?spm=a2c6h.25603864.0.0.37654ae76BAvvB
hide
Zookeeper安装包解压
leaf
tar -xzvf ./apache-zookeeper-3.7.1-bin.tar.gz\?spm\=a2c6h.25603864.0.0.37654ae76BAvvB
hide
Zookeeper目录转移
leaf
sudo mv ./apache-zookeeper-3.7.1-bin /usr/local/zookeeper
chown hadoop:users -R /usr/local/zookeeper
hide
Zookeeper配置
hide
配置zoo.cfg
leaf
mkdir -p /home/hadoop/zookeeper/data
leaf
cd /usr/local/zookeeper/conf
cp ./zoo_sample.cfg ./zoo.cfg
vi ./zoo.cfg
修改行:
dataDir=/home/hadoop/zookeeper/data
修改相应的值：
initLimit=5
syncLimit=2
在最后添加，注意从机名要修改
server.1=master:2888:3888
server.2=c22:2888:3888
server.3=c23:2888:3888
forceSync=no
zookeeper.client.sasl=false
hide
修改/etc/profile
leaf
sudo vi /etc/profile
leaf
export ZOOKEEPER_HOME=/usr/local/zookeeper
export PATH=$PATH:$ZOOKEEPER_HOME/bin
leaf
source /etc/profile
hide
复制hbase到从机
leaf
在所有从机上创建目录：
useradd hadoop -G users
passwd hadoop
(密码:hadoop)
sudo mkdir -p /usr/local/zookeeper
sudo chown hadoop:users -R /usr/local/zookeeper
sudo chown hadoop:users /etc/profile
leaf
sudo scp -r /usr/local/zookeeper/ hadoop@c22:/usr/local/
sudo scp -r /usr/local/zookeeper/ hadoop@c23:/usr/local/
sudo scp -r /usr/local/zookeeper/ hadoop@c24:/usr/local/
Arrow Link
hide
复制/etc/profile到从机
leaf
scp /etc/profile c22:/etc/
scp /etc/profile c23:/etc/
scp /etc/profile c24:/etc/
leaf
然后到各从机使用生效配置:
source /etc/profile
hide
写入文件myid
hide
mkdir -p /home/hadoop/zookeeper/data/
chown hadoop:users -R /home/hadoop/zookeeper/data/
echo "1" > /home/hadoop/zookeeper/data/myid
leaf
master机
hide
mkdir -p /home/hadoop/zookeeper/data/
chown hadoop:users -R /home/hadoop/zookeeper/data/
echo "2" > /home/hadoop/zookeeper/data/myid
leaf
c22机
hide
mkdir -p /home/hadoop/zookeeper/data/
chown hadoop:users -R /home/hadoop/zookeeper/data/
echo "3" > /home/hadoop/zookeeper/data/myid
leaf
c23机
hide
zookeeper运行
hide
在每台主机和从机都启动
leaf
cd /usr/local/zookeeper/bin
./zkServer.sh start
hide
或在master主机批量启停从机
hide
.批量启动ZooKeeper节点
leaf
cd /usr/local/zookeeper/bin
vi ./zkstart-all.sh
leaf
#!/bin/bash
echo “starting ZooKeeper cluster ......”
ssh c22 "/usr/local/zookeeper/bin/zkServer.sh start"
ssh c23 "/usr/local/zookeeper/bin/zkServer.sh start"
ssh c24 "/usr/local/zookeeper/bin/zkServer.sh start"
leaf
chmod 755 ./zkstart-all.sh
hide
批量停止ZooKeeper节点
leaf
cd /usr/local/zookeeper/bin
vi ./zkstop-all.sh
leaf
#!/bin/bash
echo “starting ZooKeeper cluster ......”
ssh c22 "/usr/local/zookeeper/bin/zkServer.sh stop"
ssh c23 "/usr/local/zookeeper/bin/zkServer.sh stop"
ssh c24 "/usr/local/zookeeper/bin/zkServer.sh stop"
leaf
chmod 755 ./zkstop-all.sh
hide
主从机上都可运行停止
leaf
停止zk节点：
cd /usr/local/zookeeper/bin
./zkServer.sh stop
hide
主从机上都可以查询
leaf
查看zk节点状态，#集群中只有一个leader其余节点为follower
cd /usr/local/zookeeper/bin
./zkServer.sh status
hide
检查进程
leaf
ps查询主从机进程会多出Dzookeeper的进程
ps aux |grep Dzookeeper
hide
jps查询master主机多出QuorumPeerMain进程
[root@master ~]# jps
3170 Master
4210 Jps
1944 SecondaryNameNode
3848 QuorumPeerMain
2217 ResourceManager
2606 JobHistoryServer
1711 NameNode
leaf
截图 User Link
hide
jps查询从机有多出QuorumPeerMain进程
2386 QuorumPeerMain
2548 Jps
2008 Worker
1626 DataNode
1738 NodeManage
leaf
截图一 User Link
leaf
截图二 User Link
hide
zookeeper客户端
leaf
参考 User Link
hide
cd /usr/local/zookeeper/bin
./zkCli.sh -server master:2181
leaf
结果截图 User Link
hide
命令使用
hide
help
leaf
如图 User Link
leaf
ls /
leaf
create /zk_test my_data
leaf
get /zk_test
leaf
set /zk_test junk
leaf
delete /zk_test
leaf
quit退出
hide
HBase安装
hide
软件安装
hide
HBase下载解压
目录转移
hide
地址参考
leaf
https://hbase.apache.org/
leaf
https://www.apache.org/dyn/closer.lua/hbase/2.4.13/hbase-2.4.13-bin.tar.gz
hide
选择一种
leaf
wget -c https://dlcdn.apache.org/hbase/2.4.17/hbase-2.4.17-bin.tar.gz --no-check-certificate
tar -xzvf ./hbase-2.4.17-bin.tar.gz
sudo mv ./hbase-2.4.17 /usr/local/hbase
chown hadoop:users -R /usr/local/hbase
leaf
wget -c wget -c https://mirrors.aliyun.com/apache/hbase/2.4.17/hbase-2.4.17-bin.tar.gz?spm=a2c6h.25603864.0.0.226a6859pYQaD4 --no-check-certificate
tar -xzvf ./hbase-2.4.17-bin.tar.gz?spm=a2c6h.25603864.0.0.226a6859pYQaD4
sudo mv ./hbase-2.4.17 /usr/local/hbase
chown hadoop:users -R /usr/local/hbase
hide
HBase配置
hide
完全分布式
HBase
hide
/etc/profile
leaf
vi /etc/profile
leaf
export HBASE_HOME=/usr/local/hbase
export PATH=$PATH:$HBASE_HOME/bin
leaf
source /etc/profile
hide
conf/hbase-env.sh
leaf
cd /usr/local/hbase/conf
vi ./hbase-env.sh
leaf
export HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP="true"
export HADOOP_CONF_DIR=/usr/local/hadoop-3.3.1/etc/hadoop
export HBASE_CLASSPATH=/usr/local/hbase/conf
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-1.el7_9.x86_64/jre
export HBASE_HEAPSIZE=512M
export HBASE_MANAGES_ZK=false
#指定ssh端口才需要打开如下设置
#export HBASE_SSH_OPTS="-p 8022"
hide
conf/hbase-site.xml
hide
缺省配置参考
leaf
参考 User Link
hide
路径创建
leaf
mkdir -p /home/hadoop/hbase/zookeeper
hdfs dfs -mkdir -p /data/hbase_db
hide
进入conf
leaf
cd /usr/local/hbase/conf
vi ./hbase-site.xml
hide
推荐配置
leaf
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://master:9864/data/hbase_db</value>
</property>
<property>
<name>hbase.master</name>
<value>master</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>dfs.support.append</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>master,c22,c23</value>
</property>
<property>
<name>hbase.zookeeper.property.datadir</name>
<value>/home/hadoop/hbase/zookeeper</value>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2181</value>
</property>
</configuration>
hide
conf/regionservers
leaf
vi conf/regionservers,修改内容如下,根据本集群主从机名修改
leaf
master
c22
c23
hide
conf/backup-masters
leaf
c22
hidemessagebox_warning
链接hadoop配置
leaf
ln -s $HADOOP_HOME/etc/hadoop/core-site.xml $HBASE_HOME/conf/core-site.xml
ln -s $HADOOP_HOME/etc/hadoop/hdfs-site.xml $HBASE_HOME/conf/hdfs-site.xml
hide
ulimit
leaf
在所有主从机上修改以下两个文件
hide
sudo vi /etc/security/limits.conf
leaf
在# End of file 行之前插入：
hadoop - nofile 32768
hadoop - nproc 32000
hide
sudo vi /etc/pam.d/common-session
leaf
session required pam_limits.so
hide
分发到从机
leaf
scp /etc/security/limits.conf c22:/etc/security/
scp /etc/security/limits.conf c23:/etc/security/
scp /etc/security/limits.conf c24:/etc/security/

scp /etc/pam.d/common-session c22:/etc/pam.d/
scp /etc/pam.d/common-session c23:/etc/pam.d/
scp /etc/pam.d/common-session c24:/etc/pam.d/
hide
复制hbase到从机
leaf
在所有从机上创建目录，设置目录权限：
sudo mkdir -p /usr/local/hbase
sudo chown hadoop:users -R /usr/local/hbase
sudo chown hadoop:users /etc/profile
leaf
以下指令在master上执行：
scp -r /usr/local/hbase/ c22:/usr/local/
scp -r /usr/local/hbase/ c23:/usr/local/
scp -r /usr/local/hbase/ c24:/usr/local/
Arrow Link
hide
复制/etc/profile到从机
leaf
scp /etc/profile c22:/etc/
scp /etc/profile c23:/etc/
scp /etc/profile c24:/etc/
leaf
然后到各从机使用生效配置：
source /etc/profile
hide
从机上创建目录
leaf
mkdir -p /home/hadoop/hbase/zookeeper
hide
启动hadoop&Zookeeper
leaf
(已经启动zookeeper和hadoop的请忽略)
启动顺序
1，启动zkServer.sh start（每个安装有Zookeeper的节点均需启动）
2，启动hadoop集群 start-all.sh
3，接着再启动 hbase集群 start-hbase.sh
hide
启动hbase集群
hide
在主master上执行
hide
bin/start-hbase.sh
leaf
正常运行截图 User Link
hide
检查hbase进程
hide
jps查看进程
hide
master和c22节点上增加了 HMaster、HRegionServer
leaf
如图 User Link
leaf
如图 User Link
hide
c23节点上只增加了 HRegionServer
leaf
如图 User Link
hide
查看HBase信息
hide
master主机
hide
http://master:16010/
leaf
截图 User Link
leaf
截图二 User Link
hide
http://master:16030/
leaf
截图一 User Link
hide
slave从机(备master)
hide
http://slave1:16010
leaf
截图一 User Link
hide
http://slave1:16030/
leaf
截图一 User Link
Arrow Link
hide
slave从机
hide
http://c22:16010/
leaf
截图 User Link
hide
http://slave2:16030/
leaf
截图一 User Link
Arrow Link
hide
停止hbase集群
hide
在master执行
leaf
cd /usr/local/hbase/bin
./hbase-daemon.sh stop master
./hbase-daemons.sh stop regionserver
hide
在slave1(备master) 执行
leaf
cd /usr/local/hbase/bin
./hbase-daemon.sh stop master
hide
HBase使用
hide
HBase的Shell
hide
启动Shell
hide
hbase shell
leaf
截图 User Link
leaf
[hadoop@master bin]$ hbase shell
HBase Shell
Use "help" to get list of supported commands.
Use "exit" to quit this interactive shell.
For Reference, please visit: http://hbase.apache.org/2.0/book.html#shell
Version 2.4.13, r90fb1ddc1df9b345f26687d5d24cedfb19621d63, Wed Jun 22 20:16:39 PDT 2022
Took 0.0329 seconds
hbase:001:0>
hide
查看HBase运行状态
hide
status
leaf
运行截图 User Link
leaf
hbase:001:0> status
1 active master, 1 backup masters, 3 servers, 0 dead, 0.6667 average load
Took 8.5895 seconds
hbase:002:0>
hide
查看版本
hide
version
leaf
运行截图 User Link
leaf
hbase:004:0> version
2.4.13, r90fb1ddc1df9b345f26687d5d24cedfb19621d63, Wed Jun 22 20:16:39 PDT 2022
Took 0.0026 seconds
hbase:005:0>
hide
获得帮助
hide
help
leaf
截图 User Link
hide
退出Shell
leaf
exit
hide
DDL操作命令
leaf
DDL（Data Definition Languages）
hide
创建表
hide
create 't', 'f'
leaf
hbase:007:0> create 't', 'f'
Created table t
Took 9.4125 seconds
=> Hbase::Table - t
hbase:008:0> scan 't'
ROW COLUMN+CELL
0 row(s)
Took 2.0022 seconds
hbase:009:0> describe 't'
Table t is ENABLED
t
COLUMN FAMILIES DESCRIPTION
{NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE
=> 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}
1 row(s)
Quota is disabled
Took 0.6158 seconds
leaf
截图 User Link
hide
disable 't'
leaf
hbase:010:0> disable 't'
Took 2.0308 seconds
hbase:011:0> drop 't'
Took 2.5845 seconds
hbase:012:0>
leaf
截图 User Link
hide
DML操作命令
leaf
数据操纵语言（Data Manipulation Language, DML）
hide
添加数据
hide
t.put 'r', 'f', 'v'
leaf
hbase:012:0> t = create 't', 'f'
Created table t
Took 4.3924 seconds
=> Hbase::Table - t
hbase:013:0> t.put 'r', 'f', 'v'
Took 0.9839 seconds
hbase:014:0> t.scan
ROW COLUMN+CELL
r column=f:, timestamp=2022-08-27T07:43:21.327, value=v
1 row(s)
Took 0.2992 seconds
leaf
截图 User Link
hide
获取表
hide
get_table
leaf
hbase:016:0> tab = get_table 't'
Took 0.0027 seconds
=> Hbase::Table - t
hbase:017:0> tab.put 'r1' ,'f', 'v'
Took 7.2173 seconds
hbase:018:0> tab.scan
ROW COLUMN+CELL
r column=f:, timestamp=2022-08-27T07:43:21.327, value=v
r1 column=f:, timestamp=2022-08-27T07:47:05.313, value=v
2 row(s)
Took 0.2466 seconds
hbase:019:0>
leaf
截图 User Link
hide
list
leaf
hbase:019:0> tables = list('t.*')
TABLE
t
1 row(s)
Took 0.1783 seconds
=> ["t"]
hbase:020:0> tables.map { |t| disable t ; drop t}
Took 4.4038 seconds
Took 1.4107 seconds
=> [nil]
hbase:021:0>
leaf
截图 User Link
leaf
运行HBase Shell脚本
hide
参考
hide
Zookeeper安装参考
leaf
参考一 User Link
hide
ZooKeeper、Hadoop、HBase的关闭顺序
leaf
第1、2点只需要在主节点执行，而第3、4点需要每台机执行。
Arrow Link
hide
1.先停止HBase
leaf
stop-hbase.sh
hide
2.再停止Hadoop
leaf
stop-all.sh
hide
3.最后停止ZooKeeper
leaf
zkServer.sh stop
hide
log4j2.xml
leaf
Since version 3.0.0, HBase has upgraded to Log4j2
leaf
log4j2参考 User Link
leaf
Log4j 2.13.0 and greater require Java 8. Version 2.4 through 2.12.1 required Java 7
hide
其它配置
hide
hadoop配置
hide
Hadoop’s conf/hdfs-site.xml
leaf
<property>
<name>dfs.datanode.max.transfer.threads</name>
<value>4096</value>
</property>
hide
常见问题
hide
hbase 输入stop-hbase.sh停止不了，一直出现......
leaf
如图 User Link
hide
解决
leaf
先 bin/hbase-daemons.sh stop regionserver
leaf
后 bin/hbase-daemon.sh stop master
hide
hbase shell中运行异常
hide
status 状态查看报异常1
hide
ServerNotRunningYetException: Server is not running yet
leaf
截图 User Link
hide
原因一，可能是hadoop异常
leaf
原因：
这种情况是由于不正常的关闭hadoop，从而导致hadoop进入了安全模式产生的原因

解决方案：
进入Hadoop的bin目录下 退出安全模式
命令：
hdfs dfsadmin -safemode leave
重新启动HBase的shell窗口
//查看
hdfs dfsadmin -safemode get
hide
原因二，目录权限
leaf
修改所有的主从机：
sudo chown hadoop:users -R /usr/local/hadoop-3.3.1/
sudo chown hadoop:users -R /usr/local/spark/
sudo chown hadoop:users -R /usr/local/scala/
sudo chown hadoop:users -R /usr/local/hbase/
sudo chown hadoop:users -R /usr/local/zookeeper/
sudo chown hadoop:users -R /usr/local/hive/
sudo chown hadoop:users -R /usr/local/sqoop/
hidebutton_ok
原因三，真正原因是
少了配置文件
hidemessagebox_warning
链接hadoop配置
leaf
ln -s $HADOOP_HOME/etc/hadoop/core-site.xml $HBASE_HOME/conf/core-site.xml
ln -s $HADOOP_HOME/etc/hadoop/hdfs-site.xml $HBASE_HOME/conf/hdfs-site.xml
hide
status状态查看报异常2
leaf
错误提示：ERROR: KeeperErrorCode = ConnectionLoss for /hbase/master
leaf
错误截图 User Link
hide
原因分析
leaf
集群hbase服务是否有启
leaf
集群zookeeper是否有启
hide
创建表报异常
hide
在create创建表的时候报错Hbase报错： Master is initializing
leaf
截图 User Link
hide
解决方法：
leaf
进入zk客户端，把hbase目录删除，重启hbase即可。
leaf
cd /usr/local/zookeeper/bin/
./zkCli.sh
ls /
deleteall /hbase
hide
重启hbase,再次测试创建表
create 'test','info'
list
leaf
截图 User Link
hide
报日志异常
hide
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
leaf
截图 User Link
hide
http://master:16030/报initializing
hide
http://master:16030/rs-status显示的内容为:The RegionServer is initializing!
leaf
如图 User Link
hide
原因一
leaf
查看hdfs safe mode
hadoop dfsadmin -safemode get

退出hdfs safe mode
hadoop dfsadmin -safemode leave
hide
原因二，少了hdfs配置文件
hide
链接hadoop配置
leaf
ln -s $HADOOP_HOME/etc/hadoop/core-site.xml $HBASE_HOME/conf/core-site.xml
ln -s $HADOOP_HOME/etc/hadoop/hdfs-site.xml $HBASE_HOME/conf/hdfs-site.xml
hidemessagebox_warning
原因三，
需开启hadoop路径lookup
hide
解决方式
leaf
cd /usr/local/hbase/conf
vi ./hbase-env.sh
将下行注释#去掉
export HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP="true"
然后在
export HADOOP_CONF_DIR=/usr/local/hadoop-3.3.1/etc/hadoop下方添加行：
export HBASE_CLASSPATH=/usr/local/hadoop-3.3.1/etc/hadoop
hidemessagebox_warning
原因四,
zookeeper需关闭sasl认证
hide
解决方法
leaf
cd /usr/local/zookeeper/conf
vi ./zoo.cfg
在文件末尾添加两行：
forceSync=no
zookeeper.client.sasl=false
hide
logs/日志报异常
hide
2022-08-27 00:50:56,433 WARN [RS-EventLoopGroup-1-1] concurrent.DefaultPromise: An exception was thrown by org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete()
java.lang.IllegalArgumentException: object is not an instance of declaring class
leaf
错误截图 User Link
leaf
hide
hbase2.3.x不兼容hadoop 3.3.x？
leaf
如https://blog.csdn.net/jinluming19/article/details/122101283
hide
当前选择hbase2.4.13
leaf
出现： Server is not running yet问题
leaf
当前选择Hadoop 3.3.1
hide
启动伪分布式hbase时报错
leaf
Will not attempt to authenticate
using SASL (unknown error)
hide
版本历史
leaf
Ver1.5.2-20220914
hide
Ver1.6-20221017
leaf
添加hbase shell上创建表时报master初始化问题
hide
Ver1.7-20230514
leaf
更新hbase版本为2.4.17