企业官网建设流程全解析

广州知名网站建设哪家好,做app网站有哪些,广告免费设计在线生成,做网站备案 空间是什么意思节点信息请参考: zookeeper: Apache Hadoop生态组件部署分享-zookeeper hadoop#xff1a;Apache Hadoop生态组件部署分享-Hadoop hive: Apache Hadoop生态组件部署分享-Hive Hbase集群部署步骤如下: 1、分发安装包并解压到指定路径下 scp hbase-2.6.0-bin.tar.gz 192.168.242…节点信息请参考:zookeeper: Apache Hadoop生态组件部署分享-zookeeperhadoopApache Hadoop生态组件部署分享-Hadoophive: Apache Hadoop生态组件部署分享-HiveHbase集群部署步骤如下:1、分发安装包并解压到指定路径下scp hbase-2.6.0-bin.tar.gz 192.168.242.231:/opt/softs/scp hbase-2.6.0-bin.tar.gz 192.168.242.232:/opt/softs/ansible hadoopsrccluster -m shell -a tar -xf /opt/softs/hbase-2.6.0-bin.tar.gz -C /opt/apache_v00/2、hbase-env.sh配置cd /opt/apache/hbase-2.6.0/confvim hbase-env.sh #添加的内容如下:export HBASE_MANAGES_ZKfalseexport JAVA_HOME/opt/module/jdk1.8.0_144export HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUPtrue然后分发ansible hadoopsrcclustero -m copy -a src/opt/apache_v00/hbase-2.6.0/conf/hbase-env.sh dest/opt/apache_v00/hbase-2.6.0/conf/3、hbase-site.xml配置configuration property descriptionhbase的根目录即在hdfs的根路径/description namehbase.rootdir/name valuehdfs://nameservice1/hbase/value /property property descriptionhbase的临时路径,对应在hdfs上的${hbase.rootdir}/.tmp/description namehbase.tmp.dir/name value./tmp/value /property property description强制检查底层文件系统如 HDFS是否支持 HBase 为了数据安全而需要的特定流操作功能特别是 hflush 或 hsync。 如果文件系统不支持这些功能而 HBase 又强制执行检查那么 RegionServer 将拒绝启动以防止数据损坏。/description namehbase.unsafe.stream.capability.enforce/name valuefalse/value /property property descriptionHBase的运行模式。false是单机模式true是分布式模式。若为false,HBase和Zookeeper会运行在同一个JVM里面。/description namehbase.cluster.distributed/name valuetrue/value /property property descriptionZookeeper集群的地址列表用逗号分割.如果在hbase-env.sh设置了HBASE_MANAGES_ZKtrue,这些ZooKeeper节点就会和HBase一起启动/description namehbase.zookeeper.quorum/name valueapache230.hadoop.com,apache231.hadoop.com,apache232.hadoop.com/value /property property descriptionhbase Master的web ui页面端口/description namehbase.master.info.port/name value16010/value /property property descriptionregionserver与master的时间差,单位秒。如果超过了这个时间差,那么regionserver就会无法上线/description namehbase.master.maxclockskew/name value180000/value /property property description若协处理器抛出的 Throwable 对象不是 IOException 或其子类异常时 将该参数设置为 true 将导致宿主服务器Master 或 RegionServer中止。在开发环境中 将此值设为 true 可能很有用因为可以立即终止服务器以便简化协处理器故障分析。/description namehbase.coprocessor.abortonerror/name valuefalse/value /property property descriptionMultiWAL允许RegionServer通过底层HDFS实例中的多个管道并行写入多个WAL流 从而提升写入期间的总吞吐量。这种并行化是通过按Region对传入的编辑操作进行分区来实现的。 因此当前实现无助于提高单个Region的写入吞吐量。/description namehbase.wal.provider/name valuemultiwal/value /property/configuration然后分发ansible hadoopsrcclustero -m copy -a src/opt/apache_v00/hbase-2.6.0/conf/hbase-site.xml dest/opt/apache_v00/hbase-2.6.0/conf/4、配置Hbase HOME环境变量cat /etc/profile.d/apache_v00.sh EOFexport ZOOKEEPER_HOME/opt/apache_v00/apache-zookeeper-3.9.2export HADOOP_HOME/opt/apache_v00/hadoop-3.3.5export HIVE_HOME/opt/apache_v00/apache-hive-3.1.3export TEZ_HOME/opt/apache_v00/tez-0.10.3export HBASE_HOME/opt/apache_v00/hbase-2.6.0export PATH$PATH:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$HIVE_HOME/bin:$HBASE_HOME/binEOFsource /etc/profile.d/apache_v00.sh5、分发Hadoop配置文件到hbase配置路径下cd /opt/apache_v00/hadoop-3.3.5/etc/hadoopcp core-site.xml hdfs-site.xml yarn-site.xml mapred-site.xml hadoop-env.sh /opt/apache_v00/hbase-2.6.0/conf/scp core-site.xml hdfs-site.xml yarn-site.xml mapred-site.xml hadoop-env.sh 192.168.242.231:/opt/apache_v00/hbase-2.6.0/conf/scp core-site.xml hdfs-site.xml yarn-site.xml mapred-site.xml hadoop-env.sh 192.168.242.232:/opt/apache_v00/hbase-2.6.0/conf/6、启动hbase服务#apache230.hadoop.com节点执行hbase-daemon.sh start masterhbase-daemon.sh start regionserver #apache231.hadoop.com节点执行hbase-daemon.sh start regionserver #apache232.hadoop.com节点执行hbase-daemon.sh start regionserver7、 验证其功能hbase shell create_namespace testacreate testa:student,infoput testa:student,1001,info:sex,maleput testa:student,1001,info:age,18put testa:student,1002,info:name,Jannaput testa:student,1002,info:sex,femalescan testa:student count testa:studentdeleteall testa:student,10018、Master启用HA#在apache231.hadoop.com节点直接启动master即可hbase-daemon.sh start master