Ubuntu 16.04.4 LTS + Ambari 2.6.1.5 + HDP 2.6.4.0 安装部署

前端之家收集整理的这篇文章主要介绍了Ubuntu 16.04.4 LTS + Ambari 2.6.1.5 + HDP 2.6.4.0 安装部署前端之家小编觉得挺不错的,现在分享给大家,也给大家做个参考。

服务器

主机名

master

slave1

slave2

slave3

IP

192.168.1.40

192.168.1.41

192.168.1.42

192.168.1.43


离线包服务器: 192.168.1.50

-------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------------------------------------------------------------------------

1.启用root账号
1)sudo passwd root

2)sudo vi /etc/ssh/sshd_config

PermitRootLogin yes
RSAAuthentication yes
PubkeyAuthentication yes
AuthorizedKeysFile      %h/.ssh/authorized_keys

3)sudo service sshd restart

4)SSH免密码
所有服务器
su - root
cd ~/.ssh/
cat id_rsa.pub >> authorized_keys

master服务器
scp [email protected]:/root/.ssh/authorized_keys /root/.ssh/authorized_keys_slave1
scp [email protected]:/root/.ssh/authorized_keys /root/.ssh/authorized_keys_slave2
scp [email protected]:/root/.ssh/authorized_keys /root/.ssh/authorized_keys_slave3

cat authorized_keys_slave1 >> authorized_keys
cat authorized_keys_slave2 >> authorized_keys
cat authorized_keys_slave3 >> authorized_keys

其它服务器
scp [email protected]:/root/.ssh/authorized_keys /root/.sshauthorized_keys

5)设置文件句柄与线程限制
vi /etc/security/limits.conf
 
* soft nofile 204800
* hard nofile 204800
* soft nproc 204800
* hard nproc 204800


2.创建如下的几个文件放到所有服务器上

hdp.list
#VERSION_NUMBER=2.6.4.0-91
deb
http://192.168.1.50/ubuntu/HDP/ubuntu16/2.6.4.0-91 HDP main


hdp.utils.list
#VERSION_NUMBER=1.1.0.22-91
deb
http://192.168.1.50/ubuntu/HDP-UTILS/ HDP-UTILS main

hdp.gpl.list
#VERSION_NUMBER=2.6.4.0-91
deb
http://192.168.1.50/ubuntu/HDP-GPL/ubuntu16/2.6.4.0-91 HDP-GPL main

ambari.list
#VERSION_NUMBER=2.6.1.5-3
deb
http://192.168.1.50/ubuntu/ambari/ubuntu16/2.6.1.5-3 Ambari main


sudo scp [email protected]:/etc/apt/sources.list.d/hdp.list /etc/apt/sources.list.d/hdp.list

sudo scp [email protected]:/etc/apt/sources.list.d/hdp.utils.list /etc/apt/sources.list.d/hdp.utils.list

sudo scp [email protected]:/etc/apt/sources.list.d/hdp.gpl.list /etc/apt/sources.list.d/hdp.gpl.list

sudo scp [email protected]:/etc/apt/sources.list.d/ambari.list /etc/apt/sources.list.d/ambari.list

sudo apt-key adv --recv-keys --keyserver keyserver.ubuntu.com B9733A7A07513CAD
sudo apt-get update


3.安装其它JAR(jce_policy-8.zip和MysqL-connector-java.jar)
1)
unzip -o -j -q jce_policy-8.zip -d /usr/lib/jvm/jdk1.8.0_171/jre/lib/security

scp -r [email protected]:/usr/lib/jvm/jdk1.8.0_171/jre/lib/security /usr/lib/jvm/jdk1.8.0_171/jre/lib/

2)将MysqL-connector-java.jar放到/usr/share/java/目录下


4.安装如下的Python组件
sudo apt-get install libffi-dev
sudo apt-get install python-pip

sudo apt-get install python-pip
 
pip install ndg-httpsclient
pip install pyopenssl
pip install pyasn1
sudo pip install -U requests[security]


5.安装ambari-server
sudo apt-get install ambari-server

sudo ambari-server setup --jdbc-db=MysqL --jdbc-driver=/usr/share/java/MysqL-connector-java.jar

/var/lib/ambari-server/resources/Ambari-DDL-MysqL-CREATE.sql

sudo ambari-server setup --java-home=/usr/lib/jvm/jdk1.8.0_171


6.取消加密方式限制
vi /etc/ambari-server/conf/ambari.properties

security.server.disabled.ciphers=


7.启动服务

ambari-server start

ambari-server stop

ambari-server status


image


image


image


http://192.168.1.50/ubuntu/HDP/ubuntu16/2.6.4.0-91/

http://192.168.1.50/ubuntu/HDP-GPL/ubuntu16/2.6.4.0-91/

http://192.168.1.50/ubuntu/HDP-UTILS/


image


image


image


image


image


image


image


image


Admin Name : admin

Cluster Name : smartmap

Total Hosts : 4 (4 new)

Repositories:

ubuntu16 (HDP-2.6):
http://192.168.1.50/ubuntu/HDP/ubuntu16/2.6.4.0-91/
ubuntu16 (HDP-UTILS-1.1.0.22):
http://192.168.1.50/ubuntu/HDP-UTILS/
Services:

HDFS     Datanode : 3 hosts     NameNode : master     NFSGateway : 0 host     SNameNode : slave1 YARN + MapReduce2     App Timeline Server : slave1     NodeManager : 3 hosts     ResourceManager : master Tez     Clients : 1 host Hive     Metastore : master     HiveServer2 : master     WebHCat Server : master     Database : Existing MysqL / MariaDB Database HBase     Master : master     RegionServer : 3 hosts     Phoenix Query Server : 1 host Pig     Clients : 1 host Sqoop     Clients : 1 host ZooKeeper     Server : slave1 Storm     DRPC Server : master     Nimbus : slave1     UI Server : master     Supervisor : 1 host Flume     Flume : 1 host Ambari Infra     Infra Solr Instance : master Ambari Metrics     Metrics Collector : slave2     Grafana : master Kafka     Broker : master SmartSense     Activity Analyzer : master     Activity Explorer : master     HST Server : master Spark2     Livy for Spark2 Server : 1 host     History Server : master     Thrift Server : 1 host Slider     Clients : 1 host

猜你在找的Ubuntu相关文章