CentOS 7配置CDH6简明文档

1、ASP站长网准备工作
 
1.1 环境
 
CentOS7、jdk8、MySQL5.7、Python2.7、CDH61.2文件下载
 
1.2.1 cloudmanger地址
 
https://archive.cloudera.com/cm6/6.0.0/RedHat7/yum/RPMS/x86_64/ cloudera-manager-agent-6.0.0-530873.el7.x86_64.rpm
 
cloudera-manager-daemons-6.0.0-530873.el7.x86_64.rpm
 
cloudera-manager-server-6.0.0-530873.el7.x86_64.rpm
 
1.2.2 资源下载地址
 
https://archive.cloudera.com/cdh6/6.0.0/parcels/
 
CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel
 
CDH-6.0.0-1.cdh6.0.0.p0.537114-el7.parcel.sha256
 
manifest.json
 
2、开始安装
 
2.1 服务器配置
 
2.1.1 修改HOST和主机名
 
vim /etc/hosts修改host，例如
 
198.168.12.1 cdh1
 
192.168.12.2 cdh2
 
192.168.12.3 cdh3
 
不能有大写字母和下划线
 
vim /etc/hostname修改主机名,修改完后三台机器分别执行hostname ***(当前节点的主机名)
 
2.1.2 配置免密登录
 
ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa b、ssh-copy-id 每台服务器地址
 
2.1.3 关闭防火墙
 
临时关闭 systemctl stop firewalld
 
禁止开机启动 systemctl disable firewalld
 
2.1.4 安装jdk，配置环境变量
 
这个大家都会，如果不会可以参考这个教程
 
https://www.linuxidc.com/Linux/2018-11/155296.htm
 
2.1.5 其他依赖
 
每台服务器yum安装依赖包：redhat-lsb、portmap、httpd、mod_ssl、openssl-devel、python-psycopg2、MySQL-python、chkconfig、python、chkconfig、bind-utils、libxslt、zlib、sqlite、cyrus-sasl-plain、cyrus-sasl-gssapi、fuse、fuse-libs
 
2.2 Mysql5.7安装(在主节点安装)
 
2.2.1 安装
 
wget -i -c http://dev.mysql.com/get/mysql57-community-release-el7-10.noarch.rpm
 
yum -y install mysql57-community-release-el7-10.noarch.rpm
 
yum -y install mysql-community-server
 
启动 systemctl start mysqld.service
 
查看运行状态 systemctl status mysqld.service
 
查看初始密码 grep "password" /var/log/mysqld.log
 
登录后修改密码（尽量复杂一点，太简单了验证不通过，也可以查看如何关闭mysql校验规则） ALTER USER 'root'@'localhost' IDENTIFIED BY 'new password';
 
卸载yum源防止自动更新 yum -y remove mysql57-community-release-el7-10.noarch
 
安装MySQL-shared-compat或MySQL-shared软件包(这是Cloudera Manager Agent软件包安装所必需的)yum install MySQL-shared-advanced
 
2.2.2 创建CDH相关数据库
 
create database scm default character set utf8 default collate utf8_general_ci;
 
grant all on scm.* to 'scm'@'%' identified by 'password';
 
create database amon default character set utf8 default collate utf8_general_ci;
 
grant all on amon.* to 'amon'@'%' identified by 'password';
 
create database rman default character set utf8 default collate utf8_general_ci;
 
grant all on rman.* to 'rman'@'%' identified by 'password';
 
create database hue default character set utf8 default collate utf8_general_ci;
 
grant all on hue.* to 'hue'@'%' identified by 'password';
 
create database metastore default character set utf8 default collate utf8_general_ci;
 
grant all on metastore.* to 'hive'@'%' identified by 'password';
 
create database sentry default character set utf8 default collate utf8_general_ci;
 
grant all on sentry.* to 'sentry'@'%' identified by 'password';
 
create database nav default character set utf8 default collate utf8_general_ci;
 
grant all on nav.* to 'nav'@'%' identified by 'password';
 
create database oozie default character set utf8 default collate utf8_general_ci;
 
grant all on oozie.* to 'oozie'@'%' identified by 'password';
 
2.3 CDH安装
 
mkdir /opt/cloudera-manager
 
将cloudera-manager-agent-6.0.0-530873.el7.x86_64.rpm、cloudera-manager-daemons-6.0.0-530873.el7.x86_64.rpm 、cloudera-manager-server-6.0.0-530873.el7.x86_64.rpm
 
复制到/opt/cloudera-manager文件夹中
 
按 daemons、server、agent顺序解压
 
修改文件/etc/cloudera-scm-agent/config.ini中serverhost指定server节点
 
下载mysql-connector-Java-5.1.47.jar包并复制为/usr/share/java/mysql-connector-java.jar