大数据组件部署——dolphinscheduler集群部署

1. 官方网站下载

https://www.apache.org/dyn/closer.lua/dolphinscheduler/3.0.0/apache-dolphinscheduler-3.0.0-bin.tar.gz

2、安装mysql-connector-java

rpm -ivh mysql-connector-java-8.0.25-1.el7.noarch.rpm --force –-nodeps

3、将/usr/share/java/mysql-connector-java.jar复制到api-server/libs/ 和 alert-server/libs 和 master-server/libs 和 worker-server/libs 和 tools/libs下

4、创建dolphinscheduler数据库、用户和密码

mysql> CREATE DATABASE dolphinscheduler DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;

mysql> CREATE USER 'ds'@'%' IDENTIFIED BY 'Szzt#2022';

mysql> GRANT ALL PRIVILEGES ON dolphinscheduler.* TO 'ds'@'%';

mysql> CREATE USER 'ds'@'localhost' IDENTIFIED BY 'Szzt#2022';

mysql> GRANT ALL PRIVILEGES ON dolphinscheduler.* TO 'ds'@'localhost';

mysql> FLUSH PRIVILEGES;

5、修改./bin/env/dolphinscheduler_env.sh，将username和password改成你在上一步中设置的用户名{user}和密码{password}

export DATABASE=${DATABASE:-mysql}

export SPRING_PROFILES_ACTIVE=${DATABASE}

export SPRING_DATASOURCE_URL="jdbc:mysql://10.255.33.196:3306/dolphinscheduler?useUnicode=true&characterEncoding=UTF-8&useSSL=false&allowPublicKeyRetrieval=true"

export SPRING_DATASOURCE_USERNAME=ds

export SPRING_DATASOURCE_PASSWORD=Szzt#2022

6、通过Shell 脚本来初始化数据库

bash tools/bin/upgrade-schema.sh

7、配置用户免密及权限

useradd dolphinscheduler

# 添加密码

echo "Szzt#2022" | passwd --stdin dolphinscheduler

# 配置 sudo 免密

visudo

进入编辑页面后在root ALL=(ALL) ALL下面加上如下示例：

dolphinscheduler ALL=(ALL) NOPASSWD:ALL

# 修改目录权限，使得部署用户对二进制包解压后的 apache-dolphinscheduler-*-bin 目录有操作权限

chown -R dolphinscheduler:dolphinscheduler apache-dolphinscheduler-*-bin

8、配置机器SSH免密登陆

su dolphinscheduler

ssh-keygen -t rsa #一直回车即可

ssh-copy-id -i master

ssh-copy-id -i node1

ssh-copy-id -i node2

9、部署zookeeper

10、修改 install_env.sh 文件

bin/env/install_env.sh

ips=${ips:-"master,node1,node2"}

masters=${masters:-"master"}

workers=${workers:-"node1:default,node2:default"}

alertServer=${alertServer:-"node1"}

apiServers=${apiServers:-"master"}

installPath=${installPath:-"/usr/local/apache-dolphinscheduler-3.0.0-bin"}

10、修改dolphinscheduler_env.sh

配置

export JAVA_HOME=${JAVA_HOME:-/usr/local/jdk-11.0.16.1}

export FLINK_HOME=${FLINK_HOME:-/usr/local/flink-1.15.2}

11、启动

sh install.sh

http://apiServers:12345/dolphinscheduler

http://10.255.33.169:12345/dolphinscheduler/ui/login

默认的用户名和密码是 admin/dolphinscheduler123