docker

关注公众号 jb51net

关闭
首页 > 网站技巧 > 服务器 > 云和虚拟化 > docker > docker部署Apache Seatunnel集群

docker环境部署Apache Seatunnel集群模式的实现方法

作者：Zhu758

本文主要介绍了docker环境部署Apache Seatunnel集群模式的实现方法,文中通过示例代码介绍的非常详细,对大家的学习或者工作具有一定的参考学习价值,需要的朋友们下面随着小编来一起学习学习吧

说明

受限资源环境，需使用docker在云主机部署Apache Seatunnel集群最新版本（2.3.13）。

创建文件

创建文件compose.yaml

services:
  master:
    image: apache/seatunnel:2.3.13
    container_name: seatunnel_master
    restart: unless-stopped
    environment:
      - ST_DOCKER_MEMBER_LIST=seatunnel_master:5801,seatunnel_worker_1:5801,seatunnel_worker_2:5801
    entrypoint: /bin/sh -c "/opt/seatunnel/bin/seatunnel-cluster.sh -r master"
    ports:
      - "5801:5801"
    networks:
      - seatunnel_network
  worker1:
    image: apache/seatunnel:2.3.13
    container_name: seatunnel_worker_1
    restart: unless-stopped
    environment:
      - ST_DOCKER_MEMBER_LIST=seatunnel_master:5801,seatunnel_worker_1:5801,seatunnel_worker_2:5801
    entrypoint: /bin/sh -c "/opt/seatunnel/bin/seatunnel-cluster.sh -r worker"
    depends_on:
      - master
    networks:
      - seatunnel_network
  worker2:
    image: apache/seatunnel:2.3.13
    container_name: seatunnel_worker_2
    restart: unless-stopped
    environment:
      - ST_DOCKER_MEMBER_LIST=seatunnel_master:5801,seatunnel_worker_1:5801,seatunnel_worker_2:5801
    entrypoint: /bin/sh -c "/opt/seatunnel/bin/seatunnel-cluster.sh -r worker"
    depends_on:
      - master
    networks:
      - seatunnel_network
networks:
  seatunnel_network:
    name: seatunnel-network
    driver: bridge

部署

docker compose up -d

测试验证

验证节点状态

docker exec -it seatunnel_master /opt/seatunnel/bin/seatunnel.sh cluster list

提交job

本地模式

docker run --name seatunnel_client \
    --network seatunnel-network \
    -e ST_DOCKER_MEMBER_LIST=seatunnel_master:5801 \
    --rm \
    apache/seatunnel:2.3.13 \
    ./bin/seatunnel.sh --config config/v2.batch.config.template -m local

集群模式

docker run --name seatunnel_client \
    --network seatunnel-network \
    -e ST_DOCKER_MEMBER_LIST=seatunnel_master:5801 \
    --rm \
    apache/seatunnel:2.3.13 \
    ./bin/seatunnel.sh --config config/v2.batch.config.template -m cluster

查询job

docker run --name seatunnel_client \
    --network seatunnel-network \
    -e ST_DOCKER_MEMBER_LIST=seatunnel_master:5801 \
    --rm \
    apache/seatunnel \
    ./bin/seatunnel.sh  -l

扩容

若希望扩容节点数量，需在compose.yaml里复制现有配置，改名为work3或其他名字，追加配置即可。

到此这篇关于docker环境部署Apache Seatunnel集群模式的实现方法的文章就介绍到这了,更多相关docker部署Apache Seatunnel集群内容请搜索脚本之家以前的文章或继续浏览下面的相关文章希望大家以后多多支持脚本之家！

您可能感兴趣的文章:
阅读全文