Skip to content

[v7.0] add automation-worker #87

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
SkywalkerSpace wants to merge 6 commits into
base: main
Choose a base branch
from
Open

[v7.0] add automation-worker #87

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
93c5874
add automation-worker
SkywalkerSpace Jul 2, 2026
2816b88
add dtable-server
SkywalkerSpace Jul 16, 2026
2398a65
Apply suggestions from code review
SkywalkerSpace Jul 16, 2026
362ab84
update dtable-server caddy
SkywalkerSpace Jul 17, 2026
5ca937a
update dtable-server.yml
SkywalkerSpace Jul 22, 2026
7953c39
STORAGE_TYPE
SkywalkerSpace Jul 29, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
42 changes: 42 additions & 0 deletions compose/automation-worker-standalone.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
---
services:
Comment thread
SkywalkerSpace marked this conversation as resolved.
automation-worker:
image: ${AUTOMATION_WORKER_IMAGE:-seatable/automation-worker:7.0.0}
restart: unless-stopped
container_name: automation-worker
ports:
- 8088:8088
volumes:
- ${SEATABLE_VOLUMES:-/opt/seatable-server}:/shared
environment:
- SEATABLE_LOG_TO_STDOUT=${LOG_TO_STDOUT:-false}
- NON_ROOT=${NON_ROOT:-false}
- TZ=${TIME_ZONE:-UTC}
Comment thread
SkywalkerSpace marked this conversation as resolved.
- JWT_PRIVATE_KEY=${JWT_PRIVATE_KEY:?Variable is not set or empty}
- SEATABLE_MYSQL_DB_HOST=${MARIADB_HOST:-mariadb}
- SEATABLE_MYSQL_DB_PORT=${MARIADB_PORT:-3306}
- SEATABLE_MYSQL_DB_USER=root
- SEATABLE_MYSQL_DB_PASSWORD=${MARIADB_PASSWORD:?Variable is not set or empty}
- SEATABLE_MYSQL_DB_DTABLE_DB_NAME=${SEATABLE_MYSQL_DB_DTABLE_DB_NAME:-dtable_db}
- SEATABLE_MYSQL_DB_SEAFILE_DB_NAME=${SEATABLE_MYSQL_DB_SEAFILE_DB_NAME:-seafile_db}
- SEATABLE_MYSQL_DB_CCNET_DB_NAME=${SEATABLE_MYSQL_DB_CCNET_DB_NAME:-ccnet_db}
- REDIS_HOST=${REDIS_HOST:-redis}
- REDIS_PORT=${REDIS_PORT:-6379}
- REDIS_PASSWORD=${REDIS_PASSWORD:-}
- STORAGE_TYPE=${STORAGE_TYPE:-}
- S3_COMMIT_BUCKET=${S3_COMMIT_BUCKET:-}
- S3_FS_BUCKET=${S3_FS_BUCKET:-}
- S3_BLOCK_BUCKET=${S3_BLOCK_BUCKET:-}
- S3_KEY_ID=${S3_KEY_ID:-}
- S3_SECRET_KEY=${S3_SECRET_KEY:-}
- S3_USE_V4_SIGNATURE=${S3_USE_V4_SIGNATURE:-true}
- S3_AWS_REGION=${S3_AWS_REGION:-us-east-1}
- S3_HOST=${S3_HOST:-}
- S3_USE_HTTPS=${S3_USE_HTTPS:-true}
- S3_PATH_STYLE_REQUEST=${S3_PATH_STYLE_REQUEST:-false}
- S3_SSE_C_KEY=${S3_SSE_C_KEY:-}
- SEATABLE_SERVER_HOSTNAME=${SEATABLE_SERVER_HOSTNAME:?Variable is not set or empty}
- SEATABLE_SERVER_PROTOCOL=${SEATABLE_SERVER_PROTOCOL:-https}
- INNER_DTABLE_WEB_SERVICE_URL=${INNER_DTABLE_WEB_SERVICE_URL:?Variable is not set or empty}
- INNER_DTABLE_SERVER_URL=${INNER_DTABLE_SERVER_URL:?Variable is not set or empty}
- INNER_DTABLE_DB_URL=${INNER_DTABLE_DB_URL:?Variable is not set or empty}
51 changes: 51 additions & 0 deletions compose/automation-worker.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
---
services:
Comment thread
SkywalkerSpace marked this conversation as resolved.
automation-worker:
image: ${AUTOMATION_WORKER_IMAGE:-seatable/automation-worker:7.0.0}
restart: unless-stopped
container_name: automation-worker
volumes:
- ${SEATABLE_VOLUMES:-/opt/seatable-server}:/shared
environment:
- SEATABLE_LOG_TO_STDOUT=${LOG_TO_STDOUT:-false}
- NON_ROOT=${NON_ROOT:-false}
- TZ=${TIME_ZONE:-UTC}
Comment thread
SkywalkerSpace marked this conversation as resolved.
- JWT_PRIVATE_KEY=${JWT_PRIVATE_KEY:?Variable is not set or empty}

@simonhammes simonhammes Aug 28, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The automation-worker also needs access to the (Django) SECRET_KEY (e.g. in order to decrypt credentials for email accounts), right?

I'm currently getting Incorrect AES key length (0 bytes) errors in our staging environment.

- SEATABLE_MYSQL_DB_HOST=${MARIADB_HOST:-mariadb}
- SEATABLE_MYSQL_DB_PORT=${MARIADB_PORT:-3306}
- SEATABLE_MYSQL_DB_USER=root
- SEATABLE_MYSQL_DB_PASSWORD=${MARIADB_PASSWORD:?Variable is not set or empty}
- SEATABLE_MYSQL_DB_DTABLE_DB_NAME=${SEATABLE_MYSQL_DB_DTABLE_DB_NAME:-dtable_db}
- SEATABLE_MYSQL_DB_SEAFILE_DB_NAME=${SEATABLE_MYSQL_DB_SEAFILE_DB_NAME:-seafile_db}
- SEATABLE_MYSQL_DB_CCNET_DB_NAME=${SEATABLE_MYSQL_DB_CCNET_DB_NAME:-ccnet_db}
- REDIS_HOST=${REDIS_HOST:-redis}
- REDIS_PORT=${REDIS_PORT:-6379}
- REDIS_PASSWORD=${REDIS_PASSWORD:-}
- STORAGE_TYPE=${STORAGE_TYPE:-disk}

@simonhammes simonhammes Aug 7, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The options for dtable-storage-server are s3 or filesystem, why does this introduce a third variant/an alias for filesystem?

@SkywalkerSpace SkywalkerSpace Aug 7, 2026

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because seafobj requires disk rather than filesystem, we will find a way to resolve this issue.

- S3_COMMIT_BUCKET=${S3_COMMIT_BUCKET:-}
- S3_FS_BUCKET=${S3_FS_BUCKET:-}
- S3_BLOCK_BUCKET=${S3_BLOCK_BUCKET:-}
- S3_KEY_ID=${S3_KEY_ID:-}
- S3_SECRET_KEY=${S3_SECRET_KEY:-}
- S3_USE_V4_SIGNATURE=${S3_USE_V4_SIGNATURE:-true}
- S3_AWS_REGION=${S3_AWS_REGION:-us-east-1}
- S3_HOST=${S3_HOST:-}
- S3_USE_HTTPS=${S3_USE_HTTPS:-true}
- S3_PATH_STYLE_REQUEST=${S3_PATH_STYLE_REQUEST:-false}
- S3_SSE_C_KEY=${S3_SSE_C_KEY:-}
- SEATABLE_SERVER_HOSTNAME=${SEATABLE_SERVER_HOSTNAME:?Variable is not set or empty}
- SEATABLE_SERVER_PROTOCOL=${SEATABLE_SERVER_PROTOCOL:-https}
Comment thread
simonhammes marked this conversation as resolved.
- INNER_DTABLE_WEB_SERVICE_URL=${INNER_DTABLE_WEB_SERVICE_URL:-http://seatable-server:8000}

@simonhammes simonhammes Aug 26, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- INNER_DTABLE_WEB_SERVICE_URL=${INNER_DTABLE_WEB_SERVICE_URL:-http://seatable-server:8000}
- INNER_DTABLE_WEB_SERVICE_URL=${INNER_DTABLE_WEB_SERVICE_URL:-http://seatable-server:80}

Otherwise gunicorn.py needs to be modified (Gunicorn does not currently listen on all interfaces).

- INNER_DTABLE_SERVER_URL=${INNER_DTABLE_SERVER_URL:-http://seatable-server:5000}
- INNER_DTABLE_DB_URL=${INNER_DTABLE_DB_URL:-http://seatable-server:7777}
depends_on:

@simonhammes simonhammes Aug 26, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are a few more variables missing for the automation-worker service:

  • INNER_SEATABLE_AI_SERVER_URL
  • PYTHON_SCHEDULER_URL
  • PYTHON_SCHEDULER_AUTH_TOKEN

We can handle ENABLE_SEATABLE_AI and ENABLE_PYTHON_SCRIPT through seatable-ai.yml and python-pipeline.yml respectively.

mariadb:
condition: service_healthy
redis:
condition: service_healthy
networks:
- backend-seatable-net

networks:
backend-seatable-net:
name: backend-seatable-net
35 changes: 35 additions & 0 deletions compose/seatable-server.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,6 +52,7 @@ services:
- LOG_LEVEL=${LOG_LEVEL:-INFO}
- ENABLE_SEATABLE_AI=${ENABLE_SEATABLE_AI:-false}
- INNER_SEATABLE_AI_SERVER_URL=${INNER_SEATABLE_AI_SERVER_URL:-http://seatable-ai:8888}
- INNER_DTABLE_SERVER_URL=${INNER_DTABLE_SERVER_URL:-http://dtable-server:5000}
labels:
caddy_0: ${SEATABLE_SERVER_PROTOCOL:-https}://${SEATABLE_SERVER_HOSTNAME:?Variable is not set or empty}
caddy_0.reverse_proxy: "{{upstreams 80}}"
Expand Down Expand Up @@ -116,6 +117,40 @@ services:
start_period: 30s
timeout: 10s

dtable-server:
image: ${DTABLE_SERVER_IMAGE:-seatable/dtable-server-js:7.0.0-testing}
restart: unless-stopped
container_name: dtable-server
volumes:
- "/opt/seatable-server:/shared"
Comment on lines +124 to +125

@simonhammes simonhammes Aug 28, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

dtable-server also needs access to seatable-license.txt since it checks for its existence inside its entrypoint script, right?

environment:
- TZ=${TIME_ZONE}
- SEATABLE_MYSQL_DB_HOST=${MARIADB_HOST:-mariadb}
- SEATABLE_MYSQL_DB_PORT=${MARIADB_PORT:-3306}
- SEATABLE_MYSQL_DB_USER=root
- SEATABLE_MYSQL_DB_PASSWORD=${MARIADB_PASSWORD:?Variable is not set or empty}
- SEATABLE_MYSQL_DB_DTABLE_DB_NAME=dtable_db
- REDIS_HOST=${REDIS_HOST:-redis}
- REDIS_PORT=${REDIS_PORT:-6379}
- REDIS_PASSWORD=${REDIS_PASSWORD:?Variable is not set or empty}
- JWT_PRIVATE_KEY=${JWT_PRIVATE_KEY:?Variable is not set or empty}
- INNER_DTABLE_WEB_SERVICE_URL=${INNER_DTABLE_WEB_SERVICE_URL:-http://seatable-server:8000}
- INNER_DTABLE_DB_URL=${INNER_DTABLE_DB_URL:-http://seatable-server:7777}
depends_on:
mariadb:
condition: service_healthy
redis:
condition: service_healthy
networks:
- frontend-net
- backend-seatable-net
healthcheck:
test: ["CMD-SHELL", "curl --fail http://localhost:5000/ping || exit 1"]
interval: 20s
retries: 3
start_period: 30s
timeout: 10s

mariadb:
image: ${SEATABLE_DB_IMAGE:-mariadb:11.8.5-noble}
restart: unless-stopped
Expand Down