feat(deploy): 证书同步改为单片段 include + ver 命名 + 声明式自愈与差集下线
- 站点内容外置为单一片段(upstreamInclude,运维维护):生成的 server 块 = 证书骨架 + 一行 include <片段>,撤掉此前的 customDir 多片段方案;并强制 include 必须是绝对路径 且文件已存在(nginx 解析相对 include 的基准是 nginx prefix,不是脚本 cwd,写相对路径 会让 nginx -t 失败并回滚整轮变更),不满足直接 exit 1(dry-run 下仅告警) - conf 命名加版本位 <domain>-<ver>.conf:轮转只改配置的 ver,旧命名自动清理并 reload - 声明式对账自愈:证书 / 私钥 / server 块缺失或被改坏,按库内内容原子重建后统一 nginx -t + reload(内容一致时零写入、零 reload);失败态(sync_status=2)同样参与 收敛并在校验通过后回到 1;nginx -t / reload 属全局失败,只落 last_sync_error 下轮 重试,不再把行写成 2 卡死 - 域名下线改为配置差集驱动:以「已配置 + 已验证 + 证书就绪」的期望集合为准(同一仓库 只取 id 最小的一条),目录中属于本系统命名规则但配置里已无该域名的 conf / 证书直接 删除并 reload;不再消费 retired_domain(该列仅作应用侧审计留痕) - 证书未配置的行不写 conf 也不作为文件保留依据(遗留产物由差集回收,避免 conf 引用 不存在的证书导致 nginx -t 全局失败),行状态回写 sync_status=0 待同步;证书非空但 非法、域名形态非法才记行级失败(2) - cert-sync 部署命令瘦身为 install / uninstall;新增 watchdog 部署命令(precheck / install / status / dry-run / run),安装路径统一到 script/;deploy-lib 保护生产运行时 配置不被发布覆盖;README 补「发布与运维」章节(目录硬约定 / 定时任务 / 命令清单)
This commit is contained in:
parent
cb8a4244e5
commit
0918f2d572
69
README.md
69
README.md
@ -123,6 +123,75 @@ npm run doc:api:update -- --spec=temp/api-doc-update.json --dry-run
|
||||
- 数据库、Redis、平台配置在对应配置文件中维护
|
||||
- 敏感信息不要提交到仓库
|
||||
|
||||
## 发布与运维(deploy / 证书同步 / 看门狗)
|
||||
|
||||
### 部署根布局(生产 `deployRoot` 默认 `/www/wwwroot/qimen`)
|
||||
|
||||
```text
|
||||
<deployRoot>/
|
||||
├── current.md # 当前活跃版本(v1 | v2)
|
||||
├── nginx-upstream.conf # 发布时改写:proxy_pass 指向活跃版本端口(v1:6061 / v2:6062)
|
||||
├── front.conf # 站点内容片段(root / 伪静态),运维维护、脚本绝不覆盖
|
||||
├── .ssl/ # 证书目录(cron 写入 {store_id}_{domain}.pem|.key,私钥 0600)
|
||||
├── nginx_config/ # nginx server 块目录(cron 写入 {domain}-<ver>.conf,如 web.wms.gztbyc.com-1.conf)
|
||||
├── script/
|
||||
│ ├── warehouse-cert-sync.sh # 证书同步薄包装(cron 每分钟入口)
|
||||
│ ├── warehouse-cert-sync.cjs # 证书同步主脚本(读库→写证书/conf→nginx -t+reload→回写状态)
|
||||
│ ├── warehouse-cert-sync.config.prod.json # 生产运行时配置(服务器自管:仅首次放置,永不覆盖)
|
||||
│ └── qimen-watchdog.sh # 接口服务看门狗(/etc/cron.d 每 5 分钟)
|
||||
├── database/config.js # 上述脚本自用的 DB 配置(install 时上传)
|
||||
├── .deploy/ # 发布状态 / 暂存 / 备份
|
||||
└── v1/ v2/ # 版本实例目录(发布与回退只清理这里)
|
||||
```
|
||||
|
||||
### 目录约定(**硬约定**:只随 `deployRoot` 变,不随版本切换变)
|
||||
|
||||
| 用途 | 路径 | 配置来源 |
|
||||
|------|------|----------|
|
||||
| 证书 | `<deployRoot>/.ssl` | `script/warehouse-cert-sync.config.prod.json` → `"certDir": "./.ssl"`(开发 `D:/wms/.ssl`) |
|
||||
| nginx server 块 | `<deployRoot>/nginx_config` | 同上 → `"confDir": "./nginx_config"`(开发 `D:/wms/nginx_config`) |
|
||||
| 站点内容片段 | `upstreamInclude` 指向的片段文件(生产 `<deployRoot>/front.conf`) | 同上 → `"upstreamInclude"`(**绝对路径**,**运维维护**) |
|
||||
|
||||
- 相对路径按 **cwd=部署根** 解析(薄包装先 `cd <deployRoot>`),目录不存在时脚本自动递归创建。
|
||||
- 这两个目录都在**部署根一级**(非版本目录):发布/回退只清理 `v1|v2`,不会触碰它们。
|
||||
- **server 块命名含 `-<ver>`**:文件名为 `<domainSafe><suffix>-<ver>.conf`(suffix 仅当域名清洗后与原名不一致时出现),版本键 `ver` 在运行时配置里(`"ver": "1"`),可用 CLI `--ver` / 环境变量 `CERT_SYNC_VER` 临时覆盖;nginx 主配置 `include <deployRoot>/nginx_config/*.conf;` 与新命名兼容,无需改 nginx。
|
||||
- **每轮声明式对账 + 自愈**:cron 每分钟把库内「期望集合」(domain 非空且已验证)逐行与磁盘核对,证书 / 私钥 / server 块缺失、被改坏或**命名过期**(旧的无后缀命名、旧 `-<ver>`、手工改名)都会自动重建 / 清理后 reload;内容一致时零写入、零 reload。不再只依赖后台“重新上传证书”触发同步。
|
||||
- **失败态(`sync_status=2`)同样收敛,不是「终态豁免」**:失败行也参与文件层对账——盘上证书 / 私钥 / server 块缺失或与库不一致就按库内容重建,本轮 `nginx -t`/reload 通过后自动回写 `sync_status=1`(日志 `[RECOVER]` / `[RECOVERED]`)。所以「手工删掉 `.ssl`、`nginx_config`」「早期遗留的失败行」都能自动恢复,**无需人工重传证书**。唯一需要人工的情形:库内 `cert_pem`/`cert_key` 为空或非法(无内容可写,日志 `[BLOCKED]`,需在后台上传证书)。
|
||||
- **nginx 全局失败不写行失败**:`nginx -t` / reload 失败属环境问题(主配置、片段 include、目录),此时待同步行保持 `sync_status=0`、已同步行保持 `1`、失败行保持 `2`,只落 `last_sync_error` 并下一轮自动重试,避免「运维修好配置后行却卡死在 2、必须人工重传证书」。
|
||||
- **下线 = 配置差集(不需要两阶段切换的额外机制)**:期望集合 = 库内「已配置 + 已验证 + 证书就绪」的行,且**每个仓库只取一条**(同一 `store_id` 多行时按 id 最小者生效,其余行 WARN 后忽略)。`nginx_config/`、`.ssl/` 中属于本系统命名规则、但域名已不在期望集合内的文件会被删除并 reload(日志 `DELETE … 原因=orphan`)。所以**换域名不需要人工下线**:旧域名在提升后已不是该行的 `domain`,下一轮即被清掉;`retired_domain` / `retired_at` 仅作应用侧审计留痕,脚本不读取、不写回。
|
||||
- **证书没配置就不写配置**:`cert_pem` / `cert_key` 为空的行**不生成** server 块,也不作为文件保留依据(其遗留 conf / 证书会被差集回收——conf 引用不存在的证书会让 `nginx -t` 全局失败),行状态回写 `sync_status=0` 待同步;证书非空但非法(或域名形态非法)才记行级失败(`sync_status=2`)。
|
||||
- **ver 轮转步骤**:改服务器 `warehouse-cert-sync.config.prod.json` 的 `"ver"`(或临时 `--ver`)→ 下一轮 cron 自动生成新命名 `<domain>-<新ver>.conf`、删除旧命名并 reload;无需清空库、无需重传证书(证书文件名不含 ver,不受影响)。
|
||||
- **站点内容单一片段**:生成的 server 块 = 证书骨架 + `include <upstreamInclude>;`;站点内容(root / 伪静态 或 反代)统一由 `upstreamInclude` 指向的片段文件提供(生产 `/www/wwwroot/qimen/front.conf`),**由运维维护、脚本绝不覆盖**;前端个性化在运行时由配置接口按域名完成,nginx 侧无需按域名区分站点内容。
|
||||
- ⚠️ **`upstreamInclude` 必须写绝对路径,且片段文件必须先存在**:nginx 解析 `include` 相对路径的基准是 **nginx prefix**(宝塔为 `/www/server/nginx/conf`),**不是脚本 cwd(部署根)**;写相对路径会让生成的 server 块 include 到不存在的文件 → `nginx -t` 失败 → 整轮变更回滚(连本轮写入的证书一起被当孤儿回收)。脚本启动即校验,不满足直接 `exit 1`(致命退出、不写盘、不改库)。
|
||||
- **改名/搬迁必须同步三处**:① nginx 主配置的 `include <deployRoot>/nginx_config/*.conf;`;② 服务器上的 `warehouse-cert-sync.config.prod.json`;③ 库表 `wms_warehouse_front_config.cert_path/key_path`(触发一次重同步即可刷新)。
|
||||
- 安全:`.ssl/` 与 `nginx_config/` 已在 `.gitignore` 忽略,且列入发布默认排除(`deploy-lib.cjs` 的 `DEFAULT_EXCLUDE_PATHS`),私钥不会进仓库或发布包。
|
||||
|
||||
### 定时任务
|
||||
|
||||
| 任务 | 载体 | 频率 | 入口与日志 |
|
||||
|------|------|------|-----------|
|
||||
| 证书/站点配置同步 | root crontab(**宝塔「计划任务」里看不到**,它是直接写入 crontab 的裸命令) | 每分钟(`flock` 锁 `/var/lock/warehouse-cert-sync.lock`) | `<deployRoot>/script/warehouse-cert-sync.sh` → `/var/log/warehouse-cert-sync.log` |
|
||||
| 接口服务看门狗 | `/etc/cron.d/qimen-watchdog`(**刻意不放 root crontab**:宝塔面板会整体重写 root crontab) | 每 5 分钟 | `<deployRoot>/script/qimen-watchdog.sh` → `/www/wwwlogs/wms/qimen-watchdog.log` |
|
||||
|
||||
### 运维命令
|
||||
|
||||
```bash
|
||||
npm run deploy:precheck / deploy:authcheck / deploy:inspect / deploy:smoke / deploy:verify
|
||||
npm run deploy:version / deploy:version:history / deploy:cleanup-backups / deploy:gateway-probe
|
||||
npm run deploy # 发布(= deploy:prod);npm run rollback # 回退
|
||||
npm run deploy:cert-sync:install / npm run deploy:cert-sync:uninstall
|
||||
npm run deploy:watchdog:precheck | :install | :status | :dry-run | :run
|
||||
```
|
||||
|
||||
- **部署配置**:`config/deploy.config.local.cjs`(**本地文件、已被 `.gitignore` 忽略**;模板 `config/deploy.config.example.cjs`)。键:`host / port / username / privateKeyPath / deployRoot / sharedDirs / preserveDirs / keepBackups / preDeployCommands / postDeployCommands / healthCheckUrl / deployIncludePaths / deployExcludePaths / sshOptions`;缺省值在 `script/deploy-lib.cjs`。查看归一化后的生效配置:
|
||||
```bash
|
||||
node -e "console.log(JSON.stringify(require('./script/deploy-lib.cjs').loadDeployConfig('production'),null,2))"
|
||||
```
|
||||
- **证书同步运行时配置**:`script/warehouse-cert-sync.config.prod.json`(生产)/ `.dev.json`(开发)。生产那份是**服务器自管**(`deploy:cert-sync:install` 仅首次放置,之后永不覆盖)——改生产运行参数请在**服务器上**直接改它,改本地仓库无效。
|
||||
- **安装位置**:`deploy:cert-sync:install` 与 `deploy:watchdog:install` 都装到 `<deployRoot>/script/`;覆盖前会留 `.prev-<时间戳>` 备份,历史根目录副本会被一次性挪成 `<名>.legacy-<时间戳>`。
|
||||
- **卸载**(`deploy:cert-sync:uninstall`):先备份再删除——备份到服务器 `/tmp/wms-cert-sync-uninstall-<时间戳>/`(`cp -a` 保留权限/时间),删除包装脚本、主脚本、双环境配置、`database/config.js`、历史位置与 `.prev-*`/`.legacy-*` 备份、crontab 中 `warehouse-cert-sync` 行;支持 `--dry-run` 只打印计划。**不删**证书与生成的 server 块(nginx 仍在 include,删了会立断 443,由运维自行决定)、不删 `/var/log/warehouse-cert-sync.log`(默认保留作排查线索)、不碰任何 watchdog 相关文件/任务。
|
||||
- **运行期手动排查**:仍可直接执行服务器上的 `<deployRoot>/script/warehouse-cert-sync.sh --dry-run`(主脚本 CLI 不变:`--cleanup-only --dry-run` / `--cleanup-only` / `--env production`)。
|
||||
|
||||
## 功能模块
|
||||
|
||||
- 多快递平台对接(快手/PolyAPI 等)
|
||||
|
||||
13
package.json
13
package.json
@ -59,14 +59,13 @@
|
||||
"deploy:smoke": "node ./script/deploy-ops.cjs production smoke",
|
||||
"deploy:verify": "node ./script/deploy-ops.cjs production verify",
|
||||
"deploy:cleanup-backups": "node ./script/deploy-ops.cjs production cleanup-backups",
|
||||
"deploy:cert-sync:precheck": "node ./script/deploy-cert-sync.cjs production precheck",
|
||||
"deploy:cert-sync:install": "node ./script/deploy-cert-sync.cjs production install",
|
||||
"deploy:cert-sync:dry-run": "node ./script/deploy-cert-sync.cjs production dry-run",
|
||||
"deploy:cert-sync:run": "node ./script/deploy-cert-sync.cjs production run",
|
||||
"deploy:cert-sync:status": "node ./script/deploy-cert-sync.cjs production status",
|
||||
"deploy:cert-sync:config-check": "node ./script/deploy-cert-sync.cjs production config-check",
|
||||
"deploy:cert-sync:cleanup-dry-run": "node ./script/deploy-cert-sync.cjs production cleanup-dry-run",
|
||||
"deploy:cert-sync:cleanup": "node ./script/deploy-cert-sync.cjs production cleanup",
|
||||
"deploy:cert-sync:uninstall": "node ./script/deploy-cert-sync.cjs production uninstall",
|
||||
"deploy:watchdog:precheck": "node ./script/deploy-watchdog.cjs production precheck",
|
||||
"deploy:watchdog:install": "node ./script/deploy-watchdog.cjs production install",
|
||||
"deploy:watchdog:status": "node ./script/deploy-watchdog.cjs production status",
|
||||
"deploy:watchdog:dry-run": "node ./script/deploy-watchdog.cjs production dry-run",
|
||||
"deploy:watchdog:run": "node ./script/deploy-watchdog.cjs production run",
|
||||
|
||||
"deploy:gateway-probe": "node ./script/deploy-ops.cjs production gateway-probe",
|
||||
"ops:check-root-logs": "node ./script/check-root-logs.cjs",
|
||||
|
||||
@ -1,3 +1,18 @@
|
||||
/**
|
||||
* cert-sync 部署工具(npm 命令仅 install / uninstall 两条)。
|
||||
*
|
||||
* - install:校验并上传主脚本 / DB 配置;prod 配置按「首次放置一次、永不覆盖」约定处理;
|
||||
* 生成薄包装 <deployRoot>/script/warehouse-cert-sync.sh 并注册 root crontab(每分钟 flock)。
|
||||
* - uninstall:先备份再删除工具自身(包装脚本 / 主脚本 / 双环境配置 / database/config.js /
|
||||
* 历史位置与 .prev-* / .legacy-* 备份 / crontab 行);支持 --dry-run 只打印计划。
|
||||
* 证书、nginx server 块、日志、watchdog 相关一律不删(原因见输出)。
|
||||
*
|
||||
* 运行期手动操作仍可直接调用服务器上的包装脚本(这是主脚本 CLI 的能力,不属于本工具 npm 命令):
|
||||
* <deployRoot>/script/warehouse-cert-sync.sh --dry-run
|
||||
* <deployRoot>/script/warehouse-cert-sync.sh --cleanup-only --dry-run
|
||||
* <deployRoot>/script/warehouse-cert-sync.sh --cleanup-only
|
||||
* <deployRoot>/script/warehouse-cert-sync.sh --env production
|
||||
*/
|
||||
'use strict';
|
||||
|
||||
const fs = require('node:fs');
|
||||
@ -11,26 +26,52 @@ const {
|
||||
runSsh,
|
||||
} = require('./deploy-lib.cjs');
|
||||
|
||||
const COMMANDS = new Set([ 'precheck', 'install', 'dry-run', 'run', 'status', 'config-check', 'cleanup-dry-run', 'cleanup' ]);
|
||||
const COMMANDS = new Set([ 'install', 'uninstall' ]);
|
||||
|
||||
const LOCAL_SYNC_SCRIPT = path.join(ROOT, 'script', 'warehouse-cert-sync.cjs');
|
||||
const LOCAL_DB_CONFIG = path.join(ROOT, 'database', 'config.js');
|
||||
const LOCAL_PROD_CONFIG = path.join(ROOT, 'script', 'warehouse-cert-sync.config.prod.json');
|
||||
|
||||
/**
|
||||
* 打印本工具用法(仅 install / uninstall 两条 npm 命令)。
|
||||
*/
|
||||
function printUsage() {
|
||||
console.error([
|
||||
'usage: node script/deploy-cert-sync.cjs [env] <command> [--dry-run]',
|
||||
' env: production | development(默认 production)',
|
||||
' command: install 上传脚本/配置、生成薄包装、注册 crontab',
|
||||
' uninstall 备份并删除工具自身(脚本/配置/crontab),支持 --dry-run',
|
||||
'运行期手动操作请直接调用服务器上的包装脚本(主脚本 CLI 能力,非本工具命令):',
|
||||
' <deployRoot>/script/warehouse-cert-sync.sh --dry-run',
|
||||
' <deployRoot>/script/warehouse-cert-sync.sh --cleanup-only --dry-run',
|
||||
' <deployRoot>/script/warehouse-cert-sync.sh --cleanup-only',
|
||||
' <deployRoot>/script/warehouse-cert-sync.sh --env production',
|
||||
].join('\n'));
|
||||
}
|
||||
|
||||
/**
|
||||
* 解析命令行参数。
|
||||
* @param {string[]} argv 原始参数数组(不含 node / 脚本名)。
|
||||
* @return {{ envName: string, command: string, dryRun: boolean }} 解析结果。
|
||||
*/
|
||||
function parseArgs(argv) {
|
||||
const options = { envName: 'production', command: '' };
|
||||
const options = { envName: 'production', command: '', dryRun: false };
|
||||
const tokens = [ ...argv ];
|
||||
if (tokens.length === 0) {
|
||||
throw new Error('missing command: precheck | install | dry-run | run | status | config-check | cleanup-dry-run | cleanup');
|
||||
options.dryRun = tokens.includes('--dry-run');
|
||||
const positional = tokens.filter(token => token !== '--dry-run');
|
||||
if (positional.length === 0) {
|
||||
printUsage();
|
||||
throw new Error('missing command: install | uninstall');
|
||||
}
|
||||
if (!COMMANDS.has(tokens[0])) {
|
||||
options.envName = tokens[0];
|
||||
tokens.shift();
|
||||
if (!COMMANDS.has(positional[0])) {
|
||||
options.envName = positional[0];
|
||||
positional.shift();
|
||||
}
|
||||
if (tokens.length === 0 || !COMMANDS.has(tokens[0])) {
|
||||
throw new Error('missing command: precheck | install | dry-run | run | status | config-check | cleanup-dry-run | cleanup');
|
||||
if (positional.length === 0 || !COMMANDS.has(positional[0])) {
|
||||
printUsage();
|
||||
throw new Error('missing command: install | uninstall');
|
||||
}
|
||||
options.command = tokens[0];
|
||||
options.command = positional[0];
|
||||
return options;
|
||||
}
|
||||
|
||||
@ -142,132 +183,6 @@ exit $STATUS
|
||||
`;
|
||||
}
|
||||
|
||||
/** Read-only DB probe JS (never prints credentials). */
|
||||
const DB_PROBE_JS = `
|
||||
const path = require("node:path");
|
||||
const Sequelize = require("sequelize");
|
||||
const appDir = process.argv[1];
|
||||
function load(p) {
|
||||
try {
|
||||
const f = require(p);
|
||||
const c = typeof f === "function" ? f({ name: "cert-sync-precheck", baseDir: appDir }) : f;
|
||||
return c && typeof c === "object" ? c : {};
|
||||
} catch (e) { return {}; }
|
||||
}
|
||||
let src = "none"; let client = null;
|
||||
const def = load(path.join(appDir, "config", "config.default.js"));
|
||||
if (def.sequelize && def.sequelize.host) { src = "config.default.js#sequelize"; client = def.sequelize; }
|
||||
else if (def.mysql && def.mysql.clients && def.mysql.clients.wms && def.mysql.clients.wms.host) { src = "config.default.js#mysql.clients.wms"; client = def.mysql.clients.wms; }
|
||||
else if (def.mysql && def.mysql.host) { src = "config.default.js#mysql"; client = def.mysql; }
|
||||
if (!client) {
|
||||
const loc = load(path.join(appDir, "config", "config.local.js"));
|
||||
if (loc.sequelize && loc.sequelize.host) { src = "config.local.js#sequelize"; client = loc.sequelize; }
|
||||
else if (loc.mysql && loc.mysql.host) { src = "config.local.js#mysql"; client = loc.mysql; }
|
||||
}
|
||||
if (!client) { console.log("[DB_PROBE] cannot resolve db config from active instance"); process.exit(0); }
|
||||
console.log("[DB_PROBE] config source: " + src + " database=" + String(client.database || ""));
|
||||
const seq = new Sequelize(client.database, client.username || client.user, client.password, {
|
||||
host: client.host, port: client.port || 3306, dialect: "mysql", logging: false,
|
||||
});
|
||||
(async () => {
|
||||
try {
|
||||
await seq.authenticate();
|
||||
console.log("[DB_PROBE] prod db connect OK");
|
||||
const [t] = await seq.query("SELECT COUNT(*) AS c FROM information_schema.tables WHERE table_schema = DATABASE() AND table_name = 'wms_warehouse_front_config'");
|
||||
const exists = Number(t[0].c) > 0;
|
||||
console.log("[DB_PROBE] wms_warehouse_front_config exists: " + (exists ? "YES" : "NO"));
|
||||
if (exists) {
|
||||
const [cols] = await seq.query("SELECT column_name AS cn FROM information_schema.columns WHERE table_schema = DATABASE() AND table_name = 'wms_warehouse_front_config'");
|
||||
console.log("[DB_PROBE] columns: " + cols.map(r => r.cn).join(","));
|
||||
const hasDomainStatus = cols.some(r => r.cn === "domain_status");
|
||||
console.log("[DB_PROBE] domain_status column: " + (hasDomainStatus ? "YES" : "NO"));
|
||||
const [total] = await seq.query("SELECT COUNT(*) AS c FROM wms_warehouse_front_config");
|
||||
console.log("[DB_PROBE] total rows: " + total[0].c);
|
||||
const [dist] = await seq.query("SELECT sync_status AS s, COUNT(*) AS c FROM wms_warehouse_front_config GROUP BY sync_status ORDER BY sync_status");
|
||||
console.log("[DB_PROBE] sync_status distribution: " + (dist.length ? dist.map(r => r.s + "=" + r.c).join(" ") : "(empty)"));
|
||||
if (hasDomainStatus) {
|
||||
const [ddist] = await seq.query("SELECT domain_status AS s, COUNT(*) AS c FROM wms_warehouse_front_config GROUP BY domain_status ORDER BY domain_status");
|
||||
console.log("[DB_PROBE] domain_status distribution: " + (ddist.length ? ddist.map(r => (r.s === null ? "null" : r.s) + "=" + r.c).join(" ") : "(empty)"));
|
||||
const sumStatus = want => ddist.filter(r => Number(r.s) === want).reduce((n, r) => n + Number(r.c), 0);
|
||||
console.log("[DB_PROBE] domain_status counts: 0_unverified=" + sumStatus(0) + " 1_verified=" + sumStatus(1) + " 2_failed=" + sumStatus(2));
|
||||
console.log("[DB_PROBE] gated-out rows (domain_status 0/2, no nginx server block after gate): " + (sumStatus(0) + sumStatus(2)));
|
||||
} else {
|
||||
console.log("[DB_PROBE] domain_status distribution: (column missing, migration not applied; cert-sync falls back to no filter)");
|
||||
}
|
||||
const hasRetiredDomain = cols.some(r => r.cn === "retired_domain");
|
||||
console.log("[DB_PROBE] retired_domain column: " + (hasRetiredDomain ? "YES" : "NO"));
|
||||
if (hasRetiredDomain) {
|
||||
const [rCount] = await seq.query("SELECT COUNT(*) AS c FROM wms_warehouse_front_config WHERE retired_domain IS NOT NULL AND retired_domain <> ''");
|
||||
const [rPreview] = await seq.query("SELECT retired_domain AS d FROM wms_warehouse_front_config WHERE retired_domain IS NOT NULL AND retired_domain <> '' ORDER BY id ASC LIMIT 20");
|
||||
const names = rPreview.map(r => String(r.d)).join(",");
|
||||
console.log("[DB_PROBE] retired_domain pending: retired=" + rCount[0].c + (names ? ": " + names : ""));
|
||||
} else {
|
||||
console.log("[DB_PROBE] retired_domain pending: (column missing, migration not applied; cleanup flow skipped)");
|
||||
}
|
||||
|
||||
}
|
||||
} catch (e) {
|
||||
console.log("[DB_PROBE] failed: " + e.message);
|
||||
}
|
||||
await seq.close();
|
||||
})();
|
||||
`;
|
||||
|
||||
/**
|
||||
* Read-only remote precheck.
|
||||
* @param {Object} config deploy 配置对象。
|
||||
*/
|
||||
function runPrecheck(config) {
|
||||
const deployRoot = config.deployRoot;
|
||||
const remoteScript = [
|
||||
'set -uo pipefail',
|
||||
`DEPLOY_ROOT=${quoteForBash(deployRoot)}`,
|
||||
'echo "[WHOAMI] $(id -un)"',
|
||||
'echo "[UNAME] $(uname -a)"',
|
||||
`echo "[CURRENT_MD] $(cat ${quoteForBash(`${deployRoot}/current.md`)} 2>/dev/null || echo MISSING)"`,
|
||||
`echo "[DEPLOY_ROOT_LS]"; ls -la ${quoteForBash(deployRoot)} | awk '{print $1, $3, $4, $9}'`,
|
||||
'echo "[NGINX_BIN]"; command -v nginx || echo "nginx not in PATH"',
|
||||
'echo "[NGINX_V]"; nginx -v 2>&1 || true',
|
||||
'echo "[NGINX_V_PREFIX]"; nginx -V 2>&1 | grep -E "configure arguments|--prefix" | head -2 || true',
|
||||
'echo "[NGINX_T_NOW]"; nginx -t 2>&1 || true',
|
||||
'echo "[NGINX_PROCESS]"; ps -eo pid=,args= | grep "[n]ginx" | head -6 || true',
|
||||
'echo "[SYSTEMD_NGINX]"; systemctl is-active nginx 2>&1 || true; systemctl is-enabled nginx 2>&1 || true',
|
||||
'echo "[FLOCK]"; command -v flock || echo "flock missing"',
|
||||
'echo "[MAIN_CONF_INCLUDES]"; for f in /etc/nginx/nginx.conf /www/server/nginx/conf/nginx.conf /usr/local/nginx/conf/nginx.conf; do if [ -f "$f" ]; then echo "-- $f"; grep -n "include" "$f" | grep -v "^[[:space:]]*#" | head -20; fi; done',
|
||||
'echo "[CONF_DIR_PROBE]"; for d in /etc/nginx/conf.d /www/server/nginx/conf/conf.d; do if [ -d "$d" ]; then echo "-- $d EXISTS"; ls -1 "$d" | head -20; fi; done',
|
||||
'echo "[SSL_DIR] /www/wwwroot/.ssl"; if [ -d /www/wwwroot/.ssl ]; then echo EXISTS; ls -la /www/wwwroot/.ssl | head -20; else echo MISSING; fi',
|
||||
'echo "[CERT_CONF_DIR] /www/wwwroot/nginx_config"; if [ -d /www/wwwroot/nginx_config ]; then echo EXISTS; ls -la /www/wwwroot/nginx_config | head -30; else echo MISSING; fi',
|
||||
'echo "[PARENT_WRITABLE]"; if [ -w /www/wwwroot ]; then echo YES; else echo NO; fi',
|
||||
'echo "[DEPLOY_ROOT_META]"; for p in script database config node_modules; do if [ -e "$DEPLOY_ROOT/$p" ]; then echo "$p EXISTS"; else echo "$p MISSING"; fi; done',
|
||||
'echo "[V1_CONFIG_LS]"; ls -la "$DEPLOY_ROOT/v1/config" 2>/dev/null | head -20 || echo "v1/config missing"',
|
||||
'echo "[V2_CONFIG_LS]"; ls -la "$DEPLOY_ROOT/v2/config" 2>/dev/null | head -20 || echo "v2/config missing"',
|
||||
'echo "[V1_SEQUELIZE]"; if [ -d "$DEPLOY_ROOT/v1/node_modules/sequelize" ]; then echo YES; else echo NO; fi',
|
||||
'echo "[V2_SEQUELIZE]"; if [ -d "$DEPLOY_ROOT/v2/node_modules/sequelize" ]; then echo YES; else echo NO; fi',
|
||||
'echo "[EXISTING_CRON_CERT]"; crontab -l 2>/dev/null | grep -i "cert" || echo NONE',
|
||||
'echo "[CRON_LINE_COUNT]"; crontab -l 2>/dev/null | grep -cv "^#" || echo 0',
|
||||
'echo "[CERT_LOG_TAIL]"; tail -20 /var/log/warehouse-cert-sync.log 2>/dev/null || echo "log not exists"',
|
||||
].join('\n');
|
||||
|
||||
console.log('[PRECHECK] remote env check (read-only)');
|
||||
console.log(runSsh(config, remoteScript, { stdio: 'pipe' }).trim());
|
||||
|
||||
const dbProbeScript = [
|
||||
'set -uo pipefail',
|
||||
`DEPLOY_ROOT=${quoteForBash(deployRoot)}`,
|
||||
'ACTIVE=$(cat "$DEPLOY_ROOT/current.md" 2>/dev/null | tr -d "[:space:]" || true)',
|
||||
'APP_DIR=""',
|
||||
'if [ -n "$ACTIVE" ] && [ -d "$DEPLOY_ROOT/$ACTIVE/config" ]; then APP_DIR="$DEPLOY_ROOT/$ACTIVE"; fi',
|
||||
'if [ -z "$APP_DIR" ]; then for CAND in v1 v2; do if [ -d "$DEPLOY_ROOT/$CAND/config" ]; then APP_DIR="$DEPLOY_ROOT/$CAND"; break; fi; done; fi',
|
||||
'if [ -z "$APP_DIR" ]; then echo "[DB_PROBE] no active instance dir found"; exit 0; fi',
|
||||
'export NODE_PATH="$APP_DIR/node_modules"',
|
||||
`node -e ${quoteForBash(DB_PROBE_JS)} "$APP_DIR"`,
|
||||
].join('\n');
|
||||
|
||||
console.log('');
|
||||
console.log('[PRECHECK] prod db probe (read-only, no credentials printed)');
|
||||
console.log(runSsh(config, dbProbeScript, { stdio: 'pipe' }).trim());
|
||||
}
|
||||
|
||||
/**
|
||||
* Install: upload files, create thin shell wrapper, register root crontab.
|
||||
* @param {Object} config deploy 配置对象。
|
||||
@ -288,11 +203,14 @@ function runInstall(config) {
|
||||
`DEPLOY_ROOT=${quoteForBash(deployRoot)}`,
|
||||
`STAMP=${quoteForBash(getNowStamp())}`,
|
||||
'mkdir -p "$DEPLOY_ROOT/script" "$DEPLOY_ROOT/database"',
|
||||
'for p in "$DEPLOY_ROOT/warehouse-cert-sync.sh" "$DEPLOY_ROOT/script/warehouse-cert-sync.cjs" "$DEPLOY_ROOT/database/config.js"; do',
|
||||
'for p in "$DEPLOY_ROOT/script/warehouse-cert-sync.sh" "$DEPLOY_ROOT/script/warehouse-cert-sync.cjs" "$DEPLOY_ROOT/database/config.js"; do',
|
||||
' if [ -f "$p" ]; then cp -a "$p" "$p.prev-$STAMP" && echo "BACKED_UP $p -> $p.prev-$STAMP"; fi',
|
||||
'done',
|
||||
'# 历史位置(部署根)一次性迁移:旧 wrapper 挪进 script/ 留作回滚备份,避免根目录残留孤儿',
|
||||
'LEGACY="$DEPLOY_ROOT/warehouse-cert-sync.sh"',
|
||||
'if [ -f "$LEGACY" ]; then mv "$LEGACY" "$DEPLOY_ROOT/script/warehouse-cert-sync.sh.legacy-$STAMP" && echo "LEGACY_MOVED $LEGACY -> $DEPLOY_ROOT/script/warehouse-cert-sync.sh.legacy-$STAMP"; fi',
|
||||
].join('\n');
|
||||
console.log('[INSTALL] remote dir prep + backup of existing files');
|
||||
console.log('[INSTALL] remote dir prep + backup of existing files (wrapper installs under script/)');
|
||||
console.log(runSsh(config, remoteDirScript, { stdio: 'pipe' }).trim());
|
||||
|
||||
const remoteScriptPath = `${deployRoot}/script/warehouse-cert-sync.cjs`;
|
||||
@ -340,7 +258,7 @@ function runInstall(config) {
|
||||
}
|
||||
console.log('[INSTALL] dev config NOT uploaded (development-only)');
|
||||
|
||||
const wrapperPath = `${deployRoot}/warehouse-cert-sync.sh`;
|
||||
const wrapperPath = `${deployRoot}/script/warehouse-cert-sync.sh`;
|
||||
const installScript = [
|
||||
'set -euo pipefail',
|
||||
`DEPLOY_ROOT=${quoteForBash(deployRoot)}`,
|
||||
@ -366,119 +284,281 @@ function runInstall(config) {
|
||||
}
|
||||
|
||||
/**
|
||||
* Run the remote wrapper with optional extra args; returns output + exit code.
|
||||
* useFlock=true 时用与 crontab 相同的锁文件串行化(手工清理与每分钟定时任务互斥),
|
||||
* flock 不可用时只告警并降级为不加锁执行(不阻断运维操作)。
|
||||
* @param {Object} config deploy 配置对象(含 deployRoot)。
|
||||
* @param {string[]} extraArgs 透传给远端包装脚本的额外参数。
|
||||
* @param {boolean} useFlock 是否用 flock 串行化执行,默认 false。
|
||||
* @return {string} 远端输出(已 trim)。
|
||||
* 把远端配置里的目录值(如 ./.ssl)按部署根解析成绝对路径。
|
||||
* @param {string} deployRoot 部署根目录。
|
||||
* @param {string} value 配置值(相对或绝对)。
|
||||
* @param {string} fallback 解析失败时的默认值。
|
||||
* @return {string} 远端绝对路径。
|
||||
*/
|
||||
function runRemoteWrapper(config, extraArgs = [], useFlock = false) {
|
||||
const wrapperPath = `${config.deployRoot}/warehouse-cert-sync.sh`;
|
||||
const runLine = useFlock
|
||||
? 'FLOCK_BIN=$(command -v flock || true); if [ -n "$FLOCK_BIN" ]; then "$FLOCK_BIN" -w 30 /var/lock/warehouse-cert-sync.lock bash "$WRAPPER" $ARGS; else echo "WARN: flock not found, run without lock"; bash "$WRAPPER" $ARGS; fi'
|
||||
: 'bash "$WRAPPER" $ARGS';
|
||||
const remoteScript = [
|
||||
'set -uo pipefail',
|
||||
`WRAPPER=${quoteForBash(wrapperPath)}`,
|
||||
`ARGS=${quoteForBash(extraArgs.join(' '))}`,
|
||||
'if [ ! -f "$WRAPPER" ]; then echo "FATAL: wrapper missing: $WRAPPER"; exit 1; fi',
|
||||
runLine,
|
||||
'echo "CERT_SYNC_EXIT=$?"',
|
||||
].join('\n');
|
||||
return runSsh(config, remoteScript, { stdio: 'pipe' }).trim();
|
||||
function resolveRemotePath(deployRoot, value, fallback) {
|
||||
const v = String(value || '').trim();
|
||||
if (!v) return fallback;
|
||||
if (v.startsWith('/')) return v;
|
||||
return `${String(deployRoot).replace(/\/+$/, '')}/${v.replace(/^\.\//, '')}`;
|
||||
}
|
||||
|
||||
/**
|
||||
* Status: crontab line, remote file list, log tail.
|
||||
* 只读解析服务器 prod 配置中的 certDir / confDir(用于「未触碰」清单展示)。
|
||||
* 配置缺失或解析失败时回退默认值(<deployRoot>/.ssl、<deployRoot>/nginx_config),不阻断卸载流程。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @return {{ certDir: string, confDir: string }} 解析出的远端绝对目录。
|
||||
*/
|
||||
function runStatus(config) {
|
||||
function resolveServerDirs(config) {
|
||||
const deployRoot = config.deployRoot;
|
||||
const remoteScript = [
|
||||
const defaultCertDir = `${deployRoot}/.ssl`;
|
||||
const defaultConfDir = `${deployRoot}/nginx_config`;
|
||||
const result = { certDir: defaultCertDir, confDir: defaultConfDir };
|
||||
const cfgPath = `${deployRoot}/script/warehouse-cert-sync.config.prod.json`;
|
||||
const probeScript = [
|
||||
'set -uo pipefail',
|
||||
'echo "[CRONTAB_CERT_LINES]"',
|
||||
'crontab -l 2>/dev/null | grep -n "warehouse-cert-sync" || echo NONE',
|
||||
'echo "[REMOTE_FILES]"',
|
||||
`ls -la ${quoteForBash(`${deployRoot}/warehouse-cert-sync.sh`)} ${quoteForBash(`${deployRoot}/script/warehouse-cert-sync.cjs`)} ${quoteForBash(`${deployRoot}/script/warehouse-cert-sync.config.prod.json`)} ${quoteForBash(`${deployRoot}/script/warehouse-cert-sync.config.dev.json`)} ${quoteForBash(`${deployRoot}/database/config.js`)} 2>&1`,
|
||||
'echo "[WRAPPER_HEAD]"',
|
||||
`head -12 ${quoteForBash(`${deployRoot}/warehouse-cert-sync.sh`)} 2>/dev/null`,
|
||||
'echo "[CERT_LOG_TAIL]"',
|
||||
'tail -30 /var/log/warehouse-cert-sync.log 2>/dev/null || echo "log not exists"',
|
||||
`CFG=${quoteForBash(cfgPath)}`,
|
||||
'if [ -f "$CFG" ]; then',
|
||||
` node -e ${quoteForBash('const c=JSON.parse(require("node:fs").readFileSync(process.argv[1],"utf8")); console.log("CERT_DIR="+(c.certDir||"./.ssl")); console.log("CONF_DIR="+(c.confDir||"./nginx_config"));')} "$CFG"`,
|
||||
'else',
|
||||
' echo "CERT_DIR=./.ssl"',
|
||||
' echo "CONF_DIR=./nginx_config"',
|
||||
'fi',
|
||||
].join('\n');
|
||||
console.log(runSsh(config, remoteScript, { stdio: 'pipe' }).trim());
|
||||
try {
|
||||
const output = String(runSsh(config, probeScript, { stdio: 'pipe' }) || '');
|
||||
for (const line of output.split('\n')) {
|
||||
if (line.startsWith('CERT_DIR=')) {
|
||||
result.certDir = resolveRemotePath(deployRoot, line.slice(9), defaultCertDir);
|
||||
}
|
||||
if (line.startsWith('CONF_DIR=')) {
|
||||
result.confDir = resolveRemotePath(deployRoot, line.slice(9), defaultConfDir);
|
||||
}
|
||||
}
|
||||
} catch (err) {
|
||||
console.warn(`[UNINSTALL] 服务器目录探测失败,回退默认值:${err.message}`);
|
||||
}
|
||||
return result;
|
||||
}
|
||||
|
||||
/**
|
||||
* 只读核对服务器 prod 配置文件:存在性 + JSON 合法性 + 内容展示(无凭据,可安全输出)。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* 生成卸载目标清单:精确路径 + 历史备份 glob(.prev-* / .legacy-*)。
|
||||
* @param {string} deployRoot 部署根目录。
|
||||
* @return {{ exactPaths: string[], globPatterns: string[] }} 目标清单。
|
||||
*/
|
||||
function runConfigCheck(config) {
|
||||
const deployRoot = config.deployRoot;
|
||||
const remoteScript = [
|
||||
function buildUninstallTargets(deployRoot) {
|
||||
const exactPaths = [
|
||||
`${deployRoot}/script/warehouse-cert-sync.sh`,
|
||||
`${deployRoot}/warehouse-cert-sync.sh`,
|
||||
`${deployRoot}/script/warehouse-cert-sync.cjs`,
|
||||
`${deployRoot}/script/warehouse-cert-sync.config.prod.json`,
|
||||
`${deployRoot}/script/warehouse-cert-sync.config.dev.json`,
|
||||
`${deployRoot}/database/config.js`,
|
||||
];
|
||||
const globPatterns = [];
|
||||
for (const base of [
|
||||
`${deployRoot}/script/warehouse-cert-sync.sh`,
|
||||
`${deployRoot}/warehouse-cert-sync.sh`,
|
||||
`${deployRoot}/script/warehouse-cert-sync.cjs`,
|
||||
`${deployRoot}/script/warehouse-cert-sync.config.prod.json`,
|
||||
`${deployRoot}/script/warehouse-cert-sync.config.dev.json`,
|
||||
`${deployRoot}/database/config.js`,
|
||||
]) {
|
||||
globPatterns.push(`${base}.prev-*`, `${base}.legacy-*`);
|
||||
}
|
||||
return { exactPaths, globPatterns };
|
||||
}
|
||||
|
||||
/**
|
||||
* 生成 dry-run 计划脚本(只读:只打印将备份/将删除的目标与将清理的 crontab 行)。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @param {string} backupDir 计划使用的备份目录(dry-run 不创建)。
|
||||
* @return {string} 远端 bash 脚本。
|
||||
*/
|
||||
function buildUninstallDryRunScript(config, backupDir) {
|
||||
const { exactPaths, globPatterns } = buildUninstallTargets(config.deployRoot);
|
||||
return [
|
||||
'set -uo pipefail',
|
||||
`DEPLOY_ROOT=${quoteForBash(deployRoot)}`,
|
||||
'PROD="$DEPLOY_ROOT/script/warehouse-cert-sync.config.prod.json"',
|
||||
'DEV="$DEPLOY_ROOT/script/warehouse-cert-sync.config.dev.json"',
|
||||
'for f in "$PROD" "$DEV"; do',
|
||||
' if [ -f "$f" ]; then',
|
||||
' echo "[CONFIG_EXISTS] $f"',
|
||||
' if node -e \'JSON.parse(require("node:fs").readFileSync(process.argv[1], "utf8"))\' "$f" >/dev/null 2>&1; then',
|
||||
' echo "[CONFIG_JSON] $f VALID"',
|
||||
`B_DIR=${quoteForBash(backupDir)}`,
|
||||
'echo "PLAN_BACKUP_DIR=$B_DIR"',
|
||||
`for T in ${exactPaths.map(quoteForBash).join(' ')}; do`,
|
||||
' if [ -f "$T" ]; then echo "WOULD_BACKUP_AND_DELETE $T"; else echo "MISSING_SKIP $T"; fi',
|
||||
'done',
|
||||
`for G in ${globPatterns.map(quoteForBash).join(' ')}; do`,
|
||||
' for F in $G; do',
|
||||
' [ -f "$F" ] || continue',
|
||||
' echo "WOULD_BACKUP_AND_DELETE $F"',
|
||||
' done',
|
||||
'done',
|
||||
'CRON_BEFORE=$(crontab -l 2>/dev/null | wc -l)',
|
||||
'CRON_CERT=$(crontab -l 2>/dev/null | grep -c "warehouse-cert-sync" || true)',
|
||||
'if [ "$CRON_CERT" -gt 0 ]; then',
|
||||
' crontab -l 2>/dev/null | grep "warehouse-cert-sync" | sed "s|^|WOULD_REMOVE_CRON_LINE |" || true',
|
||||
' echo "CRONTAB_WOULD_GO before=$CRON_BEFORE after=$((CRON_BEFORE - CRON_CERT))"',
|
||||
'else',
|
||||
' echo "CRONTAB_UNTOUCHED_NO_MATCH"',
|
||||
'fi',
|
||||
].join('\n');
|
||||
}
|
||||
|
||||
/**
|
||||
* 生成真实卸载脚本:先备份(cp -a 保留权限/时间)再删除,清理 crontab 行。
|
||||
* 单项失败不中断(HAD_ERRORS 标记),证书/server 块/日志/watchdog 一律不触碰。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @param {string} backupDir 备份目录(/tmp/wms-cert-sync-uninstall-<时间戳>/)。
|
||||
* @return {string} 远端 bash 脚本。
|
||||
*/
|
||||
function buildUninstallScript(config, backupDir) {
|
||||
const { exactPaths, globPatterns } = buildUninstallTargets(config.deployRoot);
|
||||
return [
|
||||
'set -u',
|
||||
`BACKUP_DIR=${quoteForBash(backupDir)}`,
|
||||
'HAD_ERRORS=0',
|
||||
'mkdir -p "$BACKUP_DIR" && echo "BACKUP_DIR=$BACKUP_DIR" || { echo "BACKUP_DIR_CREATE_FAILED $BACKUP_DIR"; HAD_ERRORS=1; }',
|
||||
`for T in ${exactPaths.map(quoteForBash).join(' ')}; do`,
|
||||
' if [ -f "$T" ]; then',
|
||||
' BASE=$(basename "$T")',
|
||||
' if cp -a "$T" "$BACKUP_DIR/$BASE"; then',
|
||||
' echo "BACKED_UP $T -> $BACKUP_DIR/$BASE"',
|
||||
' else',
|
||||
' echo "[CONFIG_JSON] $f INVALID"',
|
||||
' echo "BACKUP_FAILED $T (保留未删)"',
|
||||
' HAD_ERRORS=1',
|
||||
' continue',
|
||||
' fi',
|
||||
' else',
|
||||
' echo "[CONFIG_MISSING] $f"',
|
||||
' if rm -f "$T"; then echo "DELETED $T"; else echo "DELETE_FAILED $T"; HAD_ERRORS=1; fi',
|
||||
' fi',
|
||||
'done',
|
||||
'echo "[PROD_CONFIG_CONTENT]"',
|
||||
'cat "$PROD" 2>/dev/null || echo "(missing)"',
|
||||
'echo "[DEV_CONFIG_ON_SERVER]"',
|
||||
'if [ -f "$DEV" ]; then echo YES; else echo NO; fi',
|
||||
`for G in ${globPatterns.map(quoteForBash).join(' ')}; do`,
|
||||
' for F in $G; do',
|
||||
' [ -f "$F" ] || continue',
|
||||
' BASE=$(basename "$F")',
|
||||
' if cp -a "$F" "$BACKUP_DIR/$BASE"; then',
|
||||
' echo "BACKED_UP $F -> $BACKUP_DIR/$BASE"',
|
||||
' else',
|
||||
' echo "BACKUP_FAILED $F (保留未删)"',
|
||||
' HAD_ERRORS=1',
|
||||
' continue',
|
||||
' fi',
|
||||
' if rm -f "$F"; then echo "DELETED $F"; else echo "DELETE_FAILED $F"; HAD_ERRORS=1; fi',
|
||||
' done',
|
||||
'done',
|
||||
'CRON_BEFORE=$(crontab -l 2>/dev/null | wc -l)',
|
||||
'CRON_CERT=$(crontab -l 2>/dev/null | grep -c "warehouse-cert-sync" || true)',
|
||||
'if [ "$CRON_CERT" -gt 0 ]; then',
|
||||
' crontab -l 2>/dev/null | grep "warehouse-cert-sync" | sed "s|^|CRON_REMOVED_LINE |" || true',
|
||||
' if ( crontab -l 2>/dev/null | grep -v "warehouse-cert-sync" || true ) | crontab -; then',
|
||||
' echo "CRONTAB_REWRITTEN before=$CRON_BEFORE after=$(crontab -l 2>/dev/null | wc -l)"',
|
||||
' else',
|
||||
' echo "CRONTAB_REWRITE_FAILED"',
|
||||
' HAD_ERRORS=1',
|
||||
' fi',
|
||||
'else',
|
||||
' echo "CRONTAB_UNTOUCHED_NO_MATCH"',
|
||||
'fi',
|
||||
'echo "HAD_ERRORS=$HAD_ERRORS"',
|
||||
].join('\n');
|
||||
console.log(runSsh(config, remoteScript, { stdio: 'pipe' }).trim());
|
||||
}
|
||||
|
||||
/**
|
||||
* 按三段结构打印卸载输出:[UNINSTALL] 备份 / [UNINSTALL] 已删除 / [UNINSTALL] 未触碰(原因)。
|
||||
* @param {string} output 远端脚本输出。
|
||||
* @param {boolean} dryRun 是否 dry-run(只打印计划)。
|
||||
* @param {string} backupDir 备份目录路径。
|
||||
* @param {{ certDir: string, confDir: string }} dirs 证书/server 块目录解析结果。
|
||||
* @param {string} deployRoot 部署根目录。
|
||||
*/
|
||||
function printUninstallReport(output, dryRun, backupDir, dirs, deployRoot) {
|
||||
const lines = String(output || '').split(/\r?\n/);
|
||||
const planNote = dryRun ? '(计划,未执行)' : '';
|
||||
const backupLines = [];
|
||||
const deletedLines = [];
|
||||
for (const line of lines) {
|
||||
if (line.startsWith('PLAN_BACKUP_DIR=')) {
|
||||
backupLines.push(`BACKUP_DIR=${line.slice('PLAN_BACKUP_DIR='.length)}${dryRun ? '(计划,不创建)' : ''}`);
|
||||
} else if (line.startsWith('WOULD_BACKUP_AND_DELETE ')) {
|
||||
const src = line.slice('WOULD_BACKUP_AND_DELETE '.length);
|
||||
backupLines.push(`BACKED_UP ${src} -> ${backupDir}${src.split('/').pop()}${planNote}`);
|
||||
deletedLines.push(`DELETED ${src}${planNote}`);
|
||||
} else if (line.startsWith('MISSING_SKIP ')) {
|
||||
backupLines.push(`SKIP ${line.slice('MISSING_SKIP '.length)}(不存在)`);
|
||||
} else if (line.startsWith('BACKUP_DIR=')) {
|
||||
backupLines.push(line);
|
||||
} else if (line.startsWith('BACKUP_DIR_CREATE_FAILED ')) {
|
||||
backupLines.push(line);
|
||||
} else if (line.startsWith('BACKED_UP ')) {
|
||||
backupLines.push(line);
|
||||
} else if (line.startsWith('BACKUP_FAILED ')) {
|
||||
backupLines.push(line);
|
||||
} else if (line.startsWith('DELETED ')) {
|
||||
deletedLines.push(line);
|
||||
} else if (line.startsWith('DELETE_FAILED ')) {
|
||||
deletedLines.push(line);
|
||||
} else if (line.startsWith('WOULD_REMOVE_CRON_LINE ')) {
|
||||
deletedLines.push(`CRON_REMOVED_LINE ${line.slice('WOULD_REMOVE_CRON_LINE '.length)}${planNote}`);
|
||||
} else if (line.startsWith('CRON_REMOVED_LINE ')) {
|
||||
deletedLines.push(line);
|
||||
} else if (line.startsWith('CRONTAB_REWRITTEN ')) {
|
||||
deletedLines.push(line);
|
||||
} else if (line.startsWith('CRONTAB_WOULD_GO ')) {
|
||||
deletedLines.push(`${line}${dryRun ? '(计划,未执行)' : ''}`);
|
||||
} else if (line.startsWith('CRONTAB_UNTOUCHED_NO_MATCH')) {
|
||||
deletedLines.push('crontab 无 warehouse-cert-sync 行,未改写');
|
||||
}
|
||||
}
|
||||
|
||||
console.log(`[UNINSTALL] 备份${dryRun ? '(计划)' : ''}`);
|
||||
for (const line of backupLines) console.log(` ${line}`);
|
||||
console.log(`[UNINSTALL] 已删除${dryRun ? '(计划)' : ''}`);
|
||||
for (const line of deletedLines) console.log(` ${line}`);
|
||||
console.log('[UNINSTALL] 未触碰(原因)');
|
||||
console.log(` CERT_DIR_KEPT ${dirs.certDir}(运行产物:证书/私钥,nginx 仍在 include,删除会立断 443;由运维自行决定,如先切走 include 再手工删)`);
|
||||
console.log(` CONF_DIR_KEPT ${dirs.confDir}(运行产物:<domain>-<ver>.conf server 块,nginx 仍在 include,同上)`);
|
||||
console.log(' LOG_KEPT /var/log/warehouse-cert-sync.log(默认保留作排查线索)');
|
||||
console.log(` UPSTREAM_KEPT ${deployRoot}/nginx-upstream.conf(非本工具文件,不删)`);
|
||||
console.log(` WATCHDOG_KEPT ${deployRoot}/script/qimen-watchdog.*、/etc/cron.d/qimen-watchdog(看门狗相关,不属于 cert-sync 工具)`);
|
||||
if (dryRun) {
|
||||
console.log(`[UNINSTALL] dry-run 结束(未做任何变更)。实际执行时备份目录:${backupDir}`);
|
||||
console.log('如需回滚(实际执行后):把备份目录里的文件 cp -a 回原路径并重跑 install');
|
||||
return;
|
||||
}
|
||||
console.log(`备份目录:${backupDir}`);
|
||||
console.log('如需回滚:把备份目录里的文件 cp -a 回原路径并重跑 install');
|
||||
if (lines.some(line => line === 'HAD_ERRORS=1')) {
|
||||
console.error('[UNINSTALL] 存在失败项(见上),可从备份目录恢复');
|
||||
process.exitCode = 1;
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
* 卸载 cert-sync 工具自身:先备份再删除(包装脚本 / 主脚本 / 双环境配置 /
|
||||
* database/config.js / 历史位置与 .prev-* / .legacy-* 备份 / crontab 行)。
|
||||
* 证书、nginx server 块、日志、watchdog 相关一律不删(原因见输出)。
|
||||
* --dry-run 时只打印计划,不备份、不删除、不改 crontab。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @param {Object} options 命令选项(dryRun)。
|
||||
*/
|
||||
function runUninstall(config, options) {
|
||||
const backupDir = `/tmp/wms-cert-sync-uninstall-${getNowStamp()}/`;
|
||||
const dirs = resolveServerDirs(config);
|
||||
const remoteScript = options.dryRun
|
||||
? buildUninstallDryRunScript(config, backupDir)
|
||||
: buildUninstallScript(config, backupDir);
|
||||
if (options.dryRun) {
|
||||
console.log('[UNINSTALL] dry-run(只读:只打印计划,不备份、不删除、不改 crontab)');
|
||||
} else {
|
||||
console.log('[UNINSTALL] 开始卸载(先备份再删除)');
|
||||
}
|
||||
const output = String(runSsh(config, remoteScript, { stdio: 'pipe' }) || '');
|
||||
printUninstallReport(output, options.dryRun, backupDir, dirs, config.deployRoot);
|
||||
}
|
||||
|
||||
/**
|
||||
* 入口:解析命令行参数并执行 install / uninstall。
|
||||
*/
|
||||
function main() {
|
||||
const options = parseArgs(process.argv.slice(2));
|
||||
const config = loadDeployConfig(options.envName);
|
||||
|
||||
if (options.command === 'precheck') {
|
||||
runPrecheck(config);
|
||||
return;
|
||||
}
|
||||
if (options.command === 'install') {
|
||||
runInstall(config);
|
||||
return;
|
||||
}
|
||||
if (options.command === 'dry-run') {
|
||||
console.log('[DRY-RUN] remote dry-run (read-only, no file writes, no db updates)');
|
||||
console.log(runRemoteWrapper(config, [ '--dry-run' ]));
|
||||
return;
|
||||
}
|
||||
if (options.command === 'run') {
|
||||
console.log('[RUN] remote real execution');
|
||||
console.log(runRemoteWrapper(config, []));
|
||||
return;
|
||||
}
|
||||
if (options.command === 'cleanup-dry-run') {
|
||||
console.log('[CLEANUP-DRY-RUN] remote retired-domain cleanup dry-run (read-only: no file deletes, no db updates, no reload)');
|
||||
console.log(runRemoteWrapper(config, [ '--cleanup-only', '--dry-run' ], true));
|
||||
return;
|
||||
}
|
||||
if (options.command === 'cleanup') {
|
||||
console.log('[CLEANUP] remote retired-domain cleanup (real execution: deletes retired conf/cert files, then nginx -t + reload)');
|
||||
console.log(runRemoteWrapper(config, [ '--cleanup-only' ], true));
|
||||
return;
|
||||
}
|
||||
if (options.command === 'status') {
|
||||
runStatus(config);
|
||||
return;
|
||||
}
|
||||
if (options.command === 'config-check') {
|
||||
runConfigCheck(config);
|
||||
if (options.command === 'uninstall') {
|
||||
runUninstall(config, options);
|
||||
return;
|
||||
}
|
||||
throw new Error(`unsupported command: ${options.command}`);
|
||||
|
||||
@ -22,6 +22,12 @@ const DEFAULT_POST_DEPLOY_COMMANDS = [
|
||||
'npm run stop || true',
|
||||
'npm start',
|
||||
];
|
||||
/**
|
||||
* 默认发布排除路径:应用配置 + 工程内的证书/nginx 产物目录。
|
||||
* `.ssl/` 与 `nginx_config/` 同在部署根一级(工程目录内),虽已被 .gitignore 忽略,
|
||||
* 这里再排一次做防御,避免将来 include 规则放宽时把私钥打进发布包。
|
||||
*/
|
||||
const DEFAULT_EXCLUDE_PATHS = [ 'config/**', '.ssl/**', 'nginx_config/**' ];
|
||||
|
||||
/**
|
||||
* 发布包固定排除文件(与 config.deployExcludePaths 叠加,防御性兜底)。
|
||||
@ -183,7 +189,7 @@ function normalizeDeployConfig(config, envName) {
|
||||
deployIncludePaths: Array.isArray(config.deployIncludePaths) && config.deployIncludePaths.length > 0
|
||||
? config.deployIncludePaths
|
||||
: DEFAULT_EGG_MINIMAL_INCLUDE_PATHS,
|
||||
deployExcludePaths: Array.isArray(config.deployExcludePaths) ? config.deployExcludePaths : [ 'config/**' ],
|
||||
deployExcludePaths: Array.isArray(config.deployExcludePaths) ? config.deployExcludePaths : [ ...DEFAULT_EXCLUDE_PATHS ],
|
||||
sshOptions,
|
||||
};
|
||||
}
|
||||
@ -275,7 +281,7 @@ function pathMatchesRule(filePath, rule) {
|
||||
function listDeployableFiles(config) {
|
||||
const output = runCommand('git', [ 'ls-files', '--cached', '--others', '--exclude-standard' ]);
|
||||
const includeRules = Array.isArray(config && config.deployIncludePaths) ? config.deployIncludePaths : DEFAULT_EGG_MINIMAL_INCLUDE_PATHS;
|
||||
const excludeRules = Array.isArray(config && config.deployExcludePaths) ? config.deployExcludePaths : [ 'config/**' ];
|
||||
const excludeRules = Array.isArray(config && config.deployExcludePaths) ? config.deployExcludePaths : DEFAULT_EXCLUDE_PATHS;
|
||||
const allExcludeRules = [ ...excludeRules, ...RELEASE_PINNED_EXCLUDE_PATHS ];
|
||||
|
||||
return Array.from(new Set(
|
||||
|
||||
292
script/deploy-watchdog.cjs
Normal file
292
script/deploy-watchdog.cjs
Normal file
@ -0,0 +1,292 @@
|
||||
'use strict';
|
||||
|
||||
/**
|
||||
* qimen 接口服务看门狗(keep-alive)的安装与运维工具。
|
||||
*
|
||||
* 与 script/deploy-cert-sync.cjs 同源思路,但对象完全不同:
|
||||
* - 安装对象:script/qimen-watchdog.sh(仓库源)→ <部署根>/script/qimen-watchdog.sh(服务器稳定副本)
|
||||
* - 调度载体:/etc/cron.d/qimen-watchdog(系统级 cron.d)
|
||||
* **刻意不放 root crontab**:宝塔面板会整体重写 root crontab,放那儿会被冲掉。
|
||||
* - 日志:/www/wwwlogs/wms/qimen-watchdog.log
|
||||
*
|
||||
* 为什么副本放部署根下的 script/ 目录而不是 v1/v2:
|
||||
* 与证书同步脚本同理——不受版本切换与发布清理影响,版本目录里没有它的位置;
|
||||
* 同时与 warehouse-cert-sync.sh / warehouse-cert-sync.cjs 收口在同一目录,运维只需看一处。
|
||||
* install 会把历史位置(部署根)的同名副本一次性挪成 script/<name>.legacy-<时间戳> 备份。
|
||||
*
|
||||
* 设计要点:
|
||||
* 1. 幂等:可重复 install;cron.d 文件用「临时文件 + mv」原子覆盖,不会出现半截配置;
|
||||
* 2. 备份:覆盖前把既有副本 cp -a 成 <path>.prev-<时间戳>,保留回滚余地;
|
||||
* 3. 去重:若 root crontab 里存在历史 watchdog 行(早期手工装的),install 会删掉,
|
||||
* 避免与 cron.d 条目双跑——看门狗双跑会并发 kill/start 同一实例,风险很高;
|
||||
* 4. 校验三连:bash -n 语法校验 + sha256 与本地源比对(不一致直接失败)+
|
||||
* 远端 --dry-run 冒烟(只探活、绝不启动/杀进程);
|
||||
* 5. 不碰服务:install 不重启 qimen、不 reload nginx、不动任何数据库。
|
||||
*
|
||||
* 用法:
|
||||
* node script/deploy-watchdog.cjs production precheck
|
||||
* node script/deploy-watchdog.cjs production install
|
||||
* node script/deploy-watchdog.cjs production status
|
||||
* node script/deploy-watchdog.cjs production dry-run # 远端执行 --dry-run(只探活并报告)
|
||||
* node script/deploy-watchdog.cjs production run # 远端真实保活(探活失败才会拉起服务)
|
||||
*
|
||||
* 退出码:0 成功;非 0 失败(参数非法 / 本地文件缺失 / sha 不一致 / 远端命令失败)。
|
||||
*/
|
||||
|
||||
const fs = require('node:fs');
|
||||
const path = require('node:path');
|
||||
const crypto = require('node:crypto');
|
||||
const {
|
||||
ROOT,
|
||||
getNowStamp,
|
||||
loadDeployConfig,
|
||||
quoteForBash,
|
||||
runScp,
|
||||
runSsh,
|
||||
} = require('./deploy-lib.cjs');
|
||||
|
||||
const COMMANDS = new Set([ 'precheck', 'install', 'status', 'dry-run', 'run' ]);
|
||||
const COMMAND_HINT = 'precheck | install | status | dry-run | run';
|
||||
|
||||
/** 仓库源文件(脚本本体)。 */
|
||||
const LOCAL_WATCHDOG = path.join(ROOT, 'script', 'qimen-watchdog.sh');
|
||||
|
||||
/** 服务器副本文件名(落在部署根的 script/ 目录下,与 cert-sync 脚本同目录)。 */
|
||||
const REMOTE_FILENAME = 'qimen-watchdog.sh';
|
||||
/** 服务器副本相对部署根的路径。 */
|
||||
const REMOTE_RELATIVE = `script/${REMOTE_FILENAME}`;
|
||||
/** cron.d 文件名 / 路径(名称不含点,避免被 cron 忽略)。 */
|
||||
const CRON_D_NAME = 'qimen-watchdog';
|
||||
const CRON_D_PATH = `/etc/cron.d/${CRON_D_NAME}`;
|
||||
const LOG_PATH = '/www/wwwlogs/wms/qimen-watchdog.log';
|
||||
const LOCK_PATH = '/var/lock/qimen-watchdog.lock';
|
||||
const CRON_SCHEDULE = '*/5 * * * *';
|
||||
const CRON_USER = 'root';
|
||||
|
||||
/**
|
||||
* 解析命令行参数。
|
||||
* @param {string[]} argv process.argv.slice(2)。
|
||||
* @return {{envName: string, command: string}} 解析结果。
|
||||
* @throws {Error} 缺少/非法命令时抛出。
|
||||
*/
|
||||
function parseArgs(argv) {
|
||||
const options = { envName: 'production', command: '' };
|
||||
const tokens = [ ...argv ];
|
||||
if (tokens.length === 0) {
|
||||
throw new Error(`missing command: ${COMMAND_HINT}`);
|
||||
}
|
||||
if (!COMMANDS.has(tokens[0])) {
|
||||
options.envName = tokens[0];
|
||||
tokens.shift();
|
||||
}
|
||||
if (tokens.length === 0 || !COMMANDS.has(tokens[0])) {
|
||||
throw new Error(`missing command: ${COMMAND_HINT}`);
|
||||
}
|
||||
options.command = tokens[0];
|
||||
return options;
|
||||
}
|
||||
|
||||
/**
|
||||
* 计算本地文件 sha256(十六进制,小写)。
|
||||
* @param {string} filePath 文件绝对路径。
|
||||
* @return {string} sha256 摘要。
|
||||
*/
|
||||
function localSha256(filePath) {
|
||||
return crypto.createHash('sha256').update(fs.readFileSync(filePath)).digest('hex');
|
||||
}
|
||||
|
||||
/**
|
||||
* 目标服务器上的看门狗脚本绝对路径。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @return {string} 绝对路径。
|
||||
*/
|
||||
function remoteWatchdogPath(config) {
|
||||
return `${config.deployRoot}/${REMOTE_RELATIVE}`;
|
||||
}
|
||||
|
||||
/**
|
||||
* 生成 /etc/cron.d/qimen-watchdog 的完整内容。
|
||||
* @param {string} watchdogPath 服务器上的看门狗脚本绝对路径。
|
||||
* @return {string} cron.d 文件内容(含首部注释与 env 声明)。
|
||||
*/
|
||||
function buildCronFileContent(watchdogPath) {
|
||||
return [
|
||||
'# qimen 接口服务看门狗(保活)',
|
||||
'# 由 npm run deploy:watchdog:install 维护,请勿手工编辑(会被下次安装覆盖)。',
|
||||
'# 仓库源:script/qimen-watchdog.sh;服务器稳定副本:<部署根>/script/qimen-watchdog.sh',
|
||||
'# 放在 /etc/cron.d 而非 root crontab:宝塔面板会整体重写 root crontab,会把它冲掉。',
|
||||
'# 手动验证:bash <部署根>/script/qimen-watchdog.sh --dry-run',
|
||||
'SHELL=/bin/bash',
|
||||
'PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin',
|
||||
`${CRON_SCHEDULE} ${CRON_USER} ${watchdogPath} >> ${LOG_PATH} 2>&1`,
|
||||
'',
|
||||
].join('\n');
|
||||
}
|
||||
|
||||
/**
|
||||
* 只读预检:确认目标机具备安装条件。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @return {void}
|
||||
*/
|
||||
function runPrecheck(config) {
|
||||
const deployRoot = config.deployRoot;
|
||||
const remoteScript = [
|
||||
'set -uo pipefail',
|
||||
`DEPLOY_ROOT=${quoteForBash(deployRoot)}`,
|
||||
`TARGET="$DEPLOY_ROOT/${REMOTE_FILENAME}"`,
|
||||
'echo "[WHOAMI] $(id -un)"',
|
||||
'echo "[UNAME] $(uname -a)"',
|
||||
'echo "[DEPLOY_ROOT_LS]"; ls -la "$DEPLOY_ROOT" | awk \'{print $1, $3, $4, $9}\'',
|
||||
'echo "[CURRENT_MD] $(cat "$DEPLOY_ROOT/current.md" 2>/dev/null | tr -d "[:space:]" || echo MISSING)"',
|
||||
'echo "[UPSTREAM_CONF]"; cat "$DEPLOY_ROOT/nginx-upstream.conf" 2>/dev/null || echo "(missing)"',
|
||||
'echo "[WATCHDOG_FILE]"; if [ -f "$TARGET" ]; then ls -l --time-style=full-iso "$TARGET"; sha256sum "$TARGET"; else echo "MISSING"; fi',
|
||||
'echo "[CRON_D]"; if [ -f ' + quoteForBash(CRON_D_PATH) + ' ]; then cat ' + quoteForBash(CRON_D_PATH) + '; else echo "MISSING"; fi',
|
||||
'echo "[CRON_SERVICE]"; systemctl is-active cron 2>/dev/null || (service cron status 2>/dev/null | head -1) || echo unknown',
|
||||
'echo "[ROOT_CRONTAB_MATCH]"; crontab -l 2>/dev/null | grep -n "qimen-watchdog" || echo NONE',
|
||||
'echo "[LOG]"; ls -l ' + quoteForBash(LOG_PATH) + ' 2>/dev/null || echo "log missing"; tail -5 ' + quoteForBash(LOG_PATH) + ' 2>/dev/null',
|
||||
'echo "[LOCK]"; ls -l ' + quoteForBash(LOCK_PATH) + ' 2>/dev/null || echo "lock not created yet"',
|
||||
'echo "[INSTANCES]"; ps -eo pid=,etime=,args= | grep "[e]gg-scripts start" | head -6 || true',
|
||||
'echo "[PORTS]"; ss -lntp 2>/dev/null | grep -E ":6061|:6062" || echo "no 6061/6062 listener"',
|
||||
].join('\n');
|
||||
|
||||
console.log('[PRECHECK] watchdog remote env check (read-only, no service start/kill)');
|
||||
console.log(String(runSsh(config, remoteScript, { stdio: 'pipe' }) || '').trim());
|
||||
}
|
||||
|
||||
/**
|
||||
* 安装:备份旧副本 → 上传脚本 → 写 cron.d → 清理历史 root crontab 行 → 语法/哈希/冒烟校验。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @return {void}
|
||||
*/
|
||||
function runInstall(config) {
|
||||
const deployRoot = config.deployRoot;
|
||||
if (!fs.existsSync(LOCAL_WATCHDOG)) {
|
||||
throw new Error(`local file missing: ${LOCAL_WATCHDOG} (script/qimen-watchdog.sh)`);
|
||||
}
|
||||
const localSha = localSha256(LOCAL_WATCHDOG);
|
||||
const target = remoteWatchdogPath(config);
|
||||
|
||||
console.log(`[INSTALL] local source: ${LOCAL_WATCHDOG} sha256=${localSha}`);
|
||||
|
||||
const remoteDirScript = [
|
||||
'set -euo pipefail',
|
||||
`DEPLOY_ROOT=${quoteForBash(deployRoot)}`,
|
||||
`TARGET="$DEPLOY_ROOT/${REMOTE_RELATIVE}"`,
|
||||
`STAMP=${quoteForBash(getNowStamp())}`,
|
||||
'mkdir -p "$DEPLOY_ROOT/script" /www/wwwlogs/wms',
|
||||
'# 历史位置(部署根)一次性迁移:旧副本挪进 script/ 留作回滚备份,避免根目录残留孤儿',
|
||||
'LEGACY="$DEPLOY_ROOT/qimen-watchdog.sh"',
|
||||
'if [ -f "$LEGACY" ]; then mv "$LEGACY" "$DEPLOY_ROOT/script/qimen-watchdog.sh.legacy-$STAMP" && echo "LEGACY_MOVED $LEGACY -> $DEPLOY_ROOT/script/qimen-watchdog.sh.legacy-$STAMP"; fi',
|
||||
'if [ -f "$TARGET" ]; then cp -a "$TARGET" "$TARGET.prev-$STAMP" && echo "BACKED_UP $TARGET -> $TARGET.prev-$STAMP"; else echo "NO_EXISTING_COPY"; fi',
|
||||
`touch ${quoteForBash(LOG_PATH)} && chmod 644 ${quoteForBash(LOG_PATH)} && echo "LOG_FILE_OK"`,
|
||||
].join('\n');
|
||||
console.log('[INSTALL] remote dir prep + backup of existing copy');
|
||||
console.log(String(runSsh(config, remoteDirScript, { stdio: 'pipe' }) || '').trim());
|
||||
|
||||
runScp(config, LOCAL_WATCHDOG, target);
|
||||
console.log(`[INSTALL] uploaded -> ${target}`);
|
||||
|
||||
const finalizeScript = [
|
||||
'set -euo pipefail',
|
||||
`TARGET=${quoteForBash(target)}`,
|
||||
`CRON_D=${quoteForBash(CRON_D_PATH)}`,
|
||||
'chmod 755 "$TARGET" && echo "CHMOD_OK"',
|
||||
'bash -n "$TARGET" && echo "WATCHDOG_SYNTAX_OK"',
|
||||
`LOCAL_SHA=${quoteForBash(localSha)}`,
|
||||
'REMOTE_SHA_LINE=$(sha256sum "$TARGET")',
|
||||
'REMOTE_SHA=${REMOTE_SHA_LINE%% *}',
|
||||
'if [ "$REMOTE_SHA" = "$LOCAL_SHA" ]; then echo "SHA_MATCH $REMOTE_SHA"; else echo "SHA_MISMATCH local=$LOCAL_SHA remote=$REMOTE_SHA"; exit 1; fi',
|
||||
'TMP=$(mktemp /tmp/qimen-watchdog.cron.XXXXXX)',
|
||||
'cat > "$TMP" <<\'QIMEN_WATCHDOG_CRON_EOF\'',
|
||||
buildCronFileContent(target).replace(/\n+$/, ''),
|
||||
'QIMEN_WATCHDOG_CRON_EOF',
|
||||
'chown root:root "$TMP" && chmod 644 "$TMP"',
|
||||
'mv "$TMP" "$CRON_D" && echo "CRON_D_WRITTEN $CRON_D"',
|
||||
'echo "[CRON_D_CONTENT]"',
|
||||
'cat "$CRON_D"',
|
||||
'if crontab -l 2>/dev/null | grep -q "qimen-watchdog"; then',
|
||||
' crontab -l 2>/dev/null | grep -v "qimen-watchdog" | crontab -',
|
||||
' echo "ROOT_CRONTAB_DEDUPED (legacy watchdog line removed)"',
|
||||
'else',
|
||||
' echo "ROOT_CRONTAB_CLEAN"',
|
||||
'fi',
|
||||
'echo "[CRON_SERVICE] $(systemctl is-active cron 2>/dev/null || echo unknown)"',
|
||||
'echo "[SMOKE] bash $TARGET --dry-run (probe only, never starts/kills)"',
|
||||
'bash "$TARGET" --dry-run 2>&1 | tail -15 || true',
|
||||
].join('\n');
|
||||
|
||||
console.log('[INSTALL] write cron.d + verify (syntax / sha256 / dry-run smoke)');
|
||||
console.log(String(runSsh(config, finalizeScript, { stdio: 'pipe' }) || '').trim());
|
||||
}
|
||||
|
||||
/**
|
||||
* 状态:只读查看副本、cron.d、日志、锁、探活结果,并与本地源比对哈希。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @return {void}
|
||||
*/
|
||||
function runStatus(config) {
|
||||
const target = remoteWatchdogPath(config);
|
||||
const localSha = fs.existsSync(LOCAL_WATCHDOG) ? localSha256(LOCAL_WATCHDOG) : '(local file missing)';
|
||||
|
||||
const remoteScript = [
|
||||
'set -uo pipefail',
|
||||
`TARGET=${quoteForBash(target)}`,
|
||||
`CRON_D=${quoteForBash(CRON_D_PATH)}`,
|
||||
'echo "[WATCHDOG_FILE]"; if [ -f "$TARGET" ]; then ls -l --time-style=full-iso "$TARGET"; else echo "MISSING"; fi',
|
||||
'echo "[SHA_REMOTE]"; sha256sum "$TARGET" 2>/dev/null || echo "(missing)"',
|
||||
'echo "[CRON_D]"; cat "$CRON_D" 2>/dev/null || echo "MISSING"',
|
||||
'echo "[CRON_SERVICE]"; systemctl is-active cron 2>/dev/null || echo unknown',
|
||||
'echo "[ROOT_CRONTAB_MATCH]"; crontab -l 2>/dev/null | grep -n "qimen-watchdog" || echo NONE',
|
||||
'echo "[LOCK]"; ls -l ' + quoteForBash(LOCK_PATH) + ' 2>/dev/null || echo "lock not created yet"',
|
||||
'echo "[LOG_TAIL]"; tail -10 ' + quoteForBash(LOG_PATH) + ' 2>/dev/null || echo "log missing"',
|
||||
'echo "[INSTANCES]"; ps -eo pid=,etime=,args= | grep "[e]gg-scripts start" | head -6 || true',
|
||||
'echo "[PORTS]"; ss -lntp 2>/dev/null | grep -E ":6061|:6062" || echo "no 6061/6062 listener"',
|
||||
'echo "[PROBE_DRY_RUN]"; bash "$TARGET" --dry-run 2>&1 | tail -12 || true',
|
||||
].join('\n');
|
||||
|
||||
console.log('[STATUS] watchdog (read-only; probe uses --dry-run)');
|
||||
console.log(`[STATUS] local source sha256 = ${localSha}`);
|
||||
console.log(String(runSsh(config, remoteScript, { stdio: 'pipe' }) || '').trim());
|
||||
}
|
||||
|
||||
/**
|
||||
* 远端执行看门狗脚本(转发参数)。
|
||||
* @param {Object} config deploy 配置对象。
|
||||
* @param {string[]} extraArgs 追加参数(如 --dry-run)。
|
||||
* @return {string} 远端输出。
|
||||
*/
|
||||
function runRemoteWatchdog(config, extraArgs = []) {
|
||||
const script = `bash ${quoteForBash(remoteWatchdogPath(config))}${extraArgs.map(arg => ` ${arg}`).join('')}`;
|
||||
return String(runSsh(config, script) || '');
|
||||
}
|
||||
|
||||
function main() {
|
||||
const options = parseArgs(process.argv.slice(2));
|
||||
const config = loadDeployConfig(options.envName);
|
||||
|
||||
if (options.command === 'precheck') {
|
||||
runPrecheck(config);
|
||||
return;
|
||||
}
|
||||
if (options.command === 'install') {
|
||||
runInstall(config);
|
||||
return;
|
||||
}
|
||||
if (options.command === 'status') {
|
||||
runStatus(config);
|
||||
return;
|
||||
}
|
||||
if (options.command === 'dry-run') {
|
||||
console.log('[DRY-RUN] remote watchdog --dry-run (probe only, never starts/kills)');
|
||||
console.log(runRemoteWatchdog(config, [ '--dry-run' ]));
|
||||
return;
|
||||
}
|
||||
if (options.command === 'run') {
|
||||
console.log('[RUN] remote watchdog real execution (starts the instance only when probe fails)');
|
||||
console.log(runRemoteWatchdog(config, []));
|
||||
return;
|
||||
}
|
||||
throw new Error(`unsupported command: ${options.command}`);
|
||||
}
|
||||
|
||||
main();
|
||||
@ -29,10 +29,14 @@
|
||||
#
|
||||
# cron(系统级,不放在 root crontab —— 宝塔面板会整体重写 root crontab,会把它冲掉):
|
||||
# /etc/cron.d/qimen-watchdog
|
||||
# */5 * * * * root /www/wwwroot/qimen/qimen-watchdog.sh >> /www/wwwlogs/wms/qimen-watchdog.log 2>&1
|
||||
# */5 * * * * root /www/wwwroot/qimen/script/qimen-watchdog.sh >> /www/wwwlogs/wms/qimen-watchdog.log 2>&1
|
||||
#
|
||||
# 仓库源文件:script/qimen-watchdog.sh(本文件是它在服务器上的稳定副本,更新后需重新安装;
|
||||
# 放 deploy 根目录而非 v1/v2 内,是为了不受版本切换与发布清理影响)。
|
||||
# 放 deploy 根下的 script/ 目录而非 v1/v2 内,是为了不受版本切换与发布清理影响,
|
||||
# 并与 warehouse-cert-sync.sh / warehouse-cert-sync.cjs 收口在同一目录)。
|
||||
#
|
||||
# 安装/更新:npm run deploy:watchdog:install(script/deploy-watchdog.cjs;
|
||||
# 会把历史位置 <部署根>/qimen-watchdog.sh 挪成 script/<名>.legacy-<时间戳> 备份)。
|
||||
#
|
||||
set -u
|
||||
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@ -1,9 +1,10 @@
|
||||
{
|
||||
"description": "开发环境配置(Windows 本机 / 宝塔 Windows 版 nginx,nginx.exe)。nginx.exe 从任意 cwd 启动时会把启动目录当作前缀,导致读不到 conf/nginx.conf,因此 test/reload 命令必须带 -p 前缀指向 D:/BtSoft/nginx/;-p 的值使用正斜杠形式,经 win 版 nginx -t 实测可用。",
|
||||
"description": "开发环境配置(Windows 本机 / 宝塔 Windows 版 nginx,nginx.exe)。证书与 nginx 配置目录同样在【工程目录内】(仓库根 D:/wms/.ssl 与 D:/wms/nginx_config),与生产 <部署根>/.ssl、<部署根>/nginx_config 同构。nginx.exe 从任意 cwd 启动时会把启动目录当作前缀,导致读不到 conf/nginx.conf,因此 test/reload 命令必须带 -p 前缀指向 D:/BtSoft/nginx/;-p 的值使用正斜杠形式,经 win 版 nginx -t 实测可用。ver 为 conf 命名版本:生成的 server 块文件名为 <domainSafe><suffix>-<ver>.conf(如 web.wms.gztbyc.com-1.conf);证书/私钥文件名不变。站点内容片段路径 = upstreamInclude(开发为 D:/wms/nginx-upstream-local.conf,运维维护):生成的 server 块 = 证书骨架 + 一行 include <upstreamInclude>,站点 root / 伪静态 或 反代统一由该片段提供,脚本绝不覆盖,前端个性化在运行时由配置接口按域名完成。",
|
||||
"nginxBin": "D:/BtSoft/nginx/nginx.exe",
|
||||
"nginxPrefix": "D:/BtSoft/nginx/",
|
||||
"certDir": "D:/wms/.ssl",
|
||||
"confDir": "D:/wms/nginx_config",
|
||||
"ver": "1",
|
||||
"upstreamInclude": "D:/wms/nginx-upstream-local.conf",
|
||||
"testCmd": "{nginxBin} -p {nginxPrefix} -t",
|
||||
"reloadCmd": "{nginxBin} -p {nginxPrefix} -s reload"
|
||||
|
||||
@ -1,10 +1,11 @@
|
||||
{
|
||||
"description": "生产环境配置(Linux 服务器 / 宝塔构建 nginx,systemd 管理)。脚本以部署根 /www/wwwroot/qimen 为 cwd 运行,certDir/confDir 相对 cwd 解析到上一级;reload 走 systemctl reload nginx,test 直接调 /usr/bin/nginx -t。",
|
||||
"description": "生产环境配置(Linux 服务器 / 宝塔构建 nginx,systemd 管理)。脚本以部署根 /www/wwwroot/qimen 为 cwd 运行;证书与生成的 server 块固定放在【工程目录内】:certDir=<部署根>/.ssl、confDir=<部署根>/nginx_config(相对 cwd 解析,目录不存在时自动递归创建),与开发环境仓库根的 .ssl / nginx_config 同构。目录名是【硬约定】,改名必须同步改:① nginx 主配置的 include;② 本文件;③ 库表 wms_warehouse_front_config.cert_path/key_path(触发重同步刷新),详见 README「发布与运维」。ver 为 conf 命名版本:生成的 server 块文件名为 <domainSafe><suffix>-<ver>.conf(如 web.wms.gztbyc.com-1.conf);证书/私钥文件名不变。轮转时改本键(或传 --ver / CERT_SYNC_VER),下一轮脚本自动删除旧命名并生成新命名后 reload。站点内容片段路径 = upstreamInclude(生产为 /www/wwwroot/qimen/front.conf,运维维护):生成的 server 块 = 证书骨架 + 一行 include <upstreamInclude>,站点 root / 伪静态 或 反代统一由该片段提供,脚本绝不覆盖,前端个性化在运行时由配置接口按域名完成。【红线】upstreamInclude 必须写绝对路径且片段文件必须先存在(nginx 解析相对 include 的基准是 nginx prefix,如 /www/server/nginx/conf,不是脚本 cwd;写相对路径会让 nginx -t 失败并回滚整轮变更);脚本启动即校验,不满足直接 exit 1。reload 走 systemctl reload nginx,test 直接调 /usr/bin/nginx -t。",
|
||||
"nginxBin": "/usr/bin/nginx",
|
||||
"nginxPrefix": "",
|
||||
"certDir": "../.ssl",
|
||||
"confDir": "../nginx_config",
|
||||
"upstreamInclude": "/www/wwwroot/qimen/nginx-upstream.conf",
|
||||
"certDir": "./.ssl",
|
||||
"confDir": "./nginx_config",
|
||||
"ver": "1",
|
||||
"upstreamInclude": "/www/wwwroot/qimen/front.conf",
|
||||
"testCmd": "{nginxBin} -t",
|
||||
"reloadCmd": "systemctl reload nginx"
|
||||
}
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user