Commit da96f87a authored by BO ZHANG's avatar BO ZHANG 🏀
Browse files

feat: 新增用户认证与界面增强，优化监控配置

parent 2d83698e

.gitignore

+2 −0
Original line number Diff line number Diff line
@@ -29,6 +29,8 @@ Thumbs.db 


# Trae IDE

.trae

.vercel





# Directories

conda/

README.md

+1 −1
Original line number Diff line number Diff line
@@ -205,7 +205,7 @@ make up-worker ENV=csu 
| :--- | :--- | :--- | :--- |

| **Task Portal** | `38501` | **统一任务与监控控制台**。提供带进度预估的 JSON 筛选及 Grafana 资源大盘内嵌页 | `http://<MASTER_IP>:38501` |

| **API Gateway** | `38000` | **业务系统唯一对接入口**。提供高并发任务提交、任务控制(取消/重试)与状态检索 | `http://<MASTER_IP>:38000` |

| **Airflow Web UI** | `38080` | Airflow 原生控制台与官方 API (账号密码默认: `airflow`/`airflow`) | `http://<MASTER_IP>:38080` |

| **Airflow Web UI** | `38080` | Airflow 原生控制台与官方 API (已开启 `SimpleAuthManager` 免密 Admin 登录) | `http://<MASTER_IP>:38080` |

| **Grafana** | `33000` | 时间序列数据监控与仪表盘可视化 (账号密码默认: `admin`/`admin`) | `http://<MASTER_IP>:33000` |

| **Prometheus** | `39090` | 集群监控指标拉取服务器 | `http://<MASTER_IP>:39090` |

| **Kibana** | `35601` | 集中式日志可视化中心 (直接在 Discover 页面选择 `airflow-*` 视图检索日志) | `http://<MASTER_IP>:35601` |

api.md

+23 −1
Original line number Diff line number Diff line
@@ -204,3 +204,25 @@ export AIRFLOW_API_GATEWAY=http://10.73.0.27:38000 


*   **Kibana URL**: `http://10.73.0.27:35601`

*   **检索条件示例**: 在 Kibana 的 `filebeat-*` 索引中搜索 `"123e4567-e89b-12d3-a456-426614174000"`。



---



## 7. 获取共享环境变量配置



- **URL:** `/api/env`

- **Method:** `GET`

- **Description:** 获取 Airflow DAGs 共享的环境变量文件内容 (`volumes/env/common.env`)。

- **Response:**

  ```json

  {

    "content": "HARBOR=csu-harbor.csst.nao:10443\n...",

    "variables": [

      {

        "key": "HARBOR",

        "value": "csu-harbor.csst.nao:10443"

      }

    ]

  }

  ```



## 8. 获取 Celery Worker 信息
 
 No newline at end of file

docker-celery-3.0.5/ansible/roles/common/handlers/main.yml

0 → 100644
+6 −0
Original line number Diff line number Diff line 
---

- name: Restart Docker

  service:

    name: docker

    state: restarted

  become: yes
 
 No newline at end of file

docker-celery-3.0.5/ansible/roles/common/tasks/main.yml

+24 −0
Original line number Diff line number Diff line
@@ -24,3 +24,27 @@ 
  template:

    src: env.j2

    dest: /opt/csst-airflow/docker-celery-3.0.5/envs/.env.{{ env_name }}



- name: Setup Docker daemon for log rotation

  copy:

    dest: /etc/docker/daemon.json

    content: |

      {

        "log-driver": "json-file",

        "log-opts": {

          "max-size": "100m",

          "max-file": "3"

        }

      }

    mode: '0644'

  become: yes

  notify: Restart Docker



- name: Setup cron job for Docker system prune

  cron:

    name: "Docker cleanup unused images and containers weekly"

    minute: "0"

    hour: "3"

    weekday: "0" # Every Sunday at 3 AM

    job: "/usr/bin/docker system prune -a -f --filter 'until=168h' > /dev/null 2>&1"

  become: yes