Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
csst-cicd
csst-dag
Commits
f7806201
Commit
f7806201
authored
May 07, 2025
by
BO ZHANG
🏀
Browse files
update msc sls and qc0 DAG
parent
94fba0a4
Changes
4
Show whitespace changes
Inline
Side-by-side
csst_dag/dag_config/csst-msc-l1-qc0.json
View file @
f7806201
{
{
"dag_id"
:
"csst-msc-l1-qc0"
,
"priority"
:
1
,
"dag_id"
:
"csst-msc-l1-sls"
,
"dag_run_id"
:
"12345"
,
"dag_run_id"
:
"12345"
,
"batch_id"
:
"msc-093-reduction-v2"
,
"dataset"
:
"csst-msc-c9-25sqdeg-v3"
,
"message"
:
{
"obs_type"
:
"BIAS"
,
"obsid"
:
"10109300543790"
,
"project_id"
:
"none"
,
"chipid"
:
"09"
,
"obs_id"
:
"10100543790"
,
"dataset"
:
"msc-093"
,
"chip_id"
:
"01"
,
"batch_id"
:
"msc-093-reduction-v2"
"batch_id"
:
"csst-msc-c9-25-sqdeg-v3-rdx1"
}
}
}
csst_dag/dag_config/csst-msc-l1-qc0.yml
View file @
f7806201
# 定义DAG的基本信息
-
dag_id
:
csst-msc-l1-qc0
dag_id
:
"
csst-msc-l1-qc0"
dag
:
tasks
:
# 定义任务
-
name
:
QC0
tasks
:
task1
:
image
:
csst-msc-l1-qc0
image
:
csst-msc-l1-qc0
tag
:
latest
force_pull
:
true
bash_command
:
"
python
/pipeline/app/run.py
{message}"
\ No newline at end of file
csst_dag/dag_config/csst-msc-l1-sls.json
View file @
f7806201
{
{
"priority"
:
1
,
"dag_id"
:
"csst-msc-l1-sls"
,
"dag_id"
:
"csst-msc-l1-sls"
,
"dag_run_id"
:
"12345"
,
"dag_run_id"
:
"12345"
,
"batch_id"
:
"msc-093-reduction-v2"
,
"dataset"
:
"csst-msc-c9-25sqdeg-v3"
,
"message"
:
{
"obs_type"
:
"WIDE"
,
"obsid"
:
"10109300543790"
,
"project_id"
:
"none"
,
"chipid"
:
"01"
,
"obs_id"
:
"10100543790"
,
"dataset"
:
"msc-093"
,
"chip_id"
:
"01"
,
"batch_id"
:
"msc-093-reduction-v2"
"batch_id"
:
"csst-msc-c9-25-sqdeg-v3-rdx1"
}
}
}
csst_dag/dag_config/csst-msc-l1-sls.yml
View file @
f7806201
# 定义DAG的基本信息
-
dag_id
:
csst-msc-l1-sls
dag_id
:
"
csst-msc-l1-sls"
dag
:
tasks
:
# 定义任务
-
name
:
QC0
tasks
:
task1
:
image
:
csst-msc-l1-qc0
image
:
csst-msc-l1-qc0
tag
:
latest
-
name
:
SLS
force_pull
:
true
dependencies
:
[
QC0
]
bash_command
:
"
python
/pipeline/app/run.py
{message}"
task2
:
image
:
csst-msc-l1-sls
image
:
csst-msc-l1-sls
tag
:
latest
-
name
:
EXT0
force_pull
:
true
dependencies
:
[
SLS
]
bash_command
:
"
python
/pipeline/app/run.py
{message}"
upstream_tasks
:
[
"
task1"
]
# 定义依赖关系,task2依赖task1
task3
:
image
:
csst-msc-l1-sls-extraction-zero
image
:
csst-msc-l1-sls-extraction-zero
tag
:
latest
force_pull
:
true
bash_command
:
"
python
/pipeline/app/run.py
{message}"
upstream_tasks
:
[
"
task2"
]
# 定义依赖关系,task3依赖task2
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment