Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
csst-cicd
csst-dag
Commits
07e32d5a
Commit
07e32d5a
authored
Jul 10, 2025
by
BO ZHANG
🏀
Browse files
fixed no data bug in filtering
parent
6ff01013
Changes
1
Hide whitespace changes
Inline
Side-by-side
csst_dag/dag/_base_dag.py
View file @
07e32d5a
...
...
@@ -88,21 +88,14 @@ class BaseDAG:
join_type
=
"inner"
,
)
if
len
(
filtered_data_basis
)
==
0
:
print
(
">>> Input plan basis:"
)
plan_basis
.
pprint
()
print
(
">>> Input data basis:"
)
data_basis
.
pprint
()
raise
ValueError
(
"No data found for the given pattern."
)
return
plan_basis
[:
0
],
filtered_data_basis
u_data_basis
=
table
.
unique
(
filtered_data_basis
[
"dataset"
,
"obs_id"
])
if
len
(
u_data_basis
)
==
0
:
filtered_plan_basis
=
plan_basis
[:
0
]
else
:
filtered_plan_basis
=
table
.
join
(
u_data_basis
,
plan_basis
,
keys
=
[
"dataset"
,
"obs_id"
],
join_type
=
"inner"
,
)
filtered_plan_basis
=
table
.
join
(
u_data_basis
,
plan_basis
,
keys
=
[
"dataset"
,
"obs_id"
],
join_type
=
"inner"
,
)
return
filtered_plan_basis
,
filtered_data_basis
def
schedule
(
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment