data_model.md 12.7 KB
Newer Older
BO ZHANG's avatar
BO ZHANG committed
1
2
# L1-MBI Data model

Wang Rui's avatar
Wang Rui committed
3
## File: \*\_*_L1_1.fits
BO ZHANG's avatar
BO ZHANG committed
4
5
6

### File contents

BO ZHANG's avatar
BO ZHANG committed
7
8
9
10
11
12
13
| HDU   | data                    | note        |
|-------|-------------------------|-------------|
| HDU0  | None                    | PrimaryHDU  |
| HDU1  | reduced SCI (9k x 9k)   | ImageHDU    |
| HDU2  | reduced ERR (9k x 9k)   | ImageHDU    |
| HDU3  | reduced DQ (9k x 9k)    | ImageHDU    |

BO ZHANG's avatar
BO ZHANG committed
14
15
16
- 关键字 comment大写开头
- 

BO ZHANG's avatar
BO ZHANG committed
17
18
### *HDU0 --> HDU1

BO ZHANG's avatar
BO ZHANG committed
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
HDU0 修改 `NEXTEND=3`
模块之间用COMMENT隔开,例如
```
COMMENT ==================================================================      
COMMENT QC0 CHECK                                                               
COMMENT ==================================================================  
```
精简每个关键字的comment
`-`表示不可能失败,不会使用fallback_value


### HDU1-1 (先不管)

| keyword            | value                  | comment                                       | fallback_value        | type   | module                  |
|--------------------|:-----------------------|-----------------------------------------------|-----------------------|--------|-------------------------|
| VER_CRDS           | '0.0.1 '               | Version of CRDS file selection software used  | -                     | str    | csst_ms_sls_instrument  |
| R_GAIN             | '*.gain.fits'          | Gain reference file name                      | 'N/A'                 | str    | csst_ms_sls_instrument  |
| R_READN            | '*.rn.fits'            | Read noise reference file name                | 'N/A'                 | str    | csst_ms_sls_instrument  |
| R_SATURA           | '*.sat.fits'           | Saturation reference file name                | 'N/A'                 | str    | csst_ms_sls_instrument  |
| R_MASK             | '*.msk.fits'           | Mask reference file name                      | 'N/A'                 | str    | csst_ms_sls_instrument  |
| R_BIAS             | '*bias.fits'           | SuperBias reference file name                 | 'N/A'                 | str    | csst_ms_sls_instrument  |
| R_DARK             | '*dark.fits'           | Dark reference file name                      | 'N/A'                 | str    | csst_ms_sls_instrument  |
| R_DFLAT            | '*flat.fits'           | Detector Flat reference file name             | 'N/A'                 | str    | csst_ms_sls_instrument  |
| R_SFLAT            | '*flat.fits'           | Spectrograph Flat reference file name         | 'N/A'                 | str    | csst_ms_sls_instrument  |
Wang Xia's avatar
Wang Xia committed
43
44
45
46
47
48
49
50
51
| S_DQINI            | 1                     | Data Quality Initialization                   | 0                     | int  | csst_ms_sls_instrument  |
| S_SATURA           | 1                      | Saturation Checking                           | 0                     | int   | csst_ms_sls_instrument  |
| S_ERRINI           | 1                      | Error Initialization                          | 0                     | int   | csst_ms_sls_instrument  |
| S_BIAS             | 1                      | Bias correction                               | 0                     | int   | csst_ms_sls_instrument  |
| S_DARK             | 1                     | Dark correction                               | 0                     | int   | csst_ms_sls_instrument  |
| S_FLAT             | 1                      | Flat field correction                         | 0                     | int   | csst_ms_sls_instrument  |
| VER_INST           | '0.0.1 '               | Instrument calibration pipeline version   | -                     | str    | csst_ms_sls_instrument  |
| STM_INST | '2022-12-30T10:18:53'  | Instrument pipeline processing time                      | '2022-12-30T10:18:53' | str    | csst_ms_sls_instrument  |
| HISTORY            | '**step complete.'     | Record processing message                     | -              | str    | csst_ms_sls_instrument  |
BO ZHANG's avatar
BO ZHANG committed
52
53
54
55
56

### HDU1

#### Header of `csst_ms_sls_instrument`

BO ZHANG's avatar
BO ZHANG committed
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
`IMAGE STATISTICS AND DATA QUALITY FLAGS` 需要修改成为标准格式,首字母大写
增加宇宙线证认相关关键字

| keyword   | value    | comment                                 | fallback_value | type | module                   |
|-----------|:---------|-----------------------------------------|----------------|------|--------------------------|
| EXTNAME   | SCI      | extension name                          | SCI            | str  | csst_ms_sls_instrument   |
| EXTVER    | 1        | extension version number                | 1              | i8   | csst_ms_sls_instrument   |
| BUNIT     | *e-/s    | brightness units                        | *e-/s          | str  | csst_ms_sls_instrument   |
| *NGOODPIX | 84794368 | number of good pixels                   | -9999          | i32  | csst_ms_sls_instrument   |
| *SDQFLAGS | 31743    | *serious data quality flags             | -9999          | i32  | csst_ms_sls_instrument   |
| GOODMAX   | 260.0    | maxmum value of good pixels             | -9999          | f32  | csst_ms_sls_instrument   |
| GOODMIN   | -0.001   | minmum value of good pixels             | -9999          | f32  | csst_ms_sls_instrument   |
| GOODMEAN  | 0.3      | mean value of good pixels               | -9999          | f32  | csst_ms_sls_instrument   |
| SNRMIN    | 187.4    | minmum signal to noise of good pixels   | -9999          | f32  | csst_ms_sls_instrument   |
| SNRMAX    | 1.2      | maxmum signal to noise of good pixels   | -9999          | f32  | csst_ms_sls_instrument   |
| SNRMEAN   | 3.38     | average of the dark values subtracted   | -9999          | f32  | csst_ms_sls_instrument   |

VER_INST 仪器改正版本号
STA_INST 仪器改正状态
STM_INST 仪器改正时间戳
BO ZHANG's avatar
BO ZHANG committed
77
78
79

#### Header of `csst_ms_sls_position`

BO ZHANG's avatar
BO ZHANG committed
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
位置定标信息新开一节
CD1_1等系数在修改后挪到这一节

| keyword  | value                 | comment                      | fallback_value | type   | module                |
|----------|:----------------------|------------------------------|----------------|--------|-----------------------|
| CTYPE1   | 'RA---TPV'            |                              | 'RA---TAN'     | str    | csst_ms_sls_position  |
| CTYPE2   | 'DEC--TPV'            |                              | 'DEC--TAN'     | str    | csst_ms_sls_position  |
| CUNIT1   | 'deg  '               |                              | 'deg'          | str    | csst_ms_sls_position  |
| CUNIT2   | 'deg  '               |                              | 'deg'          | str    | csst_ms_sls_position  |
| RADESYS  | 'ICRS '               |                              | '?'            | str    | csst_ms_sls_position  |
| PV1_0    | 0.003205383944913964  |                              | -9999          | f32    | csst_ms_sls_position  |
| PV1_1    | 0.8673020820536499    |                              | -9999          | f32    | csst_ms_sls_position  |
| PV1_2    | -0.2011989871377834   |                              | -9999          | f32    | csst_ms_sls_position  |
| PV1_3    | -0.2597214229472611   |                              | -9999          | f32    | csst_ms_sls_position  |
| PV1_4    | 0.4353828741811097    |                              | -9999          | f32    | csst_ms_sls_position  |
| PV1_5    | -0.5054216569802673   |                              | -9999          | f32    | csst_ms_sls_position  |
| PV1_6    | 0.1951474426617432    |                              | -9999          | f32    | csst_ms_sls_position  |
| PV2_0    | 0.00109803885992697   |                              | -9999          | f32    | csst_ms_sls_position  |
| PV2_1    | 0.9171065857705857    |                              | -9999          | f32    | csst_ms_sls_position  |
| PV2_2    | -0.04908256792722099  |                              | -9999          | f32    | csst_ms_sls_position  |
| PV2_3    | -0.09860562038448289  |                              | -9999          | f32    | csst_ms_sls_position  |
| PV2_4    | 0.07961855240788976   |                              | -9999          | f32    | csst_ms_sls_position  |
| PV2_5    | -0.2009224365497067   |                              | -9999          | f32    | csst_ms_sls_position  |
| PV2_6    | 0.1741954691884874    |                              | -9999          | f32    | csst_ms_sls_position  |
| *NS_POS  | 10                    | number of the stars          | --             | i8     | csst_ms_sls_position  |
| RA_OFF   | -0.0                  | mas in unit                  | -9999          | f32    | csst_ms_sls_position  |
| DEC_OFF  | 0.0                   | mas in unit                  | -9999          | f32    | csst_ms_sls_position  |
| RA_RMS   | 127.1                 | mas in unit                  | -9999          | f32    | csst_ms_sls_position  |
| DEC_RMS  | 60.4                  | mas in unit                  | -9999          | f32    | csst_ms_sls_position  |
| RA_CEN   | 193.299027            | center of detector in ra     | --             | f32    | csst_ms_sls_position  |
| DEC_CEN  | 26.08851              | center of detector in dec    | --             | f32    | csst_ms_sls_position  |
| *VER_POS | '1.0'                 | version of distortion        | '1.0'          | str    | csst_ms_sls_position  |
| *STM_POS | '2023-02-16 12:15:16' | time of last modification    | --             | str    | csst_ms_sls_position  |
| *STA_POS | 0                     | 0 for done, 1 for failure    | 1              | i8     |  csst_ms_sls_position |
Wang Rui's avatar
Wang Rui committed
114

BO ZHANG's avatar
BO ZHANG committed
115
116

#### Header of `csst_ms_sls_qc1`
BO ZHANG's avatar
BO ZHANG committed
117
118
119
120
121
122
123
| keyword        | value    | comment                      | fallback_value | type  | module          |
|----------------|:---------|------------------------------|----------------|-------|-----------------|
| *STA_QC1 QC1_S | 0        | 0 for success, 1 for failure | 1              | i8    | csst_ms_sls_qc1 |
| VER_QC1        | '0.0.1'  | QC1 pipeline version         | '0.0.1'        | str   | csst_ms_sls_qc1 |
| QC1_FLAG       | 0        | quality flags                | -99            | i16   | csst_ms_sls_qc1 |
+ STM_QC1
+ 
Wang Rui's avatar
Wang Rui committed
124
125
126
127
### HDU2

#### Header of `csst_ms_sls_instrument`

BO ZHANG's avatar
BO ZHANG committed
128
129
130
131
132
133
134
135
136
137
138
139
| keyword  | value         | comment                    | fallback_value | type    | module                  |
|----------|---------------|----------------------------|----------------|---------|-------------------------|
| XTENSION | IMAGE         | Image extension            | IAMGE          | str     | csst_ms_sls_instrument  |
| BITPIX   | -32           | bits per data value        | -32            | i8      | csst_ms_sls_instrument  |                 
| NAXIS    | 2             | Number of array dimensions | 2              | i8      | csst_ms_sls_instrument  |                 
| NAXIS1   | 9216          | Size of the axis           | 9216           | i8      | csst_ms_sls_instrument  |                 
| NAXIS2   | 9232          | Size of the axis           | 9232           | i8      | csst_ms_sls_instrument  |
| PCOUNT   | 0             | number of parameters       | 0              | i8      | csst_ms_sls_instrument  |                         
| GCOUNT   | 1             | number of groups           | 1              | i8      | csst_ms_sls_instrument  |                                       
| EXTNAME  | ERR           | extension name             | ERR            | str     | csst_ms_sls_instrument  |
| EXTVER   | 1             | extension version number   | 1              | i8      | csst_ms_sls_instrument  |
| *BUNIT   | electrons/s   | brightness units           | electrons/s    | str     | csst_ms_sls_instrument  |
Wang Rui's avatar
Wang Rui committed
140
141
142
143

### HDU3

#### Header of `csst_ms_sls_instrument`
BO ZHANG's avatar
BO ZHANG committed
144

BO ZHANG's avatar
BO ZHANG committed
145
146
147
148
149
150
151
152
153
154
155
156
| keyword   | value       | comment                    | fallback_value | type   | module                 |
|-----------|-------------|----------------------------|----------------|--------|------------------------|
| XTENSION  | IMAGE       | Image extension            | IAMGE          | str    | csst_ms_sls_instrument |
| BITPIX    | 16          | bits per data value        | 16             | i8     | csst_ms_sls_instrument |                 
| NAXIS     | 2           | Number of array dimensions | 2              | i8     | csst_ms_sls_instrument |                 
| NAXIS1    | 9216        | Size of the axis           | 9216           | i8     | csst_ms_sls_instrument |                 
| NAXIS2    | 9232        | Size of the axis           | 9232           | i8     | csst_ms_sls_instrument |
| PCOUNT    | 0           | number of parameters       | 0              | i8     | csst_ms_sls_instrument |                         
| GCOUNT    | 1           | number of groups           | 1              | i8     | csst_ms_sls_instrument |
| EXTNAME   | DQ          | extension name             | DQ             | str    | csst_ms_sls_instrument |
| EXTVER    | 1           | extension version number   | 1              | i8     | csst_ms_sls_instrument |
| *BUNIT    | unitless    | brightness units           | unitless       | str    | csst_ms_sls_instrument |
BO ZHANG's avatar
BO ZHANG committed
157