LSST - Data Preview 1 (DP1)¶
About¶
LSST DP1 was the first preliminary dataset based on real data internally released by the LSST DM. It contains image and catalog products from Rubin Science Pipelines v29 processing of observations obtained with the LSST Commissioning Camera of seven ~1 square degree fields over seven weeks in late 2024.
Release Date: June 30, 2022
Eligibility¶
Private data available only to the LSST collaboration members: All scientists and students in the US and Chile, plus named members of international in-kind teams. For more information, see the Data Policy Document RDO-013.
How to Access¶
Data products hosted and maintained by LIneA are available through multiple access methods. This page provides information on how to access the primary and secondary data products for use in the HPC environment. They can be accessed from LIneA's Open OnDemand platform, either through the JupyterLab environment (on Interactive Apps menu) or Shell Access Terminal (Clusters menu).
Files Location¶
The data products are stored in the Lustre and NFS file systems, depending on the file types. In both cases, the directories are found using the environment variables $DATA and $PUBLIC_DATA for embargoed and public data, respectively.
Directory Structure¶
The LSST DP1 data products are organized in the following directory structure:
$DATA/lsst/dp1/
├── primary
│ ├── catalogs
│ │ ├── object
│ │ │ └── object_xxxxx_...xxx.parq # (29 files)
│ │ ├── ss_object
│ │ │ └── ss_object_...xxx.parq
│ │ └── ss_source
│ │ └── ss_source_...xxx.parq
│ ├── images
│ └── maps
└── secondary
├── catalogs
│ ├── hips # (HiPS catalog structure)
│ └── object_collection # (LSDB HATS structure)
└── images
└── hips # (HiPS image structure)
Where primary datasets are original data products provided by LSST DM downloaded to the IDAC-BR, and secondary datasets are derived data products generated by LIneA team.
Dataset information¶
Object¶
Measurements of objects detected in deep coadd images.
Path: $DATA/lsst/dp1/primary/catalogs/object/
| Key Numbers | |
|---|---|
| Number of files | 29 |
| Number of columns | 1,296 |
| Total number of rows | 2,299,757 |
| Total size | 6.3 GB |
| File format (extension) | Parquet (.parq) |
SS Object¶
Derived parameters for moving (Solar System) objects.
Path: $DATA/lsst/dp1/primary/catalogs/ss_object/
| Key Numbers | |
|---|---|
| Number of files | 1 |
| Number of columns | 3 |
| Total number of rows | 431 |
| Total size | 300 KB |
| File format (extension) | Parquet (.parq) |
SS Source¶
Instantaneous physical parameters for moving objects at the time of every observation.
Path: $DATA/lsst/dp1/primary/catalogs/ss_source/
| Keu Numbers | |
|---|---|
| Number of files | 1 |
| Number of columns | 23 |
| Total number of rows | 5,988 |
| Total size | 1.5 MB |
| File format (extension) | Parquet (.parq) |