Photo-z Server Data¶
The Photo-z Server is a web-based platform developed by LIneA as part of Brazil's in-kind contribution to the Rubin Observatory LSST project. It provides access to both official and user-generated data products. The Photo-z Server administrators maintain and periodically update a curated list of data resources to support the LSST Community with general-purpose examples.
This page provides an overview of some datasets available on the Photo-z Server along with access instructions. For more details on the platform's features and functionalities, please refer to the full Photo-z Server User Documentation.
Restricted Access
In accordance with the Rubin Observatory and IDAC-BR Data Policies, access to LSST data — including derived products hosted on the Photo-z Server — is restricted to authorized LSST Community members with valid RSP accounts.
Dataset Classification¶
Official Data Products¶
The official datasets will be validated by Rubin's Data Management and will be available to the LSST Community through the Photo-z Server. These datasets will include reference redshift catalogs, training sets, and photo-z estimates associated with the LSST data releases. The datasets will be released in a phased manner, starting with the first data release (DR1) and continuing with subsequent releases as the LSST survey progresses. For now, the Rubin Observatory PZ Data Products page is empty.
User-Generated Data Products¶
Most data products hosted on the Photo-z Server will be uploaded or created by users, and there is no quality guarantee for them. Users are encouraged to use the Photo-z Server to store data products at any stage of development, from experimental samples to refined results associated with scientific publications.
Besides data uploaded by users, the User-generated Data Products page hosts a set of datasets that were prepared by the Photo-z Server admins for educational purposes, to serve as use-case examples for the Photo-z Server tutorials. In addition, the DP1 and DP2 data products generated by the PZ Science Unit from Rubin’s Commissioning Team, such as those described in the tech notes SITCOMTN-154 (for DP1) and RTN-124 (in preparation, for DP2), are also available there. These data products were only very lightly validated. Treat them as provisional and use them with caution.
Data Preview 2¶
Detailed information about the DR2 PZ Data Products will be available in the tech note RTN-124 (in preparation).
Section under construction
Links and descriptions below might change soon.
Redshift Reference Sample¶
A compilation of reference redshifts produced using the pipeline Combine Redshift Catalogs (CRC) by combining 38 catalogs with data from 51 surveys, mostly spectroscopic, to be matched to the LSST Object catalog to produce training and test sets for photo-z algorithms.
| Data Product | Description | # of source catalogs | # of objects | Status |
|---|---|---|---|---|
| REF_Z_CLEAN_NO_DESI_LSS | Unique objects with quality flag \(\geq\) 3, excluding DESI DR1 | 37 | 6,616,173 | |
| DESI DR1 LITE | DESI DR1 (column selection) | 1 | 28,425,963 |
Legend
Planned In preparation Available
Training and Test Sets¶
| Data Product | Description | # of objects | Status |
|---|---|---|---|
| MATCHED_CLEAN RTN-124 | REF_Z_CLEAN_NO_DESI_LSS matched to DP2 Objects | 1,194,088 | |
| MATCHED_DESI RTN-124 | DESI DR1 LITE matched to DP2 Objects | 1,544,298 | |
| CLIPPED_TRAIN RTN-124 (PARQUET) | 80% random sample from MATCHED_CLEAN trimmed for biased excess based on i_mag-redshift binning | 554,676 | |
| SOM_TEST RTN-124 (PARQUET) | remaining 20% from MATCHED_CLEAN with SOM-based sampling to mimic "DP2 galaxies" | 18,400 |
Legend
Planned In preparation Available
Training Results¶
Legend
Planned In preparation Available
Validation Results¶
To be added soon.
Photo-z Estimates¶
To be added soon.
For now, Photo-z Estimates can be accessed via LSDB. For more information, visit the LSDB.io page
Data Preview 1¶
Object Catalogs¶
Data products containing object tables described in Section 2.1 and listed in Table 1 from the tech note SITCOMTN-154.
| Data Product | Data set | Selection | Number of objects |
|---|---|---|---|
| DP1 (available in the RSP) | Complete DP1 Object Catalog | None | 2,299,757 |
| ECDFS+EDFS+SV_95 gold SITCOMTN-154 | ECDFS+EDFS+SV_95 | gold | 375,610 |
| SV_38 gold_4_band SITCOMTN-154 | SV_38 | gold_4_band | 169,034 |
Comprehensive Gold dataset for all DP1 fields beyond the fields ECDFS+EDFS+SV_95 and SV_38, where spectroscopic data are available (dataset not listed in Table 1 from the tech note SITCOMTN-154):
| Data Product | Data set | Selection | Number of objects |
|---|---|---|---|
| DP1 Gold all | All fields | gold | 686,334 |
Redshift Reference Catalogs¶
Redshift Reference Catalogs from Individual Surveys¶
Data products containing reference redshift catalogs (before matching with the DP1 Object table) separated by origin survey as listed in Table 2 from the tech note SITCOMTN-154.
Note: These datasets are already filtered to the ECDFS field and cleaned with the selection criteria described in Section 2.2.1 from the tech note SITCOMTN-154. For the complete original catalogs, please go to the External datasets section below.
Additional spectroscopic data from DESI DR1 were used as an independent test set for validating the photo-z estimates. Since DESI DR1 is a very large dataset that extends beyond the DP1 footprint, it was filtered to include only the ECDFS field.
| Data Product | Reference | Number of Redshifts |
|---|---|---|
| DESI DR1 inside DP1 footprint | DESI Collaboration et al. (2025) | 50,634 |
Combined Redshift Catalog¶
A single file containing all reference redshifts combined from the individual surveys listed above (excluding DESI), as described in Section 2.2.1 of the technical note SITCOMTN-154.
| Data Product | Number of Redshifts |
|---|---|
| ComCam ECDFS z catalog SITCOMTN-154 | 104,070 |
Training and Test Sets¶
On the Photo-z Server, the product type "Training Set" comprises all samples resulting from the matching between a reference redshift and an object catalog. That might include training and test sets together in the same file or independent sub-samples uploaded separately. For the latter, both training and test sets are tagged as "Training Set".
Data products containing training and test sets generated from the ComCam ECDFS z catalog listed in Table 1 from the tech note SITCOMTN-154 are:
| Data Product | Data set | Selection | Number of objects |
|---|---|---|---|
| training_v1 match_prelim SITCOMTN-154 | training_v1 | match_prelim | 7,000 |
| test_v1 match_prelim SITCOMTN-154 | test_v1 | match_prelim | 2,437 |
| training_v4 match_ecdfs SITCOMTN-154 | training_v4 | match_ecdfs | 6,778 |
| test_v4 match_ecdfs SITCOMTN-154 | test_v4 | match_ecdfs | 2,905 |
| test_DESI match_desi SITCOMTN-154 | test_DESI | match_desi | 2,728 |
Training Results¶
Estimator data models are listed in Table 7 and described in Appendix A.3 from the tech note SITCOMTN-154.
Configuration Files
As mentioned in Section 3.4 and Appendix A.1 from the tech note SITCOMTN-154, the configuration files dp1.yaml (the complete set of configurations tested, labeled as analysis flavors) and dp1_v4.yaml (optimized configuration parameters) are available on the GitHub repository rail_project_config.
Validation Results¶
Photo-z point estimates, QP Ensembles, and evaluation metrics are related to the results shown in Table 4. Files were uploaded from directories listed in Table 7 and described in Appendix A.4 from the tech note SITCOMTN-154.
Photo-z Estimates¶
Photo-z Tables¶
PZ Tables were produced as part of the initial studies with commissioning data described in SITCOMTN-154. Data were uploaded from the directories listed in Table 7.
| Data Product | Number of objects |
|---|---|
| PZ Table dp1_all gold baseline SITCOMTN-154 | 686,334 |
| PZ Table dp1_sv38 gold baseline SITCOMTN-154 | 169,034 |
| PZ Table DESI gold baseline | 2728 |
External datasets¶
Public data collected from the literature and hosted on the Photo-z Server.
Reference Redshift Catalogs¶
Individual Surveys¶
The Photo-z Server hosts several public spectroscopic redshift catalogs from different surveys that can be used as reference datasets for training and validation of photo-z estimates. The data products listed below are the original catalogs, without any filtering or data selection.
Legend
Planned In preparation Available
Combined Redshift Catalogs (CRC)¶
Generated by the Combine Redshift Catalogs (CRC) pipeline of the Photo-z Server.
| Data Product | Release Date (MM/DD/YYYY) | # of Products | # of Objects | Status |
|---|---|---|---|---|
| REF_Z_COMPLETE | 07/06/2026 | 38 | 43,555,318 | |
| REF_Z_CLEAN | 07/06/2026 | 38 | 20,856,682 | |
| REF_Z_CLEAN_NO_DESI_LSS | 07/06/2026 | 37 | 6,668,608 |
Legend
Planned In preparation Available
Training Set Maker (TSM)¶
Generated by the Training Set Maker (TSM) pipeline of the Photo-z Server.
| Data Product | Release Date (MM/DD/YYYY) | # of Objects | Status |
|---|---|---|---|
| DP1_TRAIN_CMODEL | 07/07/2026 | 38,843 |
Legend
Planned In preparation Available