pittgoogle-client
pittgoogle-client is a python library that facilitates access to astronomy data that lives in Google Cloud services. It is being developed the Pitt-Google alert broker is curated and maintained available in Google Cloud.
Initial setup for data access requires 2 steps:
If you run into trouble, please open an Issue.
Data overview
Pub/Sub Message Streams
Topic |
Description |
---|---|
ztf-alerts |
Full ZTF alert stream |
ztf-lite |
Lite version of ztf-alerts (every alert, subset of fields) |
ztf-tagged |
ztf-lite with basic categorizations such as “is pure” and “is likely extragalactic transient” added to the message metadata. |
ztf-SuperNNova |
ztf-tagged plus SuperNNova classification results (Ia vs non-Ia). |
ztf-alert_avros |
Notification stream from the ztf-alert_avros Cloud Storage bucket indicating that a new alert packet is in file storage. These messages contain no data, only attributes. The file name is in the attribute “objectId”, and the bucket name is in the attribute “bucketId”. |
ztf-BigQuery |
Notification stream indicating that alert data is available in BigQuery tables. |
ztf-loop |
Use this stream for testing. Recent ZTF alerts are published to this topic at a roughly constant rate of 1 per second. |
BigQuery Catalogs
Dataset |
Table |
Description |
---|---|---|
ztf_alerts |
alerts |
Complete alert packet, excluding image cutouts. Same schema as the original alert, including nested and repeated fields. |
ztf_alerts |
DIASource |
Alert packet data for the triggering source only. Including the object ID and a list of source IDs for the previous sources included in the alert, excluding cutouts and data for previous sources. Flat schema. |
ztf_alerts |
SuperNNova |
Results from a SuperNNova (Möller & de Boissière, 2019) Type Ia supernova classification (binary). |
ztf_alerts |
metadata |
Information recording Pitt-Google processing (e.g., message publish times, bucket name and filename, etc.). |