4.10.1

This release is based on Science Pipelines d_2024_12_03 and rubin-env 9.0.0. It fixes storage space crashes while version 4.11 is in development.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-47868: Fix cache bloat from "any filter" processing mode by @kfindeisen in #241

Full Changelog: 4.10.0...4.10.1

4.10.0

This release is based on Science Pipelines d_2024_12_03 and rubin-env 9.0.0. It adds support for new-format machine learning models and fixes excessive memory usage in crowded fields.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-47772: Error when preloading for pipelines that don't use templates by @kfindeisen in #231
• DM-47779: "Existing raws" check ignores multiple snaps by @kfindeisen in #232
• DM-47529: Migrate Prompt Processing PipelinesConfig to YAML by @kfindeisen in #222
• DM-47814: Allow turning off central repo export in Prompt Processing by @kfindeisen in #233
• DM-47829: Prompt Processing never retries if exposure does not generate visits by @kfindeisen in #234
• DM-47750: Disable brighter fatter in AP's ISR by @hsinfang in #230

Full Changelog: 4.9.0...4.10.0

4.9.0

This release is based on Science Pipelines d_2024_11_22 and rubin-env 9.0.0. It was published to include new features and fixes in Science Pipelines and in prompt processing framework. These changes add the ability to associate known solar system objects with single-frame sources and disable brighter fatter correction in AP's ISR.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-47620 Add single-frame SS association to SingleFrame.yaml by @Gerenjie in #227
• DM-47750: Disable brighter fatter in AP's ISR by @hsinfang in #229
• DM-47737 : Point SingleFrame pipelines to ap_pipe SingleFrame rather than prompt_processing ApPipe by @Gerenjie in #228

New Contributors

• @Gerenjie made their first contribution in #227

Full Changelog: 4.8.2...4.9.0

4.8.2

This release is based on Science Pipelines d_2024_11_12 and rubin-env 9.0.0. It fixes a number of bugs discovered when expanding ComCam processing to single-frame and full-pipeline runs.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-47628: Prompt Processing does not fall back on missing PrerequisiteInputs by @kfindeisen in #225
• DM-47591: Allow main pipeline execution if preprocessing pipeline fails by @kfindeisen in #223
• DM-47631: Prompt Processing incorrectly reports preload padding is too small by @hsinfang in #226

Full Changelog: 4.8.1...4.8.2

4.8.1

This release is based on Science Pipelines d_2024_11_12 and rubin-env 9.0.0. It includes a fix that allows us to see metrics on Chronograf even if the full AP pipeline is not run.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-47609: Add PVI metrics to SingleFrame pipelines by @isullivan in #224

Full Changelog: 4.8.0...4.8.1

4.8.0

This release is based on Science Pipelines d_2024_11_12 and rubin-env 9.0.0. It adds the ability to configure search radii for refcats, templates, and DiaObjects, which is needed for early ComCam observations.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-43712: Add configurable buffer for template and refcat preload by @hsinfang in #204

Full Changelog: 4.7.2...4.8.0

4.7.2

This release is based on Science Pipelines d_2024_11_04 and rubin-env 9.0.0. It includes several logging fixes to tide us over until version 4.8 is ready.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-47426: False alarms in Prompt Processing upload by @kfindeisen in #218
• DM-46641: Test new LATISS calibs of IsrTaskLSST in PP dev butler repo by @hsinfang in #219
• DM-47455: Add incoming and outgoing logs for microservice queries. by @kfindeisen in #220

Full Changelog: 4.7.1...4.7.2

4.7.1

This release is based on Science Pipelines d_2024_11_04 and rubin-env 9.0.0. It includes several bug fixes, including correct handling of the empty filters characteristic of ComCam engineering and calibration visits.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-47387: Prompt Processing can't handle blank filters in nextVisit message by @kfindeisen in #215
• DM-47333: Logger.exception() missing 1 required positional argument by @hsinfang in #214
• DM-47388: Prompt Processing logs an error on surveys configured to "ignore" by @kfindeisen in #216
• Update version links in Playbook by @kfindeisen in #217

Full Changelog: 4.7.0...4.7.1

4.7.0

This release is based on Science Pipelines d_2024_11_04 and rubin-env 9.0.0. It was published to include new features and fixes in Science Pipelines and in prompt processing framework. This includes the fix for DM-47274 (move DiaObject sdm_schema conversion later in diaPipe) and other new features.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• DM-47067: Document config overrides in PP pipelines by @kfindeisen in #210
• DM-47121: Add ISR-cal pipeline for ComCam by @hsinfang in #211
• DM-47333: Logger.exception() missing 1 required positional argument by @hsinfang in #213
• DM-47301: Add the monster to preloaded dataset cache. by @erinleighh in #212

Full Changelog: 4.6.0...4.7.0

4.6.0

This release is based on Science Pipelines d_2024_10_23 and rubin-env 9.0.0. It was published to include new features and fixes in Science Pipelines and in prompt processing framework.

This release is compatible with:

• Next Visit Fan Out 2.x
• APDB schema 2.0.x, ApdbCassandra 0.1.x, ApdbCassandraReplica 1.0.x, and ApdbSql 0.1.x
• Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.1.

What's Changed

• Update instructions for registering new dataset types. by @kfindeisen in #198
• DM-46312: Migrate unit tests to ComCamSim data by @kfindeisen in #199
• DM-45199: Support multiple workers per Prompt Processing pod by @kfindeisen in #185
• DM-46520: Raise on AnnotatedPartialOutputsError in Prompt Processing by @kfindeisen in #200
• DM-46505: Respect instrument overrides for RawIngestTask and DefineVisitsTask by @kfindeisen in #203
• DM-46530: Write up and test backport procedure for Prompt Processing by @kfindeisen in #202
• DM-46603: Reset expired visit ID calculation for Prompt Processing HSC tests by @kfindeisen in #205
• DM-46641: Update LATISS unobserved raws for the new IsrTaskLSST calibs by @hsinfang in #206
• DM-46664: Create a new prompt processing dev butler repo by @hsinfang in #207
• DM-46987: Add PTC datasets for LSSTComCamSim unit tests. by @kfindeisen in #208
• DM-46920: Add pipelines for LSSTComCam. by @erinleighh in #209

Full Changelog: 4.5.0...4.6.0