Skip to content

write python pseudocode for RabbitMQ queueing #3

@iannesbitt

Description

@iannesbitt

Current sysmwatch code demonstrates how to use the postgres NOTIFY service to listen for changes to tables in postgres. This task is to outline a design approach to:

  1. reliably trigger a notify on relevant system metadata changes
  2. subscribe to those notifications by listening via a python clinet connected to postgres
  3. reliably enqueue a RabbitMQ message in the dataone-indexer queue for each event in Metacat that requires indexing

The current Java endopoints that handle this in Metacat are MetacatSolrIndex.submit() which calls IndexGenerator.publish(). We need to do a full scan of the code to see under what conditions the IndexGenerator.pubish(0 is being triggered and replicate that externally via the NOTIFY mechanism.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

Status

Todo

Relationships

None yet

Development

No branches or pull requests

Issue actions