Kafka Topics

There are several Kafka topics that are submitted and read in the Giles Ecosystem. Messages should be in JSON format.

Topics

TopicDescriptionProducerListeners/Processors

geco.requests.storage

Storage requests for files to be stored.GilesNepomuk

geco.requests.storage.complete

Requests submitted to indicate storage was completed.NepomukGiles

geco.requests.ocr

Requests to OCR an image.GilesCassiopeia
geco.requests.ocr.completeRequests submitted to indicate OCR was completed.CassiopeiaGiles

geco.requests.pdf.toimages

Requests to extract images from PDFs.GilesCepheus

geco.requests.pdf.toimages.complete

Requests submitted to indicate image extraction was completed.CepheusGiles

geco.requests.pdf.extract

Requests to extract texts from pdfs.GilesAndromeda

geco.requests.pdf.extract.complete

Requests submitted to indicate text extraction was completed.AndromedaGiles
geco.requests.system.messagesMessages submitted to inform about system failures, warnings, or infos.Any componentSeptember