Kafka Topics
There are several Kafka topics that are submitted and read in the Giles Ecosystem. Messages should be in JSON format.
Topics
Topic | Description | Producer | Listeners/Processors |
---|---|---|---|
geco.requests.storage | Storage requests for files to be stored. | Giles | Nepomuk |
geco.requests.storage.complete | Requests submitted to indicate storage was completed. | Nepomuk | Giles |
geco.requests.ocr | Requests to OCR an image. | Giles | Cassiopeia |
geco.requests.ocr.complete | Requests submitted to indicate OCR was completed. | Cassiopeia | Giles |
geco.requests.pdf.toimages | Requests to extract images from PDFs. | Giles | Cepheus |
geco.requests.pdf.toimages.complete | Requests submitted to indicate image extraction was completed. | Cepheus | Giles |
geco.requests.pdf.extract | Requests to extract texts from pdfs. | Giles | Andromeda |
geco.requests.pdf.extract.complete | Requests submitted to indicate text extraction was completed. | Andromeda | Giles |
geco.requests.system.messages | Messages submitted to inform about system failures, warnings, or infos. | Any component | September |