Skip to content
GitLab
Explore
Sign in
Register
Primary navigation
Search or go to…
Project
I
Indexer
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Iterations
Wiki
Requirements
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Locked files
Build
Pipelines
Jobs
Pipeline schedules
Test cases
Artifacts
Deploy
Releases
Package registry
Container Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Code review analytics
Issue analytics
Insights
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
OSDU
OSDU Data Platform
System
Indexer
Commits
abcad174
Commit
abcad174
authored
2 years ago
by
Rustam Lotsmanenko (EPAM)
Browse files
Options
Downloads
Patches
Plain Diff
update messaging config docs
parent
6e901e71
No related branches found
Branches containing commit
No related tags found
Tags containing commit
1 merge request
!453
update messaging config docs
Pipeline
#157287
failed
2 years ago
Stage: review
Changes
2
Pipelines
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
provider/indexer-gcp/docs/anthos/README.md
+10
-28
10 additions, 28 deletions
provider/indexer-gcp/docs/anthos/README.md
provider/indexer-gcp/docs/gcp/README.md
+7
-9
7 additions, 9 deletions
provider/indexer-gcp/docs/gcp/README.md
with
17 additions
and
37 deletions
provider/indexer-gcp/docs/anthos/README.md
+
10
−
28
View file @
abcad174
...
...
@@ -188,33 +188,15 @@ curl -L -X PATCH 'https://dev.osdu.club/api/partition/v1/partitions/opendes' -H
#### Exchanges and queues configuration
At
RabbitMq should
be created
exchanges and queues with names:
RabbitMq should
have
exchanges and queues with names
and configs
:
**Exchange name:** `
indexing-progress
`
| EXCHANGE NAME | EXCHANGE CONFIG | Target queue name | Target queue config |
|-------------------|-------------------------------------|----------------------------|----------------------------------------------------------------------|
| indexing-progress | `
Type fanout
` <br/>`
durable: true
` | (Consumer not implemented) | (Consumer not implemented) |
| records-changed | `
Type fanout
` <br/>`
durable: true
` | indexer-records-changed | `
x-delivery-limit: 5
`<br/>`
x-queue-type: quorum
`<br/>`
durable: true
` |
| reprocess | `
Type fanout
` <br/>`
durable: true
` | indexer-reprocess | `
x-delivery-limit: 5
`<br/>`
x-queue-type: quorum
`<br/>`
durable: true
` |
| schema-changed | `
Type fanout
` <br/>`
durable: true
` | indexer-schema-changed | `
x-delivery-limit: 5
`<br/>`
x-queue-type: quorum
`<br/>`
durable: true
` |
**Exchange config**
`
Type fanout
`
`
durable: true
`
**Target queue name** `
indexer-records-changed
`
**Target queue config**
`
x-delivery-limit: 5
`
`
x-queue-type: quorum
`
`
durable: true
`
**Exchange name:** `
reprocess
`
**Exchange config**
`
Type fanout
`
`
durable: true
`
**Target queue name** `
indexer-reprocess
`
**Target queue config**
`
x-delivery-limit: 5
`
`
x-queue-type: quorum
`
`
durable: true
`
## Keycloak configuration
...
...
@@ -257,9 +239,9 @@ You will need to have the following environment variables defined.
**Entitlements configuration for integration accounts**
| INTEGRATION_TESTER | NO_DATA_ACCESS_TESTER |
|
--- | ---
|
| users<br/>users.datalake.ops<br/>service.storage.creator<br/>service.entitlements.user<br/>service.search.user<br/>service.search.admin<br/>data.test1<br/>data.integration.test<br/>users@{tenant1}@{domain}.com |
| INTEGRATION_TESTER
| NO_DATA_ACCESS_TESTER |
|
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------
|
| users<br/>users.datalake.ops<br/>service.storage.creator<br/>service.entitlements.user<br/>service.search.user<br/>service.search.admin<br/>data.test1<br/>data.integration.test<br/>users@{tenant1}@{domain}.com |
|
Execute following command to build code and run all the integration tests:
...
...
This diff is collapsed.
Click to expand it.
provider/indexer-gcp/docs/gcp/README.md
+
7
−
9
View file @
abcad174
...
...
@@ -43,17 +43,15 @@ Usage of spring profiles is preferred.
## Pubsub configuration:
At
Pubsub should
be created
topics and subscribers with names:
Pubsub should
have
topics and subscribers with names
and configs
:
**Topic name:**
`indexing-progress`
| TOPIC NAME | Subscription name | Subscription config |
|-------------------|----------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| indexing-progress | (Consumer not implemented) | (Consumer not implemented) |
| records-changed | indexer-records-changed |
`Maximum delivery attempts: 5`
<br/>
`Retry policy: Retry after exponential backoff delay`
<br/>
`Minimum backoff duration: 10 seconds`
<br/>
`Maximum backoff duration: 600 seconds`
|
| reprocess | indexer-reprocess |
`Maximum delivery attempts: 5`
<br/>
`Retry policy: Retry after exponential backoff delay`
<br/>
`Minimum backoff duration: 10 seconds`
<br/>
`Maximum backoff duration: 600 seconds`
|
| schema-changed | indexer-schema-changed |
`Maximum delivery attempts: 5`
<br/>
`Retry policy: Retry after exponential backoff delay`
<br/>
`Minimum backoff duration: 10 seconds`
<br/>
`Maximum backoff duration: 600 seconds`
|
**Topic name:**
`records-changed`
**Subscriber name**
`indexer-records-changed`
**Topic name:**
`reprocess`
**Subscriber name**
`indexer-reprocess`
### Properties set in Partition service:
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment