Data Ingestion issueshttps://community.opengroup.org/groups/osdu/platform/data-flow/ingestion/-/issues2020-11-18T00:46:17Zhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/issues/41Support for Workflow Roles - Currently Leveraging Storage Roles2020-11-18T00:46:17ZMatt WiseSupport for Workflow Roles - Currently Leveraging Storage Roles## Status
- [X] Proposed
- [x] Trialing
- [x] Under review
- [x] Approved
- [ ] Retired
## Context & Scope
The ingestion-workflow service currently is using common model StorageRole for authorization.
In code the following is observed:
...## Status
- [X] Proposed
- [x] Trialing
- [x] Under review
- [x] Approved
- [ ] Retired
## Context & Scope
The ingestion-workflow service currently is using common model StorageRole for authorization.
In code the following is observed:
```java
import org.opengroup.osdu.core.common.model.storage.StorageRole;
...
@PreAuthorize("@authorizationFilter.hasPermission('" + StorageRole.CREATOR + "')")
public GetStatusResponse getWorkflowStatus(@RequestBody GetStatusRequest request) {...}
@PreAuthorize("@authorizationFilter.hasPermission('" + StorageRole.CREATOR + "')")
public UpdateStatusResponse updateWorkflowStatus(@RequestBody UpdateStatusRequest request) {...}
```
Note that StorageRole.* is used for auth.
## Decision
A new Role model should be created called WorkflowRole and used to assign privelages.
Sample Code
```java
public final class WorkflowRole {
public static final String VIEWER = "service.workflow.viewer";
public static final String CREATOR = "service.workflow.creator";
public static final String ADMIN = "service.workflow.admin";
}
```
## Rationale
Each individual core service should have separate Roles to allow granularity for users to give entitlements
## Consequences
Need to change Core Common and Entitlements Service? Need Groups Support?JoeDmitriy RudkoArtem Nazarenko (EPAM)Joe2020-08-21https://community.opengroup.org/osdu/platform/data-flow/ingestion/opc-ua-ingestion/-/issues/8Explore/Research on apache parquet data format storage mechanism2022-10-31T10:26:11ZAshutosh KumarExplore/Research on apache parquet data format storage mechanismWe need to explore on the apache parquest data format so that we can convert the data retrieved from OPC UA server in to parquet format.We need to explore on the apache parquest data format so that we can convert the data retrieved from OPC UA server in to parquet format.Ashutosh KumarAshutosh Kumarhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/opc-ua-ingestion/-/issues/7Collect values of Evergyvue server for a minute to process the data2022-10-31T10:26:43ZAshutosh KumarCollect values of Evergyvue server for a minute to process the data1: Connect with Energyvue server using milo sdk
2: Fetch node and respective values
3: Get these values for one min and view the data to process further.1: Connect with Energyvue server using milo sdk
2: Fetch node and respective values
3: Get these values for one min and view the data to process further.Ashutosh KumarAshutosh Kumarhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/opc-ua-ingestion/-/issues/6Connect with OPC UA server and read node values using eclipse milo2022-10-31T10:27:23ZAshutosh KumarConnect with OPC UA server and read node values using eclipse miloConnect EnergyVue server using milo sdk and try to read node valuesConnect EnergyVue server using milo sdk and try to read node valuesAshutosh KumarAshutosh Kumarhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/opc-ua-ingestion/-/issues/5Connect Everyvue server using OPC UA client (UAExpert and OPC UA browser)2022-07-06T03:57:37ZAshutosh KumarConnect Everyvue server using OPC UA client (UAExpert and OPC UA browser)Connect and see the files/folders structure of Energyvue server after connecting using:
1: OPC UAExpert
2: Prosys OPC UA browserConnect and see the files/folders structure of Energyvue server after connecting using:
1: OPC UAExpert
2: Prosys OPC UA browserAshutosh KumarAshutosh Kumarhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/opc-ua-ingestion/-/issues/4Write sample code to connect to Energyvue server using eclipse milo2022-10-31T10:27:40ZAshutosh KumarWrite sample code to connect to Energyvue server using eclipse miloWrite sample code to connect to energyvue server using eclipse milo
The OPC server endpoint is
opc.tcp://demo.energyvue.com:62546/EnergyVue/OpcServer
Preferred security is shown below and should be automatically adopted by the server ...Write sample code to connect to energyvue server using eclipse milo
The OPC server endpoint is
opc.tcp://demo.energyvue.com:62546/EnergyVue/OpcServer
Preferred security is shown below and should be automatically adopted by the server if you support it.
Mode: Sign & Encrypt
Policy: Aes256Sha256RsaPssAshutosh KumarAshutosh Kumarhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/opc-ua-ingestion/-/issues/3Write/Explore Sample code to connect to Eclipse milo server using eclipse mil...2022-07-06T03:59:29ZAshutosh KumarWrite/Explore Sample code to connect to Eclipse milo server using eclipse milo sdkDownload eclipse milo sdk code and try to write and execute program to connect to Eclipse milo server
opc.tcp://milo.digitalpetri.com:62541/milo
Also try to connect Using:
1: Unified automation UAExpert
2: Using Eclipse milo sdk.Download eclipse milo sdk code and try to write and execute program to connect to Eclipse milo server
opc.tcp://milo.digitalpetri.com:62541/milo
Also try to connect Using:
1: Unified automation UAExpert
2: Using Eclipse milo sdk.Ashutosh KumarAshutosh Kumarhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/opc-ua-ingestion/-/issues/2Explore the OPC UA client and server2022-07-06T03:59:50ZAshutosh KumarExplore the OPC UA client and server1: Explore OPC UA Client and server architecture.
2: Check the communication methods between them.1: Explore OPC UA Client and server architecture.
2: Check the communication methods between them.M14 - Release 0.17Ashutosh KumarAshutosh Kumarhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/opc-ua-ingestion/-/issues/1Exploring OPC-UA open source SDK2022-07-06T04:00:23ZChad LeongExploring OPC-UA open source SDKEvaluating different OPC-UA open-source client SDK options
1. Eclipse Milo
2. OPC UA client SDKEvaluating different OPC-UA open-source client SDK options
1. Eclipse Milo
2. OPC UA client SDKAshutosh KumarAshutosh Kumar