You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: samples/oci-load-file-into-adw-python/README.md
+11-7Lines changed: 11 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,4 +1,9 @@
1
1
# Automatically load data from Object Storage into Autonomous Data Warehouse
2
+
3
+
Note: We also have a public LiveLab based on this sample. The LiveLab has more detailed steps and screenshots.
4
+
See [Event-driven Functions with Autonomous Data Warehouse (ADW) hands-on lab | Adao Junior | August 2021](https://apexapps.oracle.com/pls/apex/dbpm/r/livelabs/view-workshop?wid=849).
5
+
6
+
## Introduction
2
7
We often have to extract data from various databases or applications and load it into a Data Warehouse to get analysed.
3
8
You can automate this process on OCI using Cloud Storage, Cloud Events, Functions and Autonomous Data Warehouse.
4
9
@@ -43,7 +48,7 @@ You need two buckets in Object Storage. The first bucket is the location where y
43
48
44
49
45
50
46
-
Create the two buckets, for example "input-bucket" and "processed-bucket". Check the *Emit Object Events* box for the first bucket (for input).
51
+
Create the two buckets: "input-bucket" and "processed-bucket". Check the *Emit Object Events* box for the "input-bucket" bucket.
47
52
48
53
49
54
@@ -58,8 +63,9 @@ Also, create a policy to allow the Object Storage service in the region to manag
58
63
59
64
Your policy should look something like this:
60
65
```
61
-
Allow dynamic-group <dynamic-group-name> to manage objects in compartment <compartment-name> where target.bucket.name=<input-bucket-name>
62
-
Allow dynamic-group <dynamic-group-name> to manage objects in compartment <compartment-name> where target.bucket.name=<processed-bucket-name>
66
+
Allow dynamic-group <dynamic-group-name> to manage objects in compartment <compartment-name> where target.bucket.name='input-bucket'
67
+
68
+
Allow dynamic-group <dynamic-group-name> to manage objects in compartment <compartment-name> where target.bucket.name='processed-bucket'
63
69
64
70
Allow service objectstorage-<region_identifier> to manage object-family in tenancy
65
71
e.g., Allow service objectstorage-ap-sydney-1 to manage object-family in tenancy
@@ -189,10 +195,8 @@ Upload one or all CSV files from the current folder to your *input bucket*. Let'
189
195
On the OCI console, navigate to *Autonomous Data Warehouse* and click on your database, click on *Service Console*, navigate to Development, and click on *SQL Developer Web*. Authenticate with your ADMIN username and password.
190
196
Enter the following query in the *worksheet* of *SQL Developer Web*:
191
197
```sql
192
-
select json_serialize (
193
-
json_data returning varchar2 pretty
194
-
)
195
-
from regionsnumbers;
198
+
select json_serialize (JSON_DOCUMENT) from regionsnumbers;
199
+
196
200
```
197
201
You should see the data from the CSV files. To learn more about JSON in Oracle Database, refer to Chris Saxon's blog [How to Store, Query, and Create JSON Documents in Oracle Database](https://blogs.oracle.com/sql/how-to-store-query-and-create-json-documents-in-oracle-database)
0 commit comments