"Databricks" (Data Connection)
"Databricks" (Data Connection)
Details
- Use DataConnectionObject to represent data located in Databricks in Wolfram Language.
- Import can be used to retrieve data from a DataConnectionObject .
Properties
"ConnectionName" "Databricks"
"Location" SQL query given as a string
"Redownload" whether to rerun the query and overwrite cached results
"Host" the host servicing the database
"Warehouse" the path to the Databricks SQL warehouse
"Port" the server port to access the database
"Schema" database or schema to connect to
"query" SQL query given as a string
Account Setting & Authentication
Automatic attempt to use saved credentials or give a dialog
"Dialog" give authentication parameters via a dialog
assoc provide explicit credentials
"Token" Databricks jdbc token
Examples
open all close allBasic Examples (2)
Create a DataConnectionObject to data from a Databricks query:
DataConnectionObject[<|"ConnectionName" -> "Databricks", "Host" -> "dbc-123456abc-abc1.cloud.databricks.com", "Port" -> 443, "Warehouse" -> "/sql/1.0/warehouses/abc123abc123", "Location" -> "SELECT * FROM table"|>, Authentication -> <|"Token" -> "mytoken"|>]DataConnectionObject[Association["ConnectionName" -> "Databricks",
"Host" -> "dbc-123456abc-abc1.cloud.databricks.com", "Port" -> 443,
"Warehouse" -> "/sql/1.0/warehouses/d96fbbe2acr8d329", "Location" -> "SELECT * FROM table"],
Association["UUID" -> "db9e416a-0032-4d9f-8ab4-44b58477454d"],
Authentication -> Association["Token" -> "mytoken"]]Retrieve the data using Import :
Import@DataConnectionObject[<|"ConnectionName" -> "Databricks", "Host" -> "dbc-123456abc-abc1.cloud.databricks.com", "Port" -> 443, "Warehouse" -> "/sql/1.0/warehouses/abc123abc123", "Location" -> "SELECT * FROM table"|>, Authentication -> <|"Token" -> "mytoken"|>]Authentication (2)
Use an account token as Authentication for a Databricks connection:
DataConnectionObject[<|"ConnectionName" -> "Databricks", "Host" -> "dbc-123456abc-abc1.cloud.databricks.com", "Port" -> 443, "Warehouse" -> "/sql/1.0/warehouses/abc123abc123", "Location" -> "SELECT * FROM table"|>, Authentication -> <|"Token" -> "mytoken"|>]DataConnectionObject[Association["ConnectionName" -> "Databricks",
"Host" -> "dbc-123456abc-abc1.cloud.databricks.com", "Port" -> 443,
"Warehouse" -> "/sql/1.0/warehouses/d96fbbe2acr8d329", "Location" -> "SELECT * FROM table"],
Association["UUID" -> "db9e416a-0032-4d9f-8ab4-44b58477454d"],
Authentication -> Association["Token" -> "mytoken"]]Retrieve the data using Import :
Import@DataConnectionObject[<|"ConnectionName" -> "Databricks", "Host" -> "dbc-123456abc-abc1.cloud.databricks.com", "Port" -> 443, "Warehouse" -> "/sql/1.0/warehouses/abc123abc123", "Location" -> "SELECT * FROM table"|>, Authentication -> <|"Token" -> "mytoken"|>]See Also
Data Connections: Snowflake PostgreSQL SQLite MySQL MicrosoftSQL Oracle