210 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
1
vote
1
answer
68
views
copy incremetal data from shopify using copy activity in azure synapse using version 2.0 linked service
currently we are fetching data from shopify using copy activity with version 1.0 shopify linked service. version 1.0 is going to get deprecated by the 3rd week of Oct 2025. version 1.0 supports query ...
0
votes
0
answers
27
views
azure synapse Processing time
When my Azure pipelines are triggered automatically, my processing time takes 1 hour... when I run it manually, it takes 30 minutes... why this difference could be happening... even if my pipelines do ...
0
votes
0
answers
101
views
Call MS Fabric REST API from Synapse notebook
I am trying to call MS Fabric Semantic model refresh API from Synapse notebook.
https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/refresh-dataset-in-group#example-of-refreshing-a-dataset
...
0
votes
0
answers
45
views
How connect and process on-prem HDFS data from Azure Synapse
I want to write data from an Azure Synapse notebook to an on-prem HDFS file system. While Azure Synapse provides Copy Activity for reading data, there doesn't seem to be a direct way to write data ...
0
votes
1
answer
98
views
Can I run stored procedures from Azure Data Factory which are hosted on an on-premise SQL Database (via a Citrix Datacentre)
We have some production stored procedures which need executing in the middle of the day using our on-prem servers, is it possible for these to be trigger via an Azure Data Factory Pipeline on our ...
0
votes
2
answers
161
views
WSO2 ESB: Using iterate and aggregate mediators without sending the split messages to an endpoint
In my scenario, there are no backend calls. I need to update some details of records in a database by looping through each record and sending a single aggregated email notification to the user with ...
0
votes
1
answer
117
views
Unable to import custom package in Azure Synapse notebook after successful installation
Problem Description
I am trying to import a custom Python package named check_excel_errors in an Azure Synapse notebook. The package was installed successfully using pip, but when I try to import it, ...
0
votes
1
answer
223
views
Get Max date value from append variable array - azure synapse pipeline
In my Synapse pipeline, I am looping through a set of filenames. Inside the loop, I use a "Get Metadata" activity to retrieve the last modified date of each file and append these dates to an ...
0
votes
1
answer
201
views
REST API call from synapse notebook to any other services outside azure not working ( power bi , Google)
REST API call from synapse notebook to any other services outside azure not working ( power bi , Google)
ex:
test_url = "https://www.google.com"
response = requests.get(test_url)
print("...
0
votes
1
answer
50
views
Create column of current balance in PySpark
I have the below dataframe created in PySpark code:
+---------------+-------------+---------------+------+
|TransactionDate|AccountNumber|TransactionType|Amount|
+---------------+-------------+--------...
2
votes
1
answer
182
views
How to get username of API caller in wso2 apim in Basic Authorization?
As you know we have 3 types of Authorization in WSO2 API management API Call: Basic, ApiKey, OAuth
I need to extract username of API caller. I used this way as you can see in this link: https://...
1
vote
1
answer
142
views
JsonNull UnsupportedOperationException on null value using WSO2 JsonTransform Mediator
I'm using a JsonTransform Mediator in my sequence to make sure a phone number field in my database query is returned as a string instead of as a number.
<jsontransform description="JSON ...
0
votes
2
answers
293
views
How to access API Version in WSo2 MI backend
I am trying to access the API version set in the API Manager frontend, defined via an openAPI v3.0.3 spec, in the Micro Integrator backend - I can see this is defined in the API Overview page. However ...
1
vote
1
answer
232
views
WSO2 IntegrationStudio 8.2.0 Endpoint requiring SSL
I've an endpoint which can be reached only through SSL validation. E.g. to reach it by Google Chrome, I've installed xxxx.p12 certificate. On other implementations, such as python, I can reach the ...
-1
votes
2
answers
154
views
Joining two tables with different sizes takes hours to execute
Here is the scenario:
we are using Azure Synapse analytics with 100 DTU, we have several tables.
All tables are round robin distributed and clustered columnstore because data is loaded once in a day ...