I need to transfer data from an Azure SQL database in Tenant A to another Azure SQL database in Tenant B using Azure Data Factory. I want to use Service Principal authentication without relying on ...
Just came across a task and had to do some digging to find the answer:How to export Azure Synapse artifacts, more specifically pipelines, conserving their folder hierarchy, when Git integration is ...
I'm using a PySpark notebook inside of Azure Synapse.This is my schema definitionqcew_schema = StructType([ StructField( 'area_fips', dataType = CharType(5), ...
I want to query a different subscription SQL Pool using SPark can I just use the same syntax or is additional configuration neccesary and if so how to?df = spark.read.option(Constants.SERVER, "&...
Anyone know how to call single notebook with different parameters parallel, and all notebooks should appear on spark UI to make the trouble shooting easier? I have one child notebook, calling from ...
When I try to access tables from a serverless SQL pool from my application I get the error.Msg 13807, Level 16, State 1, Line 1Content of directory on path 'https://xxx.dfs.core.windows.net/xxx/...
I have a delta lake in azure blob storage.I want to read the data using serverless sql pool.My team mate already defined the views and he is able to access them without a problem.When I try to ...
I have a Azure Synapse Notebook and want to read parquest files from google cloud. I created a linked service to the google cloud. This works fine: I can test the connection with success.But how can ...
I need to extract data from a vendor API in Azure Data Factory using Service Principal authentication.In Web activity, I’m not sure what the correct resource value should be for external (non-...
I have SQL query that I'm trying to make work on Azure Synapse where the project is being built. But everything I try doesn't get the correct record count. The tables I have ingested onto Azure ...
I'm working on a Synapse pipeline that pulls data from the Azure Devops OData feed. The base query works fine in both the browser and Synapse, but it seems to ignore the $expand portion of the query ...
I want to extract "email" from JSON using ADF/Synapse.Below is the JSON that I want to flatten and extract all "email" which is in an object in a multidimensional array:{ "...
Given XML with element that has both attribute and value, e.g.<root><elem attr="world">hello</elem></root>how can I parse both the attribute and the value in ...
I am trying to connect Synapse Analytics to an existing CosmosDB container. In official tutorials the code is simple,SELECT TOP 10 *FROM OPENROWSET( 'CosmosDB', 'Account=your-cosmosdb;...
I want to create a Synapse pipeline in which one of the activities is a lightweight, long-running job. Once it succeeds, the flow should proceed to the next activity. However, I don't see any activity ...