Unable to Connect Azure Data Factory to Azure SQL Database Using Managed Identity
Hi, I am experiencing persistent connectivity issues between my Azure Data Factory (ADF) and Azure SQL Database using System-assigned Managed Identity. Despite following the recommended steps. Verified linked service configuration (server, database) …
Azure Data Factory
Couldn't launch Azure Data Factory
Hi, I couldn't launch Azure data factory since this morning. It prompted 'loading' for almost 1 hour. Other Azure are working. Anyone know what happened? Regards, Bo X
Azure Data Factory
How to Load Hierarchical JSON with Nested Arrays into Azure SQL Using Only ADF Copy Activity
Hi all, I’m trying to load hierarchical JSON data into Azure SQL using only Copy Activity in Azure Data Factory (ADF). The JSON structure is like this: Account_Id at the root level data[] array containing ad metrics (ad_id, clicks, impressions, spend,…
Azure Data Factory
A blob/storage event triggers a pipeline two times
Hello all, I have this issue where sometimes when a file is inserted in a blob, and picked up by a event trigger, then a pipeline is ran twice instead of once. Has anyone also experienced this and knows why this occurs? Gr, Manish
Azure Data Factory
How to ingest data to Azure using ODBC software(.exe) application
Hi, I am new to Azure, so please bear with me. We have a on prem sql server and we download data from our provider using a ODBC connection i.e. we have a software that we need to install on the server and use SSIS to download the data from the source to…
Azure Data Factory
Azure Data Factory Pipeline error 429
Hello there, I am using since a few years now Azure Data Factory to pull out data from MS Graph and lately this year at the start of the year, I keep getting error 429. That means that my automatic requests from ADF pipeline, I keep get most of my…
Azure Data Factory
DWCopyCommandOperationFailed
Why do I keep getting this error. I think I have checked all permissions, but I can't seem to resolve it. ErrorCode=DWCopyCommandOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message='AzureSqlDW' Copy Command…
Azure Data Factory
What is the impact of Databricks IP allow/denylists on orchestration using ADF/Synapse
Databricks jobs are often scheduled using Azure Data Factory and/or Synapse. What is the impact of Databricks IP access lists on this orchestration? Can we add service tags to the whitelist to allow ADF? Thanks for elaborating.
Azure Synapse Analytics
Azure Databricks
Azure Data Factory
ADF deployment using ARM
Helllo, Can we deploy ADF using ARM templates ? Thanks Himanshu
Azure Data Factory
Unable to download Purview exports
Hello I have tried to download the export packages from the ediscovery menu. I have tried on mac & linux Edge and firefox browsers. When I push the download button, nothing happens. The close button does work. Is there another way to access these…
Azure Data Factory
Cross-tenant Azure SQL Database schema sync and data copy using pipelines from a single tenant
I have the following scenario and would like guidance on feasibility and best practices. Scenario: I have one Azure SQL Database in my tenant. I need to sync with another Azure SQL Database in a client’s tenant. Both databases have the same schema…
Azure Data Factory
Azure Data factory for Jira via REST API not working
Hi, I'm using Azure data factory to get Jira issue data via REST API. The linked service type is REST, authentication type is Basic. It's a weekly job, the last succussed job was January 15th 2026. In this morning, the job was succussed but it returned…
Azure Data Factory
How to load excel data from share point online?
Hi there, Is there a way to loading excel data from share point ? In Azure Data Factory, there's no share point file linked service? Thanks&Regards, zmsoft
Azure Data Factory
Issue with Oracle Connector Ver. 2.0 in ADF writing to Parquet fles
As recommended I have updated our Oracle connectors in our ADF linked services from ver 1.0 to 2.0 since ver 1.0 will be deprecated by 31st July 2025. Since using ver 2.0 we are getting errors when saving files to parquet format. Below is the error we…
Azure Data Factory
How to move data from Sharepoint to Azure Blob storage
Hello, I am looking to create a pipeline that will transfer files of many different types from Sharepoint to Azure blob storage. I am currently planning on using ADF, but am open to other resources if easier to use. The transfer needs to just be a copy…
Azure Data Factory
Azure Private DNS: cannot add VNet link to Databricks managed VNet due to system deny. what is the supported path?
Details Goal: Databricks clusters must resolve `
Azure Data Factory
Azure Data Factory Pipeline Failure
We are copying data from a table in Azure SQL to Snowflake DB. The table schema is exactly the same on the source and target, and it has 216 columns. We are using Azure Data Factory to do the copy. There are couple of ways we tried to do it, but both…
Azure Data Factory
Shopify Connector with OAuth Client Credentials - Unauthorized Error
Hi There, Hope life is good Current situation: My Shopify integration works perfectly using WebActivity with OAuth client credentials flow (client_id + client_secret) I successfully obtain an access token via POST to /admin/oauth/access_token …
Azure Data Factory
connect a proxy using Azure Data Factory (ADF) to Snowflake
We have a client requirement that all services must be hosted in the North Europe region, and the client allows only 8 outbound IP addresses to be whitelisted. We are trying to connect Azure Data Factory (ADF) to Snowflake using the Microsoft-hosted…
Azure Data Factory
How to fix the " ErrorCode=JreNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Java Runtime Environment cannot be found on the Self-hosted Integration Runtime machine. It is required for parsing or writing to Parquet/ORC
Issue with Pipeline SQL _ADLS_PARQUET While validating their is no error shown but debugging time Error: ErrorCode=JreNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Java Runtime Environment cannot be found on the…