12,040 questions with Azure Data Factory tags

Sort by: Updated
1 answer

Unable to Connect Azure Data Factory to Azure SQL Database Using Managed Identity

Hi, I am experiencing persistent connectivity issues between my Azure Data Factory (ADF) and Azure SQL Database using System-assigned Managed Identity. Despite following the recommended steps. Verified linked service configuration (server, database) …

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-26T20:26:16.8866667+00:00
Yuvaraj M 0 Reputation points
commented 2026-01-28T00:44:19.7633333+00:00
VRISHABHANATH PATIL 4,845 Reputation points Microsoft External Staff Moderator
2 answers

Couldn't launch Azure Data Factory

Hi, I couldn't launch Azure data factory since this morning. It prompted 'loading' for almost 1 hour. Other Azure are working. Anyone know what happened? Regards, Bo X

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-22T21:53:15.22+00:00
Bo Xiao 76 Reputation points
commented 2026-01-27T17:01:39+00:00
VRISHABHANATH PATIL 4,845 Reputation points Microsoft External Staff Moderator
2 answers

How to Load Hierarchical JSON with Nested Arrays into Azure SQL Using Only ADF Copy Activity

Hi all, I’m trying to load hierarchical JSON data into Azure SQL using only Copy Activity in Azure Data Factory (ADF). The JSON structure is like this: Account_Id at the root level data[] array containing ad metrics (ad_id, clicks, impressions, spend,…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-01T12:39:37.48+00:00
YERNAIDU SIRAPARAPU 125 Reputation points
edited the question 2026-01-27T14:04:34.6433333+00:00
Manoj Kumar Boyini 4,630 Reputation points Microsoft External Staff Moderator
1 answer

A blob/storage event triggers a pipeline two times

Hello all, I have this issue where sometimes when a file is inserted in a blob, and picked up by a event trigger, then a pipeline is ran twice instead of once. Has anyone also experienced this and knows why this occurs? Gr, Manish

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-21T10:09:36.63+00:00
Admin Bravinci 0 Reputation points
commented 2026-01-27T11:08:56.35+00:00
Pilladi Padma Sai Manisha 2,650 Reputation points Microsoft External Staff Moderator
2 answers

How to ingest data to Azure using ODBC software(.exe) application

Hi, I am new to Azure, so please bear with me. We have a on prem sql server and we download data from our provider using a ODBC connection i.e. we have a software that we need to install on the server and use SSIS to download the data from the source to…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-26T09:40:58.2066667+00:00
prime prime 0 Reputation points
edited a comment 2026-01-27T07:13:56.3033333+00:00
SAI JAGADEESH KUDIPUDI 0 Reputation points Microsoft External Staff
2 answers

Azure Data Factory Pipeline error 429

Hello there, I am using since a few years now Azure Data Factory to pull out data from MS Graph and lately this year at the start of the year, I keep getting error 429. That means that my automatic requests from ADF pipeline, I keep get most of my…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-20T16:05:41.4933333+00:00
Gherghinel, Cristian 0 Reputation points
commented 2026-01-27T05:41:01.53+00:00
Pilladi Padma Sai Manisha 2,650 Reputation points Microsoft External Staff Moderator
1 answer

DWCopyCommandOperationFailed

Why do I keep getting this error. I think I have checked all permissions, but I can't seem to resolve it. ErrorCode=DWCopyCommandOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message='AzureSqlDW' Copy Command…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-26T14:16:31.2433333+00:00
Dana Brooks 0 Reputation points
commented 2026-01-26T14:27:36.9466667+00:00
Manoj Kumar Boyini 4,630 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

What is the impact of Databricks IP allow/denylists on orchestration using ADF/Synapse

Databricks jobs are often scheduled using Azure Data Factory and/or Synapse. What is the impact of Databricks IP access lists on this orchestration? Can we add service tags to the whitelist to allow ADF? Thanks for elaborating.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,563 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,816 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2022-07-28T09:17:09.643+00:00
wout 21 Reputation points
accepted 2026-01-24T20:25:58.28+00:00
wout 21 Reputation points
2 answers One of the answers was accepted by the question author.

ADF deployment using ARM

Helllo, Can we deploy ADF using ARM templates ? Thanks Himanshu

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-16T06:05:01.6033333+00:00
HimanshuSinha 19,567 Reputation points Microsoft Employee Moderator
accepted 2026-01-23T18:25:58.8833333+00:00
HimanshuSinha 19,567 Reputation points Microsoft Employee Moderator
6 answers One of the answers was accepted by the question author.

Unable to download Purview exports

Hello I have tried to download the export packages from the ediscovery menu. I have tried on mac & linux Edge and firefox browsers. When I push the download button, nothing happens. The close button does work. Is there another way to access these…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2025-03-03T07:21:08.6833333+00:00
Christopher Lowden 220 Reputation points
commented 2026-01-23T16:05:59.9633333+00:00
Jan Adam Breukel 0 Reputation points
2 answers

Cross-tenant Azure SQL Database schema sync and data copy using pipelines from a single tenant

I have the following scenario and would like guidance on feasibility and best practices. Scenario: I have one Azure SQL Database in my tenant. I need to sync with another Azure SQL Database in a client’s tenant. Both databases have the same schema…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-20T09:21:40.2666667+00:00
Faisal Riaz 100 Reputation points
commented 2026-01-23T11:18:58.56+00:00
Pilladi Padma Sai Manisha 2,650 Reputation points Microsoft External Staff Moderator
1 answer

Azure Data factory for Jira via REST API not working

Hi, I'm using Azure data factory to get Jira issue data via REST API. The linked service type is REST, authentication type is Basic. It's a weekly job, the last succussed job was January 15th 2026. In this morning, the job was succussed but it returned…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-21T21:58:42.2066667+00:00
Bo Xiao 76 Reputation points
commented 2026-01-22T21:16:19+00:00
VRISHABHANATH PATIL 4,845 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

How to load excel data from share point online?

Hi there, Is there a way to loading excel data from share point ? In Azure Data Factory, there's no share point file linked service? Thanks&Regards, zmsoft

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-14T02:01:38.4266667+00:00
zmsoft 675 Reputation points
accepted 2026-01-22T05:21:00.2+00:00
zmsoft 675 Reputation points
4 answers

Issue with Oracle Connector Ver. 2.0 in ADF writing to Parquet fles

As recommended I have updated our Oracle connectors in our ADF linked services from ver 1.0 to 2.0 since ver 1.0 will be deprecated by 31st July 2025. Since using ver 2.0 we are getting errors when saving files to parquet format. Below is the error we…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2025-06-06T01:44:17.1966667+00:00
Kelman David 35 Reputation points
commented 2026-01-20T21:25:06.38+00:00
2 answers One of the answers was accepted by the question author.

How to move data from Sharepoint to Azure Blob storage

Hello, I am looking to create a pipeline that will transfer files of many different types from Sharepoint to Azure blob storage. I am currently planning on using ADF, but am open to other resources if easier to use. The transfer needs to just be a copy…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-19T21:19:12.87+00:00
Siddhant Kumta 200 Reputation points
accepted 2026-01-20T16:13:10.99+00:00
Siddhant Kumta 200 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Private DNS: cannot add VNet link to Databricks managed VNet due to system deny. what is the supported path?

Details Goal: Databricks clusters must resolve `

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-14T22:28:35+00:00
Melky Dinsay 40 Reputation points
accepted 2026-01-20T16:05:28.1633333+00:00
Melky Dinsay 40 Reputation points
3 answers

Azure Data Factory Pipeline Failure

We are copying data from a table in Azure SQL to Snowflake DB. The table schema is exactly the same on the source and target, and it has 216 columns. We are using Azure Data Factory to do the copy. There are couple of ways we tried to do it, but both…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-15T16:13:51.84+00:00
Aaron Wong 40 Reputation points
edited a comment 2026-01-20T12:31:05.29+00:00
Smaran Thoomu 32,865 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Shopify Connector with OAuth Client Credentials - Unauthorized Error

Hi There, Hope life is good Current situation: My Shopify integration works perfectly using WebActivity with OAuth client credentials flow (client_id + client_secret) I successfully obtain an access token via POST to /admin/oauth/access_token …

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-16T09:29:26.51+00:00
Geoffrey SOUQUIÈRE 71 Reputation points
accepted 2026-01-19T10:33:33.7433333+00:00
Geoffrey SOUQUIÈRE 71 Reputation points
2 answers

connect a proxy using Azure Data Factory (ADF) to Snowflake

We have a client requirement that all services must be hosted in the North Europe region, and the client allows only 8 outbound IP addresses to be whitelisted. We are trying to connect Azure Data Factory (ADF) to Snowflake using the Microsoft-hosted…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-12T14:09:35.99+00:00
Shubham Sanap 40 Reputation points
edited an answer 2026-01-16T16:50:23.34+00:00
Manoj Kumar Boyini 4,630 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

How to fix the " ErrorCode=JreNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Java Runtime Environment cannot be found on the Self-hosted Integration Runtime machine. It is required for parsing or writing to Parquet/ORC

Issue with Pipeline SQL _ADLS_PARQUET While validating their is no error shown but debugging time Error: ErrorCode=JreNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Java Runtime Environment cannot be found on the…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
12,040 questions
asked 2026-01-14T05:39:42.05+00:00
soorya 20 Reputation points
commented 2026-01-16T06:34:34.9566667+00:00
Smaran Thoomu 32,865 Reputation points Microsoft External Staff Moderator