Power Shell script to load data in to Data Lake Store

In an earlier post, we talked about self-service process to hydrate the Data Lake Store. We also mentioned the need to use Power Shell to load data files larger than 2Gb. Here is the Power Shell script: Provide your credentials to login to Azure: $MyAzureName = "<YourAzureUsername>"; $MyAzurePassword = ConvertTo-SecureString '<YourAzurePassword>' -AsPlainText -Force; $AzureRMCredential = New-Object System.Management.Automation.PSCredential($MyAzureName, … Continue reading Power Shell script to load data in to Data Lake Store

How to Publish Azure Data Factory Artifacts

Azure Data Factory artifacts can be edited and deployed using the Azure portal. However, as an enterprise solution, one would want the capability to edit and publish these artifacts using Visual Studio. Let’s check are options available to publish using Visual Studio. Assuming you have the created a Data Factory project in Visual Studio and … Continue reading How to Publish Azure Data Factory Artifacts