Adding Weather Forecast in Power BI using Azure Map

Azure Maps is a Microsoft technology that has a lot of cool features. Somewhat unexpectedly I discovered that along with purely mapping stuff it also provides functionality to acquire weather forecast data using REST API as outlined here. The detailed process is detailed in the video below, but I will highlight the key steps in … Continue reading Adding Weather Forecast in Power BI using Azure Map

How to Deploy Azure Data Factory (ADF) from Dev to QA using Devops

Just wanted to do a quick video to cover the process of deploying ADF artifacts from Development environment to higher environments like QA, etc. these are the basic steps to get it done (please watch the video for detailed instructions) https://youtu.be/7fsIwWheyDk Create a new project in Devops if there is no project set up alreadyMake … Continue reading How to Deploy Azure Data Factory (ADF) from Dev to QA using Devops

How to make Azure Databricks work with Azure Data Lake Storage Gen2 and Power BI

  This post is a beginning to a series of articles about building analytical capabilities in Azure using data lake, Databricks and Power BI. On the surface, those technologies seem like they were specifically designed to complement each other as they provide a set of foundational capabilities necessary to develop scalable and cost-effective business intelligence … Continue reading How to make Azure Databricks work with Azure Data Lake Storage Gen2 and Power BI

Optimizing Azure Analysis Services Partitions for Azure Data Warehouse External Tables

Recently, I had a chance to work with Azure Analysis Services (AS) sourcing data from Azure Data Warehouse (DW) external tables. Optimizing the processing of the Azure Analysis Services partitions to use with the Azure DW external tables is a bit different from working with the regular (physical) data tables, and I will discuss the … Continue reading Optimizing Azure Analysis Services Partitions for Azure Data Warehouse External Tables

Quirks of Visual Studio Query Editor working with Analysis Services

Visual Studio 2017 and the SQL Server Data Tool (SSDT), a tool that comes with Visual Studio, finally integrates the now familiar Query Editor (Power Query) capability to work with the Analysis Services Tabular Model. Query Editor is a data ingestion and transformation tool used by Excel Power Pivot as well as Power BI. Now, … Continue reading Quirks of Visual Studio Query Editor working with Analysis Services

Power Shell script to load data in to Data Lake Store

In an earlier post, we talked about self-service process to hydrate the Data Lake Store. We also mentioned the need to use Power Shell to load data files larger than 2Gb. Here is the Power Shell script: Provide your credentials to login to Azure: $MyAzureName = "<YourAzureUsername>"; $MyAzurePassword = ConvertTo-SecureString '<YourAzurePassword>' -AsPlainText -Force; $AzureRMCredential = New-Object System.Management.Automation.PSCredential($MyAzureName, … Continue reading Power Shell script to load data in to Data Lake Store

How to Publish Azure Data Factory Artifacts

Azure Data Factory artifacts can be edited and deployed using the Azure portal. However, as an enterprise solution, one would want the capability to edit and publish these artifacts using Visual Studio. Let’s check are options available to publish using Visual Studio. Assuming you have the created a Data Factory project in Visual Studio and … Continue reading How to Publish Azure Data Factory Artifacts