Fast Copy provides the ability to ingest data at scale. In this video I try to answer: Is Fast Copy the only way to ingest data at scale ? Is there an advantage of using Fast Copy over Copy Activity ? How to configure Fast Copy ? And more... https://www.youtube.com/watch?v=FD9QKeDX6zo
Category: Dataflow
Data Wrangler – Visual Editor for Notebooks
Are you new to writing PySpark code in Notebooks, do you need a code snippet to get you jump started or you are some one who likes a visual editor ? If yes, Data Wrangler is the tool you are looking for. Check out the video for more details. https://youtu.be/xxh_4ZIIf9M
Data Orchestration in Microsoft Fabric
In this week's video I answer the following questions: - Can I run Dataflow Gen2 using Pipeliine ? - Do all the artifacts have to exist in the same workspace as the Pipeline ? - Can I have nested Pipelines ? - Is Data Pipeline only way to orchestrate data in Fabric ? Hint:: runMultiple() … Continue reading Data Orchestration in Microsoft Fabric
Data Ingestion with Lakehouse & Data Flow Gen2
Dive into what we learned the hard way with Microsoft Fabric, launched in November 2023. This isn't just any guide; it's our real talk on the ups and downs of using Lakehouse and Data Flow Gen2. We've been through the wringer, figuring out the best ways to get data in and make the most of … Continue reading Data Ingestion with Lakehouse & Data Flow Gen2
Is Snowflake One Bad Quarter Away from Being Microsoft Power BI Biggest Threat?
I suspect that many of you have looked at the title of this video and immediately thought that I was just being silly and provocative. And, generally speaking, you would be right as I do enjoy a fair amount of silly and provocation every now and then. However, in this case, even though I do … Continue reading Is Snowflake One Bad Quarter Away from Being Microsoft Power BI Biggest Threat?
How to Make a Copy of a Power BI DataFlow
Turns out that making a copy of a Power BI Dataflow is not that intuitive. If you don't want to watch this 3 minute video, then you can just click on the menu options for the dataflow and then click on "Export .json" option. This will export the dataflow in a json file format. Now … Continue reading How to Make a Copy of a Power BI DataFlow
business intelligist 