Microsoft Fabric provides various options for data ingestion, each with its own strengths and use cases. Understanding which option to use and when can significantly impact your data workflow efficiency. In this video, we'll explore the different data ingestion methods offered by Microsoft Fabric—Dataflow (with and without Fast Copy), Data Pipeline, and Notebooks—and discuss their … Continue reading Choosing the Right Data Ingestion Method with Microsoft Fabric
Author: nikilprabhakar
Exploring Copilot’s Role in Dataflow: A Dive into its Functionality
In the realm of Power BI Dataflow, we're accustomed to the richness of functionality and the ease with which these functionalities can transform data. But what about Copilot? Can it help us navigate complex operations such as append, merge, pivot, unpivot, and group by? While we may not need assistance with basic operations like filtering … Continue reading Exploring Copilot’s Role in Dataflow: A Dive into its Functionality
What is FAST COPY ? Explained…
Fast Copy provides the ability to ingest data at scale. In this video I try to answer: Is Fast Copy the only way to ingest data at scale ? Is there an advantage of using Fast Copy over Copy Activity ? How to configure Fast Copy ? And more... https://www.youtube.com/watch?v=FD9QKeDX6zo
Data Mirroring – Real-Time data replication
We have all heard of Real-Time solutions before. But each of them come with challenges. Either configuration is complicated or involves coding/ETL or the cost is exorbitant. Data Mirroring in Microsoft Fabric is none of the above. It is easy to configure, involves no ETL and the cost is minimal. This feature is in public … Continue reading Data Mirroring – Real-Time data replication
Copilot in Action – Does it replace web search ?
In the last few months, I have been using with Copilot to help with writing code in Notebooks. And here are some of my findings: Copilot is good with basic code Result is not consistent. I got different answers to the same question... some times a better answer and sometimes not Since it is part … Continue reading Copilot in Action – Does it replace web search ?
Data Wrangler – Visual Editor for Notebooks
Are you new to writing PySpark code in Notebooks, do you need a code snippet to get you jump started or you are some one who likes a visual editor ? If yes, Data Wrangler is the tool you are looking for. Check out the video for more details. https://youtu.be/xxh_4ZIIf9M
Is Data Activator ready for Prime Time ?
I have been working with Data Activator for a few months now. I have seen it evolve (and it is evolving fast), but is it ready for Prime Time ? Check out this video where I share my thoughts: Walk through the functionality. Talk about the pros and cons. Features I would like to see … Continue reading Is Data Activator ready for Prime Time ?
Data Orchestration in Microsoft Fabric
In this week's video I answer the following questions: - Can I run Dataflow Gen2 using Pipeliine ? - Do all the artifacts have to exist in the same workspace as the Pipeline ? - Can I have nested Pipelines ? - Is Data Pipeline only way to orchestrate data in Fabric ? Hint:: runMultiple() … Continue reading Data Orchestration in Microsoft Fabric
Notebooks in Microsoft Fabric
Want to learn the ins and outs of using Notebook in Microsoft Fabric... you are in the right place. Check out the video where I talk about: Using Notebook across Lakehouses and Workspaces Configuring an environment In-line libraries Virtual tables And more... https://youtu.be/aaiiUyaj46k
Data Ingestion with Lakehouse & Data Flow Gen2
Dive into what we learned the hard way with Microsoft Fabric, launched in November 2023. This isn't just any guide; it's our real talk on the ups and downs of using Lakehouse and Data Flow Gen2. We've been through the wringer, figuring out the best ways to get data in and make the most of … Continue reading Data Ingestion with Lakehouse & Data Flow Gen2
business intelligist 