Skip to main content

Azure Synapse SQL Pool – Implement Polybase

 

Azure Synapse SQL Pool – Implement Polybase

Duration: 2 hours

Intermediate
No download needed

Split-screen video
English
Desktop only

What You’ll Learn:

  • Create Azure SQL Pool
  • Create Azure Data Lake Storage Gen2
  • Configure and Implement Polybase
  • Showcase this hands-on experience in an interview

Enroll Now

Also Read: IIT Kharagpur Free Courses on Introduction to Machine Learning

In this 1-hour long project-based course, you will learn how to implement Polybase in Azure Synapse SQL Pool. In this project, we are going to see how to implement Polybase in Azure Synapse SQL Pool. Polybase in simple words is, a feature provided by Azure SQL Pool through which you can access the data stored in Azure Data Lake Storage/Blob/HDFS using a SQL interface to access the files stored in above mentioned storage systems. Basically, you can execute SQL queries on the files containing the data. To implement Polybase the source that we are considering is a text file stored in Azure Data Lake Storage - Gen2. Pre requisites: 1. Azure subscription account 2. Basic understanding of Azure SQL Pool and Synapse Analytics 3. Basic understanding of T-SQL queries Here is a brief description of the tasks we are going to perform in this project: Task1: Create Azure Data Lake Storage - Gn2 In this task we are going to create the ADLS account which is going to have the source file (Customer.txt) which we would be eventually reading via SQL queries. Task2: Create Source File and upload it on ADLS container In this task, we are going to create a sample comma delimited text file and also see how to upload it on the container created in the ADLS account. Task1 & Task2 is to prepare our source. Task3: Create Azure SQL Pool In this task, we are going to create Azure SQL Pool and Azure Synapse Workspace. Polybase is a feature supported by Azure SQL Pool hence we need to create this service along with Synapse Workspace account. Task4: Configure Polybase So far in all above tasks we have created all the resources needed to configure and implement Polybase. Hence, in this task we are going to see how to configure Polybase. Task5: Polybase in action In this task, we are going to see polybase in action. We are going to see how to execute SQL queries on the Customer.txt file stored in ADLS account and retrieve the data.

Requirements

Data Engineer, BI Engineer

SKILLS YOU WILL DEVELOP

Azure Data Lake Storage Gen2Azure SQL PoolAzure Synapse Workspace

Learn step-by-step

In a video that plays in a split-screen with your work area, your instructor will walk you through these steps:

  1. Create Azure Data Lake Gen2

  2. Create Sample file and upload it on Azure Data Lake account

  3. Create Azure SQL Pool & Azure Synapse Workspace

  4. Configure Polybase

  5. Implement Polybase


Labels:

Comments

Post a Comment

Popular posts from this blog

English for Personal and Professional Development

  English for Personal and Professional Development DETAILS English for Personal and Professional Development Language English Certification Yes Duration 21 Hours The course is designed to give you the tools you need to improve your communication skills and the best strategies for using them to your advantage. ENROLL FOR FREE! COURSE DESCRIPTION Do you struggle when you communicate in English? Do you feel short of words and confidence when it comes to public speaking? Do you struggle with words and expressions when you draft a letter and an email? If you answer yes to any of the above, you can rely on this course. The course is designed to give you both the tools you need to improve your communication skills, and the most successful strategies for using them to your advantage. It is a combination of communication skills, grammar and soft skills which gives it an edge over other courses. The icing on the cake is the bilingual method through which concepts have been elaborated. The cours
Post a Comment
Read more

IIT Kharagpur Free Courses on Introduction to Machine Learning

  Hello Learner, this post is to inform you about that IIT Kharagpur (Indian Institute of Technology, Kharagpur) Offers Premium Online Course For Free. IIT Madras launching a fresh course “ Introduction to Machine Learning ” Enrollments are now  open  for this course.  Course Description This course provides a concise introduction to the fundamental concepts in machine learning and popular machine learning algorithms. We will cover the standard and most popular supervised learning algorithms including linear regression, logistic regression, decision trees, k-nearest neighbour, an introduction to Bayesian learning and the naïve Bayes algorithm, support vector machines and kernels and neural networks with an introduction to Deep Learning. We will also cover the basic clustering algorithms. Feature reduction methods will also be discussed. We will introduce the basics of computational learning theory. In the course we will discuss various issues related to the application of machine learn
Post a Comment
Read more