國立虎尾科技大學 |

The Definitive Guide to Azure Data Engineering = Modern ELT, DevOps, and Analytics on the Azure Cloud Platform /

紀錄類型:	書目-語言資料,印刷品 : Monograph/item
正題名/作者:	The Definitive Guide to Azure Data Engineering/ by Ron C. L'Esteve.
其他題名:	Modern ELT, DevOps, and Analytics on the Azure Cloud Platform /
作者:	L'Esteve, Ron C.
面頁冊數:	XXIII, 612 p. 606 illus.online resource. :
Contained By:	Springer Nature eBook
標題:	Big Data. -
電子資源:	https://doi.org/10.1007/978-1-4842-7182-7
ISBN:	9781484271827

The Definitive Guide to Azure Data Engineering = Modern ELT, DevOps, and Analytics on the Azure Cloud Platform /
L'Esteve, Ron C.

The Definitive Guide to Azure Data EngineeringModern ELT, DevOps, and Analytics on the Azure Cloud Platform /[electronic resource] :by Ron C. L'Esteve. - 1st ed. 2021. - XXIII, 612 p. 606 illus.online resource.

Introduction -- Part I. Getting Started -- 1. The Tools and Pre-Requisites -- 2. Data Factory vs SSIS vs Databricks -- 3. Design a Data Lake Storage Gen2 Account -- Part II. Azure Data Factory for ELT -- 4. Dynamically Load SQL Database to Data Lake Storage Gen 2 -- 5. Use COPY INTO to Load Synapse Analytics Dedicated SQL Pool -- 6. Load Data Lake Storage Gen2 Files into Synapse Analytics Dedicated SQL Pool -- 7. Create and Load Synapse Analytics Dedicated SQL Pool Tables Dynamically -- 8. Build Custom Logs in SQL Database for Pipeline Activity Metrics -- 9. Capture Pipeline Error Logs in SQL Database.-10. Dynamically Load Snowflake Data Warehouse.-11. Mapping Data Flows for Data Warehouse ETL -- 12. Aggregate and Transform Big Data Using Mapping Data Flows -- 13. Incrementally Upsert Data.-14. Loading Excel Sheets into Azure SQL Database Tables.-15. Delta Lake -- Part III. Real-Time Analytics in Azure -- 16. Stream Analytics Anomaly Detection -- 17. Real-time IoT Analytics Using Apache Spark -- 18. Azure Synapse Link for Cosmos DB -- Part IV. DevOps for Continuous Integration and Deployment -- 19. Deploy Data Factory Changes -- 20. Deploy SQL Database -- Part V. Advanced Analytics -- 21. Graph Analytics Using Apache Spark’s GraphFrame API -- 22. Synapse Analytics Workspaces -- 23. Machine Learning in Databricks -- Part VI. Data Governance -- 24. Purview for Data Governance.

Build efficient and scalable batch and real-time data ingestion pipelines, DevOps continuous integration and deployment pipelines, and advanced analytics solutions on the Azure Data Platform. This book teaches you to design and implement robust data engineering solutions using Data Factory, Databricks, Synapse Analytics, Snowflake, Azure SQL database, Stream Analytics, Cosmos database, and Data Lake Storage Gen2. You will learn how to engineer your use of these Azure Data Platform components for optimal performance and scalability. You will also learn to design self-service capabilities to maintain and drive the pipelines and your workloads. The approach in this book is to guide you through a hands-on, scenario-based learning process that will empower you to promote digital innovation best practices while you work through your organization’s projects, challenges, and needs. The clear examples enable you to use this book as a reference and guide for building data engineering solutions in Azure. After reading this book, you will have a far stronger skill set and confidence level in getting hands on with the Azure Data Platform. You will learn to: Build dynamic, parameterized ELT data ingestion orchestration pipelines in Azure Data Factory Create data ingestion pipelines that integrate control tables for self-service ELT Implement a reusable logging framework that can be applied to multiple pipelines Integrate Azure Data Factory pipelines with a variety of Azure data sources and tools Transform data with Mapping Data Flows in Azure Data Factory Apply Azure DevOps continuous integration and deployment practices to your Azure Data Factory pipelines and development SQL databases Design and implement real-time streaming and advanced analytics solutions using Databricks, Stream Analytics, and Synapse Analytics Get started with a variety of Azure data services through hands-on examples.

ISBN: 9781484271827

Standard No.: 10.1007/978-1-4842-7182-7doiSubjects--Topical Terms:

1017136
Big Data.

LC Class. No.: QA76.76.M52

Dewey Class. No.: 004.165

The Definitive Guide to Azure Data Engineering = Modern ELT, DevOps, and Analytics on the Azure Cloud Platform /
LDR:04664nam a22003855i 4500 001 1052658
003 DE-He213
005 20210806103820.0
007 cr nn 008mamaa
008 220103s2021 xxu| s |||| 0|eng d
020 $a 9781484271827 $9 978-1-4842-7182-7
024 7 $a 10.1007/978-1-4842-7182-7 $2 doi
035 $a 978-1-4842-7182-7
050 4 $a QA76.76.M52
072 7 $a UMP $2 bicssc
072 7 $a COM051380 $2 bisacsh
072 7 $a UMP $2 thema
082 0 4 $a 004.165 $2 23
100 1 $a L'Esteve, Ron C. $e author. $4 aut $4 http://id.loc.gov/vocabulary/relators/aut $3 1357403
245 1 4 $a The Definitive Guide to Azure Data Engineering $h [electronic resource] : $b Modern ELT, DevOps, and Analytics on the Azure Cloud Platform / $c by Ron C. L'Esteve.
250 $a 1st ed. 2021.
264 1 $a Berkeley, CA : $b Apress : $b Imprint: Apress, $c 2021.
300 $a XXIII, 612 p. 606 illus. $b online resource.
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
347 $a text file $b PDF $2 rda
505 0 $a Introduction -- Part I. Getting Started -- 1. The Tools and Pre-Requisites -- 2. Data Factory vs SSIS vs Databricks -- 3. Design a Data Lake Storage Gen2 Account -- Part II. Azure Data Factory for ELT -- 4. Dynamically Load SQL Database to Data Lake Storage Gen 2 -- 5. Use COPY INTO to Load Synapse Analytics Dedicated SQL Pool -- 6. Load Data Lake Storage Gen2 Files into Synapse Analytics Dedicated SQL Pool -- 7. Create and Load Synapse Analytics Dedicated SQL Pool Tables Dynamically -- 8. Build Custom Logs in SQL Database for Pipeline Activity Metrics -- 9. Capture Pipeline Error Logs in SQL Database.-10. Dynamically Load Snowflake Data Warehouse.-11. Mapping Data Flows for Data Warehouse ETL -- 12. Aggregate and Transform Big Data Using Mapping Data Flows -- 13. Incrementally Upsert Data.-14. Loading Excel Sheets into Azure SQL Database Tables.-15. Delta Lake -- Part III. Real-Time Analytics in Azure -- 16. Stream Analytics Anomaly Detection -- 17. Real-time IoT Analytics Using Apache Spark -- 18. Azure Synapse Link for Cosmos DB -- Part IV. DevOps for Continuous Integration and Deployment -- 19. Deploy Data Factory Changes -- 20. Deploy SQL Database -- Part V. Advanced Analytics -- 21. Graph Analytics Using Apache Spark’s GraphFrame API -- 22. Synapse Analytics Workspaces -- 23. Machine Learning in Databricks -- Part VI. Data Governance -- 24. Purview for Data Governance.
520 $a Build efficient and scalable batch and real-time data ingestion pipelines, DevOps continuous integration and deployment pipelines, and advanced analytics solutions on the Azure Data Platform. This book teaches you to design and implement robust data engineering solutions using Data Factory, Databricks, Synapse Analytics, Snowflake, Azure SQL database, Stream Analytics, Cosmos database, and Data Lake Storage Gen2. You will learn how to engineer your use of these Azure Data Platform components for optimal performance and scalability. You will also learn to design self-service capabilities to maintain and drive the pipelines and your workloads. The approach in this book is to guide you through a hands-on, scenario-based learning process that will empower you to promote digital innovation best practices while you work through your organization’s projects, challenges, and needs. The clear examples enable you to use this book as a reference and guide for building data engineering solutions in Azure. After reading this book, you will have a far stronger skill set and confidence level in getting hands on with the Azure Data Platform. You will learn to: Build dynamic, parameterized ELT data ingestion orchestration pipelines in Azure Data Factory Create data ingestion pipelines that integrate control tables for self-service ELT Implement a reusable logging framework that can be applied to multiple pipelines Integrate Azure Data Factory pipelines with a variety of Azure data sources and tools Transform data with Mapping Data Flows in Azure Data Factory Apply Azure DevOps continuous integration and deployment practices to your Azure Data Factory pipelines and development SQL databases Design and implement real-time streaming and advanced analytics solutions using Databricks, Stream Analytics, and Synapse Analytics Get started with a variety of Azure data services through hands-on examples.
650 2 4 $a Big Data. $3 1017136
650 2 4 $a Database Management. $3 669820
650 1 4 $a Microsoft and .NET. $3 1114109
650 0 $a Big data. $3 981821
650 0 $a Database management. $3 557799
650 0 $a Microsoft .NET Framework. $3 565417
650 0 $a Microsoft software. $3 1253736
710 2 $a SpringerLink (Online service) $3 593884
773 0 $t Springer Nature eBook
776 0 8 $i Printed edition: $z 9781484271810
776 0 8 $i Printed edition: $z 9781484271834
856 4 0 $u https://doi.org/10.1007/978-1-4842-7182-7
912 $a ZDB-2-CWD
912 $a ZDB-2-SXPC
950 $a Professional and Applied Computing (SpringerNature-12059)
950 $a Professional and Applied Computing (R0) (SpringerNature-43716)