Data Engineering courses in Glasgow

Duration 4 Days 24 CPD hours This course is intended for The primary audience for this course is data professionals, data architects, and business intelligence professionals who want to learn about data engineering and building analytical solutions using data platform technologies that exist on Microsoft Azure. The secondary audience for this course includes data analysts and data scientists who work with analytical solutions built on Microsoft Azure. In this course, the student will learn how to implement and manage data engineering workloads on Microsoft Azure, using Azure services such as Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure Stream Analytics, Azure Databricks, and others. The course focuses on common data engineering tasks such as orchestrating data transfer and transformation pipelines, working with data files in a data lake, creating and loading relational data warehouses, capturing and aggregating streams of real-time data, and tracking data assets and lineage. Prerequisites Successful students start this course with knowledge of cloud computing and core data concepts and professional experience with data solutions. AZ-900T00 Microsoft Azure Fundamentals DP-900T00 Microsoft Azure Data Fundamentals 1 - Introduction to data engineering on Azure What is data engineering Important data engineering concepts Data engineering in Microsoft Azure 2 - Introduction to Azure Data Lake Storage Gen2 Understand Azure Data Lake Storage Gen2 Enable Azure Data Lake Storage Gen2 in Azure Storage Compare Azure Data Lake Store to Azure Blob storage Understand the stages for processing big data Use Azure Data Lake Storage Gen2 in data analytics workloads 3 - Introduction to Azure Synapse Analytics What is Azure Synapse Analytics How Azure Synapse Analytics works When to use Azure Synapse Analytics 4 - Use Azure Synapse serverless SQL pool to query files in a data lake Understand Azure Synapse serverless SQL pool capabilities and use cases Query files using a serverless SQL pool Create external database objects 5 - Use Azure Synapse serverless SQL pools to transform data in a data lake Transform data files with the CREATE EXTERNAL TABLE AS SELECT statement Encapsulate data transformations in a stored procedure Include a data transformation stored procedure in a pipeline 6 - Create a lake database in Azure Synapse Analytics Understand lake database concepts Explore database templates Create a lake database Use a lake database 7 - Analyze data with Apache Spark in Azure Synapse Analytics Get to know Apache Spark Use Spark in Azure Synapse Analytics Analyze data with Spark Visualize data with Spark 8 - Transform data with Spark in Azure Synapse Analytics Modify and save dataframes Partition data files Transform data with SQL 9 - Use Delta Lake in Azure Synapse Analytics Understand Delta Lake Create Delta Lake tables Create catalog tables Use Delta Lake with streaming data Use Delta Lake in a SQL pool 10 - Analyze data in a relational data warehouse Design a data warehouse schema Create data warehouse tables Load data warehouse tables Query a data warehouse 11 - Load data into a relational data warehouse Load staging tables Load dimension tables Load time dimension tables Load slowly changing dimensions Load fact tables Perform post load optimization 12 - Build a data pipeline in Azure Synapse Analytics Understand pipelines in Azure Synapse Analytics Create a pipeline in Azure Synapse Studio Define data flows Run a pipeline 13 - Use Spark Notebooks in an Azure Synapse Pipeline Understand Synapse Notebooks and Pipelines Use a Synapse notebook activity in a pipeline Use parameters in a notebook 14 - Plan hybrid transactional and analytical processing using Azure Synapse Analytics Understand hybrid transactional and analytical processing patterns Describe Azure Synapse Link 15 - Implement Azure Synapse Link with Azure Cosmos DB Enable Cosmos DB account to use Azure Synapse Link Create an analytical store enabled container Create a linked service for Cosmos DB Query Cosmos DB data with Spark Query Cosmos DB with Synapse SQL 16 - Implement Azure Synapse Link for SQL What is Azure Synapse Link for SQL? Configure Azure Synapse Link for Azure SQL Database Configure Azure Synapse Link for SQL Server 2022 17 - Get started with Azure Stream Analytics Understand data streams Understand event processing Understand window functions 18 - Ingest streaming data using Azure Stream Analytics and Azure Synapse Analytics Stream ingestion scenarios Configure inputs and outputs Define a query to select, filter, and aggregate data Run a job to ingest data 19 - Visualize real-time data with Azure Stream Analytics and Power BI Use a Power BI output in Azure Stream Analytics Create a query for real-time visualization Create real-time data visualizations in Power BI 20 - Introduction to Microsoft Purview What is Microsoft Purview? How Microsoft Purview works When to use Microsoft Purview 21 - Integrate Microsoft Purview and Azure Synapse Analytics Catalog Azure Synapse Analytics data assets in Microsoft Purview Connect Microsoft Purview to an Azure Synapse Analytics workspace Search a Purview catalog in Synapse Studio Track data lineage in pipelines 22 - Explore Azure Databricks Get started with Azure Databricks Identify Azure Databricks workloads Understand key concepts 23 - Use Apache Spark in Azure Databricks Get to know Spark Create a Spark cluster Use Spark in notebooks Use Spark to work with data files Visualize data 24 - Run Azure Databricks Notebooks with Azure Data Factory Understand Azure Databricks notebooks and pipelines Create a linked service for Azure Databricks Use a Notebook activity in a pipeline Use parameters in a notebook Additional course details: Nexus Humans DP-203T00 Data Engineering on Microsoft Azure training program is a workshop that presents an invigorating mix of sessions, lessons, and masterclasses meticulously crafted to propel your learning expedition forward. This immersive bootcamp-style experience boasts interactive lectures, hands-on labs, and collaborative hackathons, all strategically designed to fortify fundamental concepts. Guided by seasoned coaches, each session offers priceless insights and practical skills crucial for honing your expertise. Whether you're stepping into the realm of professional skills or a seasoned professional, this comprehensive course ensures you're equipped with the knowledge and prowess necessary for success. While we feel this is the best course for the DP-203T00 Data Engineering on Microsoft Azure course and one of our Top 10 we encourage you to read the course outline to make sure it is the right content for you. Additionally, private sessions, closed classes or dedicated events are available both live online and at our training centres in Dublin and London, as well as at your offices anywhere in the UK, Ireland or across EMEA.

24 Hours Left! Don't Let Winter Sale Slip Away - Enrol Now! With over 100,000 civil engineers in the UK, the demand for data-savvy professionals is high. According to a recent study, 72% of UK civil engineering firms are investing in data analytics to enhance decision-making processes, with data engineering experiencing a 40% year-on-year growth. This surge outpaces other tech sectors, highlighting the critical role of data engineers in big data and advanced analytics. This Data Engineering bundle empowers you to capitalise on this growing trend, equipping you with the proficiency to extract valuable insights from vast datasets, optimise project planning, and enhance overall efficiency. Embark on a transformative journey with our Data Engineering Bundle, thoroughly crafted to bridge the skill gap in one of the UK's fastest-growing job markets. Our bundle offers a comprehensive exploration into the world of data, equipping you with the analytical prowess to harness, process, and visualise data effectively. From mastering SQL programming to delving into the complexities of machine learning with R, this bundle is your gateway to becoming a data engineering maestro. In today's data-driven landscape, possessing a robust set of analytical skills is no longer a luxury but a necessity. With an emphasis on Data engineering, our courses are designed to foster a deep understanding of data analytics, visualisation, and mining, ensuring you can convert raw data into strategic insights that propel business decisions. Seize the opportunity to be at the helm of innovation and become the architect of tomorrow's data landscape with our Data Engineering Bundle. Join us now! Courses are Included in This Data Engineering Bundle: Course 01: Introduction to Data Analysis Course 02: Data Science & Machine Learning with R Course 03: Data Analytics with Tableau Course 04: SQL Programming Masterclass Course 05: Excel Pivot table for Data analytics Course 06: Data analytics with Excel Course 07: Python for Data Analysis Course 08: Basic Google Data Studio Course 09: Business Intelligence and Data Mining Masterclass Course 10: Microsoft Excel: Automated Dashboard Using Advanced Formula, VBA, Power Query Course 11: JavaScript Functions for Data Analyst Course 12: GDPR Data Protection Level 5 Course 13: GDPR Training Course 14: Learn Programming with Python Course 15: Data Center Training Essentials: General Introduction Course 16: Quick Data Science Approach from Scratch Course 17: Statistics & Probability for Data Science & Machine Learning Course 18: Master JavaScript with Data Visualization Course 19: Excel Data Tools and Data Management Course 20: Cloud Computing Essentials for Data Analysis Learning Outcomes of Data Engineering Bundle: Gain proficiency in SQL for complex database management and analytics tasks. Master R for data science and machine learning applications in various industries. Develop advanced Excel skills, including data analytics and pivot table expertise. Acquire hands-on experience with Tableau for effective data visualisation. Learn Python programming essentials for data analysis and engineering solutions. Understand Google Data Studio to create dynamic reports and dashboards. Why Choose Our Data Engineering Course? FREE Data Engineering certificate accredited Get a free student ID card with Data Engineering Training Get instant access to this Data Engineering course. Learn Data Engineering from anywhere in the world The Data Engineering is affordable and simple to understand The Data Engineering is an entirely online, interactive lesson with voiceover audio Lifetime access to the Data Engineering course materials The Data Engineering comes with 24/7 tutor support Start your learning journey straightaway with our Data Engineering Bundle! This Data Engineering bundle will equip you with the skills and knowledge to become a data-savvy civil engineer. You will learn how to collect, analyze, and interpret data to improve infrastructure projects and processes. This Data Engineering bundle includes courses on data analysis, data science, machine learning, SQL programming, Excel pivot tables, Excel data analytics, Python for data analysis, Google Data Studio, business intelligence, data mining, GDPR data protection, JavaScript functions for data analysts, and Python programming. Assessment Process of Data Engineering Once you have completed all the courses in the Data Engineering bundle, you can assess your skills and knowledge with an optional assignment. Our expert trainers will assess your assignment and give you feedback afterwards. CPD 200 CPD hours / points Accredited by CPD Quality Standards Who is this course for? This Data Engineering bundle is suitable for everyone. Also, our Data Engineering Bundle is perfect for: Aspiring data engineers Business intelligence analysts Data-driven marketers IT professionals Statistics enthusiasts Career changers Requirements You will not need any prior background or expertise in the Data Engineering Bundle. Career path This Data Engineering bundle will allow you to kickstart or take your career to the next stage in the related sector such as: Data Analyst BI Developer ML Engineer Data Scientist Database Administrator Data Strategist Certificates CPD Accredited Digital Certificate Digital certificate - Included CPD Accredited Hard Copy Certificate Hard copy certificate - Included If you are an international student, then you have to pay an additional 10 GBP for each certificate as an international delivery charge.

24 Hour Flash Deal **25-in-1 Data Engineering Advanced Diploma Mega Bundle** Data Engineering Advanced Diploma Enrolment Gifts **FREE PDF Certificate**FREE PDF Transcript ** FREE Exam** FREE Student ID ** Lifetime Access **FREE Enrolment Letter ** Take the initial steps toward a successful long-term career by studying the Data Engineering Advanced Diploma package online with Studyhub through our online learning platform. The Data Engineering Advanced Diploma bundle can help you improve your CV, wow potential employers, and differentiate yourself from the mass. This Data Engineering Advanced Diploma course provides complete 360-degree training on Data Engineering Advanced Diploma. You'll get not one, not two, not three, but twenty-five Data Engineering Advanced Diploma courses included in this course. Plus Studyhub's signature Forever Access is given as always, meaning these Data Engineering Advanced Diploma courses are yours for as long as you want them once you enrol in this course This Data Engineering Advanced Diploma Bundle consists the following career oriented courses: Course 01: Data Analysis Course 02: Data Science & Machine Learning with R Course 03: Data Analytics with Tableau Course 04: SQL Programming Course 05: Excel Pivot Tables, Pivot Charts, Slicers, and Timelines Course 06: Data Analytics Course 07: Python Data Science with Numpy, Pandas and Matplotlib Course 08: Google Analytics Course 09: Business Intelligence and Data Mining Course 10: Microsoft Excel: Automated Dashboard Using Advanced Formula, VBA, Power Query Course 11: JavaScript Functions Course 12: Data Protection and Data Security (GDPR) Training Certification Course 13: GDPR Training Course 14: Diploma in Python Programming Course 15: Data Center Training Essentials: General Introduction Course 16: Quick Data Science Approach from Scratch Course 17: Diploma in Statistics & Probability for Data Science & Machine Learning Course 18: Master JavaScript with Data Visualization Course 19: Data Analysis and Forecasting in Excel Course 20: AWS Certified Solutions Architect Associate Preparation Course 21: Statistical Analysis Course Course 22: SQL for Data Science, Data Analytics and Data Visualization Course 23: Learn MySQL from Scratch for Data Science and Analytics Course 24: Data Analysis & Forecasting Course 25: Data Structure The Data Engineering Advanced Diploma course has been prepared by focusing largely on Data Engineering Advanced Diploma career readiness. It has been designed by our Data Engineering Advanced Diploma specialists in a manner that you will be likely to find yourself head and shoulders above the others. For better learning, one to one assistance will also be provided if it's required by any learners. The Data Engineering Advanced Diploma Bundle is one of the most prestigious training offered at StudyHub and is highly valued by employers for good reason. This Data Engineering Advanced Diploma bundle course has been created with twenty-five premium courses to provide our learners with the best learning experience possible to increase their understanding of their chosen field. This Data Engineering Advanced Diploma Course, like every one of Study Hub's courses, is meticulously developed and well researched. Every one of the topics is divided into Data Engineering Advanced Diploma Elementary modules, allowing our students to grasp each lesson quickly. The Data Engineering Advanced Diploma course is self-paced and can be taken from the comfort of your home, office, or on the go! With our Student ID card you will get discounts on things like music, food, travel and clothes etc. In this exclusive Data Engineering Advanced Diploma bundle, you really hit the jackpot. Here's what you get: Step by step Data Engineering Advanced Diploma lessons One to one assistance from Data Engineering Advanced Diplomaprofessionals if you need it Innovative exams to test your knowledge after the Data Engineering Advanced Diplomacourse 24/7 customer support should you encounter any hiccups Top-class learning portal Unlimited lifetime access to all twenty-five Data Engineering Advanced Diploma courses Digital Certificate, Transcript and student ID are all included in the price PDF certificate immediately after passing Original copies of your Data Engineering Advanced Diploma certificate and transcript on the next working day Easily learn the Data Engineering Advanced Diploma skills and knowledge you want from the comfort of your home CPD 250 CPD hours / points Accredited by CPD Quality Standards Who is this course for? This Data Engineering Advanced Diploma training is suitable for - Students Recent graduates Job Seekers Individuals who are already employed in the relevant sectors and wish to enhance their knowledge and expertise in Data Engineering Advanced Diploma Requirements To participate in this Data Engineering Advanced Diploma course, all you need is - A smart device A secure internet connection And a keen interest in Data Engineering Advanced Diploma Career path You will be able to kickstart your Data Engineering Advanced Diploma career because this course includes various courses as a bonus. This Data Engineering Advanced Diploma is an excellent opportunity for you to learn multiple skills from the convenience of your own home and explore Data Engineering Advanced Diploma career opportunities. Certificates CPD Accredited Certificate Digital certificate - Included CPD Accredited e-Certificate - Free CPD Accredited Hardcopy Certificate - Free Enrolment Letter - Free Student ID Card - Free

If you aim to enhance your Data Engineering skills, our comprehensive Data Engineering course is perfect for you. Designed for success, this Data Engineering course covers everything from basics to advanced topics in Data Engineering. Each lesson in this Data Engineering course is crafted for easy understanding, enabling you to become proficient in Data Engineering. Whether you are a beginner or looking to sharpen your existing skills, this Data Engineering is the ideal choice. With our Data Engineering exclusive bundle, you will get a PDF Certificate, PDF Transcript and Digital Student ID Card (worth £50) Absolutely FREE. Courses are Included in This Data Engineering Bundle: Course 01: Diploma in Data Analysis Fundamentals Course 02: Python for Data Analysis Course 03: Data Analytics with Tableau Course 04: SQL Masterclass: SQL For Data Analytics Course 05: Basic Google Data Studio Course 06: Data Analysis and Forecasting in Excel Why Choose Our Data Engineering Course? FREE Data Engineering certificate accredited Get a free student ID card with Data Engineering Training Get instant access to this Data Engineering course. Learn Data Engineering from anywhere in the world The Data Engineering is affordable and simple to understand The Data Engineering is an entirely online, interactive lesson with voiceover audio Lifetime access to the Data Engineering course materials The Data Engineering comes with 24/7 tutor support So enrol now in this Data Engineering Today to advance your career! Start your learning journey straightaway! This Data Engineering's curriculum has been designed by Data Engineering experts with years of Data Engineering experience behind them. The Data Engineering course is extremely dynamic and well-paced to help you understand Data Engineering with ease. You'll discover how to master the Data Engineering skill while exploring relevant and essential topics. Assessment Process Once you have completed all the courses in the Data Engineering bundle, you can assess your skills and knowledge with an optional assignment. Our expert trainers will assess your assignment and give you feedback afterwards. CPD 60 CPD hours / points Accredited by CPD Quality Standards Who is this course for? This Data Engineering bundle is suitable for everyone. Requirements You will not need any prior background or expertise. Career path This Data Engineering bundle will allow you to kickstart or take your career in the related sector to the next stage. Certificates CPD Accredited Digital certificate Digital certificate - Included CPD Accredited Hard copy certificate Hard copy certificate - £29 If you are an international student, you will be required to pay an additional fee of 10 GBP for international delivery, and 4.99 GBP for delivery within the UK, for each certificate

Duration 1 Days 6 CPD hours This course is intended for The primary audience for this course is data professionals who are familiar with data modeling, extraction, and analytics. It is designed for professionals who are interested in gaining knowledge about Lakehouse architecture, the Microsoft Fabric platform, and how to enable end-to-end analytics using these technologies. Job role: Data Analyst, Data Engineer, Data Scientist Overview Describe end-to-end analytics in Microsoft Fabric Describe core features and capabilities of lakehouses in Microsoft Fabric Create a lakehouse Ingest data into files and tables in a lakehouse Query lakehouse tables with SQL Configure Spark in a Microsoft Fabric workspace Identify suitable scenarios for Spark notebooks and Spark jobs Use Spark dataframes to analyze and transform data Use Spark SQL to query data in tables and views Visualize data in a Spark notebook Understand Delta Lake and delta tables in Microsoft Fabric Create and manage delta tables using Spark Use Spark to query and transform data in delta tables Use delta tables with Spark structured streaming Describe Dataflow (Gen2) capabilities in Microsoft Fabric Create Dataflow (Gen2) solutions to ingest and transform data Include a Dataflow (Gen2) in a pipeline This course is designed to build your foundational skills in data engineering on Microsoft Fabric, focusing on the Lakehouse concept. This course will explore the powerful capabilities of Apache Spark for distributed data processing and the essential techniques for efficient data management, versioning, and reliability by working with Delta Lake tables. This course will also explore data ingestion and orchestration using Dataflows Gen2 and Data Factory pipelines. This course includes a combination of lectures and hands-on exercises that will prepare you to work with lakehouses in Microsoft Fabric. Introduction to end-to-end analytics using Microsoft Fabric Explore end-to-end analytics with Microsoft Fabric Data teams and Microsoft Fabric Enable and use Microsoft Fabric Knowledge Check Get started with lakehouses in Microsoft Fabric Explore the Microsoft Fabric Lakehouse Work with Microsoft Fabric Lakehouses Exercise - Create and ingest data with a Microsoft Fabric Lakehouse Use Apache Spark in Microsoft Fabric Prepare to use Apache Spark Run Spark code Work with data in a Spark dataframe Work with data using Spark SQL Visualize data in a Spark notebook Exercise - Analyze data with Apache Spark Work with Delta Lake Tables in Microsoft Fabric Understand Delta Lake Create delta tables Work with delta tables in Spark Use delta tables with streaming data Exercise - Use delta tables in Apache Spark Ingest Data with DataFlows Gen2 in Microsoft Fabric Understand Dataflows (Gen2) in Microsoft Fabric Explore Dataflows (Gen2) in Microsoft Fabric Integrate Dataflows (Gen2) and Pipelines in Microsoft Fabric Exercise - Create and use a Dataflow (Gen2) in Microsoft Fabric

CPD Certified | 17-in-1 Diploma Bundle | 170 CPD Points | Free PDF & Transcript Certificate | Lifetime Access

his course covers the essential Python Basics, in our interactive, instructor led Live Virtual Classroom. This Python Basics course is a very good introduction to essential fundamental programming concepts using Python as programming language. These concepts are daily used by programmers and is your first step to working as a programmer. By the end, you'll be comfortable in programming Python code. You will have done small projects. This will serve for you as examples and samples that you can use to build larger projects.

QLS Endorsed + CPD QS Accredited - Dual Certification | Instant Access | 24/7 Tutor Support | All-Inclusive Cost

  The comprehensive Diploma in Data Engineering with Google BigQuery & Google Cloud has been designed by industry experts to provide learners with everything they need to enhance their skills and knowledge in their chosen area of study. Enrol on the Diploma in Data Engineering with Google BigQuery & Google Cloud today, and learn from the very best the industry has to offer! This best selling Diploma in Data Engineering with Google BigQuery & Google Cloud has been developed by industry professionals and has already been completed by hundreds of satisfied students. This in-depth Diploma in Data Engineering with Google BigQuery & Google Cloud is suitable for anyone who wants to build their professional skill set and improve their expert knowledge. The Diploma in Data Engineering with Google BigQuery & Google Cloud is CPD-accredited, so you can be confident you're completing a quality training course will boost your CV and enhance your career potential. The Diploma in Data Engineering with Google BigQuery & Google Cloud is made up of several information-packed modules which break down each topic into bite-sized chunks to ensure you understand and retain everything you learn. After successfully completing the Diploma in Data Engineering with Google BigQuery & Google Cloud, you will be awarded a certificate of completion as proof of your new skills. If you are looking to pursue a new career and want to build your professional skills to excel in your chosen field, the certificate of completion from the Diploma in Data Engineering with Google BigQuery & Google Cloud will help you stand out from the crowd. You can also validate your certification on our website. We know that you are busy and that time is precious, so we have designed the Diploma in Data Engineering with Google BigQuery & Google Cloud to be completed at your own pace, whether that's part-time or full-time. Get full course access upon registration and access the course materials from anywhere in the world, at any time, from any internet-enabled device.  Our experienced tutors are here to support you through the entire learning process and answer any queries you may have via email.

Gain the solid skills and knowledge to kickstart a successful career and learn from the experts with this