How to perform join operation in BigQuery? Exploring BigQuery Join Operations: Broadcast and Hashing Joins & Nested and Repeated Structures.

BigQuery - SQL Joins (Photo by Resource Database on Unsplash) SQL joins are used to combine columns from multiple tables to get desired result set. In a typical Relational model we use normalized tables, each table represents an entity (example:...

Read more...

How to Choose a Data Serialization/Encoding Format? A Practical Guide for Engineers

Data Encoding & Decoding. Image Source: Unsplash In the world of software, we often work with different types of data like lists, tables, and more. These data structures are designed to be fast and efficient when our computer programs use them....

Read more...

Unlock Advanced Data Visualization: The Complete Guide to Installing and Using Apache Superset on Linux

Data Visualization - Apache Superset Guide. Image Source: Unsplash Note: This article provides a comprehensive guide on deploying and using Apache Superset on a Linux server. It covers the installation and configuration process, as well...

Read more...

GCP Cloud Pub/Sub Replay: Seeking to timestamp & Seeking to snapshots

Google Cloud Pub/Sub Replay (Pixabay) Let's assume, you have data pipeline deployed on Google Cloud Platform, events are published to Cloud Pub/Sub topic from publisher client, and subscribed by a data processing application, which reads data from...

Read more...

[Solved] Access is denied - Check credentials and try again - Microsoft Graph - Calendar API

Microsoft Graph (Source: microsoft.com)When sending API request to Microsoft Graph API, it responds with access denied error. You might have followed the documentation and added the correct permission and granted admin consent for the same, but it still...

Read more...

Streaming Analytics in Google Cloud Platform (GCP) - Building Data Pipeline with Apache Beam

Building Apache Beam Data Pipeline (Source: Pixabay) In introduction article of this series Streaming Analytics in Google Cloud Platform (GCP) - Introduction, we have seen the basics of streaming analytics, its importance and example uses cases,...

Read more...

Streaming Analytics in Google Cloud Platform (GCP) - Setting Up The Environment

Streaming Analytics in GCP (Source: Pixabay) Hello everyone, in the previous article Streaming Analytics in Google Cloud Platform - Introduction, we have covered what is streaming analytics, what services we are going to use and a quick introduction...

Read more...

Streaming Analytics in Google Cloud Platform (GCP) - Introduction

Streaming Analytics in Google Cloud Platform (image source - pixabay) From data-to-decision in real-time Welcome to our new series on building a streaming analytics system in the Google Cloud Platform!. Let's begin with a quick introduction....

Read more...