data warehouse

Spark SQL vs T-SQL Date Query Differences

March 28, 2022October 28, 2022

Spark SQL, for example in Databricks, is different to T-SQL in Microsoft SQL Server. Below are some examples of the differences, considering dates. In general, Spark SQL and T-SQL are relatively similar, date queries are… Read More »Spark SQL vs T-SQL Date Query Differences

Data Lake VS Delta Lake – Data Upsert and Partition Compaction Management

August 21, 2021October 14, 2021

Data warehouse, data lake and delta lake data platform architectures behave differently in the terms of data upserts or merge, and file partition compaction management. Big data often requires inserts, updates, or other incremental data… Read More »Data Lake VS Delta Lake – Data Upsert and Partition Compaction Management