/ notes / misc

Fabric & c.

Some useful scripts

PySpark

Count records:

print(spark.sql("SELECT COUNT(*) AS customers          FROM FabryLakeHouse.customer         ").first())
print(spark.sql("SELECT COUNT(*) AS stores             FROM FabryLakeHouse.store            ").first())
print(spark.sql("SELECT COUNT(*) AS products           FROM FabryLakeHouse.product          ").first())
print(spark.sql("SELECT COUNT(*) AS dates              FROM FabryLakeHouse.date             ").first())
print(spark.sql("SELECT COUNT(*) AS currencyexchanges  FROM FabryLakeHouse.currencyexchange ").first())
print(spark.sql("SELECT COUNT(*) AS sales              FROM FabryLakeHouse.sales            ").first())

Show tables:

%%sql
show tables;
show TABLE EXTENDED LIKE '*';