Warehouse or Lake House? What to build and what actually matters?A bit of a ramble of thoughts realising the trends of data engineeringMay 4May 4
Understanding `Optional` and `Nullable` propertiesEffect of optional vs nullable properties on data qualitySep 4, 2022Sep 4, 2022
Two skills I value and look forSoft skills that are most valuable in engineeringJul 27, 2022Jul 27, 2022
Published inAnalytics VidhyaEnabling testing and local development with Spark and AWSIntegrating Spark with LocalStackOct 9, 2021Oct 9, 2021
Published inTowards Data ScienceUnderstanding Apache ParquetUnderstand why Parquet should be used for warehouse/lake storageSep 26, 20201Sep 26, 20201
Published inAnalytics VidhyaBBC micro:bit as a Wireless SensorUsing the micro:bit as a wireless transmitter for Analogue sensorsSep 4, 2020Sep 4, 2020
Published inTowards Data ScienceAmazon Redshift ArchitectureUnderstanding the foundations of RedshiftAug 16, 2020Aug 16, 2020