Seattle DataGuy

Aug 11, 2024 | seattledataguy.substack.com | Seattle DataGuy

As a consultant, I have been called in to review and, in many cases, replace dozens of half-finished, abandoned, and sometimes forgotten data infrastructure projects. The data infrastructure in a few cases may just need a little tweaking to operate effectively, but other times the project is either so incomplete or so lacking in a central design that the best thing to do is replace the old system.

Jan 4, 2024 | towardsdatascience.com | Seattle DataGuy |Matt Collins

Use various data source types to quickly generate text data for artificial datasets. In a previous article, we explored creating many-to-one relationships between columns in a synthetic PySpark DataFrame. This DataFrame only consisted of Foreign Key information and we didn’t produce any textual information that might be useful in a demo DataSet.