Seattle DataGuy

Featured in: Favicon

medium.com Favicon

substack.com Favicon

towardsdatascience.com Favicon

kdnuggets.com Favicon

betterprogramming.pub Favicon

digitizingpolaris.com

Articles

Why Your Data Stack Won't Last - And How To Build Data Infrastructure That Will

Aug 11, 2024 | seattledataguy.substack.com | Seattle DataGuy

As a consultant, I have been called in to review and, in many cases, replace dozens of half-finished, abandoned, and sometimes forgotten data infrastructure projects. The data infrastructure in a few cases may just need a little tweaking to operate effectively, but other times the project is either so incomplete or so lacking in a central design that the best thing to do is replace the old system.
Methods for generating synthetic descriptive data

Jan 4, 2024 | towardsdatascience.com | Seattle DataGuy |Matt Collins

Use various data source types to quickly generate text data for artificial datasets. In a previous article, we explored creating many-to-one relationships between columns in a synthetic PySpark DataFrame. This DataFrame only consisted of Foreign Key information and we didn’t produce any textual information that might be useful in a demo DataSet.
Can ChatGPT Compete with Domain-Specific Sentiment Analysis Machine Learning Models?

Apr 25, 2023 | towardsdatascience.com | Seattle DataGuy

A hands-on comparison using ChatGPT and Domain-Specific ModelChatGPT is a GPT (Generative Pre-trained Transformer) machine learning (ML) tool that has surprised the world. Its breathtaking capabilities impress casual users, professionals, researchers, and even its own creators. Moreover, its capacity to be an ML model trained for general tasks and perform very well in domain-specific situations is impressive. I am a researcher, and its ability to do sentiment analysis (SA) interests me.
Zero-ETL, ChatGPT, And The Future of Data Engineering

Apr 24, 2023 | towardsdatascience.com | Seattle DataGuy |Barr Moses

The post-modern data stack is coming. Are we ready? If you don’t like change, data engineering is not for you. Little in this space has escaped reinvention. The most prominent, recent examples are Snowflake and Databricks disrupting the concept of the database and ushering in the modern data stack era. As part of this movement, Fivetran and dbt fundamentally altered the data pipeline from ETL to ELT.
How Do These 5 Data Leaders Drive Value With Data

Apr 14, 2023 | seattledataguy.substack.com | Seattle DataGuy

Regardless if you’re using Excel, Snowflake, or ChatGPT, the end goal of using data is to provide some sort of value. For businesses, this often means cutting costs or increasing revenue. Of course, the initiatives written out by a consultant or a CEO will never be titled something so bland. One example I have from my past was when I worked for a healthcare analytics company and we built a solution to help detect provider fraud.
What I Don't Want To See In The Data World In 5 Years

Apr 4, 2023 | seattledataguy.substack.com | Seattle DataGuy

If you were in Austin this past week, perhaps you saw my talk about “things I don’t want to see in the data world in the next five years.”Maybe you’ve been lucky and never had to write an SFTP job. You’ve never had to generate a ssh key pair (ok, you should probably know how to do this), and you’ve never had to spend several weeks just to get the schema from an external partner that will change by the time both businesses sign an agreement to work together. I was not.
This Time It's Different - ChatGPT

Mar 24, 2023 | seattledataguy.substack.com | Seattle DataGuy

When I first broke into the data world, tools like Tensorflow, Caffe, and Theano were growing in popularity. In addition, I had taken several courses in neuroscience, bioinformatics, and computational neuroscience. Culminating in immediate interest in the subject of neural networks and machine learning. Now a lot…and I mean a lot has changed since when I first even heard of these topics. Each passing year brings further advancements and changes in what we think and know is possible using AI and ML.
Why You Should Upgrade Your Data Infrastructure

Mar 16, 2023 | seattledataguy.substack.com | Seattle DataGuy

Companies that have successfully used data don't generally try to big bang their data infrastructure. That is to say, they don't try to create the most awe-inspiring technical diagram. Instead, they often go through a few phases. Each phase helps them grow on both the technical and business side of using data. Over the past few years, I have seen several very common path for companies, especially those that are start-ups, SMBs, and even a few mid-markets.