John Leung

Jun 12, 2024 | towardsdatascience.com | John Leung

Python tricks and techniques for data ingestion, validation, processing, and testing: a practical walkthrough Raw data comes from various sources and formats. Before the data can be available to answer critical business questions, substantial effort and time are required to perform data engineering. While the underlying data infrastructure can vary based on the data volume, velocity, and analytics requirements, some fundamental code design techniques are still...

May 31, 2024 | towardsdatascience.com | John Leung

Orchestrating a Dynamic Time-Series Pipeline with Azure Data Factory and DatabricksExplore how to build, trigger, and parameterize a time-series data pipeline in Azure, accompanied by a step-by-step tutorialIn the previous story, we went through the potential of PySpark on Databricks for time-series data. I encourage you to catch up here to know more. Without configuring a standalone Spark instance, we can ingest static and streaming data, perform transformation, extract useful…

May 15, 2024 | towardsdatascience.com | John Leung

Feature Engineering for Time-Series Using PySpark on DatabricksDiscover the potentials of PySpark for time-series data: Ingest, extract, and visualize data, accompanied by practical implementation codeWith the increasing demand for high-speed querying and analysis on large datasets, Apache Spark has stood out as one of the most popular analytical engines in recent years. It is powerful in distributed data processing due to its master-worker architecture. This includes a driver program that…

May 9, 2024 | morningstar.com | John Leung

New York, NY, May 09, 2024 (GLOBE NEWSWIRE) -- PhotonPay, a pioneering global payment PaaS platform and digital financial infrastructure, and Discover® Global Network, the payment brand of Discover Financial Services, to launch the PhotonPay Commercial Card. Cardholders will now have the ability to use their PhotonPay Commercial Card on the Discover Global Network which can offers exceptional and seamless B2B and B2C payment solutions that cater to our customers' financial needs.

Feb 13, 2024 | medium.com | John Leung

Explore the potentials and constraints of LangChain in calculating statistics, insight generation, visualization, and making conversation for customer analytics — with implementation codesMany businesses possess a lot of proprietary data stored in their databases. However, the data is complex and unapproachable for users, so they often struggle to identify trends and extract actionable insights.