Christopher Chung

Santa Rosa

Visual Journalist at The Press Democrat

I am Not a Robot. Staff Photojournalist at The Press Democrat. Pacific Media Workers Guild member. (Not paying for that blue checkmark)

Featured in: Favicon

pressdemocrat.com Favicon

jamanetwork.com Favicon

djournal.com Favicon

jaad.org

arthroplastytoday.org Favicon

mdpi.com

medium.com Favicon

scnow.com

chronicleonline.com Favicon

industrytoday.com + 1 more

Articles

Is Your Agile Turning Waterfall?

2 months ago | chungcy.medium.com | Christopher Chung

Member-only storyChristopher Chung·Follow5 min read·--It’s increasingly common to see businesses favoring an Agile approach over the traditional Waterfall method, primarily because today’s markets demand flexibility and speed. Where Waterfall relies on rigid, sequential planning, Agile embraces iterative development and adaptability. This means projects are broken into smaller, manageable chunks, allowing for continuous feedback and adjustments.
‘For Loop’ in Python is Easy

Oct 14, 2024 | medium.com | Christopher Chung

A for loop is a control flow statement that allows you to execute a block of code multiple times, iterating over a sequenceChristopher Chung·FollowPublished inPolymath Data Lab·3 min read·--Photo by Alexander Andrews on UnsplashIn Python, a for loop is a control flow statement that allows you to execute a block of code multiple times, iterating over a sequence (such as a list, tuple, dictionary, set, or range).
Mastering API Calls in Python: A Step-by-Step Guide for Beginners

Oct 13, 2024 | medium.com | Christopher Chung

APIs, or Application Programming Interfaces, serve as the bridges that connect software, allowing them to communicate and share data. Christopher Chung·FollowPublished inPolymath Data Lab·3 min read·--Photo by Juliana Malta on UnsplashIn the digital age, seamless integration between different services and data sources is paramount. APIs, or Application Programming Interfaces, serve as the bridges that connect software, allowing them to communicate and share data.
The Surprising Connection Between Gut Health and Mental Well-being: How to Boost Your Mood…

Oct 6, 2024 | chungcy.medium.com | Christopher Chung

Christopher Chung·Follow3 min read·--In recent years, the link between gut health and mental well-being has become a topic of significant interest among health professionals and researchers. As we delve deeper into the world of the gut-brain axis, we begin to understand how a healthy digestive system can impact our mood, cognitive function, and overall mental health.
Repartition vs Coalesce in PySpark: Key Differences and Performance Implications

Aug 13, 2024 | medium.com | Christopher Chung

In the realm of big data processing using PySpark, efficient data management across partitions is paramount for performance optimisation. Two commonly used methods for adjusting the number of partitions are and . Although they appear similar, they serve distinct purposes and are suited for specific scenarios. Understanding these differences and their performance implications can significantly enhance your data processing workflows. What is Repartition in PySpark?
Optimizing Apache Spark Performance: Top Strategies for Faster Big Data Processing

Aug 11, 2024 | chungcy.medium.com | Christopher Chung

Apache Spark has become a pivotal tool in the big data landscape, known for its exceptional speed, scalability, and flexibility. However, merely feeding data into Spark is not enough to unlock its full potential. As datasets expand and become more complex, optimizing Spark performance is crucial for efficient data processing. This article will guide you through the top strategies and best practices for optimizing Apache Spark applications for accelerated big data processing.
A Comprehensive Guide

Aug 4, 2024 | chungcy.medium.com | Christopher Chung

In the world of big data analytics, efficient data sorting is paramount. The ability to sort data effectively can influence the performance and speed of data processing tasks. One powerful tool that stands out in this realm is PySpark OrderBy. This feature in Apache Spark's Python API is a cornerstone for performing sorting operations on large datasets. In this article, we delve deep into PySpark OrderBy, exploring its syntax, functionality, and best practices.
How to Build Emotional Strength and Confidence

Aug 3, 2024 | chungcy.medium.com | Christopher Chung

Discover effective strategies for raising resilient kids who thrive. Learn tips for building emotional strength and confidence in children to prepare them for a bright future. Raising resilient kids in today's fast-paced, ever-changing world can be challenging for any parent. However, fostering resilience - emotional strength and confidence - can empower children to navigate life's ups and downs with grace and determination.
Selecting Top N records by Group

Jul 26, 2024 | medium.com | Christopher Chung

from pyspark.sql import functions as F from pyspark.sql.window import Window # Sample DataFrame data = [("A", 10), ("A", 8), ("A", 12), ("B", 5), ("B", 7), ("B", 3)] df = spark.createDataFrame(data, ["group", "value"]) # Define the window specification windowSpec = Window.partitionBy("group").orderBy(F.col("value").desc()) # Calculate the row number for each group df = df.withColumn("row_num", F.row_number().over(windowSpec)) # Filter for top N records top_n = 2 # Replace with desired N...
Mastering PySpark GroupBy: Unleashing the Power of Data Aggregation

Jul 24, 2024 | medium.com | Christopher Chung

PySpark, a powerful distributed processing framework, offers a vast toolkit for data manipulation and analysis. One of its core functionalities is groupBy(), a method that allows you to group DataFrame rows based on specific columns and perform aggregations on those groups. This blog delves into the world of groupBy(), empowering you to unlock valuable insights from your data.