Can You Trust Machine Learning Chat Applications for Weather Information?

Today, machine learning (ML) applications such as chatGPT are all the rage, with folks worried about the displacement of humans, bogus homework, and more.   

So I was not a little curious to evaluate OpenAI's chatGPT abilities in the meteorological realm.

My conclusion:  human meteorologists currently don't have much to worry about.


ChatGPT can produce reasonable-sounding prose that is often totally wrong.

For example, I asked it about the origin of the all-important Puget Sound convergence zone (see below).

According to chatGPT convergence zones occur when ocean air collides with drier air from the eastern part of Washington State.  Wrong.  The Puget Sound Convergence occurs when marine air moves around the Olympics and then converges (comes together) east of the Olympics, forcing air upwards (and thus producing clouds and precipitation).   Zero for chatGPT


Then I thought I would give it an easy one...why Bellingham is often cold.  The answer is that cold air from the interior can jet out of the Fraser River Valley, a low-level passage through the Cascades.  ChatGPT came up with a crazy answer having to do with rain shadowing by local mountain ranges.  Totally bogus.


Then I asked about why there is often cold air in the Columbia Gorge.  Another easy one.

Truth: the low-level Columbia Gorge acts as a near-sea level conduit of cold air from eastern Washington.   But chatGPT had other ideas, from elevation (it got it 180° wrong), rain shadowing, and cold air drainage from the slopes of the Gorge.  Very bad explanation.



In sheer frustration, I decided to give chatGPT an even easier question: to produce my bio.

Much of it was wrong.  It claims I was born in 1951 (wrong) in Brooklyn (wrong) and that I grew up in Great Neck, NY. (wrong).  It was I got my Ph.D. from MIT (WRONG...I graduated from the UW).   And many of the other "facts" were in error.

applications such as chatGPT are all the rage Can You Trust Machine Learning Chat Applications for Weather Information?

In summary, chatGPT's performance was generally quite poor and one has to be VERY careful before believing its often convincing prose.

Finally, I asked chatGPT to write a weather blog for me and it was happy to oblige (see below).  I will let you, my readers, decide whether it is good enough to take over.


A lot of it was wrong, by the way.


Comments

Post a Comment

Popular posts from this blog

Why so little lightning in the Pacific Northwest? And a very nice weekend ahead.

Image
During the past 24-hours, there have been a few lightning strokes over the region (see below) but nothing to write home about (see below). It turns out that the Pacific Northwest and the remainder of the West Coast have some of the lowest frequencies of thunderstorms in the entire country (see below). But why?    My podcast provides the answer. And I also give the weekend forecast....and I think most will like what I have to say. To listen to my podcast, use the link below or access it through your favorite podcast service. Some major podcast servers:     Like the podcast? Support on Patreon 
Read more

The Time of Year You Can See the Air Move

Image
  Most of the time, you can not see the air move.   You can feel it, but the complex, turbulent motions are invisible to you, except when it interacts with leaves and branches on trees and plants. But for a few weeks of the year, the sky is full of small, cotton-like tuffs that like a natural MRI machine reveals the complex three-dimensional motions of the atmosphere.   Cottonwood season.  And we right in the middle of it.   Being cottonwood aware is of particular value this year.  It reveals the active dispersion and movement of air that makes the outdoors essentially COVID safe, and thus should be of some comfort for those nervous about transmission outside. Cottonwood seeds are embedded in small cotton-like fibers.   A million seeds weigh about 3 pounds.  Yes, each seed and tuff weights about .000003 pounds.   And that fact, plus the cottonwood tuff, means that these seeds fall VERY, VERY, VERY slowly.   So slowly that they are excellent markers for the three-dimensional flow of the
Read more

A Much Colder Than Normal April: But How Unusual?

Image
  April was a chilly month over the Northwest, but how chilly?     It turns out the answer depends on where you are located. The difference between this April's temperatures from normal across Washington State (below) shows that the entire state was well below normal.  The eastern side of the state was particularly frigid:  some areas were more than 6 degrees below normal.   Considering the west side of the state, the April mean temperatures at SeaTac Airport are plotted below.   This April was the coolest since 2011. April 2020 was in 15th place for the coolest April since the mid-1940s and was a bit more than 4F below normal.  So if you felt that you were cheated out of normal spring warmth...you are right. But if you really wanted to experience extraordinary April cold you had to be east of the Cascade crest. Consider Yakima.  Wow.  It had the third coldest April temperature since the mid-1940s.   And the all-time record in 1955 was only slightly colder. If you want a longer-te
Read more