Can You Trust Machine Learning Chat Applications for Weather Information?

Today, machine learning (ML) applications such as chatGPT are all the rage, with folks worried about the displacement of humans, bogus homework, and more.   

So I was not a little curious to evaluate OpenAI's chatGPT abilities in the meteorological realm.

My conclusion:  human meteorologists currently don't have much to worry about.


ChatGPT can produce reasonable-sounding prose that is often totally wrong.

For example, I asked it about the origin of the all-important Puget Sound convergence zone (see below).

According to chatGPT convergence zones occur when ocean air collides with drier air from the eastern part of Washington State.  Wrong.  The Puget Sound Convergence occurs when marine air moves around the Olympics and then converges (comes together) east of the Olympics, forcing air upwards (and thus producing clouds and precipitation).   Zero for chatGPT


Then I thought I would give it an easy one...why Bellingham is often cold.  The answer is that cold air from the interior can jet out of the Fraser River Valley, a low-level passage through the Cascades.  ChatGPT came up with a crazy answer having to do with rain shadowing by local mountain ranges.  Totally bogus.


Then I asked about why there is often cold air in the Columbia Gorge.  Another easy one.

Truth: the low-level Columbia Gorge acts as a near-sea level conduit of cold air from eastern Washington.   But chatGPT had other ideas, from elevation (it got it 180° wrong), rain shadowing, and cold air drainage from the slopes of the Gorge.  Very bad explanation.



In sheer frustration, I decided to give chatGPT an even easier question: to produce my bio.

Much of it was wrong.  It claims I was born in 1951 (wrong) in Brooklyn (wrong) and that I grew up in Great Neck, NY. (wrong).  It was I got my Ph.D. from MIT (WRONG...I graduated from the UW).   And many of the other "facts" were in error.

applications such as chatGPT are all the rage Can You Trust Machine Learning Chat Applications for Weather Information?

In summary, chatGPT's performance was generally quite poor and one has to be VERY careful before believing its often convincing prose.

Finally, I asked chatGPT to write a weather blog for me and it was happy to oblige (see below).  I will let you, my readers, decide whether it is good enough to take over.


A lot of it was wrong, by the way.


Comments

Post a Comment

Popular posts from this blog

The Time of Year You Can See the Air Move

Image
  Most of the time, you can not see the air move.   You can feel it, but the complex, turbulent motions are invisible to you, except when it interacts with leaves and branches on trees and plants. But for a few weeks of the year, the sky is full of small, cotton-like tuffs that like a natural MRI machine reveals the complex three-dimensional motions of the atmosphere.   Cottonwood season.  And we right in the middle of it.   Being cottonwood aware is of particular value this year.  It reveals the active dispersion and movement of air that makes the outdoors essentially COVID safe, and thus should be of some comfort for those nervous about transmission outside. Cottonwood seeds are embedded in small cotton-like fibers.   A million seeds weigh about 3 pounds.  Yes, each seed and tuff weights about .000003 pounds.   And that fact, plus the cottonwood tuff, means that these seeds fall VERY, VERY, VERY slowly.   So slowly that they are excellent markers for the three-dimensional flow of the
Read more

Why so little lightning in the Pacific Northwest? And a very nice weekend ahead.

Image
During the past 24-hours, there have been a few lightning strokes over the region (see below) but nothing to write home about (see below). It turns out that the Pacific Northwest and the remainder of the West Coast have some of the lowest frequencies of thunderstorms in the entire country (see below). But why?    My podcast provides the answer. And I also give the weekend forecast....and I think most will like what I have to say. To listen to my podcast, use the link below or access it through your favorite podcast service. Some major podcast servers:     Like the podcast? Support on Patreon 
Read more

Strong Atmosphere River Heads into British Columbia and Southeast Alaska

Image
While the Northwest has been drier than normal, it has been drenching wet a few hundred miles to the north. An unusually strong atmospheric river ....a long current of moisture stretching southward to the subtropics...has been in place for days, bringing large amounts of water vapor to Alaska.   And the atmospheric river will be in place for several more days, slowly moving southward. To illustrate, the scale and beauty of the atmospheric river, here is a water vapor satellite image for 11 AM today. The lighter areas have more water vapor.  You can see the current of moisture extending from near Hawaii into central BC.  This current is the result of low pressure over the Gulf of Alaska and high pressure offshore of California.   A forecast of total water vapor content in the atmosphere for 11 PM tonight shows a healthy atmospheric river (white and blue colors indicate the higher amounts of moisture). As this atmospheric river slams into the mountainous West Coast, the air is forced to
Read more