Turns out this one is easy, assuming you can log into the Postgresql database. Once logged in (i.e., using the psql command line, just run this command:

\l

(a backslash followed by the lowercase letter L). It provides a nice list of all of the databases.