I had EXACTLY the same problem when we bought our 83 wagon last week. Previous owner stated ac does not work I fixed that by hard vibrating/tapping on ac accumulator with ac compressor on and high revs to give lots of pressure in line. This unblocked the acccumulator screen of accumulated sludgy oil buildup and it suddenly started blowing cold!
But......
When ac was off, driving air pressure, or external wind over the hood would blow hot air out the vents, unless I closed the vent tab between the two center dash vents. At first I thought this would work, but of course the vent tab needs to be open to get any airflow. I noticed that the cold ac air had to cool this hot air down, so I wasn't getting full cold air benefit.
I took the dash center cover off, which is around the radio and two slider selector knob assembly(the one that lets you select between ac , heat, and vent, and hot/cold selector), and saw that there were two cables that fit onto pegs on the interior selector mechanism that rotates left to right. The one that attached onto the top right peg of the ac max/ac/heat/vent/bi level selector that opened and closed the vent door that allows outaide air to go the heater core had popped off of the peg, and was unattached, in the half open position.
I'll bet money that is what you guys have. The cable end is curled into a round spring shape which pops down onto the 1/3" diameter , 1/2" tall peg on the rotating part, with no circlip or detent to prevent it from falling off eventually, under torque when you move the selector.
I think that as the selector cable(which is almost identical to a bicycle brake cable) gets stiffer/gummy with age, and the ac selector which most likely used to slide easily when car was new, now needs considerable force to push the gummed up cable through the now resisting sheath, thus putting torque force enough to pop off the cable off of the peg acutator.
My idea for a fix, was to spray wd40 into cable/sheath end and work back and forth until it moved smoothly and easily, then put the loop end of the cable back onto the peg.
Voila, now when you move it from heat to ac setting, hot air immediately stops, and actually zero air movement comes in the center vents from the outside air moving through the heater core to the vents. Then when ac fan is turned on, and ac kicked in, boy, the air froze my fingers, after only a few seconds!
Hope this description helps you guys fix the issue!