So basically kajsdf, a 4.0 head swap in itself will require the following parts:
-4.0l cylinder head (preferably the 7120 casting off a 91-95 Jeep)
-4.0l exhaust manifold (decent stainless one can be bought off the 'bay for about $90)
-JB weld and water soluble packing peanuts to seal off certain unnecessary water jackets in the head
-new head bolts
-new head gasket, intake/exhaust gasket, flange gasket, possibly valve cover gasket, and possibly water outlet gasket
and it will also require modifications to the exhaust pipe that attaches to the new manifold. Your intake can remain the same, and the 4.0 swap by itself will give you about 40hp more, maybe up to 50 if you clean everything up thoroughly so air can flow better. A lot of the real hp and reliability comes from fuel injection, but it is not necessary for just this conversion. You can also stick with the stock carburetor if you desire, but if it's a Carter I would suggest at least rebuilding it to make sure nothing's clogged up. Not too difficult to do with a $20 kit.
All in all, it will probably cost $300-$500, depending mostly on how cheap you can get the cylinder head for. Start your search at the junk yard or the 'List site. Hot tank at your local shop would probably be another $20 or $30, machining maybe $100 or so?
The write-up on the Eaglepedia is nice, but it is way too cluttered and confusing for those just looking to do the head swap without fuel injection. It could also use some more pictures to be less confusing.