Can I not cap off the valve and add a shower arm and head or tub filler?

Yes, there are many options to consider:

Here are the product category links to our selections:
Tub Spout - Tub filler
Shower Arms & Shower Heads
Slider Bar Mount with Matching Hose and Handheld Shower

Brass plug for single-handle and two-handles faucet.