Can you draw a picture for me:yes: I think I know what you are talking about but really suck at visualizing
I was going to do a sketch then decided on a quick prototype.
The Jharris2 style is easy, but it will only push the fence forward. If you push too far, then you have to unscrew, reset the fence and start to push again.
An alternate design is to be able to push or pull the fence. This needs the threaded rod/screw to be able to swivel at the end.
I mentioned a "U" to hold the end of the threaded rod/screw and allow space for the swivel. A very quick and easy swivel. Not pretty but functional.
This is a piece of scrap from the shop. Imagine this is one side of the "U".
I drilled a 3/32in hole in a piece of threaded rod, an offcut from another project.
I use a small hitch pin in the hole and a washer behind the hitch pin.
On the back side I used two nuts tightened against each other. The nuts would be adjusted to minimize slop/backlash, but not too tight since we need the rod to swivel.
I am showing a connection nut, also called coupler nut, just to provide more area for clamping or gluing.
I added a lock nut at the end. This is a nut with a plastic collar. Showing a rachet wrench in lieu of a knob.
I hope this helps you understand the suggestion.