Take 3x5 index cards to caucus with you! (bump!!!)
In Colorado, they ran out of ballots for both the Presidential Preference Poll, and the Delegate elections. I would suggest every precinct leader to take a stack of 100 3x5 index cards with you to your caucus -- so people can vote via secret ballot as suggested. There is alot of peer pressure from the Romney supporters if there is a vote by a show of hands!
bump - we're a primary down here, but I could imagine the chaos/uncertainty this would cause at caucus.