Just to clarify, you will be connecting the positive side of the cap to the positive pole of the battery. The negative side of the cap will be connected to negative pole of the battery. Generally, an electrolytic cap will have it's positive pin longer than the negative.
And yes, a high voltage, high capacitance capacitor can potentially shock someone.