Recent experiments on UPt3 indicate the existence of more than one superconducting phase and an associated unconventional order parameter belonging to a nontrivial representation of the crystal point group D6h. In this article we consider the Ginzburg-Landau (GL) theory for the vortex states in the two-dimensional E1 representation for the order parameter, the representation believed to describe the phases of UPt3. One of the zero-field superconducting phases is predicted to break time-reversal symmetry. We show that the lower critical field for vortex nucleation in a ground state with broken time-reversal symmetry exhibits a novel asymmetry. Observation of this asymmetry in any superconductor would provide clear evidence for an unconventional order parameter. We present solutions to the GL equations for singly quantized vortices. For rectilinear vortices along the c axis two classes of solutions are found: (i) axially symmetric vortices and (ii) non-axisymmetric vortices which spontaneously break the axial symmetry of the condensate density. We discuss the structure of these vortices, their relation to the asymmetry of Hc1, the possibility of phase transitions between vortex states of different symmetry, and the phase diagram of UPt3 in the H-T plane.