A series of chiral peptide luminophores containing the coumarin moiety was synthesized via a simple and efficient solution-based procedure. The peptides, containing either L-Phe, or L-Ala, or L-Leu (designated, respectively, as p1, p2, and p3), self-aggregate to form anti-parallel sheet-like structures. The self-assembly of the peptide luminophores leads to non-centrosymmetric crystals which display significant second harmonic generation (SHG). The dependence of the SHG intensity on the input laser polarization revealed a strong correlation between the SHG and the crystal packing. In the polar plots, the SHG intensity as a function of the linear polarization orientation of the input laser beam gave a four-petal pattern for p1, a predominantly two-petal pattern for p2, and a dumbbell-shaped pattern for p3. This reflects the dependence of the second order optical susceptibility tensor on the crystal symmetry. The polar plots can be fitted very well with the theoretical expressions derived from the second order polarization equation after incorporating crystal symmetry in the second order optical susceptibility tensor. The strong polarization-dependent SHG from organic crystals may be interesting for polarization controlled nonlinear optical switches, sensors, and actuators.