Amyloid-like fibrous crystals formed by the peptide KFFEAAAKKFFE have been previously characterized and provide an ideal model system to examine the importance of specific interactions by introducing specific substitutions. We find that the removal of any phenylalanine residue completely abrogates assembly ability, while charged residues modulate interactions within the structure resulting in alternative fibrillar morphologies. X-ray fiber diffraction analysis reveals that the essential backbone packing of the peptide molecules is maintained, while small changes accommodate differences in side chain size in the variants. We conclude that even very short peptides are adaptable and add to the growing knowledge regarding amyloid polymorphisms. Additionally, this work impacts on our understanding of the importance of residue composition for amyloidogenic peptides, in particular the roles of electrostatic, aromatic, and hydrophobic interactions in amyloid assembly.