The formation of well-ordered fibrillar protein deposits is common to a large group of amyloid-associated disorders. This group consists of several major human diseases such as Alzheimer's disease, Parkinson's disease, prion diseases, and type II diabetes. Currently, there is no approved therapeutic agent directed towards the formation of fibrillar assemblies, which have been recently shown to have a key role in the cytotoxic nature of amyloidogenic proteins. One important approach in the development of therapeutic agents is the use of small molecules that specifically and efficiently inhibit the aggregation process. Several small polyphenol molecules have been demonstrated to remarkably inhibit the formation of fibrillar assemblies in vitro and their associated cytotoxicity. Yet, the inhibition mechanism was mostly attributed to the antioxidative properties of these polyphenol compounds. Based on several observations demonstrating that polyphenols are capable of inhibiting amyloid fibril formation in vitro, regardless of oxidative conditions, and in view of their structural similarities we suggest an additional mechanism of action. This mechanism is assuming structural constraints and specific aromatic interactions, which direct polyphenol inhibitors to the amyloidogenic core. This proposed mechanism is highly relevant for future de novo inhibitors' design as therapeutic agents for the treatment of amyloid-associated diseases.