Background: Pharmacology-based target identification has become a novel strategy leading to the discovery of novel pathological biomarkers. Ellagic acid (EA), a dietary polyphenol compound, exhibits potent anticancer activities; however, the underlying mechanisms remain unclear. The current study sought to determine the role and regulation of ACTN4 expression in human breast cancer metastasis and EA-based therapy. Methods: The anti-metastasis ability of EA was validated by MMTV-PyMT mice and in vitro cell models. Drug affinity responsive target stability (DARTS) was utilized to identify ACTN4 as the direct target of EA. The metastatic regulated function of ACTN4 were assessed by cancer stem cells (CSCs)-related assays, including mammosphere formation, tumorigenic ability, reattachment differentiation, and signaling pathway analysis. The mechanisms of ACTN4 on beta-catenin stabilization were investigated by western blotting, co-immunoprecipitation and ubiquitination assays. The clinical significance of ACTN4 was based on human tissue microarray (TMA) analysis and The Cancer Genome Atlas (TCGA) database exploration. Results: EA inhibited breast cancer growth and metastasis via directly targeting ACTN4 in vitro and in vivo, and was accompanied by a limited CSC population. ACTN4 knockdown resulted in the blockage of malignant cell proliferation, colony formation, and ameliorated metastasis potency. ACTN4-positive CSCs exhibited a higher ESA(+) proportion, increased mammosphere-formation ability, and enhanced in vivo tumorigenesis ability. Mechanism exploration revealed that interruption of ACTN4/beta-catenin interaction will result in the activation of beta-catenin proteasome degradation. Increased ACTN4 expression was directly associated with the advanced cancer stage, an increased incidence of metastasis, and poor overall survival period. Conclusions: Taken together, our results suggest that ACTN4 plays an important role in breast CSCs-related metastasis and is a novel therapeutic target of EA treatment.