Ginsenoside Rh2 (GRh2) and ginsenoside Rg3 (GRg3) are primary bioactive components in Panax ginseng. The present study aimed to investigate the underlying mechanisms of apoptotic cell-death induced by GRh2 and GRg3 in human leukemia Jurkat cells. The Cell Counting kit-8 assay was used to determine cell proliferation. Apoptosis was detected by nuclear morphologic observation by Hoechst 33342 staining and Annexin V-allophycocyanin and 7-amino-actinomycin D assay. mitoTEMPO, a mitochondrial reactive oxygen species (ROS) scavenger, was used to examine the effects of mitochondrial ROS on cell viability and mitochondrial membrane potential (MMP). Finally, the expression levels of numerous mitochondrial-associated apoptosis proteins were assessed by western blot analysis. These results demonstrated that GRh2 and GRg3 inhibited cell growth and induced apoptosis, and that GRh2 had greater cytotoxicity than GRg3. GRh2 induced generation of more mitochondrial ROS compared with GRg3 in Jurkat cells; however, this effect was ameliorated by subsequent treatment with mitoTEMPO. Furthermore, excess mitochondrial ROS induced by GRh2 was more potent than GRg3 in inhibiting cell proliferation and reducing MMP. In addition, expression levels of apoptosis-associated proteins were significantly increased in Jurkat cells treated with GRh2 than GRg3. In conclusion, these findings suggested that GRh2 and GRg3 induce mitochondrial-associated apoptosis by increasing mitochondrial ROS in human leukemia Jurkat cells. GRh2 may more effectively inhibit cell growth and accelerate apoptosis than GRg3. This study provides a potential novel strategy for the treatment of acute lymphoblastic leukemia.