Abstract
Ehsan Malek1,2, James J. Driscoll2,3,4
1Case Western Reserve University School of Medicine, Cleveland, OH, USA
2Division of Hematology and Oncology, University of Cincinnati College of Medicine, Cincinnati, OH, USA
3The Vontz Center for Molecular Studies, University of Cincinnati College of Medicine, Cincinnati, OH, USA
4University of Cincinnati Cancer Institute, Cincinnati, OH, USA
Correspondence to:
James J. Driscoll, email: [email protected]
Keywords: phosphatidylinositol 3-kinase, p110-delta, multiple myeloma, proteasome, bortezomib resistance
Received: February 25, 2016 Accepted: May 04, 2016 Published: May 24, 2016
ABSTRACT
Multiple myeloma (MM) remains an incurable plasma cell malignancy and drug resistance persists as the major cause of treatment failure leading to fatal outcomes. The phosphatidyl-inositol-3-kinase (PI3K) pathway is constitutively hyperactivated in MM to promote disease progression and drug resistance. While inhibiting PI3K induces apoptosis in MM and is predicted to increase tumor susceptibility to anticancer therapy, early-generation pan-PI3K inhibitors display poor clinical efficacy as well as intolerable side effects. Here, we found that PI3K activity is significantly upregulated in MM cell lines and patient tumor cells resistant to bortezomib and that the majority of PI3K activity in MM cells is dependent upon the p110-δ isoform. Genetic or pharmacologic inhibition of p110-δ substantially reduced myeloma viability and enhanced cellular sensitivity to bortezomib. Chemical library screens then identified a novel compound, DT97, that potently inhibited p110-δ kinase activity and induced apoptosis in MM cells. DT97 was evaluated in the NCI-60 panel of human cancer cell types and anticancer activity was greatest against MM, leukemia and lymphoma cells. Co-treatment with DT97 and bortezomib synergistically induced apoptosis in MM patient cells and overcame bortezomib-resistance. Although bone marrow stromal cells (BMSCs) promote MM growth, the pro-survival effects of BMSCs were significantly reduced by DT97 treatment. Co-treatment with bortezomib and DT97 reduced the growth of myeloma xenotransplants in murine models and prolonged host survival. Taken together, the results provide the basis for further clinical evaluation of p110-δ inhibitors, as monotherapy or in synergistic combinations, for the benefit of MM patients.
INTRODUCTION
Despite recent advances in understanding myelomagenesis and the discovery of proteasome inhibitors (PIs) and immunomodulatory agents, the majority of multiple myeloma (MM) patients continue to have a relapse and MM remains nearly uniformly fatal [1–3]. Drug resistance is a common cause of poor patient outcome, however, the precise mechanisms that underlie drug resistance remain poorly defined and effective strategies to prevent or revert resistance are lacking [4–8]. The phosphatidyl-inositol-3-kinase (PI3K) pathway is hyperactivated in MM cells to create a state of kinase dependency, and consequently, exquisite sensitivity to certain PI3K inhibitors. Controlling key growth-promoting pathways with small molecule drugs is an emerging strategy that can improve treatment of MM patients.
Class I PI3Ks consist of regulatory subunit (p85 or p101) bound to a catalytic subunit of the class 1A (p110-α, -β, and -δ) or class 1B (p110-γ) isoforms [9]. The genes PIK3CA, PIK3CB, PIK3CD and PIK3CG express the PI3K/p110-δ, β, γ and δ isoforms. Expression of p110-γ is largely restricted to leukocytes, whereas the expression of p110-α and p110-β appears ubiquitous. PIK3CA, PIK3CB, PIK3CD or PIK3CG gene mutations in MM cells have not been reported [10–12]. PI3K inhibitors have shown promise in mouse models of cancer and led to the development of multiple agents currently being evaluated in clinical trials. The PI3K isoforms appear to fulfill distinct roles during physiologic and pathologic conditions, suggesting that isoform-specific inhibitors may more target tumor growth [13, 14]. Moreover, pan-PI3K inhibitors have not been successful in clinical studies and have yielded numerous adverse effects in patients. Therefore, inhibitors that are selective for a single PI3K isoform may offer more refined activity with reduced adverse effects. p110-δ has a crucial role in a plethora of leukocyte and B cell functions, including proliferation, antibody secretion, survival and migration [15–18]. Genetic or pharmacologic inactivation of p110-δ demonstrates its critical importance in B-cell signaling and survival [19–23].
We sought to identify small molecules that inhibited p110-δ activity and potentiated the anti-myeloma effect of bortezomib. Our studies were fueled by the remarkable success of the FDA-approved p110-δ inhibitor idelalisib (Zydelig®) that exhibits significant activity for the treatment of chronic lymphocytic leukemia (CLL), relapsed of follicular non-Hodgkin’s lymphoma (NHL) or small lymphocytic lymphoma (SLL) [19]. However, idelalisib is not effective in treating MM and can generate numerous severe, adverse effects [21]. Development of p110-δ inhibitors that overcome the drawbacks associated with current p110-δ-targeting drugs and that are effective in MM patients represents an urgent and unmet need.
RESULTS
PI3K activity is increased in PCs from MM patients relative to those from healthy individuals or MGUS patients
The contribution of PI3K kinase activity in MM remains poorly understood. To investigate the role of PI3K, we directly measured PI3K kinase activity in CD138+ cells that had been isolated from healthy individuals, monoclonal gammopathy of unknown significance (MGUS) or MM patients (Figure 1A). MGUS is a pre-malignant condition that nearly uniformly precedes the development of MM. PI3K kinase activity was directly measured by quantitating production of phosphatidylinositol [3, 4, 5]-trisphosphate (PIP3) using a colorimetric ELISA assay. PI3K activity was greater in PCs from MM patients compared to PCs from MGUS or healthy individuals (Figure 1A).
Figure 1: PI3K catalytic activity in MM cells. (A) Comparison of healthy (normal), MGUS and MM CD138+ cells. PIP3 production was measured using CD138+cells from healthy individuals, MGUS or MM patients. Cells were incubated with substrate and the amount of PIP3 generated quantitated by ELISA according to the manufacturer’s instructions. (B) PIP3 production from CD138+ cells of MM patients that were either clinical responders or non-responders to bortezomib-based therapy. (C) PIP3 production from bortezomib sensitive and resistant MM cells. Each assay contained approximately 10,000 cells. All assays were performed in triplicate, values shown represent the mean and error bars represent the SD.
PI3K activity is increased in bortezomib-resistant MM cells
We then compared PI3K activity in CD138+ cells isolated from MM patients that did or did not respond to bortezomib treatment (Figure 1B). PI3K kinase activity was greater in CD138+ cells from bortezomib non-responders compared to bortezomib responders. RPMI8226 cells resistant to PIs were generated as described [38] and results indicated that PI3K activity was also greater in cells the cells resistant to PIs -resistant cells compared to those that were drug-naïve (Figure 1C).
Genetic inactivation of p110-δ reduces MM growth and sensitizes cells to bortezomib
We determined the effect of shRNA knockdown of individual PI3K isoforms on MM growth. RPMI8226 cells were transfected using shRNA to specifically inactivate the individual p110 isoforms. Knockdown of p110–δ most significantly reduced the growth rate of RPMI8226 MM cells (Figure 2A). The role of p110-δ has been studied in vivo in a p110-δ null mouse and in a p110-δ kinase-dead mouse (p110-δD910A/D910A) [23]. Phenotypic analyses, in vitro and ex vivo studies determined that p110-δ is the predominant PI3K isoform that regulates the B cell phenotype. Moreover, using cells derived from p110-δ kinase-dead mice, it was shown that 90% of the PI3K kinase activity was dependent on p110-δ. Importantly, knockdown of PIK3CD also preferentially sensitized MM cells to proteasome inhibition (Figure 2B).
Figure 2: Effect of p110-δ knockdown on MM cell growth and bortezomib sensitivity. (A) Effect of p110-isoform specific shRNA on MM cell growth. RPMI8226 cells were transfected as indicated, selected in puromycn and cell number counted at indicated times. (B) Effect of p110-isoform specific shRNA on MM cell sensitivtiy to bortezomib. Cells were transfected as indicated, treated with bortezomib and cell viability determined using the XTT assay.
High-throughput screening identifies a novel p110-δ inhibitor
High-throughput screening (HTS) of chemical libraries represents a systematic and inexpensive method to rapidly identify novel compounds that specifically inhibit protein targets that promote or maintain tumor growth. Based upon the comparison of chemical structures for the pan-PI3K inhibitor GSK2126458 and the p110-δ-specific inhibitor CAL-101, we performed virtual screening to identify novel chemical compounds that potentially inhibited p110-δ kinase activity (Figure 3A). Virtual screening of 360,000 compounds in the University of Cincinnati Drug Discovery Library was performed using the Accelrys Pipeline Pilot Software. Similarity searches compared the molecular fingerprints of chemical compounds to those of the pan-PI3K and p110-δ inhibitors. The top 96 compounds identified in the screen were then obtained and tested for ability to reduce the viability of myeloma cells in a cell-based in vitro assay using RPMI8226 cells (Figure 3B). The anti-myeloma effect of the 96 compounds was simultaneously compared to a panel of 68 known PI3K/AKT/mTOR inhibitors. We identified the most potent compounds that exhibited anti-myeloma activity and that also reduced PIP3 production. In this manner, we identified several promising hits with diverse scaffolds that ultimately led to the identification of our lead compound, DT97 (Figure 3C). DT97, (N-[4-hydroxy-3-(8-quinolinylthio)-1-naphthyl]benzenesulfonamide), was the most potent compound that reduced myeloma viability, reduced PIP3 production and that also possessed favorable physico-chemical properties (Figure 3D).
Figure 3: High-throughput screening of chemical compounds to identify novel p110-δ inhibitors. (A) Target structures were searched using 360,000 compounds in the drug discovery library and Accelrys Pipeline Pilot Software. Similarity searches were performed through comparison of molecular fingerprints. The Accelrys Pipeline Pilot (version 8.0.1.600) was used to generate 18 connectivity, 2 pharmacophore and 1 MDLKeys fingerprints for each compound to serve as the basis for comparisons. The two pharmacophore fingerprints were averaged due to strong redundancy, leaving a total of 21 fingerprint types for the analysis. These are circular fingerprints based on substructure environments of a specific length (2, 4, or 6 atoms) centered about each atom of the molecule. Each atom of the molecule generates such an integer string, with each integer representing an atom within x atoms of the initial point. The composite of these strings is a matrix of character strings representing the entire molecule, i.e., the aggregate of the parts is the whole). Different fingerprints have slightly different strengths and weaknesses, so the UC DDC executes each compound search as 21 parallel searches that are combined as shown in the graphic below. (B) Viability of MM cells after treatment with either the 96 compounds identified in the virtual screen or with known commercially-available PI3K inhibitors. (C) Chemical structure of DT97. (D) DT97 physico-chemical properties.
DT97 inhibits p110-δ kinase activity
We next determined the effect of individual p110 isoforms on PI3K kinase activity in RPMI8226 cells. Cells were transfected with isoform-specific shRNA to individually knockdown p110 isoforms, cultured in the presence of puromycin and PIP3 production then measured in the transfected cells (Figure 4A). Results indicated that the knockdown of p110-δ dramatically reduced PIP3 production in RPMI8226 cells, while knockdown of p110-α reduced PIP3 production by ~20%. Knockdown of p110-β and p110–γ had minimal effect on PIP3 production. The results were consistent with prior studies to indicated that the majority of PI3K activity in plasma cells (PCs) is dependent upon p110-δ [22, 23]. The dose-dependent effect of DT97 on PIP3 production by individual p110-isoforms was then determined (Figure 4B). The results indicated that DT97 inhibited the production of PIP3 most potently against the p110-δ isoform and had weaker activity against p110-α and no effect on p110-β or p110-γ. By comparison, idelalisib (formerly CAL-101) predominantly inhibits the p110-δ isoform but also reduces p110-γ activity (Table 1) [32]. DT97 did not significantly inhibit a number of other kinases that have been targeted to treat human cancers (Table 1).
Figure 4: Effect of DT97 on p110-δ kinase activity. (A) Effect of individual p110 isoform knockdown on PIP3 production. RPMI8226 cells were transfected with shRNA to scrambled control or isoforms PIK3CA, PIK3CB, PIK3CG or PIK3CD. PIP3 production was then determined from the transfected cells after puromycin selection. Data points represent the average value from triplicate measurements. (B) Dose-dependent effect of DT97 on purified p110-δ. Assays were performed in triplicate, values represent the mean and error bars represent the SD. (C) Effect of DT97 treatment on RPMI8226 cells after transfection with control shRNA or shRNA specific to individual PIK3C isoforms. Cells were transfected, selected in puromycin and cell viabiltiy determined using the XTT assay. Values represent the average of triplicate measurements. (D) Effect of DT97 and idelalisib on MM and CLL cell viability. The effect of each agent at 1 uM was determined using the XTT assay after treatment for 72 h. Values represent the average of triplicate measurements. (E) Effect of DT97 and idelalisib on apoptosis in MM and CLL cells. The effect of each agent at 1 uM was determined by counting the number of apoptotic cells after 24 h. Values represent the average of triplicate measurements.
Table 1: Inhibitory profile of DT97 and idelalisib
Kinase | DT97 | Idelalisib |
---|---|---|
Class I PI3Ks | ||
p110-α | ++ | + |
p110-β | none | + |
p110-γ | none | ++ |
p110-δ | +++ | +++ |
Class II PI3Ks | ||
PKC2-α | none | none |
PKC2β | + | + |
PKCγ | none | none |
Class III PI3Ks | ||
VPS34 | none | + |
Class IV PI3Ks | ||
DNA-PK | + | + |
mTOR | + | + |
Other Clinically-relevant Kinases | ||
FGFR | none | ND |
PDGFR | none | none |
ERBB2 | + | none |
ERBB4 | + | none |
MAPK | + | ND |
AMPK | + | ND |
Values for the effect of DT97 on kinases were obtained from 10-point concentration assays. Values for idelalisib were obtained from ref. 32. ND indicates that values were not determined. None indicates that significant activity was not detected. Plus signs indicate the activity relative to that of either DT97 or idelalisib.
To more rigorously define the on-target effect of DT97 on MM cytotoxicity, we then demonstrated that PIK3CD knockdown significantly reduced the effect of DT97 on the viability of RPMI8226 cells (Figure 4C). Treatment with DT97 had little effect on RPMI8226 cells after shRNA knockdown of PIK3CD. The in vitro growth inhibitory effect of DT97 on RPMI8226 cells was then determined and compared to that of idelalisib (Figure 4D). DT97 reduced the viability of parental and drug-resistant MM cells more potently than idelalisib. The p110-δ isoform is critical for transformation in CLL and activates the serine (Ser)–threonine (Thr) kinases AKT and mammalian target of rapamycin (mTOR). However, CXCR4, CD40 and CD49d, also play important roles in this process. Idelalisib is a potent, p110-δ inhibitor that is FDA-approved for the treatment of CLL. While idelalisib more effectively reduced the viability of CLL cells, DT97 more potently reduced the viability of MM cells. DT97 treatment generated more apoptotic MM cells than CLL cells while idelalisib had a more potent effect on CLL cells that DT97 (Figure 4E).
DT97 overcomes bortezomib-resistance and inhibits chemotaxis
Results indicated that co-treatment with DT97 and either bortezomib or carfilzomib overcame resistance to PIs (Figure 5A). Importantly, results indicated that DT97 affected drug-resistant RPMI8226 cells but did not induce apoptosis in peripheral blood mononuclear cells (PBMCs) (Figure 5B). BMSCs induce the migration and homing (chemotaxis) of MM cells to BM. To investigate the effect of DT97 on chemotaxis, RPMI8226 cells were labeled using the CellTrace reagent CFSE (5(6)-carboxyfluorescein N-hydroxysuccinimidyl, a cell permeant, pro-dye that permits the tracing single cell types in mixed cell type populations. The CellTrace method employs a bright, single-peak green fluorescent stain that enables visualization of tumor cells co-cultured with BMSCs. CFSE covalently binds intracellular proteins and is well-retained in cells for several days, is non-toxic and does not adversely affect growth. Intracellular esterases in live cells then cleave CFSE-acetate to generate the green fluorescent carboxy-fluorescein. MM cells were placed in the upper chamber separated from BMSCs in the lower chamber by a semi-permeable membrane. DT97 treatment reduced the migration of MM cells into the lower chambers with BMSCs (Figure 5C). We then demonstrated that the culture media from BMSCs (BM sup) also promoted the migration of MM cells and that the effect of BM sup on migration was reduced by DT97 treatment (Figure 5D). In addition, treatment with DT97 did not significantly reduce the viability of BMSCs (Figure 5E). Co-culture of MM cells with BMSCs significantly increased the production of the cytokines Il-6 and CXCR12 but the induction was inhibited by DT97 treatment (Figure 5F, 5G). It appears that DT97 treatment prevents MM migration, in part, through the reduction of cytokine production.
Figure 5: DT97 overcomes bortezomib-resistance and inhibits chemotaxis. (A) MM patient CD138+ PCs or PI-resistant MM cells were incubated with bortezomib and DT97 at the indicated concentrations. Cell viability was determined using the XTT assay. (B) MM cells and PBMCs were incubated with bortezomib and DT97 as indicated. Cells were treated as indicated and apoptotic cells counted using the Roche in situ cell death detection kit. (C) MM patient PCs were CFSE-labeled, placed in the upper chamber and BMSCs in the lower chamber. CFSE-labeled MM cells that migrated to the lower chamber were then counted at 72 h. All assays were performed in triplicate. Values represent the arithmetic mean. Error bars represent the standard deviation. (D) Effect of BM sup on the migration of MM cells. Shown is the relative number of MM cells that migrated through transwells with given supplement or treatment. Values represent the arithmetic mean of triplicate measurements. Error bars represent the standard deviation (E) Effect of DT97 on BMSCs. After treatment at the given concentration for 72 h, viability was determined using the XTT assay. Values represent the arithmetic mean of triplicate measurements. Error bars represent the standard deviation. (F) Effect of DT97 on IL-6 production. After the given treatments, the Quantikine Human IL-6 Immunoassay (R&D Systems, Minneapolis, MN) that employs a solid phase sandwish ELISA was used to measure IL-6 in cell culture supernates, according to the manufacturer’s instructions. (G) Effect of DT97 on CXCR12 production. After the given treatments, the Human CXCL12/SDF-1 alpha Quantikine ELISA kit (R&D Systems, Minneapolis, MN) was used to measure CXCL12 in cell culture supernates, according to the manufacturer’s instructions.
Efficacy of DT97 against other cancer cell types
The anticancer effect of DT97 was externally validated using the NCI-60 panel of human cancer cells (Figure 6). The anticancer efficacy of DT97 prioritized to MM, leukemia and lymphoma cancer cell lines (Table 2). The most potent effect was seen in the MM cell line RPMI8226 (IC50 ~450 nM).
Figure 6: Evaluation of DT97 in the NCI-60 panel. The anticancer effect of DT97 in different cancer types was independently determined at the NCI in the Developmental Therapeutics Program. DT97 was tested at the indicated concentrations using the NCI-60 panel of 60 different human solid tumor and blood cancer cell lines to determine the effect on cell growth.
Table 2: Sensitivity of cell lines in the NCI-60 panel to DT97
The anti-tumor screening was performed at the National Cancer Institute (NCI) Developmental Therapeutics Program (DTP), Bethesda, Maryland. Compounds were subjected to the NCI’s in vitro disease-oriented human cells screening panel assay. 60 cell lines of nine tumor subpanels were incubated with five concentrations (0.01–100 mM) of DT97 to create log concentration vs % growth inhibition curves. Three response parameters, median growth inhibition (GI50), total growth inhibition (TGI) and median lethal concentration (LC50), were calculated for each cell line. The GI50 value corresponds to the compound’s concentration causing 50% decrease in net cell growth, the TGI value is the compound’s concentration resulting in total growth inhibition and the LC50 value is the compound’s concentration causing a net 50% loss of initial cells at the end of the incubation period.
Efficacy of DT97 to induce apoptosis
IC50 values for DT97 determined using blood cancer cell lines ranged from 300 to 500 nM (Figure 7A). MM cells were treated with DT97, annexin-positive cells quantitated by flow cytometry and results analyzed using Compusyn software (Figure 7B). The Chou-Talalay theorem quantitatively determines the effect of two drugs added together by determining a combination index (CI). By definition, CI = 1 reflects an additive effect, CI < 1 reflects drug synergism and CI > 1 reflects drug antagonism [24–26]. Co-treatment with DT97 and bortezomib synergistically increased the number of apoptotic cells. CI values for bortezomib at 3 nM and DT97 added at 100, 200 or 300 nM were < 1 indicating that the effect of this combination was synergistic. AKT and ERK1/2 are downstream targets of PI3K. DT97 treatment reduced the phosphorylation of AKT at Ser308/Thr473 and ERK1/2 at Thre202/Tyr-204 (Figure 7C).
Figure 7: Induction of apoptosis in different hematologic cancer cell lines. (A) Relative number of annexin-positive cells detected after treatment with DT97 and bortezomib at indicated concentrations. Error bars represent the SD. (B) IC50 values for DT97 against 12 hematologic cancer cell lines. The effect of DT97 on cell viability was determined using the XTT assay. Values represent the arithmetic mean and error bars represent the SD. (C) Effect of DT97 on AKT and ERK phosphorylation. MM cells were treated with DT97 at 500 nm or 1 uM for 48 h and lysates probed using the following antibodies: pan-AKT (Cell Signaling Technology CST4658), phospho-AKT Thr308 (CST4056), phospho-AKT Ser473 (CST3787), total ERK1/2 (pp44/42 MAPK, CST4695) and the phospho-ERK1/2 Thr202/Tyr204 (CST4370).
Effect of DT97 on MM patient tumor cells co-cultured with BMSCs
A major reason that PI3K inhibitors have been unsuccessful in the clinic may be attributed to a lack of therapeutic efficacy within the tumor microenvironment. CFSE-labeled MM cells were grown in culture with BMSCs and the number of CFSE-positive cells counted at 72 h. The number of RPMI8226 cells was greater in the fraction grown with BMSCs than those grown cells alone (Figure 8A). MM cells grown with BMSCs were also less sensitive to bortezomib than those MM cells cultured alone (Figure 8B). RPMI8226 cells grown with BMSCs were treated with bortezomib, DT97 or both as indicated (Figure 8C). Importantly, CFSE-labeled MM cells grown together with BMSCs were more sensitive to co-treatment with both agents than with either agent alone.
Figure 8: Effect of DT97 on MM cells in the presence of BMSCs. (A) Effect of BMSCs on the growth of MM cells. RPMI8226 cells were labeled with CellTrace, and cultured alone or with BMSCs. The number green cells was then counted by confocal microscopy. Values represent the arithmetic mean and error bars represent the SD. (B) Effect of DT97 on bortezomib sensitivity in the presence of BMSCs. RPMI8226 cells were labeled with CellTrace, and cultured alone or with BMSCs. Cells were then treated with borteomib at indicated concentrations and the number of green cells counted at 72 h. (C) Effect of DT97 on MM cells alone or with bortezomib in the presence of DT97. RPMI8226 cells were labeled with CellTrace, treated as indicated and cultured alone or with BMSCs. RPMI8226 cells were cultured alone (lane 1) or with BMSCs (lanes 2–9). Cells were treated as follows: lanes 1, 2- no addition, lane 3- bortezomib 1 nM, lane 4-bortezomib 3 nM, lane 5- bortezomib 5 nM, lane 6- DT97 250 nM, lane 7- bortezomib 3 nM and DT97 250 nM, lane 8- bortezomib 5 nM and DT97 250 nM. Cells were then treated as indicated and the number of green cells counted at 72 h. Assays were performed in triplicate, values represent the arithmetic mean, error bars represent the SD.
In vivo effect of DT97 as monotherapy and in combination with bortezomib
Five week old nude mice flanks are injected subcutaneously with MM.1S myeloma cells. Tumors formed within two weeks and mice were then treated intravenously with vehicle, bortezomib, DT97 or both bortezomib and DT97. Treatment with bortezomib alone or bortezomib with DT97 dramatically reduced tumor growth (Figure 9A). Kaplan-Meier survival analysis indicated that treatment with bortezomib and DT97 also improved overall survival (OS) relative those mice treated with vehicle, DT97 or bortezomib alone (Figure 9B). OS for untreated mice was 14 days, DT97 treatment alone was 16 days, bortezomib alone was 20 days and DT97+bortezomib was 23 days (p < 0.05).
Figure 9: Effect of DT97 and bortezomib on tumor growth and overall survival. (A) Effect of DT97 on growth of MM tumors in vivo. Subcutaneous tumors were generated after injection of myeloma cells. Mice were randomly distributed into four groups (7/group) and received intravenous injection of vehicle (PBS containing 10% DMSO); bortezomib (0.5 mg/kg in PBS, 10% DMSO), DT97 (10 mg/ml diluted in PBS) or both DT97 and Bortezomib. Vehicle or bortezomib was administered on days 1, 4, 8 and 11. Mice were euthanized when tumors reached 2 cm3, became ulcerated or elicited neurologic or musculoskeletal complications that limited mobility and feeding. Survival and tumor growth were evaluated from the first day of treatment. Shown is the average of replicate measurements. (B) Effect of DT97 on OS. Kaplan-Meier survival curves comparison of NOD. SCID mice after subcutaneous injection of parental myeloma cells treated with vehicle, DT97, bortezomib or both.
Publically available datasets were analyzed to compare expression of the different p110 isoforms in MGUS, Smoldering MM (SMM) and MM versus healthy PCs (Figure 10). Dataset GDS4968 compared expression of p110 isoforms from PCs of healthy individuals, MGUS, SMM and MM patients [27]. Importantly, the expression of PIK3CA, PIK3CB and PIK3CG was actually lower in PCs from MM patients than in healthy PCs. The only PIK3C isoform expressed at greater levels in PCs from MM patients compared to healthy individuals was PIK3CD. These findings support the importance of targeting the p110-δ isoform in MM. In addition, dataset GDS2643 was analyzed to compare PIK3CD expression in B lymphocytes and PCs from healthy, Waldenstrom’s Macroglobulinemia (WM), CLL and MM patients [28] (Figure 11A). Again, PIK3CD expression was greater in PCs from MM patients than from healthy individuals. PIK3CD expression was also greater in B lymphocytes and PCs isolated from WM patients than from healthy individuals. Moreover, we found that the mean expression of PIK3CD was actually lower in B lymphocytes from CLL patients than in B lymphocytes isolated from healthy individuals. Analysis of dataset GDS4167 also supported the finding that PIK3CD expression was greater in healthy B cells than those from CLL patients [29] (Figure 11B).
Figure 10: PIK3C isoform expression in normal, MGUS, SMM and MM patients. The relative expression of each PI3K p110 isoform was determined using dataset GDS4968 in which bone marrow PCs were isolated from patients with monoclonal gammopathy of undetermined significance (MGUS), smoldering multiple myeloma (MM), or MM. The median-centered average of expression is indicated with the dashed line.
Figure 11: (A) Comparison of PIK3C isoform expression in normal, WM, CLL and MM patients. The relative expression of the PIK3CD isoform was determined using dataset GDS2643 in which B lymphocytes and PCs were isolated from normal patients or those diagnosed with WM, CLL or MM. The median-centered average of expression is indicated with the dashed line. (B) Comparison of PIK3C isoform expression in B lymphocytes from normal individuals and CLL patients. The relative expression of the PIK3CD isoform was determined using dataset GDS4167 in which B lymphocytes were isolated from normal patients or those diagnosed with CLL. The dashed line indicates the edian-centered average of expression.
DISCUSSION
Despite the introduction of PIs and immunomodulatory agents into the clinic, MM remains incurable. While most patients initially respond to PIs, drug resistance emerges and represents the primary factor for treatment failure. Despite the availability of numerous salvage regimens, once drug resistance has emerged, median survival is less than one year. Only ~25% of MM patients respond to bortezomib or carfilzomib when administered as monotherapy, leaving substantial room for improvement. Each PI3K isoform fulfill a unique role in cancer and has prompted development of isoform-selective inhibitors. The lack of efficacy of idelalisib in MM, as well as in acute myeloid leukemia and myeloproliferative neoplasms, is attributed to a highly variable p110-δ active site and a high degree of conformational flexibility that leads to poor inhibitor binding. Structures of p110-δ in complex with a broad panel of isoform- and pan-selective PI3K inhibitors revealed that selectivity toward p110-δ can be achieved by exploiting the sequence diversity and conformational flexibility of the p110-δ active site [11, 30–32]. We used these observations to rationalize the design of a selective p110-δ inhibitor with greatly improved potencies to treat MM. An important downstream effector of PI3K is the Ser/Thr protein kinase AKT, which is activated by phosphorylation of Thr308 and Ser473. DT97 treatment of MM cells reduced AKT phosphorylation at both sites. Previously, AKT phosphorylation was shown to be a major determinant of bortezomib sensitivity [33]. In related studies, bortezomib treatment downregulated phospho-AKT levels in drug sensitive hepatocellular carcinoma cells (HCC) but no alterations of phospho-AKT were observed in drug resistant HCC cells. We speculate that DT97 reduces AKT phosphorylation to overcome drug resistance. Future studies will further investigate the role of DT97 in AKT signaling in MM tumor cells.
Related studies also indicate that treatment of hematologic cancer cells with proteasome inhibitors activates Bruton tyrosine kinase (BTK) [34]. Bortezomib co-treatment with the BTK inhibitor ibrutinib in drug-resistant lymphoma also led to AKT inactivation [35]. The BM microenvironment has also been proposed to promote drug resistance and DT97 treatment effectively reduced MM growth and enhanced the anti-myeloma effect of bortezomib in presence of BMSCs [36]. In summary, we identified a novel small molecule that inhibits p110-δ activity to reduce MM growth and that holds promise for lead compound optimization, pharmacokinetic studies and early phase clinical trials. Combination of DT97 with existing therapies is a rational strategy to improve MM treatment.
MATERIALS AND METHODS
Myeloma cell lines and patient tumor cells
MM cell lines (ATCC, Manassas, VA) were cultured in complete RPMI-1640 medium supplemented with fetal calf serum (Hyclone), penicillin-streptomycin, L-glutamine, sodium pyruvate and β-mercaptoethanol (Sigma-Aldrich, St. Louis, MO). AMCL1, AMCL2, leukemic, lymphoma and Waldenström’s macroglobulinemia cell lines were cultured as described [37, 38]. Bortezomib and carfilzomib were from Selleck Chemicals (Houston, TX). Human bone marrow stromal cell line HS-5 (ATCC) was cultured in DMEM. Patient bone marrow aspirates were obtained after Institutional Review Board approval or from ConversantBio (Huntsville, AL) and CD138+ cells then isolated by microbead selection (Miltenyi Biotec, San Diego, CA). Cells were cultured at 37°C in humidified atmosphere containing 5% CO2.
XTT viability assay
Cells were plated, treated as indicated for 72 h and 2, 3-bis-(2-methoxy-4-nitro-5-sulfophenyl)-2H-tetrazolium-5-carboxanilide) added (Sigma-Aldrich) after activation with N-methyl dibenzopyrazine methyl sulfate (Sigma-Aldrich). Absorbance was measured and the effect on myeloma viability determined as previously described [37–39]. Assays were performed in triplicate and the mean and standard deviation determined. Relative cell viability (mean ± SD) was calculated compared to readings from untreated cells.
Apoptosis assay
Cells were treated as indicated and incubated for 18 h at 37°C. Cells were collected, centrifuged at 200 × g for 5 min, supernatant discarded and the pellet was washed with 1× buffer. Cells were then resuspended in 90 μl of 1 × buffer and 10 μl of FITC-conjugated annexin V (Molecular Probes®, Grand Island, NY), incubated in the dark and analyzed using a Coulter® epics® XL-MCL.
Generation of PI-resistant cell lines
RPMI8226 cells were grown under standard conditions and exposed to successively increased concentrations of the PIs bortezomib, carfilzomib or ixazomib over 6 months to generate PI-resistant cells. As controls, parental cells were exposed to DMSO vehicle under the same algorithm as resistant cells.
PIK3C isoform knockdown
shRNA in pLKO.1-TCR lentiviral cloning vectors were transfected into 293T packaging cells with packaging and envelope vector using lipofectamine 2000 (Thermo-Fisher). Viral supernatants were used to transduce myeloma cells. After 48 h, virus was collected and RPMI8226 cells transduced with vectors expressing scrambled (control) or p110-specific shRNA. Cells were mixed with virus and polybrene (8 μg/mL), centrifuged at 2000 × rpm for 90 min, incubated overnight, media changed and selected in puromycin.
Quantitation of PI3K activity
To directly assess PI3K activity, PI3K was isolated by immunoprecipitation using an antibody to the p85 adapter subunit and the ability of the co-precipitated catalytic p110 subunit to convert PIP2 to PIP3 in a kinase reaction assessed by measuring the amount of PIP3 generated using a competitive ELISA [40, 41]. 1 × 106 cells were washed thrice with 137 mM NaCl, 20 mM Tris-HCl pH 7.4, 1 mM CaCl2, 1 mM MgCl2, 0.1 mM Na orthovanadate (Sigma) (buffer A) and lysed in 1 mL of the same supplemented with 1 mM phenylmethylsulphonyl fluoride (PMSF) (Sigma) and 1% nonyl phenoxylpolyethoxylethanol (NP40) (Calbiochem, Darmstadt, Germany) for 20 min on ice. Lysates were centrifuged at 13,000 × rpm for 10 min and supernatants stored at −80°C. Frozen lysates were thawed and PI3K immunoprecipitated with 5 μl anti-PI3K p85 (Cell Signaling Technology, Danvers, MA) for 1 h at 4°C, followed by the addition of 60 μl of a 50% slurry of Protein A agarose beads for 1 h at 4°C. The immunoprecipitate was collected by centrifugation at 13,000 × rpm for 10 sec, washed 3 times in buffer A + 1% NP40, thrice with 0.1 M Tris-HCl, pH 7.4, 5 mM LiCl, 0.1 mM Na orthovanadate and twice with 10 mM Tris-HCl, pH 7.4, 150 mM NaCl, 5 mM ethylenediaminetetraacetic acid (EDTA), 0.1 mM Na orthovanadate. Pellets resuspended in 110 μl of the kinase reaction buffer containing 4-(2-hydroxyethyl)-1-piperazineethanesulfonic acid (HEPES) pH 7.0, 2.5 mM MgCl2, 25 μM ATP. Reactions were incubated for 3 h at 37°C with 40 pmol PIP2 (Echelon Biosciences, Salt Lake City, UT). Reactions were stopped with EDTA (5 mM) and centrifuged at 13,000 × rpm at 4°C. Supernatants were transferred to a microtitre plate for a competitive ELISA (Echelon Biosciences) to quantify PIP3 generated. Triplicate reactions were incubated with anti-PIP3 antibody for 1 h at room temperature. Reactions were then transferred to plates coated with PIP3 and incubated for 1 h. After 3 washes with TBS + 0.05% Tween20 (TBST), 100 μl horseradish peroxidase (HRP)-conjugated antibody to the anti-PIP3 was added and incubation continued for 1 h in the dark. Following 3 washes with TBST, 100 μl of tetramethyl benzidine (TMB) substrate was added and reactions were stopped after 20 min with 100 μl 0.5 M H2SO4. Absorbance was measured (450 nm) and PIP3 quantified using a standard curve generated with experimental samples and plotted on a log scale.
Mouse xenograft models of myeloma
To evaluate the anti-myeloma effect of DT97 in vivo, 5–6 week old female athymic NCr (nu/nu) mice (Charles River, Frederick, MD) were injected subcutaneously with 2 × 106 KMS28BM cells in serum-free medium. After tumors were detected (> 50 mm3), mice were randomized to 4 groups (7/group). Mice received intravenous injection of either vehicle (PBS in 10% DMSO); bortezomib (0.5 mg/kg), DT97 (10 mg/kg) or both bortezomib and DT97. Tumor volume (TV) measurements were made using a vernier caliper and calculated using the formula: TV = 0.5 (a × b2) where a is the long diameter and b the short diameter. Mice were euthanized when tumors reached 2 cm3, became ulcerated or elicited neurologic or musculoskeletal complications that limited mobility and feeding.
Biostatistical analysis
In vitro assays were performed in triplicate and data presented are mean ± S.D. of independent experiments performed. Statistical significance of differences (SD) was determined using the Student t and ANOVA tests with a minimal level of significance of P < 0.05. In vivo statistical tests were performed using the 2-tailed Student t test. Overall survival (OS) was determined using the Kaplan-Meier method with 95% confidence intervals [42]. Results are presented as the median OS with 95% confidence intervals. Prism Version 5.0 software (GraphPad, La Jolla, CA) was used for statistical analyses.
Drug synergy
The Compusyn software and program was used to determine the effect of drug combinations and general dose-effects and is based on the median-effect principle and the Chou-Talalay Combination Index-Isobologram Theorem (24–26). The Chou-Talalay method for drug combination is based on the median-effect equation, derived from the mass-action law principle, which provides the common link between single entity and multiple entities, and first order and higher order dynamics. This general equation encompasses the Michaelis-Menten, Hill, Henderson-Hasselbalch, and Scatchard equations. The resulting combination index (CI) theorem of Chou-Talalay offers quantitative definition for additive effect (CI = 1), synergism (CI < 1), and antagonism (CI > 1) in drug combinations.
Kaplan-meier analysis
In vivo statistical tests were performed using the 2-tailed Student t test. Median OS was determined using the Kaplan-Meier method with 95% confidence intervals.
ACKNOWLEDGMENTS
The authors acknowledge the support of the University of Cincinnati College of Medicine and the Division of Hematology & Oncology Translational Studies Award.
CONFLICTS OF INTEREST
The authors report no conflicts of interest.
FUNDING
EM was supported partially by an NIH K12 Physician Scientist Award. JD is recipient of the University of Cincinnati Division of Hematology and Oncology Translational Studies Award and the University of Cincinnati Division of Hematology and Oncology Just-in-Time Award.
REFERENCES
1. Becker N. Epidemiology of multiple myeloma. Cancer Res. 2011; 183:25–35. doi: 10.1007/978-3-540-85772-3_2.
2. Kyle RA, Rajkumar SV. Multiple myeloma. N Engl J Med. 2004; 351:1860–73. doi: 10.1056/NEJMra041875.
3. Palumbo A, Anderson K. Multiple myeloma. N Engl J Med. 2011; 364:1046–60. doi: 10.1056/NEJMra1011442.
4. Tai YT, Podar K, Catley L, Tseng YH, Akiyama M, Shringarpure R, Burger R, Hideshima T, Chauhan D, Mitsiades N, Richardson P, Munshi NC, Kahn CR, et al. Insulin-like growth factor-1 induces adhesion and migration in human multiple myeloma cells via activation of beta1-integrin and phosphatidylinositol 3′-kinase/AKT signaling. Cancer Res. 2003; 63:5850–8. PMID: 14522909.
5. Harvey RD, Lonial S. PI3 kinase/AKT pathway as a therapeutic target in multiple myeloma. Future Oncol. 2007; 3:639–47. PMID: 18041916.
6. Sahin I, Moschetta M, Mishima Y, Glavey SV, Tsang B, Azab F, Manier S, Zhang Y, Maiso P, Sacco A, Azab AK, Roccaro AM, Ghobrial IM. Distinct roles of class I PI3K isoforms in multiple myeloma cell survival and dissemination. Blood Cancer Journal. 2014; 4:e204. doi: 10.1038/bcj.2014.24.
7. Ismail SI, Mahmoud IS, Msallam MM, Sughayer MA. Hotspot mutations of PIK3CA and AKT1 genes are absent in multiple myeloma. Leuk Res. 2010; 34:824–26. doi: 10.1016/j.leukres.2009.11.018.
8. Hsu JH, Shi Y, Frost P, Yan H, Hoang B, Sharma S, Gera J, Lichtenstein A. Interleukin-6 activates phosphoinositol-3′ kinase in multiple myeloma tumor cells by signaling through RAS-dependent and, separately, through p85-dependent pathways. Oncogene. 2004; 23:3368–75. doi: 10.1038/sj.onc.1207459.
9. Liu P, Cheng H, Roberts TM, Zhao JJ. Targeting the phosphoinositide 3-kinase pathway in cancer. Nat Rev Drug Discov. 2009; 8:627–44. doi: 10.1038/nrd2926.
10. Engelman JA. Targeting PI3K signaling in cancer: opportunities, challenges and limitations. Nat Rev Cancer. 2009; 9:55–62. doi: 10.1038/nrc2664.
11. Ikeda H, Hideshima T, Fulciniti M, Perrone G, Miura N, Yasui H, Okawa Y, Kiziltepe T, Santo L, Vallet S, Cristea D, Calabrese E, et al. PI3K/p110{delta} is a novel therapeutic target in multiple myeloma. Blood. 2010; 116:1460–8. doi: 10.1182/blood-2009-06-222943.
12. Podar K, Chauhan D, Anderson KC. Bone marrow microenvironment and the identification of new targets for myeloma therapy. Leukemia. 2009; 23:10–24. doi: 10.1038/leu.2008.259.
13. Castillo JJ, Iyengar M, Kuritzky B, Bishop KD. Isotype-specific inhibition of the phosphatidylinositol-3-kinase pathway in hematologic malignancies. OncoTargets and Therapy. 2013; 7:333–42. doi: 10.2147/OTT.S34641.
14. Liu P, Cheng H, Roberts TM, Zhao JJ. Targeting the phosphoinositide 3-kinase pathway in cancer. Nat Rev Drug Discov. 2009; 8:627–44. doi: 10.1038/nrd2926.
15. Katso R, Okkenhaug K, Ahmadi K, White S, Timms JF, Waterfield MD. Cellular function of phosphoinositide 3-kinases: implications for development, homeostasis, and cancer. Annu Rev Cell Dev Biol. 2001; 17:615–75. doi: 10.1146/annurev.cellbio.17.1.615.
16. Chantry D, Vojtek A, Kashishian A, Holtzman DA, Wood C, Gray PW, Cooper JA, Hoekstra MF. p110delta, a novel PI3-K catalytic subunit that associates with p85 and is expressed predominantly in leukocytes. J Biol Chem. 1997; 272:19236–41. doi: 10.1074.
17. Vanhaesebroeck B, Welham MJ, Kotani K, Stein R, Warne PH, Zvelebil MJ, Higashi K, Volinia S, Downward J, Waterfield MD. P110delta, a novel phosphoinositide 3-kinase in leukocytes. Proc Natl Acad Sci. USA. 1997; 94:4330–5. PMID: 9113989.
18. Gopal AK, Kahl BS, de Vos S, Wagner-Johnston ND, Schuster S, Jurczak WJ, Flinn IW, Flowers CR, Martin P, Viardot A, Blum KA, Goy AH, Davies AJ, et al. PI3Kδ inhibition by idelalisib in patients with relapsed indolent lymphoma. N Engl J Med. 2014; 370:1008–18. doi: 10.1056/NEJMoa1314583.
19. Fruman DA, Cantley LC. Idelalisib - a PI3Kδ inhibitor for B-cell cancers. N Engl J Med. 2014; 370:1061–2. doi: 10.1056/NEJMe1400055.
20. Vanhaesebroeck B, Khwaja A. PI3Kδ inhibition hits a sensitive spot in B cell malignancies. Cancer Cell. 2014; 25:269–71. PMID: 24651009.
21. Flinn IW, Furman RR, Brown JR, Lin TS, Bello C, Giese NA. Preliminary evidence of clinical activity in a phase I study of CAL-101, a selective inhibitor of the p110-d isoform of PI3K, in patients with select hematologic malignancies. J Clin Oncol. 2009; 27:(A3543). doi: 10.1186/1741-7015-10-161.
22. Clayton E, Bardi G, Bell SE, Chantry D, Downes C, Gray A, Humphries LA, Rawlings D, Reynolds H, Vigorito E, Turner M. A crucial role for the p110d subunit of phosphatidylinositol 3-kinase in B cell development and activation. J Ex Med. 2002; 196:753–63. PMID: 12235209.
23. Okkenhaug K, Vanhaesebroeck B. PI3K in lymphocyte development, differentiation and activation. Nat Rev Immunol. 2003; 3:317–30. PMID: 2669022.
24. Chou TC. Drug combination studies and their synergy quantification using the Chou-Talalay method. Cancer Res. 2010; 70:440–6. doi: 10.1158/0008-5472.CAN-09-1947.
25. Chou TC. Theoretical basis, experimental design, and computerized simulation of synergism and antagonism in drug combination studies. Pharmacol Rev. 2006; 58:621–81. PMID: 16968952.
26. Chou TC, Talalay P. Quantitative analysis of dose-effect relationships: the combined effects of multiple drugs or enzyme inhibitors. Adv Enzyme Regul. 1984; 22;27–55. PMID: 6382953.
27. López-Corral L, Corchete LA, Sarasquete ME, Mateos MV, Garcia-Sanz R, Ferminan E, Lahuerta JJ, Blade J, Oriol A, Teruel AI, Martino ML, Hernandez J, JM Hernandez-Rivas, Burgillo FJ, et al. Transcriptome analysis reveals molecular profiles associated with evolving steps of monoclonal gammopathies. Haematologica. 2014; 99:1365–72. doi: 10.3324/haematol. 2013.087809.
28. Gutiérrez NC, Ocio EM, de Las Rivas J, Maiso P, Delgado M, Ferminan E, Arcos MJ, Sanchez ML, Hernandez JM, San Miguel JF. Gene expression profiling of B lymphocytes and plasma cells from Waldenström’s macroglobulinemia: comparison with expression patterns of the same cell counterparts from chronic lymphocytic leukemia, multiple myeloma and normal individuals. Leukemia. 2007; 21:541–9. PMID: 17252022.
29. Gutierrez A Jr, Tschumper RC, Wu X, Shanafelt TD, Eckel-Passow J, Huddleston PM, Slager SL, Kay NE, Jelinek DF. LEF-1 is a prosurvival factor in chronic lymphocytic leukemia and is expressed in the preleukemic state of monoclonal B-cell lymphocytosis. Blood. 2010; 21; 116: 2975–83. doi: 10.1182/blood-2010-02-269878.
30. Huang CH, Mandelker D, Schmidt-Kittler O, Samuels Y, Velculescu VE, Kinzler KW, Vogelstein B, Gabelli SB, Amzel LM. The structure of a human p110alpha/p85alpha complex elucidates the effects of oncogenic PI3Kalpha mutations. Science. 2007; 318:1744–8. PMID: 18079394.
31. Williams R, Berndt A, Miller S, Hon WC, Zhang X. Form and flexibility in phosphoinositide 3-kinases. Biochem Soc Trans. 2009; 37:615–26. doi: 10.1042/BST0370615.
32. Lannutti B, Meadows S, Herman S., Kashishian A, Steiner B, Johnson A, Byrd JC, Tyner JW, Loriaux MM, Deininger M, Druker BJ, Puri KD, Ulrich RG, et al. CAL-101, a p110delta selective phosphatidylinositol-3-kinase inhibitor for the treatment of B-cell malignancies, inhibits PI3K signaling and cellular viability. Blood. 2011; 117:591–4. doi: 10.1182/blood-2010-03-275305.
33. Chen KF, Yeh PY, Yeh KH, Lu YS, Huang SY, Cheng AL. Down-regulation of phospho-Akt is a major molecular determinant of bortezomib-induced apoptosis in hepatocellular carcinoma cells. Cancer Res. 2008; 68:6698–707. doi: 10.1158/0008-5472.CAN-08-0257.
34. Dasmahapatra G, Patel H, Dent P, Fisher RI, Friedberg J, Grant S. The Bruton tyrosine kinase (BTK) inhibitor PCI-32765 synergistically increases proteasome inhibitor activity in diffuse large-B cell lymphoma (DLBCL) and mantle cell lymphoma (MCL) cells sensitive or resistant to bortezomib. Br J Haematol. 2013; 161:43–56. doi: 10.1111/bjh.12206.
35. Reagan MR, Mishima Y, Glavey S, Zhang Y, Manier S, Lu ZN, Memarzadeh M, Zhang Y, Sacco A, Aljawai Y, Tai Y-T, Ready JE, Shi J, et al. Investigating osteogenic differentiation in multiple myeloma using a novel 3D bone marrow niche model. Blood. 2014; 124:3250–9. doi: 10.1182/blood-2014-02-558007.
36. Zhang W, Gu Y, Sun Q, Siegel DS, Tolias P, Yang Z, Lee WY, Zilberberg J. Ex Vivo Maintenance of Primary Human Multiple Myeloma Cells through the Optimization of the Osteoblastic Niche. PLoS One. 2015; 10:e0125995. doi: 10.1371/journal.pone.0125995.
37. Jagannathan S, Vad N, Vallabhapurapu Su, Vallabhapurapu Si, Anderson KC, Driscoll JJ. MiR-29b replacement inhibits proteasomes and disrupts aggresome+autophagosome formation to enhance the anti-myeloma benefit of bortezomib. Leukemia. 2015; 29:727–38. doi: 10.1038/leu.2014.279.
38. Jagannathan S, Malek E, Vallabhapurapu Su, Vallabhapurapu Si, Driscoll JJ. Bortezomib induces AMPK-dependent autophagosome formation uncoupled from apoptosis in drug resistant cells. Oncotarget. 2014; 5:12358–70. doi: 10.18632/oncotarget.2590.
39. Abdel Malek M, Jagannathan S, Malek E, Sayed DM, Elgammal SA, Driscoll JJ. Molecular Chaperone GRP78 Enhances Aggresome Delivery to Autophagosomes to Promote Drug Resistance in Multiple Myeloma. Oncotarget. 2015; 6:3098–110. doi:10.18632/oncotarget.3075.
40. Ehrmantrout KK, Branch AM, Neilsen PO, Thompson JE. Nonradioactive Quantification of Phosphoinositide 3-Kinase (PI3K) Products from Breast Cancer Cell Lines. American Society for Cell Biology, Washington, DC. 2007; Abstract #5258.
41. Ehrmantrout KK, Branch AM, Neilsen PO. Quantification of PI3-Kinase Products from Breast Cancer Cell Lines. American Association for Cancer Research (AACR). Denver, CO. 2009; Abstract #1204.
42. Kaplan EL, Meier P. Nonparametric estimation from incomplete observations. J Amer Statist Assn. 1958; 53:457–81. JSTOR 2281868.