Lethal prostate cancer (PCa) is characterized by the presence of metastases and development of resistance to therapies. Metastases form in a multi-step process enabled by dynamic cytoskeleton remodeling. An actin cytoskeleton regulating gene, CALD1, encodes a protein caldesmon (CaD). Its isoform, low-molecular-weight CaD (l-CaD), operates in non-muscle cells, supporting the function of filaments involved in force production and mechanosensing. Several factors, including glucocorticoid receptor (GR), have been identified as regulators of l-CaD in different cell types, but the regulation of l-CaD in PCa has not been defined. PCa develops resistance in response to therapeutic inhibition of androgen signaling by multiple strategies. Known strategies include androgen receptor (AR) alterations, modified steroid synthesis, and bypassing AR signaling, for example, by GR upregulation. Here, we report that in vitro downregulation of l-CaD promotes epithelial phenotype and reduces spheroid growth in 3D, which is reflected in vivo in reduced formation of metastases in zebrafish PCa xenografts. In accordance, CALD1 mRNA expression correlates with epithelial-to-mesenchymal transition (EMT) transcripts in PCa patients. We also show that CALD1 is highly co-expressed with GR in multiple PCa data sets, and GR activation upregulates l-CaD in vitro. Moreover, GR upregulation associates with increased l-CaD expression after the development of resistance to antiandrogen therapy in PCa xenograft mouse models. In summary, GR-regulated l-CaD plays a role in forming PCa metastases, being clinically relevant when antiandrogen resistance is attained by the means of bypassing AR signaling by GR upregulation.