While many prostate cancer (PCa) cases remain indolent and treatable, others are aggressive and progress to the metastatic stage where there are limited curative therapies. Androgen receptor (AR) signaling remains an important pathway for proliferative and survival programs in PCa, making disruption of AR signaling a viable therapy option. However, most patients develop resistance to AR-targeted therapies or inherently never respond. The field has turned to PCa genomics to aid in stratifying high risk patients, and to better understand the mechanisms driving aggressive PCa and therapy resistance. While alterations to the AR gene itself occur at later stages, genomic changes at the primary stage can affect the AR axis and impact response to AR-directed therapies. Here, we review common genomic alterations in primary PCa and their influence on AR function and activity. Through a meta-analysis of multiple independent primary PCa databases, we also identified subtypes of significantly co-occurring alterations and examined their combinatorial effects on the AR axis. Further, we discussed the subsequent implications for response to AR-targeted therapies and other treatments. We identified multiple primary PCa genomic subtypes, and given their differing effects on AR activity, patient tumor genetics may be an important stratifying factor for AR therapy resistance.