Background: While clinical trials have demonstrated the benefits of structured exercise for prostate cancer survivors, few attempts have been made to investigate and implement sustainable community-based exercise programs supporting adoption of long-term physical activity behavior. Against this background, the aims of this study was to explore the perspectives of experts and stakeholders on the development of a training course and intervention manual used to support the delivery of community-based soccer training in men with prostate cancer (the FC Prostate Community [FCPC] trial). Methods: A two-step qualitative design including triangulation of methods, data sources, and researchers. Step 1 comprised key informant interviews with clinical and scientific experts (n = 4). Step 2 included stakeholder focus group interviews with nurses (n = 5), non-professional soccer coaches and club representatives (n = 5), and prostate cancer survivors (n = 7). Results: Four themes emerged from the analysis of the key informant interviews: The Coach’s Qualifications, Structure of the Training, Prevention of Injuries, and A Non-Patient Environment, which informed development of the training course and intervention manual. The stakeholders added the importance of clarifying the Responsibility of the Coach, the value of Positive Competition, and Social Inclusion of the prostate cancer survivors in the club. Based on these results, we present the final templates for the training course and intervention manual. Conclusions: No general set of rules or safety measures to promote or optimize the delivery of community-based exercise in cancer survivors is recommended. However, the general principles related to the necessary clarification of the coach’s responsibility in relation to the prevention and management of injuries and participant adherence through a non-patient environment may be transferable to the training and education of other groups of lay persons in charge of delivering exercise interventions to other clinical subpopulations in a non-hospital setting.