This section identifies and describes the evaluation methodology employed and the role of stakeholders.

Design

A mixed-methods, longitudinal, participatory design will be used. A mixed-methods approach with quantitative and qualitative data is appropriate for evaluations as it provides a range of evidence relevant to program objectives. Concurrent and sequential data collection will be used [31].

Participatory stakeholder groups and roles

There are three stakeholder groups involved, each with distinctive though at times overlapping roles in the evaluation; the evaluation team, young people and Satellite staff. The evaluation team is comprised of university researchers who have individual and collective experience working with young people. Within the team, different staff are responsible for the various project components. The evaluation team leader takes overall responsibility for the project including oversight of the budget and ensuring that ethical processes are followed.

Satellite’s pre-existing Youth Advisory Council (YAC) will be the main way for young people to participate in the evaluation process. The YAC is comprised of 15 young people with lived experience of having family member/s with mental health challenges. The role of the YAC is to shape the work of Satellite by providing input and advice and co-creating programs. They are remunerated for their time by Satellite. Prospective YAC members apply for membership, and are selected by current YAC members, who ensure members have diverse backgrounds and varied exposure to Satellite (some with much, some with little or none).

To provide consistency and continuity, one evaluation team member (RH) will be the primary conduit between the YAC and the evaluation team. It will be their responsibility to work with and support the YAC throughout the evaluation design, interpretation and dissemination process. This team member brings substantial experience working with young people in a participatory manner. Additional evaluation team members will meet with the YAC as relevant throughout the three years. Other young people are involved in the evaluation as participants but also provide feedback on ongoing program development and the evaluation design (see below).

The final group of stakeholders are Satellite staff. They bring a close knowledge of Satellite; its vision aims and approaches, and are responsible for facilitating Satellite programs. Their participation is key to enhancing relevance, ownership and unitization of the findings to inform ongoing program development. Satellite staff will action the implications of the evaluation and make any relevant changes to program content and types.

Initial participatory YAC workshop

A full-day workshop was held with the YAC at the beginning of the project. The day was facilitated by the evaluation team YAC contact (RH), Satellite’s Youth Liaison staff member, the Evaluation lead and co-lead, and other evaluation team members, and attended by the YAC and selected Satellite staff. The workshop was held at a location and at a time that made it easy for participants to attend. To accommodate participants’ capacities, priorities and preferences, including large and small group discussions, various pedagogies were used (e.g. Zoom and face-to-face; large and small group discussion). The language employed aimed to be age-appropriate, non-judgemental and jargon free, using the Mental Health Coordinating Council [32] guide for recovery-oriented language. Consideration of trauma-informed and inclusive principles were incorporated into the physical environment, with the aim of creating a safe and supportive space. To that end, a youth-designed community space was used, in which the sensory impact has been considered and modified (e.g. gentle music, soft lighting, furniture placement that enables connection). Similarly, participants had access to, and were aware of support options as required, with breaks offered as needed, in addition to scheduled meal breaks. See Table 2 for an outline of the workshop. The workshop concluded by inviting YAC participants to evaluate how inclusive the workshop was. Their collated and de-identified feedback were provided back to the YAC with action steps, in future deliberations with the Council.

Table 2 Youth Advisory Council: workshop details

The feedback and advice generated from the workshop was used to inform the evaluation approach outlined here. For example, the outcomes identified by YAC participants were used to identify relevant outcome measures. Likewise, their advice about interviewing was used when deciding on approaches (focus group or individual etc.) and the types of questions that should be asked.

Ongoing YAC collaboration

During the three-year evaluation, we aim to meet every three months with the YAC to discuss evaluation results and ask for their feedback about (i) what the results might mean, (ii) the implication of the results for program development and (iii) appropriateness of the data collected, and what changes may be required to the evaluation process. Their views will be used to inform future rounds of the evaluation and Satellite offerings. Changes that were or were not actioned regarding Satellite programs, and why, will be discussed at subsequent YAC meetings, to ensure the evaluation and program development processes are transparent and accountable.

Data collection

As per Table 1, Satellite offers a range of program activities, with varying lengths (e.g. a weekend camp or one-off event) and in different mediums (e.g. online, face to face). Additionally, many young people participate in more than one activity. Thus, rather than evaluating each program activity as a distinct entity, the evaluation needs to reflect the ongoing and ecological nature of all of Satellite’s offerings. Notwithstanding this, Satellite were also keen to delve deeper into some program activities which were considered to be representative of their vision and objectives. Using input from the YAC, the data collection method is outlined below.

Semi-structured interviews or conversations

The YAC recommended these be called conversations rather than interviews, indicating that this term would be more acceptable to young people A purposive sampling approach will be used to conduct semi-structured face-to -face, telephone or Zoom individual conversations or focus groups with Satellite participants. Though there is some debate about the efficacy of these different mediums, some have argued that there is little difference in outcomes, depending on the research questions posed [33]. Conversations are based on a narrative approach which aims to illuminate the value of a program and highlight what needs to occur to improve it [34]. Each year, three programs will be identified by Satellite staff that they consider to be particularly important to their overall offerings and nine young people from each of those three programs will be invited to a conversation each year. The sample size of nine per program was chosen as it is considered adequate for sampling amongst a homogenous population while also allowing for deep analysis [35]. The YAC provided feedback on what should be asked and how. A key element of the evaluation approach is not only evaluating what Satellite does but also how successfully they work with young people in a participatory manner. Thus, questions will be asked, in an age appropriate way, about how involved the young person was in the program/s they were a part of, and whether they wanted to be more/less involved. Other questions will be around process (e.g. what parts of the program were important to you?), accessibility (e.g. how easy was it to get to the program?), safety (e.g. how safe did you feel participating in the program) and outcomes (e.g. what changed, if anything, for you, as a result of participating?). The YAC recommended a mix of individual and focus group conversations, depending on participants’ ages and the particular program.

In addition, we intend to conduct individual conversations longitudinally, involving yearly interviews with the same nine participants over three years, regardless of whether they remain Satellite or not. This will allow us to explore why they remained or did not remain with Satellite, the accumulative impact of Satellite’s offerings (if applicable), looking for instances of continuity, change and growth over time [36]. A longitudinal approach also allows participants to reflect on changes since the previous conversation, anticipated future trajectories and whether and how Satellite is aligned with those narratives. From these conversations, we aim to capture critical moments and processes involved in change as well as what might have been needed to better support young people at different time points.

Survey outcome measures and design

All young people who enter Satellite (approximately n = 150 each year) will be invited to participate in surveys on program entry, and then again six and 12 months later, using the number of programs they engage in as a variable. Using what we know from previous evaluations in this field [12, 16] and feedback on expected outcomes from the YAC (Table 2) we intend to use various questionnaires for the different age groups (See Table 3). Satellite have various outcomes in their charter, which relate to strengths-based areas that they hope to nurture in young people who are part of their programs. In consultation with Satellite staff and the YAC, the four most important outcomes were identified and valid, reliable measures were selected to align with these outcomes. Additionally, a similar group of Australian children/adolescents who self-identified as having caring responsibilities will be matched with young people who have participated in Satellite’s programs on demographics such as age and gender. The identified Longitudinal Study of Australian Children (LSAC) cohort will be used as a quasi “usual care” group on the outcomes of interest. Commencing in 2003, the LSAC is a national longitudinal study of data collected every two years on various child, parental and family characteristics that influence children’s development at different ages [37]. An a priori power analysis was conducted using G*Power version 3.1.9.7 software [38] to ascertain the minimum sample size required to test the study hypotheses. Results indicated that the required sample size to achieve 80% power for detecting a medium effect at a significance criterion of α = 0.05 will be 29 per group (intervention [Satellite participants] and usual care [LSAC])

Table 3 Outcome measures for children and youth

Creative outputs

Across the various Satellite programs, young people are engaged in many different creative activities, including song writing and photovoice. All participants will be invited at program completion to share their creative outputs with a member of the evaluation team. This process will be very different from the interviews or questionnaire evaluation components. The way the young person wants to portray their creative work, and how they want to describe it will be up to them. Nonetheless, with the permission of the young person (and if under 16 years of age, the additional permission of their parent/caregiver), these artworks will be featured in the evaluation findings and reported as a means of describing the types of activities Satellite offers and the types of experiences and possible outcomes for the people involved [39]. Ideally, a YAC representative will be available to engage with the young person about their experiences of creating these outputs and the meaning they attribute to the pieces. The messages conveyed will be either via video or in text and photographs.

Data analysis

Qualitative

Transcripts for the one-off conversations will be analysed within an inductive qualitative paradigm, using the six-step reflexive thematic process recommended by Braun and Clarke [40]. Thematic analysis is flexible to the format of the collected data and theoretically independent. Participants’ and researchers’ sociocultural interpretations are expected to influence the structure of themes. The analysis involves becoming familiar with the data by reading and re-reading each transcript, generating initial codes, searching for and then reviewing themes and then defining and naming themes. Intercoder consistency will be employed, whereby one member of the team will identify themes and follow this up with a group (evaluation team plus YAC) discussion of overlaps and divergences [41]. Specific data sets will be linked to particular programs and then compared and contrasted to see if there are overall patterns across programs or unique results to any particular offering.

Transcripts for the longitudinal conversations over three years will be managed using a longitudinal coding matrix template. A within-case analysis will initially be conducted with each interview set, then a cross-case analysis of patterns emerging over time across interviews [36].

Quantitative

The impact of Satellite on young people will be examined using the same outcome measures across the three time points using multi-level modelling (see Table 3). This will allow examination of whether the number of programs that young people enrol in over the 12 months results in different outcomes, as well as controlling for other variables such as age and gender. This model will also allow people to be entered into the analyses even if they do not complete the questionnaire at every time point (i.e., only complete the questionnaires at two of the three time points). Outcomes of interest will also be compared across groups (participants in the Satellite programs and the “usual care” (LSAC) participants) using repeated-measures MANOVA.

Ethics

Working with young people, especially those living with adversity, requires several ethical considerations. Parental consent is typically needed for children and young people under the age of 16, though previously, some parents from these families have actively or inadvertently limited their children’s involvement in research [42]. For instance, previous research has found that some parents are reluctant for their children to discuss what they considered to be family problems to outsiders while others consider that the process may be too upsetting for their children [42]. Additionally, if parents are very unwell and/or hospitalised they will not be eligible to participate, given that the parent is not able to provide informed consent. In addition to parental consent for those aged under 16, we will also seek child assent for their involvement.

Age appropriate language will be used to ensure informed consent/assent. As per Reupert et al. [42],young people will be given the option of not being involved (even if their parent has given consent to their involvement), e.g., “You don’t have to be involved in this interview if you don’t want to be, no one will be angry with you”. They will be told not only about their right to withdraw, but also how they might do this (e.g. say they have changed their mind) [43]. As recommended by Spriggs [44], children and young people will be able to withdraw from the evaluation at any time up to when the results are written up in reports/publications. Children and young people will be assured that unless they are at risk themselves, or may harm someone else, no one outside of the evaluation team will have access to what they said.

Interviews will be conducted in a COVID safe and accessible way. In discussing their involvement with Satellite, children and young people may become upset or uncomfortable and the potential for this will be clearly communicated. Given this, the interviewer will be sensitive to the verbal and nonverbal cues of the children and young people interviewed, alert to the need to pause or end the interview and offer further assistance and/or professional support as needed. At the conclusion of each interview, the child or young person will be asked whether they had any concerns or require any additional support. They will be provided with organisations to contact if they need support at a later stage. While acknowledging the potentially distressing nature of the evaluation process for children and young people, we are simultaneously mindful of Gladstone’s et al. [13] argument that although vulnerable, these young people are often insightful and autonomous, and have a right to discuss their experiences, especially concerning services that purport to support their needs. It can be cathartic to be part of an evaluation project, as it gives young people and children an opportunity to reflect on their individual circumstances; it can also be empowering to be consulted in a genuine, authentic manner.

Ethics approval has been obtained from the Monash University Human Research Ethics Committee (MUHREC):project number 31,681.

Findings and dissemination

Throughout the project, consistent with participatory methods, all the collected, de-identified results will be workshopped with the YAC to discuss program implications. Evaluation reports will be generated six times at six-monthly intervals over the three years with a final report submitted at the end of the project. In order to make the various evaluation reports accessible to various audiences, especially young people, findings will be presented in diverse ways, tailored to the needs of different audiences, in written form and/or through video, and infographics. Analysed data will be presented to the YAC and Satellite staff every six months over the three-year project, with subsequent recommendations made for program delivery and the evaluation design. If Satellite decides to make changes in a program, consideration will be made as to evaluation implications e.g. the addition of other measures, or additional interview questions. Thus, subsequent program changes will be monitored and reflected in the evaluation plan. The final evaluation report will be produced in multiple formats; one specifically with the funders as the intended audience, and another for the young people using accessible language, with both reports being publicly available. The YAC will be consulted as to the best ways of disseminating results to the community, with an option also of a public event with media invited at the end of the project.

Along with evaluation results, the number of participants who were involved in the various programs will be recorded, as there will likely be more who participate in the programs than participate in the evaluation. This information will include a breakdown of different demographic groups and identify those groups that Satellite have not yet been successful in attracting. For example, Maybery et al. [18] found it difficult to recruit young men into a similar early intervention program. Together with the YAC, strategies will be developed to target any missing groups into programs or efforts made to ascertain why specific demographic groups are not being recruited into Satellite programs. Referral sources will be reported, identifying those organisations referring young people to Satellite, and arguably more importantly, which services are not, which will allow for targeted messages to selective services.

link

By admin

https://muehlenbar.de/wp-includes/slot-online/

https://the-chef.co/sbobet/

Slot Gacor Terbaru

Link Slot Gacor

Sbobet

Situs Slot Gacor

Slot Gacor 2022

Login Sbobet

Daftar Sbobet

https://www.dcosmeticclinics.com.au/wp-includes/sbobet/

https://thetastesoflife.com/wp-includes/sbobet/

https://www.townshipofsugargrove.com/wp-includes/slot-gacor/

https://texasmamaboutique.com/wp-includes/slot-gacor/

https://bizu-me.com/wp-includes/slot-gacor/

https://tiketa.co.za/wp-includes/slot-gacor/

situs slot gacor

slot gacor gampang menang

slot gacor terbaru

daftar sbobet

slot bonus newmember

link sbobet

sbobet login