Social Transformation and Empowerment Projects (STEPS) Evaluation

This 60-page report, provided to STEPS for the Future by the Community Development Resource Association (CADRE), offers an account of an external evaluation of the Social Transformation and Empowerment Project's (STEPS) HIV/AIDS Outreach Programme that was undertaken by the Community Development Resource Association between October 2008 and July 2009. The research found that the STEPS Training of Trainers (ToT) programme contributed towards: building new knowledge and skills; creating a space for sharing and learning and personal development; facilitating linkages through a regional communication system; and the production of training materials.

The Social Transformation and Empowerment Project's (STEPS) HIV/AIDS Outreach Programme was started in February 2003 to promote discussion and debate around HIV/AIDS-related topics. The organisation trained facilitators from across partner organisations to use films as tools for opening/stimulating discussion and raising awareness of HIV/AIDS-related issues. Through a series of films focusing on different aspects of HIV/AIDS and use of a specific methodological approach, the programme seeks to enable individuals, organisations, and groups to explore questions about how HIV/AIDS affects them.

The evaluation of the programme was designed to assess:

• the extent to which the STEPS methodology has contributed toward enhancing the HIV/AIDS programmes of regional partners;
• the effectiveness and impact of the Training of Trainers (ToT) and Training and Facilitators (ToF) programmes;
• the effectiveness and impact of facilitated screenings;
• the extent to which income-generation for trainers and partners was stimulated; and
• areas that need to be improved in order to strengthen and sustain interventions and programmes in the region.

The evaluation was conducted in two phases. Phase One comprised a regional trainers workshop that included individual interviews prior to the workshop, as well as sharing experiences and achievements of the ToT programme. The workshop was participatory and made use of an action learning methodology. The second phase of the evaluation involved field visits to partner organisations in Lesotho, Namibia, South Africa, Tanzania, and Zimbabwe for a more in-depth assessment of the impact of the ToF programme and facilitated film screenings.

Related to the ToF programme, the evaluation found that it enhanced facilitators' confidence, self-awareness, self-esteem, and self-knowledge, and that this has impacted positively on their interactions with others. Those living with HIV mentioned that they benefited from the training on a personal level - it stimulated their passion and interest for outreach work and increased their openness to speak about their own fears and stresses around their personal relationships and HIV status.

The research found that the majority of facilitators indicated that they gained new knowledge on HIV/AIDS beyond the basic facts, and that they learned how to approach issues such as stigma, disclosure, treatment, and behaviour change. Many respondents also indicated that the training challenged their conventional ways of learning and helped them develop a set of skills that can be applied both in the home and work environment. Using documentary films as discussion tools was seen as a unique methodology and facilitators mentioned they have learned to establish a two-way communication process with audiences. Many also indicated that they have learned how to work with diverse groups.

As part of the evaluation, the researchers also attended facilitated screenings held with schools, support groups, prisons, and mine workers in South Africa, Lesotho, Namibia, Zanzibar, and Zimbabwe. They evaluated the screenings based on preparation of facilitators, venue, audience demographic, films screened, facilitation/application of learning cycle, audience reactions, main issues, and motivation for action. From these screenings, as well as from reports from different partner organisations and interviews with audiences and facilitators, the report found that facilitated screenings have contributed positively toward encouraging audiences to openly address sensitive issues and be able to disclose and share experiences. According to the report, such actions have contributed to reducing stigma and calling people to action.

The report found that film proved to be a powerful tool, particularly because the films are real life stories and not dramas. The screenings have created a platform for more open discussion, debate, and sharing. The screenings have also become a 'vehicle' for accessing knowledge and information around HIV/AIDS, as well as for promoting discussion about taboo subjects such as sex work and homosexuality. According to the report, the screenings have contributed toward challenging HIV-related stigma, with audiences pointing out that the films motivated them to challenge stigma in their homes and communities. The films have also helped people living with HIV to cope with their own fears, to disclose their status, and to seek support. In addition, the report states that the screenings motivated audience members and enabled them to make informed decisions. Many were encouraged to undergo voluntary counselling and testing.

The evaluation highlights a number of areas of the programme that need improvement, including: support for the network of facilitators; communication between STEPS and partner organisations within the region; monitoring and evaluation; and resources for more locally-produced films. The report recommends: strengthening the network of trainers, facilitators, and organisations; producing more films in more local languages; and integrating the films into existing organisational programmes. It also recommends improving usage of the website by all partners, re-working report formats to provide monitoring and evaluation data, and developing a system for data collection and analysis. The report also states that the programme would be improved by strengthening strategic partnerships with other stakeholders, using the STEPS methodology to generate income, and revisiting the idea of a basket fund for regional training and capacity building activities in order to ensure programme sustainability.