National Drug Strategy
National Drug Strategy

Workplace Tobacco Management Project Research Findings (Evaluation) Report by Alcohol Tobacco and Other Drug Association ACT

3. Research evaluation

prev pageTOC |next page

Purpose of the research evaluation

The purpose of this research evaluation was to determine if the aims of the Project were met. Therefore the evaluation is concerned with:

Methodology

This research evaluation used a mixed methods approach.

Research design and data elements

Design

The evaluation used two methods to monitor and evaluate the Project:

Data collection matrix

Three methods of data collection were used to inform the monitoring and evaluation.

Baseline organisation and staff surveys

Surveys of organisations and staff were undertaken within pilot organisations to elicit information about:

Follow-up survey of organisations and staff

The follow up surveys were used to monitor changes in from the baseline survey.

Field notes (observations) and field interviews

The initial Project Manager made a number of field notes from observing processes around tobacco policy developments within the pilot sites. These observations were concerned with how the policy process was being undertaken in each pilot site. The results from these observations are mixed with the quantitative data where appropriate and offer insights into the how and why of the policy development and implementation processes within sites. In addition to these field observations,
additional field interviews were conducted from June to September 2011. These interviews were with management and staff in each of the pilot sites. The interviews aimed to assess how the process of tobacco policy development and implementation was seen by staff, management and by their governing structures.

Sampling

All staff in the nine pilot sites were eligible to complete the baseline and follow –up internet based surveys. The surveys were conducted as a census.

Data Analysis

The baseline and follow-up surveys were analysed using SPSS version 19.

Descriptive analysis

Descriptive analysis is provided for:

Inferential analysis

Where indicated, testing for statistically significant differences between independent and dependent variables was conducted.

For each of the categorical repeated measures included in this report Cochranʼs Q Test has been utilised to examine statistical significance of changes in variables over time.

For continuous data one-way repeated measures ANOVA has been conducted to test for statistical significance.

Qualitative analysis

A cross case analysis was conducted to determine any common themes across sites. Thematic analysis was performed by examining the content (content analysis) of the qualitative data gathered from the field reports, interviews and surveys.
Themes are organized and presented in categories.
Top of page

prev pageTOC |next page