Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
101 changes: 0 additions & 101 deletions 02_activities/assignments/a2_survey_design_and_evaluation.md

This file was deleted.

196 changes: 196 additions & 0 deletions 02_activities/assignments/assignment-2.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,196 @@
# Assignment: Questionnaire Design and Sample Evaluation

## Requirements

The goal of this assignment is to practice developing and evaluating sampling materials.

### Part A - Survey Design:

Select one of the scenarios below and design a survey to meet the need(s) outlined in the prompt.

1. In two to three sentences, describe the purpose of your survey
2. Describe your target population, sampling frame, sampling units, and overall sampling strategy.
3. Write a 5-10 question survey to address your chosen scenario below.

##### Scenarios
1. You work in the Human Resources Department at a large tech company. Over the past few months, the company has been experiencing a high turnover rate across many of its departments, specifically within the entry- and lower-level positions. The company wishes to understand why this turnover is happening, and what changes need to occur to improve employee satisfaction.
2. You work for a Canadian national political party during a federal election. Throughout the campaign period, your party has seen relatively high approval ratings, but an opposing party is also polling favorably and may still have a chance to win the election. You are one month away from the election and you want to understand what voters want from your party and its leader in order to maintain your lead and eventually win the election.
3. You are a student researcher in the sociology department at the University of Toronto. You are working on a research project that concerns the relationship between music taste and age. This involves both comparisons between different people of different ages and comparisons of the same individual at different ages during their lifetime. You wish to understand to what extent age influences music taste, specifically as it relates to perceptions of popular music. Your results will be written into an academic paper that you hope to publish.

### Part B - Survey Evaluation:

For the **Canadian General Social Survey on Giving, Volunteering, and Participating, 2018 (cycle 33)**, conducted by Statistics Canada find any and all available documentation for the data gathered and identify and describe the survey features indicated below.

1. Sample type
2. Sample size
3. Target population
4. Sampling frame
5. Survey mode(s)
6. Timeline
7. Response rate
8. Weights
9. Data processing
10. Cleaning, imputation, etc
11. Sources of error
12. Limitations, known biases, etc
13. Link to documentation and any additional sources used


# Your Changes

## Part A - Survey Design:

The number of your chosen topic: `3`

Describe the purpose of your survey:
```
write your answer here...The aim of this survey is to examine the relationship between age and music taste, with a specific focus on how individuals perceive popular music. The survey aims to explore differences in music preferences across age groups as well as changes in music taste within the same individuals over their lifespan. By collecting both current preferences and retrospective data collection which reflections on past music tastes, the study seeks to understand how aging influences tasete toward popular music genres, artists, etc. The findings will contribute to sociological research thesis project.

Describe your target population, sampling frame, sampling units, and observational units:
```
write your answer here...
```Target Population:
The target population consists of adults aged 18 years or older, including young adults, middle-aged adults, and older adults. The study aims to capture generational differences in music taste and perceptions of pop music.

Sampling Frame:
The sampling frame can be included from students, staff, faculty, and alumni of the University of Toronto, as well as members of the general public reachable through online platforms (e.g., university mailing lists, social media, and online survey distribution).

Sampling Units:
The primary sampling unit is the individual respondent. Each participant represents one unit of analysis.

Sampling Strategy:
A non-probability convenience sampling strategy will be used, supplemented by quota sampling to ensure representation across different age groups for example: categorized age to these age ranges: 18-29, 30-44, 45-59 or 60+.

Your 5-10 question survey:
```
1. write your question here...How old are you?
A. 18-29
B. 30-44
C. 45-59
D. 60 or older
2. write your question here...How would you describe your overall interest in music?
A. Very interested
B. Somewhat interested
C. Neutral
D. Not very interested
3. write your question here...Which music genres do you listen to most frequently? (Select all that apply)
A. Pop
B. Rock
C. Hip-hop/Rap
D. Jazz
E. Classical
F. Other:
4. write your question here...How often do you listen to currently pop music?
A. Very often
B. Sometimes
C. Rarely
D. Never
5. write your question here...Compared to when you were younger, how has your music taste changed?
A. Changed significantly
B. Changed somewhat
C. Stayed mostly the same
D. Not sure
6. write your question here... (optional)
7. write your question here... (optional)
8. write your question here... (optional)
9. write your question here... (optional)
10. write your question here... (optional)
```

## Part B - Survey Evaluation:

Identify and describe survey features:

```
write your answer here
```1. Sample Type

The 2018 General Social Survey on Giving, Volunteering and Participating (GSS-GVP) used a probability sample design. The 2018 GSS GVP collected data from persons aged 15 years and over living in private households in Canada, excluding residents of the Yukon, Northwest Territories and Nunavut and full time residents of institutions. The sampling frame integrates telephone numbers (landline and cellular) linked to addresses from the Address Register and other administrative sources.

2. Sample Size

It collected data from 16,149 respondents within the target population.

3. Target Population

The target population for the GSS-GVP includes persons aged 15 years and older living in private households in the ten Canadian provinces, excluding residents of Yukon, Northwest Territories, Nunavut, and full-time institutional residents.

4. Sampling Frame

The sampling frame for the 2018 GSS is built from Statistics Canada's integrated telephone frame, combining landline and cell phone numbers associated with residential addresses from the Address Register and various administrative sources. This frame aims to cover households across the provinces, including "cell-phone-only" households.

5. Survey Mode(s)

Data collection in 2018 included both computer-assisted interviewing and an internet questionnaire option. These mixed modes were introduced in recognition of changing technology use and respondent preferences.

6. Timeline

The documentation for the General Social Survey, Cycle 33 (2018) was released in January 2021. While specific fieldwork dates are not detailed in the public documentation, the survey refers to activities in the 12 months preceding collection and follows the usual multi-month administration period for GSS cycles. The Daily release in January 2021 confirms availability of the public use microdata file and tables at that time.

7. Response Rate
It is a limitation that the numeric number wasn't reported.


8. Weights

The public use microdata includes person-level weighting factors that adjust for unequal probabilities of selection and non-response so estimates better reflect the Canadian population aged 15 and over. Bootstrap weights are provided for variance estimation to support proper statistical inference. The weights are further adjusted so that key demographic distributions (e.g., age and sex by province) match known population totals.

9. Data Processing

Data integration and editing to prepare responses from different collection modes.

Weighting adjustments to correct for unequal sample design, coverage issues, and non-response.

Imputation for missing income or demographic values when possible (e.g., linking to administrative sources for income data, with imputation for missing cases).

10. Cleaning, Imputation, etc.

The survey documentation notes that missing information (fo example the income) was supplemented by linking to administrative tax data for respondents who consented, with imputation applied for cases without linked administrative data. Coverage and non-response adjustments combined with quality assurance checks help reduce potential bias.

11. Sources of Error

Sampling error: because only a sample of the population is surveyed, estimates will vary from one possible sample to another.

Coverage error: households without telephones or those outside the sampling frame may be excluded.

Non-response error: some selected respondents may not participate, potentially skewing estimates if non-respondents differ systematically from respondents.

Measurement error: differences in how respondents interpret and answer questions across modes some answered with phone, or some in person or online.

12. Limitations, Known Biases, etc.


Mode differences: The introduction of an internet option in 2018 may affect comparability with previous cycles.

Non-response and coverage bias: non responder numbers didn't reported.


13. Documentation and Sources

https://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=4430 and https://www150.statcan.gc.ca/n1/en/catalogue/452500112021001

## Rubric

- All required components are present and complete **Complete / Incomplete**
- Choice of sampling strategy for Part A is justified and related to survey purpose **Complete / Incomplete**
- Information for Part B is complete and correct **Complete / Incomplete**

## Submission Information

🚨 **Please review our [Assignment Submission Guide](https://github.com/UofT-DSI/onboarding/blob/main/onboarding_documents/submissions.md)** 🚨 for detailed instructions on how to format, branch, and submit your work. Following these guidelines is crucial for your submissions to be evaluated correctly.

### Submission Parameters:
* Submission Due Date: `23:59 - 14 January 2026`
* The branch name for your repo should be: `assignment-2`
* What to submit for this assignment:
* This markdown file (a2_survey_design_and_evaluation.md) should be populated and should be the only change in your pull request.
* What the pull request link should look like for this assignment: `https://github.com/<your_github_username>/sampling/pull/<pr_id>`
* Open a private window in your browser. Copy and paste the link to your pull request into the address bar. Make sure you can see your pull request properly. This helps the technical facilitator and learning support staff review your submission easily.

Checklist:
- [ ] Create a branch called `assignment-2`.
- [ ] Ensure that the repository is public.
- [ ] Review [the PR description guidelines](https://github.com/UofT-DSI/onboarding/blob/main/onboarding_documents/submissions.md#guidelines-for-pull-request-descriptions) and adhere to them.
- [ ] Verify that the link is accessible in a private browser window.

If you encounter any difficulties or have questions, please don't hesitate to reach out to our team via the help channel in Slack. Our Technical Facilitators and Learning Support staff are here to help you navigate any challenges.
Loading