Hey Team,
So I’m pleased to now be able to tell you more about this mysterious ‘Experiment 1′.
We were trying to figure our what sort of brief receives the best responses from designers.
If you’ve been involved with us from the beginning, you would have seen three pretty different briefs. As part of developing a long term model for Positive Posters (more to come on this soon) we needed to try and understand what kind of briefs actually produce the highest quality designs that will in turn have best chance of creating the most impact. So to test this we ran an experiment with the following hypothesis as it’s back bone:
1. How we tested this
Step 1: We asked members of our community on Facebook and Twitter if they’ed help us out and form our sample group
Step 2: We collected their emails and randomly separated them into 3 groups
Step 3: We sent all the members of the experiment identical briefs expect for the call to action (download the briefs below). The call to actions were a ‘choose you’re own topic’, a ‘general topic’ (women’s rights), and a ‘specific topic’ the story of a Tibetan nun who set her self on fire in protest to Chinas governance of Tibet. Each of the participants was given 7 days to respond.
Step 4: We recorded when each entry came through, how many, the overall quality of the entries from each group and a bunch of other data. We also sent a 10 question survey to each participant after the experiment closed asking them about the whole process.
2. The Results/Key Findings
We got some pretty interesting results. But before I go on, I’d like to point out that we are aware that our sample group (around 90 people) was small and that the results may not be ‘statistically significant’, but we feel it’s important to share them regardless and learn what we can.
Key finding #1 – The Open Brief produced the most posters
This one was probably the most surprising outcome of the experiment. We had thought that the Specific Brief would return the highest number as well as the highest quality designs. We were wrong. 41% of the people in Group A, (the open brief) submitted a poster compared 29% in Group B (the general brief) and only 14% in Group C (the specific brief).
Key finding #2 – Most designers submit their work in the last few days
This was one of those insights that we kind of already knew, but it was still interesting to see the data support it. 81% of everyone who entered did so on the last two days. We’ve seen this same pattern each year with our annual competition too.
Key finding #3 – The quality of the posters were similar, but varied in communication style
As always, commenting on the quality of design is a difficult thing to do. In this case, there was no judging panel, it was just the two of us looking at the entries and then trying to decide which brief, if any, produced higher quality entires. What do we mean when we say ‘higher quality’ though? Well when you’re talking about a poster it really means: 1. Did the design grab and hold our attention? and then 2. Did the design communicate it’s intended message with clarity? After looking at all the submissions from the experiment, it wasn’t clear that one brief produced higher quality designs than another. However, we did notice that the posters that were in response to the Open Brief were more literal compared to the that were submitted for the General and Specific Briefs.
Key finding #4 – Clarity on why people actually take part in our competitions
While we did not set out to discover why designers actually take part in our competitions, some of the direct feedback through email and some of the responses from the follow up survey have given us a bit more of an insight as to what motivates designers to get involved in competitions such as our own. When asked in the survey, “What are the reasons you enter design competitions?“, the top 3 results were 1. To be involved in a community of likeminded people, 2. Personal Exposure and 3. To build my folio. The other options, ‘prizes and money‘ and ‘to compare my self to my peers‘, barely got a mention.
Key finding #5 – We are time poor
We probably already knew this, but in response to the question, “Did you submit a poster as part of the experiment? Why or why not?“, a lot of people said they simply had too much work on or not enough time. Now, we understand that 7 days wasn’t a lot of time to complete the brief, but it did give us an insight as to what things (Uni, TAFE, work, other projects etc.) are keeping you from taking part in competitions like ours.
Key finding #6 – Your computers break a lot
Oh, and we received a bizzar number of people said that their computers broke last week…Hope you’ve all got them fixed now.
3. Was our hypothesis proven?
Our hypothesis was only somewhat proven. While the Specific Brief generated the least amount of posters, they were the more lateral and probably the most engaging. However, for this experiment, we probably didn’t have a large enough sample size to draw any really solid conclusions, but we’ve been able to gain some insights that we never have been able to before. It was defiantly worth doing and as a result, we’ll be doing a few more of these kinds of thing as the year goes on.
If you took part, thank you. We appreciate it heaps.
Any q’s or more info, shoot us mail nick or tenielle@positive-posters.com
Download the briefs here”
Brief One (The open brief)
Brief Two (The general brief)
Brief Three (The specific brief)







Clever… and exciting!
Very exciting in a nerdy kind of way.
We start by passing out the velentuor sheet to see where everyone fits in to the VBS team then from there we give the teachers there booklets so they can get prepared. We also have ~2 meetings a month to go over any new information, answer questions, have the groups get together to discuss their area & the needs they have. I have found you can never have too much communication. Try to also do things along the way at the meetings to encourage & thank the workers for all that they do.
Interesting! Some of your results were seemingly ‘obvious’ but even though the sample size was small – I imagine the info would help.
A more specific topic would cut out a lot of poor design.
The info does help, a lot. I’m not sure if a specific topic will cut out poor design. I think rather it will just focus designers minds, almost forcing them to be more clear with their communication. That might be what you meant.
Great work!
Thanks Jono. Nice to hear from you.
Interesting results & keep up the good work.
Thanks Abhee!
… என ன ய ம அற ம கப பட த த னத க க நன ற தல அற ம கப பட த த ம வ தம ர ம ப அர ம ய இர க க .//வ ங க!!! அக பர , மக ழ ச ச !!நன ற அக பர . // r.v.saravanan said… ஆச ர யர பண க க வ ழ த த கள .ந ங க வல ச சரம ச ன ற இட க ய ட ட ல ம ச வ ரச யம க ற யவ ல ல கலக க ங க//ம க க நன ற சரவணன .// ஜ ல தண ண said… ர ட ட கண ட ப ப இந த வல ச சரம ட ப ப த ன இந த ம த ரய நச ச ன பத வர கள ஊக க வ த த ல ச ப பர நன ற ப ர ட ட !!எல ல ர ய ம இப பவ ஃப ள பண ற ன //மக ழ ச ச !!! நன ற ஜ ல தண ண . //ஜ ய ல ன said… ப த ப ப த பர ட ட வ இர க க ..//அப ப றம என ன, நல ல ச ப ப ட ங க
நன ற ஜ ய ல ன . // philosophy prarhakaban said… வ ச பக கங கள கத இரண ட ம அட டக சம …//பட ச ச ச ச !!! நன ற ப ரப கரன . // இர மச ம கண ணண said… நல ல அற ம கங கள நண பர . த டரட ட ம உங கள நற பண .//த டர ஊக கங கள க க நன ற ர ம .// Starjan ( ஸ ட ர ஜன ) said… ப ர ட ட இன ற நல ல ர ச , ட ஸ ட இர க க .. எல ல ம நல ல அற ம கங கள .அக பர இன ற க ற ப ப ட டத க க ம க க நன ற ..//அப பட ய !!! அப ப , ஸ ட ர ஜன ச ர க க ர ண ட பர ட ட ப சல
)நன ற ஸ ட ர ஜன .
Clever! I think the difference is when you have a very specific topic in a brief it takes more time and effort to research the topic, especially if you don’t know much about the subject/story. Most designers that are given an open brief and a short turnaround time would probably re-develop a piece of work they have already been playing with.
Yeah that’s a fair point Steven. What would be really interesting is to see what would happen if we extended the time limit to see if that had an impact on whether people would enter or not.
Great work! I think it’s great for PP to do work like this — in terms of design research but also improving the competition.
Sounds like a cool thing to take to AGIdeas or AGDA or something…
Yeah good idea Sam.
The specific brief still doesn’t seem very specific to me. It only defines the audience as “people” – but people where? China, Tibet, Australia? And if Australia, who? Rural, urban, young, old? This all matters.
It reinforces a general thought that, while I love the concept of PP, it seems there’s a big danger of the designers designing for fellow idealistic, ethically-minded “people-like-them”, rather than plugging into the motivations of other people driven by other factors like fashion/esteem-of-others or safety/traditional-values. Given that the idealistic are likely to be onside anyway, isn’t it these other groups that PP should be aiming at in order to make change happen?
HI Mike,
Sorry for the late reply, I only just saw your comment. (Must have missed it in my inbox).
Firstly, I agree with you that the ‘specific brief’ could have been more specific and identifying the target audience in as much detail as possible is very important. Thanks for bringing it up, I’ll make sure we look at that in more detail next time.
I’m not sure I fully understand your second point. Are you concerned that we are only targeting the posters at people ho are already ‘on-board’ with social responsibility and therefore not really making much difference?
Let me know….