Most amateur double blind tastings are horrible from a statistical perspective. They barely shed any insight into the truth at all but, what’s worse, they give a false sense of knowledge. Last night, I made the assertion that top shelf vodkas are indistinguishable from each other and that any perceived taste differences were purely psychological. This lead me to be responsible for a quick, impromptu blind vodka tasting of 3 top shelf vodkas (Ketel 1, Grey Goose & Ciroc) between myself & 4 other skeptical participants (in retrospect, we should have added a well vodka as a control but we did try a well vodka after the blind tests and the difference was pretty apparent).

Our very helpful bartender marked the bottom of each glass with the vodka brand such that we could not see them, then we proceeded to taste & rate. Now, most amateur double blind studies I’ve seen rely on a single tasting then ranking. This is somewhat fine in a large lab setting with a sufficient number of participants and samples but, in our circumstances would lead to 0 statistical insight. The reason why is pretty simple, among a sample of 3 vodkas, there are only 6 different permutations. Thus, with 5 participants, it’s more likely or not, someone will get a “hit” purely by chance.

Instead, what we relied on was a double tasting procedure. Each person would sip & rank the vodkas, an independant 3rd party would then proceed to shuffle the order while we closed our eyes and we then proceeded to sip & rank the vodkas again. What we were looking for was not whether you could correctly assign the brand to a vodka (which is relatively hard) but whether you could rerecognize a vodka you had just drank (which is relatively easy). As it turns out, of the 5 participants, I was the only one who correctly determined how the vodka had been shuffled.

Now, despite the fact that I was crooning all night about how I “won” the challenge, this is not the correct conclusion to be drawn from the data. What it demonstrated was that at least 4 of the 5 participants were unable to distinguish top shelf vodkas with reliability, despite their certainty before revealing the results that there were clear and distinct differences. What this proves was that the perceived differences were purely physiologically and psychologically based and not as a result of the chemical qualities of the vodka. Additionally, it is unknown whether I could truly distinguish the difference. Remember, there’s still only 6 possible answers so it’s pretty probably that I got them right purely on luck. A further shuffle & taste would be able to shed more insight into this hypothesis but we were out of vodka at that point.

Most amateur double blind studies aren’t worth the blog post they’re written on because the authors have such a poor grasp of experimental setup that the data is worthless. Amateur studies don’t have the resources of a professional study to collect large enough amounts of data to make confident predictions, thus you need to scale back the expectations of the experiment to match the resources you have on hand. If you want to perform a double blind study with either a small sample set or experimental group, you need to use a repeated tasting procedure rather than a single tasting procedure or you run the risk of making assertions which are not statistically supported.

  • Gk

    I don't believe the first taste test was technically a double-blind, since the bartender knew which was which. At any rate, a more robust test, at least in this application, is the triangle taste test. Two of one drink, one of the other, tell which is the odd one out. From Malcolm Gladwell:

    “That particular test was so counterintuitive that I needed to try it on my friends before I believed it. I did it at a dinner party once with ten people. Sure enough, it works every time. I've made money off that triangle test, routinely. I take bets on whether they can tell which drink is different from the other two, and I clean up. It will blow your mind. They can't do it. And when they do, it's clear they're just guessing. You watch them get more and more intense, and you can see they're just randomly picking. ”

    I'm with you 100% on the vodkas, though. There's only so much you can do with water and ethanol.

  • Hang

    We didn't communicate with the waitress until after the test was concluded.

  • Anonymous

    This is somewhat fine in a large lab setting with a sufficient number of participants and samples but, in our circumstances

    Salvage Cars

  • Lijing1821839896
  • Sunlimei1989

    At first, exposure to discount ugg boots in other countries was limited to the surfing crowd, who wore them to keep their feet warm after climbing out of the ocean from surfing. In the late 1970’s, Uggs were popularized and being sold in the United States, garnering surfer Brian Smith, the proprietor of Ugg Holdings, a hefty profit.
    Ugg boots are singular in their simplistic and striking design – primarily brown, though these days the colors can range from pink, to blue, to green. The stitching on discount ugg boots are usually prominent, which actually add to the visually pleasing look. One of the great things about owning a pair of these boots is that the inner fleece draws moisture away from the feet, allowing them to stay at body temperature without cooling. This means that even in cold weather, a person can wear Uggs without socks and still have their feet remain warm!
    The best thing about Ugg boots, though, is the fact that they can be found for low prices over the Internet. Shopping online can save you a lot of time and money; cash that could be going somewhere else instead of into the markup that retails stores are famous for charging. Online vendors aren’t pressed to jack their prices to compensate for markup, so it’s more than possible to find what you need for far less than wholesale price, if you’re patient and willing to search.
    If you’re looking for chic footwear to pull together any ensemble and make it shine, look no farther than the discount ugg boots, with a sheepskin out layer…some faux, some not, with a layer of warm fleece on the inside, and a thick sole. These fashionista accessories are believed to have been created either in Australia, or New Zealand, where the term “Ugg” is a generic labeling of the boot itself, and not the brand name, like many would likely surmise.
    Used by fighter pilots in the First World War, at blisteringly cold altitudes, Uggs are designed to keep your feet warm in the harshest of circumstances, fashion statement or not. So while the boots may be a relatively recent find for the rest of the world, they had long been used and known colloquially by our friends down under, though we can’t pinpoint exactly who invented them. We do know that mass production of them has been going on for over half a century, though…making discount ugg boots slightly retro as well!

  • Vfdght
  • Joomla Development

    Great to read this post. I just enjoyed reading your web blogs! they are very well published. Keep it up!

  • domain register

    You made certain good points there. I did a search on the subject matter and found the majority of people will have the same opinion with your blog.

  • Sunlimei1989

    Then of course I found ugg boots discount uk it. I’d been flicking through a row of cassette cases, my mind on other things, when suddenly there it was, under my fingers, looking just the way it had all those years ago: Judy, her cigarette, the coquettish look for the barman, the blurred palms in the background.   
    I didn’t exclaim, the way I’d been doing when I’d come across other items that had mildly excited me. I stood there quite still, looking at the plastic case, unsure whether discount ugg boots or not I was delighted. For a second, it even felt like a mistake. The tape had been the perfect excuse for all this fun, and now it had turned up, we’d have to stop. Maybe that was why, to my own surprise, I kept silent at first; why I thought about pretending never to have seen it. And now it was there in front of me, there was something vaguely embarrassing about uggs discount the tape, like it was something I should have grown out of. I actually went as far as flicking the cassette on and letting its neighbour fall on it. But there was the spine, looking up at me, and in the end I called Tommy over.   
    “Is that it?” He seemed genuinely sceptical, perhaps because I wasn’t making more fuss. I pulled it out and held it in both hands. Then suddenly I felt ugg boots discount outlet a huge pleasure–and something else, something more complicated that threatened to make me burst into tears. But I got a hold of the emotion, and just gave Tommy’s arm a tug.   
    “Yes, this is it,” I said, and for the first time smiled excitedly. “Can you believe it? We’ve really found it!”   
    “Do you think it could be the same one? I mean, the actual one. The one you lost?”   
    As I turned it in my cheap uggs online fingers, I found I could remember all the design details on the back, the titles of the tracks, everything.   
    “For all I know, it might be,” I said. “But I have to tell you, Tommy, there might be thousands of these knocking about.”   
    Then it was my turn to notice Tommy wasn’t as triumphant as he might be.   
    “Tommy, you don’t seem very pleased for me,” I said, though in an obviously jokey voice.   
    “I am pleased discount uggs for women for you, Kath. It’s just that, well, I wish I’d found it.” Then he did a small laugh and went on: “Back then, when you lost it, I used to think about it, in my head, what it would be like, if I found it and brought it to you. What you’d say, your face, all of that.”

  • Sunlimei1989

    “Tommy, you idiot. You really buy cheap uggs online believe it, don’t you? All this lost-corner stuff.”   
    “I don’t necessarily believe it. But we might as well look now we’re here. I mean, you’d like to find it again, wouldn’t you? What have we got to lose?”   
    “All right. You’re a complete idiot, but all right.”   
    He opened his arms out helplessly. “Well, Kath, where do we go? Like I say, I’m no good at shopping.”   
    “We have to look in second-hand places,” I said, after a moment’s thought. “Places ugg boots for girls full of old clothes, old books. They’ll sometimes have a box full of records and tapes.”   
    “Okay. But where are these shops?”   
    When I think of that moment now, standing with Tommy in the little side-street about to begin our search, I feel a warmth welling up through me. Everything suddenly felt perfect: an hour set aside, stretching ahead of us, and there wasn’t a better way to spend it. I had to really ugg boots discount uk hold myself back from giggling stupidly, or jumping up and down on the pavement like a little kid. Not long ago, when I was caring for Tommy, and I brought up our Norfolk trip, he told me he’d felt exactly the same. That moment when we decided to go searching for my lost tape, it was like suddenly every cloud had blown away, and we had nothing but fun and laughter before discount ugg boots us.   
    At the start, we kept going into the wrong sort of places: second-hand bookshops, or shops full of old vacuum cleaners, but no music at all. After a while Tommy decided I didn’t know any better than he did and announced he would lead the way. As it happened, by sheer luck really, he discovered straight away a street with four shops of just the kind we were after, standing virtually in uggs discount a row. Their front windows were full of dresses, handbags, children’s annuals, and when you went inside, a sweet stale smell. There were piles of creased paperbacks, dusty boxes full of postcards or trinkets. One shop specialised in hippie stuff, while another had war medals and photos of soldiers in the desert. But they all had somewhere a big cardboard box or two with LPs and cassette tapes. We rummaged around those ugg boots discount outlet shops, and in all honesty, after the first few minutes, I think Judy Bridgewater had more or less slipped from our minds. We were just enjoying looking through all those things together; drifting apart then finding ourselves side by side again, maybe competing for the same box of bric-a-brac in a dusty corner lit up by a shaft of sun.

  • outsourcing website

    Lovely post! Enjoyed reading it!

  • joomla developers

    Dude.. I am not much into reading, but somehow I got to read lots of articles on your blog. Its amazing how interesting it is for me to visit you very often.

  • Sunlimei1989

    “I am afraid, Countess, you discount uggs for women are not quite so well as usual?” I said.   
    “The very remark I was about to make to you,” she replied. “You are looking pale, my dear.”   
    My dear! It was the first time she had ever addressed me with that familiarity! There was an insolent smile too on her face when she said the words.   
    “I am suffering from one of my bad headaches,” I answered coldly.   
    “Ah, indeed? Want of exercise, I suppose? buy uggs online cheap A walk before dinner would have been just the thing for you.” She referred to the “walk” with a strange emphasis. Had she seen me go out? No matter if she had. The letters were safe now in Fanny’s hands.   
    “Come and have a smoke, Fosco,” said Sir Percival, rising, with another uneasy look at his friend.   
    “With pleasure, Percival, when the ladies have gone to bed,” replied ugg boots on sale the Count.   
    “Excuse me, Countess, if I set you the example of retiring,” I said. “The only remedy for such a headache as mine is going to bed.”   
    I took my leave. There was the same insolent smile on the woman’s face when I shook hands with her. Sir Percival paid no attention to me. He was looking impatiently at Madame Fosco, who showed no signs of leaving discount ugg boots store the room with me. The Count smiled to himself behind his book. There was yet another delay to that quiet talk with Sir Percival–and the Countess was the impediment this time.   
    The Story Begun By Walter Hartright Chapter 9   
    June 19th.–Once safely shut into my own room, I opened these pages, and prepared to go on with that part of the day’s record which was still left to ugg boots cheap sale write.   
    For ten minutes or more I sat idle, with the pen in my hand, thinking over the events of the last twelve hours. When I at last addressed myself to my task, I found a difficulty in proceeding with it which I had never experienced before. In spite of my efforts to fix my thoughts on the matter in hand, they wandered away with the strangest ugg boots on sale persistency in the one direction of Sir Percival and the Count, and all the interest which I tried to concentrate on my journal centred instead in that private interview between them which had been put off all through the day, and which was now to take place in the silence and solitude of the night.