I love it. For years with my old dog I would give him a binary choice between two treats and intuitively got a sense of his favorites as well. More satisfying to me was giving him the choice, which (maybe I'm over personifying him) I think he liked to pick his favorite. He had stomach issues which limited him to really only a few types of treats, and it was obvious which were his favorites, but it was fun anyway. I miss that dog.
rkagerer 41 minutes ago [-]
The same time every day, around 11pm, I go to the kitchen, select two different treats, say the word “choice”, and present the treats in either hand, allowing Bebop to only take one... By the time the experiment started, Bebop was used to the routine and sniffing both treats before taking one.
Winner was Pur Luv Chicken, closely followed by MON2SUN duck + rawhide. Greenies and Pork Chomps fared poorly.
gwern 20 hours ago [-]
One thing I'm not following is how the side/order bias is being handled. OP measures a IMO very large bias towards left-hand treats, but it is unclear how that is handled (ahem)? Skimming https://github.com/adamwespiser/best-dog-treat/blame/main/an... doesn't help me understand if it is being modeled as a covariate to adjust for the bias or if it was dealt with by construction (eg. by always offering pairs twice, swapping hands), or what?
Incidentally OP if you want to make it more adaptive, you can just fit the B-T model each time, and grab a posterior sample of what the best pair is, and test that, which turns out to be Thompson sampling. I did this for fun with blind taste-testing of mineral waters: https://gwern.net/water
nosioptar 1 hours ago [-]
Some dogs have a strong preference on right/left. I've known at least six dogs that will only shake hands with their left paw.
RataNova 51 minutes ago [-]
Yep, I have seen dogs that clearly have "a side" for certain habits, even if it is not obvious whether it is paw preference, training, comfort...
kokanee 1 hours ago [-]
Yes, and also the presence of a window fan on that side is a big deal because the selection is based on scent. In my experience dogs appear to "like" a scent based on how strong it is, not necessarily how it is "flavored" (for examples, dogs can behave as if they love the smell of poop or skunk spray, but it's actually the powerful sensory information that they're reacting to, not a culinary desire). It seems possible to me that the dog is choosing whichever scent is more powerful.
wespiser_2018 1 minutes ago [-]
If I repeat this experiment, I'll be a lot more careful about that, or also alternate which direction I'm standing in.
I didn't realize R/L preference was biased until I did the data analysis, and during the trials he was picking from both hands often enough that I perceived it as roughly 50% depending on the treats!
RataNova 54 minutes ago [-]
I liked that the post surfaced the bias instead of quietly ignoring it
markerz 16 hours ago [-]
I suspect it’s by construction, looks like they’re offering every permutation of treat choice twice.
Below, I filtered for A vs E, the top two choices. Notice how they switch left and right hand each time:
A/E :: A
E/A :: A
A/E :: E
E/A :: E
A/E :: E
wespiser_2018 7 hours ago [-]
Author here, yes, that's correct.
The initial set-up was to do 3 comparisons of the 5 treats (30 trials), alternate between right and left hand, then write a quick python script to randomize the order.
A bit more than halfway through the experiment, I ran the model and realized that A/D/E were the only contenders left, so I removed the B/C trials and added more A/D/E trials.
wespiser_2018 20 hours ago [-]
That's awesome! Thank you!
RataNova 56 minutes ago [-]
Even in a simple setup with one dog and five treats, the measurement process can still sneak into the result
jnellis 20 hours ago [-]
My dog's favorite treat is the most expensive one. Or the one that causes the most intestinal (and therefore cleanup) issues. All it takes is a pause and some brief math to see that a lot of (good for your dog) dog treats are $16/lb. That's not even remotely the most expensive. It's cheaper to feed them straight meat. I've resorted to making my own treats. It's like $4/lb, plus you know exactly what goes into it (mostly ground turkey, yams, rice/chickpea flour).
This just feels like an excuse to give your dog a statically significant amount of treats
RataNova 48 minutes ago [-]
Bebop: "I don't fully understand the model but I support increasing the sample size"
CM30 1 days ago [-]
This makes me wonder what the research is for whether certain types or breeds of dog prefer certain dog treats, and how individual dogs might develop a preference for one kind over another. Based on this experiment it doesn't seem like the type of meat matters much, since while the top ranked treat is chicken, his second favourite seems to be the duck one.
tracker1 2 hours ago [-]
We have 4 smaller dogs (mix of chihuahua and terriers), and they all absolutely love the greenies over anything else. One of them now has a prescribed treat and he definitely isn't happy about it, and the others won't touch it.
Hardest part is now feeding them all separate dishes at regular times every day.
RataNova 46 minutes ago [-]
I'd guess texture and(or) smell might matter as much as the actual meat
wespiser_2018 1 days ago [-]
Author here: I did a quick experiment with my Greyhound, Bebop, to figure out the treat he prefers best using pair-wise comparison analyzed with the Bradley-Terry model. Same tech as Elo scores in chess, and several other places! Enjoy!
zthrowaway 9 hours ago [-]
Really weird question but what boots are you wearing in your blog photo? They look wide enough for my weird feet. Thanks
thih9 24 hours ago [-]
My dog told me to write that the set of treats is missing non bleached rawhide, other dehydrated meats (eg rabbit, goat, fish), animal parts (eg ears), and vegetables. Also, he volunteers.
buildsjets 21 hours ago [-]
My Husky used to CRAVE little dehydrated minnows. Extra crunchy.
buildsjets 1 days ago [-]
The best dog treat is always the treat the OTHER dog is eating.
ses1984 17 hours ago [-]
My one dog hates broccoli but she will choke it down just so the other one can’t have it.
savethejoy 17 hours ago [-]
Oh my goodness.
weberer 16 hours ago [-]
Or cat turds
buildsjets 16 hours ago [-]
Kitty roca confirmed. Our Husky was a goon for it. At least it forced us to keep the boxes clean several times a day.
nosioptar 1 hours ago [-]
Kitty Roca is both the best and most awful thing I've seen in ages.
There is a medicine you can put on dogs' food to make their crap taste bad to them. There might be something similar you can give kitty.
NordStreamYacht 15 hours ago [-]
Good grief.
Why would you give your dog those as treats?
buildsjets 10 hours ago [-]
You don’t need to give it to them, they just graze at the conveniently provided buffet.
NordStreamYacht 9 hours ago [-]
Truffles come to mind.
lijok 24 hours ago [-]
Bebop is clearly being paid off by Big Chicken to skew the results
shermantanktop 23 hours ago [-]
Big Chicken == Tyson, I believe, at least in the US.
Big Strawberry == Driscoll's, at least on the west coast. And those are some pretty undistinguished strawberries.
buildsjets 21 hours ago [-]
No, Big Chicken == Shaquille O'Neal in the US. His picture is right there on the official Big Chicken Dot Com website and everything.
I stand corrected. And he is big, so that’s an apt spokesman.
buildsjets 16 hours ago [-]
Check out his hands. That’s a full sized chicken sandwich he is holding, and it looks like a McNugget on a slider bun.
pike00 21 hours ago [-]
Interesting read! I might replicate with my two whippets. What’s their inter-rater reliability?
You also should continue with a swap of the hands; randomize which one is in the left and record the results to see if the left bias is real
dieselgate 23 hours ago [-]
Our Malinois really liked the dehydrated chicken too, currently finishing a bag of the Trader Joes organic chicken jerky sticks. Interesting idea for some experiments, thanks for sharing
zerobees 19 hours ago [-]
In my experience, it's usually a partly-rotten deer leg found in the bushes on a nature walk.
wespiser_2018 5 minutes ago [-]
With Bebop, it's dead birds! He also finds them, then checks the same spot for months afterwords!
13 hours ago [-]
doglover737484 23 hours ago [-]
Add some interesting smells and dogs will eat absolutely anything.
Used tampons, literal shit, soiled underwear, dierhia, dead bird, freshly killed cat, they owners... It is basically a pig with collar that lives in your house.
I've seen many a lab eat their own shit, but my standard poodle takes his time investigating even a piece of steak before he decides whether it's worth eating.
srean 5 hours ago [-]
Varies by personality too.
embedding-shape 16 hours ago [-]
It'd be hard to sleep with a pig in the bed with us though, but point taken. Now I kind of wanna get a pig-buddy for our dog.
dgacmu 22 hours ago [-]
And so useful when you don't feel like scraping the dishes. ;-)
dice 1 days ago [-]
I missed the word "Treat" in the title initially and I was incensed. All dogs are the best dog TYVM.
Winner was Pur Luv Chicken, closely followed by MON2SUN duck + rawhide. Greenies and Pork Chomps fared poorly.
Incidentally OP if you want to make it more adaptive, you can just fit the B-T model each time, and grab a posterior sample of what the best pair is, and test that, which turns out to be Thompson sampling. I did this for fun with blind taste-testing of mineral waters: https://gwern.net/water
I didn't realize R/L preference was biased until I did the data analysis, and during the trials he was picking from both hands often enough that I perceived it as roughly 50% depending on the treats!
Below, I filtered for A vs E, the top two choices. Notice how they switch left and right hand each time:
A/E :: A
E/A :: A
A/E :: E
E/A :: E
A/E :: E
The initial set-up was to do 3 comparisons of the 5 treats (30 trials), alternate between right and left hand, then write a quick python script to randomize the order.
A bit more than halfway through the experiment, I ran the model and realized that A/D/E were the only contenders left, so I removed the B/C trials and added more A/D/E trials.
Hardest part is now feeding them all separate dishes at regular times every day.
There is a medicine you can put on dogs' food to make their crap taste bad to them. There might be something similar you can give kitty.
Why would you give your dog those as treats?
Big Strawberry == Driscoll's, at least on the west coast. And those are some pretty undistinguished strawberries.
https://www.bigchicken.com/about
You also should continue with a swap of the hands; randomize which one is in the left and record the results to see if the left bias is real
Used tampons, literal shit, soiled underwear, dierhia, dead bird, freshly killed cat, they owners... It is basically a pig with collar that lives in your house.
https://youtu.be/nMNLrQW7_pU
I've seen many a lab eat their own shit, but my standard poodle takes his time investigating even a piece of steak before he decides whether it's worth eating.
https://growlersdogbones.org/