A side project over the last few weeks has been something called the "Replication value project," something by folks affiliated with the Center for Open Science (Charlie Ebersole et al.). Here's a link to the project page on OSF: https://osf.io/bwp24/
The idea behind the project is to determine a metric indicating the degree to which a particular unit of research should be replicated. As in, how might someone compare two papers and determine which paper is more in need of replication?
I'm a contributor to the project and came up with my own candidate formula for determining replication value. Nine other authors and groups did the same, and we're currently going through and commenting on the formulas of others. If there's interest, I'll share my formula in a future post. In my opinion, there are some useful ideas there (of course, many smarter minds than mine are participating and probably have a solution that's "more right").
I hope to share more information about this project as it continues on!
In other news, I recently had a data paper accepted at the Journal of Open Psychology Data that I co-wrote with a former undergraduate student I worked with, Cecilia Votta. I'll share that, too, once it's up online. The idea behind this project is that we ran an experiment for a particular experimental purpose, but the writeup never really went anywhere (and the data were not too interesting). So rather than keep things in a file drawer, I felt it would be a good idea to put them online so that others might be able to use them. Please contact me if you'd like the accepted draft of the manuscript.
Here's the citation for the data:
DeSoto, K. A., & Votta, C. M. (2015). Psychology data on the effects of study schedules on category-member classification: Dataset. figshare. http://doi.org/10.6084/m9.figshare.1570940.v7
Hi all -- I know it's been over a year since my last research note. Working on the new blog plan for 2016. Stay tuned for more. Not quite sure what the right approach is yet, but I'll figure it out. Recommendations appreciated!
I've been using a Jawbone UP 24 to record total steps, total sleep, and total workout time since January 2014. I use it to track other stuff, too, but I'm most confident about these estimates. Here are my numbers from 2014.
My numbers are pretty decent! Just under seven hours of sleep is totally reasonable (these estimates exclude time I'm in bed but am awake -- e.g., if I can't fall asleep). I break the 10,000 steps per day recommendation with a little room to spare. And I manage to work out for 30 minutes a day, on average, mostly thanks to the first half of the year.
August is a clear outlier. What was I doing in August? Not much, apparently. Actually, I spent about half the month on a trip to Puerto Rico and moving Becky back to Virginia, so there was a lot going on -- just none of it was all too active.
Anyone else want to compile similar reports?
The #memorylab is quieting down before the winter holidays, and personally, there's no exception. I met with Roddy today to discuss some of our projects as we transition into the Spring 2015 semester. There's dissertation progress, as usual -- four experiments collected and basically analyzed -- but the presidents paper has got us interested in a few ideas involving collective memory. One project is a followup to the presidents paper, and another one is something different exploring recent events in St. Louis. Adam and I are collaborating on this front. The project with Steve is also developing, too.
Inspired by some of the highly superior memory folks we've had come visit (e.g., Nelson Dellis), I've been keeping a paper diary for about a month and a half now to see if it seems to improve my autobiographical memory. My unscientific intuition is that the thing isn't making a bit of difference. I do have some recollection of specific entries (e.g., one in which I was extremely angry), but nothing else feels qualitatively different. Is it a failed experiment so far? I don't know. One nice aspect is that a lot of exciting things have happened for me and others over the last 90 days or so. In that respect, it is nice to have an as-it-happens look at these different events. Will I ever go back and rehearse my memories of these events? Unlikely.
Meanwhile, it's been about three weeks since I switched to my Android phone (a Galaxy Note 4). So far I really like it. I love the size of the screen, the attached stylus, and the flexibility (e.g., if you want to modify the LED colors, you just download an application that lets you do this). I do miss the overall ease of sending text messages with the iPhone, but I think when Android Lollipop gets released for the phone in a month or two, hopefully, on-screen notifications will ease this burden. The device certainly feels further in the computer/tablet direction on the phone to tablet to computer spectrum. Overall, this is OK. I have been having a strange bug involving receipt of MMS messages, though, which I'd like to figure out at some point.
It was a good week in the #memorylab. I made my first public radio appearance on Tuesday, on St. Louis on the Air. You can listen to the 30-minute segment by clicking here. I had a great time, and the folks in the St. Louis Public Radio office were very professional and friendly. Hopefully I'll do something worth inviting me back for someday.
We also said farewell to Steven Smith, who had been visiting WUSTL for the semester and is now headed back to his post at Texas A&M University. He was in St. Louis just long enough for us to put our heads together for the beginnings of a project investigating high confidence false memories for face materials. See a recent paper by Deffler, Brown, and Marsh (2014) for related research.
Deniz and I have been working hard on interpreting the data we collected for the fourth study of my dissertation. Whether it goes into the actual thesis remains to be seen, though, since it is a pretty thick dataset.
And tonight is the first Psychology Department Holiday Party in my six years here that's not being held in Room 216. If you're in the department and have RSVP'd, I hope to see you Upstairs at the Cheshire this evening. The festivities won't be too prolonged, though, considering there's a Frostbite Series 12K at 8:30 the next morning!
Been a hectic week with a paper release imminent and Psychonomics on its way. Not to mention the Thanksgiving holiday is up in a little over a week, too. Well, the good news is with the November holidays over I'll be able to focus full-time on my dissertation again, and get that ball rolling for what should be the final time. Once we hit December it should be a good kind of freefall from there.
Another project I've been thinking about is something that's in the works with Dr. Steve Smith, who's visiting from Texas A&M this year. We're interested in some forensic questions that are a bit more applied than the other things I've tacked in graduate school. Hopefully there will be some interesting things to report in this space a little later.
But, as the title of the post says, with everything that's going on, it's a bad time to have doubled (tripled?) my daily coffee intake. I wonder if it's affecting my sleep, too, although a recent night of sleep (slept in a bit, don't judge) looks pretty unconcerning:
Most of the lab is spending this week gearing up for Psychonomics, the big experimental psychology convention that's being held this year in Long Beach, CA. Perhaps we will see you there! Here's where you can see #memorylab members in the wild (members in bold):
Roediger and DeSoto in Recall I, Seaview A & B, at 1:50 PM Saturday
Putnam and Roediger, Friday Evening Poster 3081
Abel, Holterman, and Baeuml in Human Learning and Instruction I, Regency D-F, H, at 2:10 PM Friday
Yan, Sungkhasettee, Murayama, and Castel at Friday Evening Poster 3097
Hays, Garcia, Finley, and Bjork, Thursday Evening Poster 1114
Did I miss you? Any alumni want to be added to the list? Comment below!
Submitted what's probably the last version of our page proofs for our paper today. This means that it's likely the article will be published sometime before the end of the year, and quite possibly before the end of November -- who knows, it's hard to say. Continue to stay tuned; there's probably nothing more to say on the manuscript until it's published.
Which reminds me that I need to work on an IRB modification to get the task up and online. This needs to happen pretty quickly, so I should stop writing updates and get on that immediately.
Yesterday, I ran the Skippo, a 20K trail race at Castlewood State Park. It was my first time at Castlewood and my first trail race. I finished!
A picture from afterwards:
A few accomplishments today:
Looked over Adam's paper draft that he'll be resubmitting in a few hours. It's looking pretty good. Will try and link to it once it's published.
The majority of the day was spent working on proofreading and editing the Science paper, and other rigamarole associated with getting the publication out the door. The page proofs are looking really nice and it'll be exciting to share it with readers here before the end of the year.
Also spent some time working on a few professional development issues.
Deniz is running seven (or so) subjects as we speak.
And lastly, the day was capped off by a pleasant surprise visit by Andrew Butler, Assistant Professor at the University of Texas at Austin. He's a fabulous researcher who is bound to continue a great career in the land of beef brisket.
P.S. Made arrangements for another meeting with the Neon Electrons this Friday.