Grad School Series: Applying to Graduate School in Industrial/Organizational Psychology
Starting Sophomore Year: Should I get a Ph.D. or Master’s? | How to Get Research Experience
Starting Junior Year: Preparing for the GRE | Getting Recommendations
Starting Senior Year: Where to Apply | Traditional vs. Online Degrees | Personal Statements
Interviews/Visits: Preparing for Interviews | Going to Interviews
In Graduate School: What to Expect First Year
Rankings/Listings: PhD Program Rankings | Online Programs Listing
Having written my grad school series, one of the most common questions I get is, “Which graduate programs should I apply to?” As I’ve explained on this blog, that’s a complicated question. You should evaluate which schools offer what you want as a student.
Unfortunately, SIOP does not make it easy to directly compare such information across programs. That’s understandable to a degree – much of this information, like research interests, changes frequently. However, every few years, a new set of rankings appears in SIOP’s newsletter, TIP, for some reason still chained to a text-based format, and sometimes to PDF. Why not something a little more modern?
So to fix that, I’ve combined the most recent of several rankings currently available into a searchable, sortable format: US News and World Report’s ranking of I/O psychology programs (woefully incomplete), the most recent evaluations of I/O faculty research productivity as reported by Beiler, Zimmerman, Doerr and Clark (2014), the number of I/O faculty in each program from that same source, and the most recent student satisfaction ratings of I/O PhD programs as reported by Kraiger and Abalos (2004). Those student satisfaction ratings are a bit old (collected in 2002), but they’re the most recent currently available.
These rankings shouldn’t be the only thing you look at when considering a graduate program, but it is something worth paying attention to.
Table column meanings are as follow (1 = highest rank for all columns except Num Fac, NR = not ranked)):
- Num Fac = The number of I/O faculty at the program.
- US News = The US News and World Report ranking.
- Pubs = The number of publications by I/O faculty in any peer-reviewed outlet between 2003 and 2012.
- IO Pubs = The number of publications by I/O faculty in the “top 10 I/O journals” between 2003 and 2012.
- SIOP = The number of SIOP presentations by I/O faculty between 2003 and 2012.
- Prod = An overall productivity index of I/O faculty between 2003 and 2012.
- Per Cap = The overall productivity index per capita (i.e., split per I/O faculty) between 2003 and 2012.
- Students = An overall weighted index of student satisfaction across 20 dimensions, from a study conducted in 2002.
Note that you can click on the headings to re-sort the table at will.
|Program||Num Fac||US News||Pubs||IO Pubs||SIOP||Prod||Per Cap||Students|
|Michigan State University||8||1||1||3||1||1||9||NR|
|University of Minnesota||5||1||2||4||4||3||3||NR|
|University of South Florida||8||4||3||1||5||2||16||NR|
|University of Central Florida||6||NR||4||29||2||16||25||NR|
|George Mason University||7||NR||7||8||3||5||21||10|
|University of Georgia||8||NR||8||2||7||4||29||20|
|Teacher’s College, Columbia University||9||NR||9||33||38||8||38||7|
|University of Akron||8||NR||10||7||12||6||32||NR|
|University of North Carolina – Charlotte||6||NR||11||10||29||18||27||NR|
|University of Calgary||4||NR||12||34||37||31||7||NR|
|Portland State University||5||NR||13||19||13||19||14||NR|
|Bowling Green State University||5||3||14||11||11||10||8||17|
|University of Maryland||3||NR||15||13||9||12||2||9|
|University of Waterloo||5||NR||16||26||36||30||23||NR|
|Old Dominion University||5||NR||17||38||28||27||20||NR|
|The Pennsylvania State University||6||NR||19||18||10||14||24||NR|
|Georgia Institute of Technology||5||NR||20||14||27||13||10||5|
|Texas A&M University||6||NR||21||6||6||9||18||NR|
|University of Illinois at Urbana – Champaign||4||NR||22||12||14||11||6||NR|
|Central Michigan University||5||NR||23||22||18||20||15||NR|
|Florida Institute of Technology||6||NR||24||36||19||35||34||3|
|Wright State University||5||NR||25||20||16||26||19||NR|
|Baruch College, CUNY||7||NR||26||16||24||22||36||13|
|North Carolina State University||7||NR||27||17||21||24||37||NR|
|University of Western Ontario||5||NR||28||21||26||23||17||NR|
|University of Missouri – St. Louis||6||NR||29||28||34||29||31||NR|
|Colorado State University||4||NR||30||37||22||36||11||4|
|Florida International University||5||NR||31||27||25||28||22||NR|
|University of Houston||5||NR||32||15||8||15||12||12|
|Wayne State University||8||NR||34||23||15||25||39||NR|
|De Paul University||5||NR||35||25||31||34||26||NR|
|University of Albany, SUNY||3||NR||36||30||30||37||4||NR|
|University of Guelph||7||NR||37||35||39||39||40||2|
|Illinois Institute of Technology||5||NR||40||31||32||40||30||6|
If you haven’t heard of it, inbox zero is an email management technique where you pursue an inbox clear of messages. You can accomplish this by doing one of five things to each message each time you go through your inbox or as messages arrive: delete, delegate, respond, defer, or do.
Both the strength and challenge of inbox zero is that it encourages you to “do” whenever an email comes in if that email is doable. If it’s junk, trash it. If it doesn’t require a response but you might need it later, file it. If it just requires a reply email, send it. If it’s about something that will only take 10 minutes (maybe 20 or 30, depending on the complexity of emails you usually get), just do it then. What’s left me are things that will take a substantial amount of time to deal with, in which case you can set a reminder to return to that email at a specific day and time in the future when you can schedule it in.
In following this approach, I imagined this left my graduate students wondering why in some cases I respond to their email in 5 minutes, and other times, in 2 days. Well, there’s your reason.
The inbox zero technique was actually my default strategy with email since before the start of graduate school, before I knew it had a name. I always found it a little baffling that people would allow hundreds or thousands of messages to pile up in their accounts. How would you possibly keep track of what needed doing? Since at least 2003, I’ve sorted read/dealt with emails into folders as soon as they were “dealt with.” Occasionally, I would hit the state of inbox zero (the goal of the inbox zero technique), where your inbox is literally empty. Rare, but it would happen. Mostly during the summer.
The problem with inbox zero as a goal for research faculty is that you rarely have an email that says “go do research,” which means research became the thing I did after inbox zero was reached. This ended up pushing me into a weird cycle for a few years: I would get all my service done (article peer review, committee work), I would get all my teaching done (class is a hard deadline), I would be active in mentoring (graduate students send emails, so those emails end up being “done”), and I would end up with a large number of research studies being run by graduate students (the consequence of those graduate student emails and subsequent meetings), but I would only be able to get one or two article manuscripts out each year.
It might seem odd that I had so many studies running yet relatively little actual writing going on. That is because inbox zero as a time management technique really only requires you to act on your incoming emails; if it’s not in an email, it’s not “to do.” And when your day is full of 10- to 20-minute tasks, it becomes difficult to find a stretch of time for writing while inbox zero remains a few emails away.
Critically, over a few years, I also learned an important related lesson: quick responses to emails bring more emails. Where I might respond to 30 emails per day if I responded to them in a single daily batch, my pursuit of inbox zero resulted in maybe 50 emails per day instead. That adds up, and quickly.
To deal with both of these problems, I’ve now instituted a modified inbox zero approach, which I think of as inbox zero with pause days. Each week, I set aside at least one (and preferably two) days, which are reserved for writing. On pause days, I don’t keep my email program open. I check once every hour or two, on purpose, and I put my phone out of reach. When I do read email, I don’t follow my normal inbox zero approach. Instead, I cut “do” from the list. Anything that will take more than a simple delete, file, or return email doesn’t get done that day. Period.
This has resulted in a remarkable increase in my ability to write, which is important, because I ended up with 6+ datasets that needed writing up. Changing my approach this year has resulted in a dramatic change, going from 1-2 publications per year up to 5 articles and chapters currently in press and 3 under review. And I still have 4 datasets to go!
If you ever talk to an artist about how they create whatever it is they create, whether that is acting, pottery, or blog articles, you will eventually begin to talk about their “process.” The process is whatever technique people use to go from a default state (e.g., bored and watching TV) to a state of creation.
A person’s process is really about two things: it is about motivation and technique. If you’re an actor, you must motivate yourself to throw yourself entirely into the emotional and behavioral state of a character. You must also do so well.
When writing, recommendations about process focus largely on writer’s block. As a person writing a research article, with a decent process, you should never have writer’s block. The reason is that scientific writing is a highly technical, by-the-books sort of task. You don’t need to be inspired, and you shouldn’t wait to be inspired. In fact, writing scientific articles while inspired is the leading cause of bad scientific articles. Instead, you need to be methodical. With sufficient technique, motivation becomes less relevant.
With that in mind, here is my process, which is really all about technique. I use this process in my own writing, and I recommend it to all of my graduate students. Following it step by step helps to avoid extensive re-writing, which is the worst nightmare of many a graduate student.
Step 1: Identify your audience and eventual publishing venue. If writing a thesis, this will be your committee. If writing a journal manuscript, this will be the journal’s reviewers.
As a graduate student, audience can be a tough one. I think, by default, graduate students tend to think of the audience as “people who know more about my topic than I do.” But it is a bit more specific than that. People that are asked to be reviewers for particular journals are asked for one of four reasons.
- They may be asked by connection. For example, the editor has collaborated with the reviewer in this area before and leans on that relationship to get a timely review.
- They may be asked by guilt. For example, the editor is a little desperate for reviewers, so s/he asks an early career person, like a grad student or first-year PhD, or any random person off of the journal’s prior reviewer list. Such folks are generally scared to turn down any opportunity/responsibility that comes their way, so they almost always say “yes” even if they know little about your topic.
- They may be asked by association. For example, if you base your paper largely off of a particular other researcher’s work (i.e., their name is cited in your paper a lot), that person may be asked.
- They may be asked by reputation. This is where most people assume reviewers come from, but it is probably the least common source in practice across journals. When you submit to high-tier journals, though, you’re more likely to get this sort of reviewer. In this case, a known expert in the topic of your paper reads your paper.
In terms of reviewer quality, the guilt and connection groups are your worst nightmares, because they are completely unpredictable. The best way to write for these reviewers is simply to use clear, unambiguous prose. Even if those reviewers are skimming through your paper, they should understand what you’re trying to say. I’ll return to this point in a later Step.
The association and reputation groups are the ones you’re really writing for. They know what you’re talking about, and they want to know what you are contributing and why. People in these two categories generally don’t read your article word for word. The reason for this is that they already know most everything you’re saying. You’re citing literature they’ve read before, describing ideas they already know. Instead, they want to know what unique message you are delivering with your paper. So to determine this, many experts read topic sentences only and briefly skim the rest of each paragraph, taking time to read in deatil only when they are unsure what point you’re making.
This is really the secret of scientific writing. You make the major points you are trying to get across to support your argument in the topic sentence of each paragraph. The sentences that come after that point only serve to support that topic sentence. In scientific writing, you should not make callbacks to previous points unless absolutely necessary, and you (usually) should not use transition sentences between paragraphs. Each paragraph should be a self-contained little island of information – a major point, following by information to support that point.
When reviewing, reviewers identified by association and reputation will expect this format and use it to get to the meat of the paper as quickly as possible. Scan, scan, scan – oh look, a paragraph that makes a unique point that I’ll read more closely – scan, scan, scan. If your reader can’t tell what point you’re making in a paragraph, they may skip it anyway and then miss whatever you were trying to say. If you don’t follow the topic-then-support pattern, your paper will be more difficult for an experienced scientist to read, and a difficult-to-read paper is a quick path to rejection.
If this sounds different than what you learned in English class, you’re right. Narratives rely on a poetic flow of ideas expressed eloquently, although not necessarily clearly (depending upon the author’s intent). For maximum rhetorical impact, the author of a narrative may leave out important details to encourage you to think a certain way, only revealing them later to maximize the impact on the reader. In contrast, scientific writing relies on predictability and fully supported points. You must always make your points up front and then provide supporting details. This takes a dramatically different approach than writing a story – which is what we’ll get to next.
Step 2: Write a Skeleton Outline matching the publishing venue’s expected article structure.
Once you’ve identified the sort of expertise and expectations of your reviewers, you’ll want to start to meet those expectations. The first step in this process is laying out an outline that matches the required format of your intended publication target. These vary widely. In Psychology, you might need to write a paper in APA, or you might not. Check the journal’s website and find out. For our example here, I’m going to assume that you’re writing an manuscript for a journal requiring APA style. That means the next step is creating this outline:
- (Introduction to the Introduction – Less than 4 pages)
- Heading 1
- Heading 2
- Heading 3
- (Introduction to the Discussion)
- Practical and Theoretical Recommendations
That’s it – an entire paper. Note that a few sections are surrounded by parentheses. That is because these headings are not “real” headings – they will not go into your paper. Instead, they are implied by the structure of your paper. All other headings (the bolded ones) will eventually appear, word for word, in your actual paper.
There are a couple of special sections worth noting at this point.
The intro to the intro is 4 or fewer pages that come immediately after your title but before any other headings. The intro to the intro is the most important part of your paper. It should set up all major arguments that you plan to make in your paper and all major terms that you will use in your paper. If your reviewer can’t figure out exactly what you’re researching and why by the end of this section, you will get a negative review.
The intro to the discussion is the second-most-important section. Folks in the connection and guilt reviewer groups are going to rely on this section to tell them exactly what your paper contributed and if it was important. This is a terrible shortcut for them to take, but it is unfortunately pretty common. Ensure you make all of your hard-hitting conclusions in this section, right up front. Don’t save the best for last.
That’s it at this stage – ensure your skeleton outline matches the journal’s expected format, and you’re ready to move to Step 3.
Step 3: Create a Summary Outline by filling in the outline with verbatim headings, summaries of major points, and target page counts.
This outline is, at this point, pretty fluid. You want to keep the overall structure of the skeleton outline, but you may add or remove headings as needed. You might, for example, decide you need to have headings in your results section because you have a lot of results to get through. You might decide to split up theoretical and practical recommendations because you have a lot of recommendations. This is the stage to make those decisions. Here’s an example:
TITLE: An Amazing Exploration of Writing Scientific Papers
- (Introduction to the Introduction – Less than 4 pages)
- Discuss how popular paper writing is
- Discuss how more research is needed on paper writing
- Describe how we’ll be testing paper writing
- Paper Writing Theory (2 pages)
- Paper writing theory is complicated
- Paper writing requires training
- Paper Writing Training (2 pages)
- Training is very important to improve paper writing
- Training delivers paper writing theory to those in need
- Past research has supported the use of training to improve paper writing
- H1. Being trained in paper writing will improve paper writing.
- (Introduction to the Introduction – Less than 4 pages)
- Method (3 pages)
- Participants were some random wahoos from the Internet
- Summarize demographics here
- Describe paper writing intervention
- Describe outcome measure (noting inter-rater reliability)
- Describe procedure
- Results (1 page)
- We did an independent-samples t-test, and we found a big effect which was also statistically significant.
- (Introduction to the Discussion – 2 pages)
- Paper writing training totally worked!
- Describe implications for paper writing theory
- Limitations (1 page)
- We didn’t actually conduct the study, so that’s limiting
- The participants were random wahoos from the Internet
- Practical and Theoretical Recommendations (2 pages)
- We need more work on paper writing theory
- We need more brilliant blog articles on paper writing
- Conclusion (1 page)
- Things are better now because of my paper
- (Introduction to the Discussion – 2 pages)
This outline should be shared and worked on collaboratively with any co-authors, although I recommend it be written initially by the primary author alone. In doing this, all writers will know exactly which points have been made by any given point in the paper, but the primary author will be responsible for the overall vision and progression of what is written. This is helpful for several reasons, most especially, if I’m working on the discussion and coauthors are writing everything else, I won’t need to see their actual writing to know what has already been said. This supports a coherency of writing in multi-author papers that is difficult to achieve otherwise without hiring a professional editor post hoc. This also increases the overall speed of article production, since less back-and-forth coordination is required later (minimizing what is called “team process loss”).
By the end of this stage, all writers should agree that the flow of major ideas supports the points being made.
Step 4: Create a Detailed Outline by replacing major point summaries with verbatim topic sentences.
In the next stage, each author should update the summary outline by replacing general concepts with actual topic sentences. For example, the intro to the discussion might be changed to this:
- (Introduction to the Discussion – 2 pages)
- As hypothesized, the training of paper writing skills produced a strong, positive effect upon paper quality scores as made by expert raters.
- This study’s major contribution to paper writing theory is our integration of the effects of training on existing theoretical frameworks.
When creating a detailed outline, you should try not to add or remove any paragraphs that you’ve already agreed upon in the previous Step. Sometimes it is necessary, but if you completed the previous Step correctly, it will be minimal. It happens most often when writing topic sentences – you realize that something you summarized before is more complicated than you initially believed.
Topic sentences are the only point at which there should be “transitions” in your paper. A topic sentence can refer to a previous topic sentence if two points are closely tied together. However, you should avoid this unless absolutely necessary so that the paper is easier to reorganize later, if necessary (for example, by reviewer request in a revise and resubmit).
Once all authors have finished their sections, the complete outline should be reassembled. Because the topic sentences are where the “story” of your paper is told, you should be able to read your entire outline of topic sentences and come away with a complete picture of everything you argued, everything you did, and everything you contributed. If a reviewer were to take everything in this version of your outline at face value (i.e., if they didn’t care about previous research supporting your points), your outline alone should form a compelling argument for what you did.
After all authors have reviewed all contributions and agreed that the topic sentences make a compelling and fully supported argument, you move on to the next Step.
Step 5: Convert your outline into a paper by adding supporting points to each topic sentence. Try not to change any topic sentences at this point.
In scientific writing, actually writing your paper is the easiest step! At this point, you have a very specific blueprint. You’ve finished all the hefty thinking work already! Thus, the final step is simply to add supporting details, with plenty of citations, for each of your points. The key in this stage is that every sentence you write – every word – should be written to support the topic sentence of the paragraph you are currently writing. Don’t worry about additional planning, or additional points, and remember to ensure that each paragraph is self-contained. If you do end up changing a topic sentence, or adding or deleting one, make a comment (Word’s reviewing tools are great for this) to alert your co-authors of the change, just in case they based some of their points on yours.
Step 6: Check for logical consistency and voice in the completed paper and edit as needed.
In the final step, all contributions from all authors should be combined into a complete paper. First, review this paper for consistency – if anyone changed a topic sentence, you may need to revise the flow of the overall paper. This is where self-contained paragraphs are useful; if you need to move anything, you don’t need to worry about breaking the flow of the paper because you can see exactly which points fall where. Especially important here are term definitions – if you introduced a term in Paragraph 10 and then move Paragraph 12 to become Paragraph 8, remember to check that you didn’t use that term from Paragraph 10 before defining it. Second, review the paper for voice – ensure that there are not obvious “breaks” between different authors where the style changes dramatically. It is typically the primary author’s responsibility to resolve such discrepancies.
That’s it! If you complete all of these steps, you will have a must better chance at ending up with a logical, well-argued, social scientific paper suitable for publication. Well done!