Skip to content

Trying to Understand SIOP 2020 and Coronavirus

2020 March 11
tags:
by Richard N. Landers

Mar 17 Update: Four days after posting this (although it felt like longer!), SIOP 2020 was officially canceled. Clues from the official announcement point to financial concerns being the major issue to resolve before announcing, as I predicted below. We still don’t know if there will be an online version of the conference, but at least we know SIOPers won’t be infecting each other come April. At least not in Austin!

There’s a lot of panic and concern in relation to SIOP 2020 within the I-O psychology community right now. There have been several posts per day on the I-O psychology subreddit, Twitter has gone crazy, and the leadership has for some reason decided upon austerity in terms of communicating to the membership, which has driven people to a bit of a frenzy.

Given that, I have decided to share my thoughts on this more completely than I can on Twitter or elsewhere, as someone who is not in the leadership but who has been an active volunteer for many years and has a general sense of “how SIOP works.” So take this as you will, and please recognize that I don’t have access to any information that you don’t. So I am taking the information I do have and extrapolating a bit based on my own experience.

Let me first give a general recommendation:

Calm the f%&$ down.

Here’s the main thing to remember. SIOP is almost entirely a volunteer organization. The administrative office (affectionately referred to as “the AO”) is roughly a dozen people that keep the lights on and manage all of the technical aspects of running a many-thousands-person large non-profit organization.

The vast majority of the decision-making is actually made by the “volunteer workforce” of SIOP, which is several hundred people, all enthusiastic academics and practitioners who wanted to give back to the I-O community. I’m part of this community myself but not in the leadership; I’m the chair of the Futures Committee and head of the Technology-Enhanced Workforce Advocacy Task Force, which lobbies in Washington DC for the relevance of SIOP to federal decision-making.

The decision-making leadership of SIOP is the Executive Board (often called “the EB”), many of whom full SIOP members elect to 3-year terms in elections held every year and are themselves volunteers, typically with lots of prior experience elsewhere in the volunteer workforce. It’s the EB that makes the “big decisions,” and they’re the people managing the COVID-19 response. I think it’s around one to two dozen people, but that’s a rough guess from sitting in the room during the EB meeting at SIOP last year.

This all means that for the most part, no one on the EB or the broader volunteer workforce has any non-profit leadership training or experience, and “dealing with the fallout of coronavirus threatening to cancel SIOP” was definitely not something they had considered when volunteering.

So when you decry “SIOP,” please recognize that these are the people you are criticizing. That doesn’t let them off the hook for bad decision-making, but it’s important to keep in mind that they are doing the best they can while in way over their heads, and that they are academics and practitioners just like you and me. I can almost guarantee you that almost all the EB has been dealing with for the last week is the COVID-19 situation, often at the expense of time spent on their own (paying) jobs and families.

Given all of that, let’s explore the situation right now, as of March 11. What we know so far:

  • Austin, TX has banned all gatherings larger than 2500 people. Word on the street from Austin locals is that this number is going to be reduced soon.
  • Many universities and businesses (including mine!) have banned non-essential travel by their employees, which will prevent people from attending even if they still wanted to.
  • Given those travel bans, many presenters will be unable to attend SIOP. I had to cancel my pre-conference workshop, for example, and I won’t be at any of the three sessions I’m attached to.
  • SIOP released an extremely odd-sounding statement that they seemed to be petitioning Austin to hold SIOP anyway.
  • Given how conferences work (I have organized a small conference before, so a bit of extrapolation here to big conferences), SIOP will be financially responsible for hotel rooms not paid for and for the conference space reserved, even if no one shows up. Exceptions to this would be made by Marriott International, not SIOP, and we don’t know what Marriott is willing to do (another detailed that would need to be worked out via our volunteer workforce).
  • Let’s estimate that SIOP is on the hook for 2000 hotel rooms (I know SIOP booked the JW Marriott completely, which has 1012 rooms, plus due to overflow SIOP booked at least two additional hotels) at $260/night for an average of 3 nights. Conference hotel contracts typically require the organization booking them to guarantee 75% of rooms. That would be a bill of approximately $1.5 million.
  • If Marriott will not grant an exception, and this would be a big bill to just waive away, SIOP will need to absorb the cost or make an insurance claim, and their insurance company is going to have specific rules about cancellations. SIOP can’t just cancel the conference because it’s scared of COVID-19 and get insurance to cover it. There are rules about what insurance will cover and under what conditions, as anyone who has had to make a claim on insurance is well-aware of. It’s very common for insurance companies to ensure you’ve “exhausted all options” before making a claim.
  • There are no policies regarding pandemics at SIOP. We don’t know if registration fees would/should be refunded, for example, which is a further financial hit.
  • Pre-conference workshops are a major source of annual revenue for SIOP, and they would almost certainly need to be refunded. My pre-conference workshop has been canceled, since I can’t go to SIOP, and workshops typically have 25-35 attendees. Averaging 30 attendees, at $420 registration, that’s $12000 in revenue lost from my workshop alone. There are 16 workshops, so let’s say around $200,000 in lost revenue from this. And this isn’t something insurance would cover. So not only will SIOP need to cover unexpected expenses, but it will lose revenue as well.
  • There are many clues that SIOP depends on conference revenue to continue existing. For example, see the note about “decrease dependency on conference revenue” as a major strategic goal here.
  • Thus, if SIOP refunds all registration fees including workshops and pays all penalties, it’s down a minimum of $1.7 million. I suspect it’s more than that, given caterers, setup crews, etc., may not have been hired through Marriott, and the $1.7 million number does not even include money already spent to reserve the rooms in the convention center.
  • I would be absolutely shocked if SIOP has even close to that much cash in reserve. Most non-profits run expenses fairly close to revenues, and I suspect SIOP has done the same.

All together, that means the announcement should not be all that surprising. My tentative conclusion is: if SIOP does not respond correctly in relation to its insurance company, it will not exist next year.

There are some clues in the March 11 announcement that support this interpretation:

  • SIOP is “working to find the best possible solution to ensure the integrity of public health, science-practice translation, and the financial future of SIOP”. Odd to just casually throw “financial future” in there, isn’t it? Almost like they need to resolve some background issues before they can cancel the conference?
  • We are partnering with JW Marriott and Austin Public Health to obtain an official ruling.” A lot of emphasis here on “other organizations need to make decisions before we can.”
  • “The decision by Austin Public Health will help to guide our path”. I read this as “we hope we are not allowed to hold SIOP, because that will force insurance to pay up.”

So again, you might ask at this point why the leadership would not just admit all of this, and my suspicion is that they don’t know if they can. Insurance companies are notoriously finicky about what they will cover and what they won’t, and if they announce intentions to cancel ahead of a formal decision by the City of Austin, who knows what impact that would have?

So my final recommendation: let the SIOP EB work this out, and stop panicking. Give them some time and some space. I know several members of the leadership as friends and colleagues, and I can guarantee you that they are working in the best interests of SIOP. Service positions like this, in addition to being without any financial compensation beyond one or two dinners a year, are often thankless too. There is no reason to go up for one of these positions unless you want to make a positive impact on the field. I promise you they are doing their best and will let you know what’s happening as soon as they feel they can. And I’m waiting here to hear about it right beside you.

The State of the IO Psychologist Academic Workforce

2020 February 23
by Richard N. Landers

The American Psychological Association released a report in December summarizing the current state of the “academic psychology workforce” based upon the results of the 2015 Survey of Doctorate Recipients, a National Science Foundation project. The APA’s report is intended to give a number of demographic summaries of what people with research PhDs in psychology end up doing in academia.

This sort of reporting has the potential to inform a number of high profile conversations going on right now regarding the relative rates of PhDs graduating versus the number of tenure-track positions available for them. Should psychology graduate fewer PhDs, knowing that there are more limited tenure-track jobs available for them?

Having said that, my impression before reading this report was that IO is a bit unusual in the grand scheme of academic psychologists. Many PhDs graduate with no intention or desire to go into academia, and even those that are considering academia often are attracted by the salaries and other assorted benefits of working in industry. That reduces the supply of research PhDs trying to get academic jobs. And as any IO knows, when the supply of job applicants is small, that generally produces better outcomes for those job applicants – better salaries, better benefits, less competition, and so on.

So, does that prediction pan out? Mostly. Here is a summary of major findings related to IO from the report (which I’d urge you to scan yourself):

  • Currently, 29313 people with psychology research PhDs work as faculty, which is roughly 25% of all psychology PhDs. 1131 of those are IOs, meaning IO psychology makes up roughly 3.9% of the American psychology faculty workforce.
  • 3798 people with IO psychology PhDs work in other academic positions, meaning that more IOs work in support of academic institutions (e.g., admissions officers, HR offices, soft money researchers) than in faculty roles (77% of IOs are outside of faculty roles; 23% in faculty roles). That’s actually no different in pattern from other areas; for example, 86% of clinical psychologists are in non-faculty academic roles. If you think this is limited to applied positions, not true there either; 55% of academic social psychologists are in non-faculty roles. My suspicion is that IOs are more on the admissions/HR side than the soft money side, and the reverse is true for social, but that’s a guess and not explored in the report.
  • Of psychology PhDs in faculty positions, IO is severely underrepresented in two-year/community colleges. In fact, there were so few, that the report does not even report the actual number for IO and was collapsed into “other subfields.” At four-year colleges, we make up 4% of faculty, and at university-affiliated research institutes, we make up 6% of faculty.
  • Among faculty roles, 89% are in tenure-track roles, and only 11% are in non-tenure-track roles. This is the highest by subfield, tied with social psychology. Subfields that are more health-oriented are at the opposite end (e.g., counseling psychology is 45% in tenure-track roles). For comparison, 89% is close to the tenure-track rate for other science and engineering fields. 45% is closer to the rates for the humanities.
  • Other reported stats were not field-specific, although there are several interesting nuggets. For example, the number of psychology PhD faculty in any institution has increased by almost 1/3 over a 10 year period (2003: 22323 faculty; 2015: 29313 faculty). In 20 years, it’s increased 57% (1995: 18542), suggesting that growth is slowing, but not by much.

Take-homes from this? IO is sitting pretty, at least in relation to other areas of psychology. My suspicion is that the market pressure for IOs, to leave for industry, keeps things a bit nicer for IO faculty than for faculty in other areas.

Having said that, we are also lightly represented in many places. This has subtle effects with big implications; for example, if a four-year institution only has 2 or 3 faculty, and by chance all or most of those faculty decide to change jobs, it’s quite easy for the rest of the department to lobby to take over and eliminate the IO area in a bid to increase their own resources. We’ve actually seen this exact scenario a few times already, where (for example) a social or personality psychology area will “absorb” the IO area once it becomes too small to have the political power to defend itself.

Another issue is that the lack of IOs in community colleges, which serve a lot of students (each year in the US, there are about 10 million four-year students and 6 million two-year students). That means we have limited or perhaps zero exposure to at least a third of the post-secondary students taking psychology courses. This is the situation that led to SIOP conducting so many initiatives to get IO represented in introductory psych courses, but without IOs teaching at the front line, the impact is likely to be limited. Unfortunately, I see no easy solution to that; low pay already drives potential four-year IO faculty to other opportunities, and community colleges typically pay even less. One option would be to promote the fact that it’s relatively easy as a full-time community college faculty member to run a profitable side consulting business, but I don’t know how many people would really pursue that combination.

So, overall, a mixed bag here: IO is doing well where it exists but is underrepresented, and that underrepresentation is likely to harm us long term. There are several ways to address that problem, but it would likely take a concerted effort by SIOP (and/or other IO organizations) to see any real change.

TNTLAB SIOP 2020 Schedule

2019 December 9
by Richard N. Landers

Another year, another round of SIOP acceptances! We’ll be having another busy year in 2020 – please join us! This year, in addition to Dr. Landers and associated graduate students, TNTLAB is also represented by Markus Langer, who is a Visiting International Scholar in the lab through next year.

Tutorials and Workshops

Free Workshop: Alexander, L. (Chair) & Landers, R. N. (Discussant). (2020, April). Interactive tools: Web-based applications in organizational research and practice.

Master Tutorial: Auer, E. M., Collmus, A. C., & Kaminsky, S. E. (2020, April). Essential data science toolkit for IO: A crash course in scientific programming.

Free Workshop: Belwalker, B. B., Bipp, T., Buckner, J. E., Marin, S., Vantilborgh, T., Oswald, F. (2020, April). Kicking off open science collaborations in IO psych.

Roundtable: Kay, K., Golbodaghi, A., Poeppelman, T. R., Field, J. G., Campion, E. D., … Medeiros, K. E. (2019, April). Top trends roundtable forum and communities of engagement kickoff.

Free Workshop: Landers, R. N. (2020, April). Curating big datasets from free online data sources using APIs.  In S. McAbee, F. Guo, & A. Samo (Chairs), Teaching Big Data Methods in I-O Graduate Curriculum 3.0.

Pre-Conference Workshop (fee applies, sign up during conference registration, seats are limited): Landers, R. N. & Carter, M. (2020, April). Designing data-driven systems: AI and data science in I-O psychology.

Research Incubator: Marin, S., Asseri, S., Rosenberg, E. S., & Landers, R. N. (2020, April). Virtual reality as a method for IO psychology. In S. G. Brown (Chair), Novel or Underutilized Research Techniques: A Research Incubator.

Machine Learning and AI

Symposium: Auer, E. M., Marin, S., & Landers, R. N. (2020, April). Predicting non-cognitive traits using trace data from a cognitive ability GBA.  In S.-C. Codreanu (Chair) & F. Leutner (Chair), Game-based assessments: Fad or sound psychometrics assessments?

Symposium: Auer, E. M., Tran, K., Dunk, L., & Landers, R. N. (2020, April). Machine learning in employee selection: A simulation study. In C. D. Nye & J. Bradburn (Chairs), The Rise of the Machines: How Machine Learning is Changing Organizations and Research.

Poster: Chen, C. & Chan, DKS. (2020, April). Classifying and predicting voluntary turnover on Twitter with machine learning. 

Poster: Feldkamp, T., Langer, M., König, C. J., & Wies, L. (2019). A question of morality: Is there a double standard when it comes to algorithms?

Panel: Justenhoven, R., Gonzalez, M. F., Martin, N. R., Shirase, L., Preuss, A., … & Gibby, R. (2020, April). Humanistic machines: Artificial intelligence and fairness in employee selection.

Symposium: Langer, M., König, C. J. & Busch, V. (2019). The effects of automated decision-support systems on personnel selection tasks. In M. Langer & J. Basch (Chairs), Interview technology and AI: Effects on applicants, evaluators, and adverse impact.

Games, Gamification, and Virtual Reality

Symposium: Auer, E. M., Marin, S., & Landers, R. N. (2020, April). Predicting non-cognitive traits using trace data from a cognitive ability GBA.  In S.-C. Codreanu (Chair) & F. Leutner (Chair), Game-based assessments: Fad or sound psychometrics assessments?

Symposium: Marin. S., Wang, Y., Qu, J., & Landers, R. N. (2020, April). The effects of leaderboards: A meta-analysis. In N. A. Celestine (Chair) & S. L. D. Restubog (Chair), Play and Gamification Across Organizational Levels. 

Symposium/Panel: Pitcher, B., Marin, S., Behrend, T. S., Howard, M. C., Lee, L. M., Montefiori, L. (2020, April). Virtual Reality and Assessment: Future Directions for Research and Practice.

Other

Panel: Bromley, T. W., Grabarek, P. E., Hetrick, A. L., Landers, R. N., Mockler, S. A., … Westring, A. (2020, April). Masters of media: How to communicate IO psychology to the public.

Poster: Qu, J., Marin, S., & Landers, R. N. (2020, April). A multilevel analysis of transformational face-to-face and online teaching.

Poster: Siegel, R., König, C. J., Zobel, J., & Langer, M. (2019). Executive search consultants’ biases against women (or men?).