I don't think he's got the power to layoff someone from a different department, so my best guess is that he's (apologetically) throwing more work on Nijima.
Another possibility is something to the effect of "They don't like your work, so your time has been for nothing." or the opposite "You're...