The brilliant writer offered unblinking insight into hard-luck characters on the fringe of society, yet his own inner world remained elusive during his short life.